AEGIS TELEMETRY
|
COOKIES DETECTED: 0
| GDPR: PENDING

PRIVACY & VISITOR TRACE NOTICE

This portal logs real-time telemetry (IP geolocation, canvas hash, network latency) for security defense and AI agent evaluation. Choose your data permission level.

← MAIN

📡 AI SCOUT RADAR

📦 ARCHIVE: PAGE 23/96 · 9551 TOTAL ⚙️ PIPELINES
🔍 100 of 100 shown · 68 sources
NOV 03, 2026 // LIVE DAILY RUN
• OpenAI introduced LifeVal, a new benchmark designed to measure AI performance on complex, real-world tasks like managing finances and government paperwork.
• AWS released new guidance on using sequence-level knowledge distillation to transfer frontier agentic behaviors into smaller, cost-efficient models on SageMaker.
• MIT researchers Regina Barzilay and Jim Collins were awarded the Pritzker Prize for their pioneering work in AI-enabled antibiotic discovery.
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Large language models can reason in continuous space instead of decoded text, by recurring on their own hidden states or by passing those states between agents, while training supervises only the Cross-Entropy (CE) of the final decoded answer and does not constrain the thought. Theoretical and empirical analyses establish and confirm four failures of CE-only training that lead to a lower probabili

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Looped transformers have demonstrated promising parameter efficiency by reusing layers for latent computation. Prior studies compare looped and non-looped models at matched parameters or per-token FLOPs. However, to the best of our knowledge, whether looping improves test-time scaling as outputs grow longer remains underexplored. Through post-training looped transformers, we study the accuracy-com

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Language model agents serving organizations must coordinate requests from multiple users while using knowledge distributed across their interactions. We identify two complementary capabilities for this setting, namely cross-user interaction and decision-making, as well as cross-user memory and knowledge use. Both capabilities are governed by organizational constraints across three aspects: user id

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Visual-token compression is effective for improving the efficiency of vision-language models, but under extreme compression budgets, token pruning can break visual grounding while learned resamplers increase parameter count, attention cost, and training complexity. We revisit compression through a token parameterization lens, separating (i) basis transformation and structured truncation (retained

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Video-language models are increasingly used as judges of video understanding, both for evaluating model outputs and for training reward models. Whether their judgments remain reliable when the evidence is buried in day-long videos has yet to be established. Existing benchmarks cannot answer this. Their videos are typically only a few minutes long, many answer pairs can be separated from the transc

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Humans naturally possess the ability to work persistently toward long-term goals. Given a challenging task, humans can continuously work for months or even years to accomplish a specific objective. In this paper, we propose Marathoner, an autonomous agentic model possessing the ability of ultra-long-horizon execution. Specifically, we propose a comprehensive post-training pipeline to instill this

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Discrete diffusion language models (dLLMs) expose a denoised solution at every step, which makes process reward model (PRM) guidance look like a way to spend compute at test time. We show that once denoising, PRM scoring, and outcome reward model (ORM) scoring are charged in the same budget of forward passes, its deterministic form loses to a much simpler baseline. Our PRMs score intermediate deno

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Realistic and editable animal fur reconstruction from multi-view images is challenging due to fine-scale detail, self-occlusion and obfuscation, and, unlike human hair, the lack of animal-fur datasets. Fur usually covers most of an animal's body, with large inter-species and intra-species variability. We present FurE, an efficient strand-based animal fur reconstruction method that recovers a per-s

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Does conversational memory need LLM-extracted facts, or is selecting the right raw turns enough? Published results disagree. Extraction-based systems report gains from distilled facts. Recent studies find raw history with good ranking does as well, but disagree about whether ranking matters. We ran a pre-registered study on held-out LoCoMo conversations and LongMemEval. At a tight budget on LoCoMo

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

When a large language model (LLM) agent executes the same task, token consumption can vary by over an order of magnitude across runs. The agent chooses its next steps based on tool feedback and intermediate results, while the growing context steadily inflates the input size of every subsequent call. The total consumption of a task is therefore hard to predict before execution and the prediction mu

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
MODEL RELEASE

Reinforcement learning (RL) has become a key paradigm for enhancing the reasoning of large language models, yet the high dimensionality of parameter updates makes its training dynamics hard to analyze. We study reinforcement learning with verifiable rewards (RLVR) and use vector steering to identify a low-dimensional effective manifold in activation space associated with RL-induced gains. We uncov

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Vision-language-action (VLA) and world-action (WAM) models map observations and instructions directly to robot actions. This directness ties a policy to training: minor layout or viewpoint changes cause failure, and instructions generalize poorly. The root cause lies in representation: task requirements, conditions, progress, and failure recovery are implicitly encoded in action sequences, making

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Machine intelligence is often evaluated through abstract reasoning problems, yet many real-world problems are visual, such as arranging objects, repairing layouts, or tracing routes. Solving these problems requires understanding a scene, inferring what must change to achieve a goal, and realizing that change without disturbing unrelated content. However, existing benchmarks mainly evaluate percept

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Recent gains in language model capability have come more from data than from architecture. Frontier labs and data companies produce verifiable agentic tasks, which supervised finetuning and reinforcement learning then turn into capability.This production line still rests on human labour and on human-in-the-loop collaboration. Automating task creation would let data production scale with compute ra

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Executable programs offer explicit control over how images and videos are constructed, but generating runnable code is only the beginning of visual creation. A program can execute correctly while violating the requested composition, appearance, or motion. We define this discrepancy as the Program-to-Visual (P2V) gap and introduce MaLiang-Harness, a unified framework for organizing MLLM-driven visu

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
RESEARCH PAPER

Recent vision-language models (VLMs) have advanced vision-and-language navigation (VLN), enabling models to predict navigation actions from visual observations and language instructions. In this work, we explore VLN with panoramic observations and introduce PanoVLN. The motivation is straightforward: more complete visual context should enable better-informed navigation decisions. For example, a pa

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Native 3D texture generation synthesizes colors directly in 3D space for a given geometry, conditioned on multi-view reference images. It is generally believed that training such models requires large-scale, high-quality real 3D asset data, whose acquisition remains a long-standing and challenging problem. In this work, we propose Tex-Zero, demonstrating that a high-fidelity native 3D texture gene

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Safety-aligned LLMs can exhibit emergent misalignment (EM): narrow domain adaptation unexpectedly triggers catastrophic safety failures across unrelated domains. Prior static analyses leave training dynamics unmapped, while existing defenses rely on heuristics that degrade utility. We present a dynamic, second-order geometric study of EM. Tracking training trajectories reveals that directional Hes

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
MODEL RELEASE

State Space Models (SSMs) compress sequence history into a bounded recurrent state, making the resulting memory law a central architectural choice for long-context performance. Most modern SSMs rely on ODE-based dynamics that lead to exponential forgetting, limiting their ability to retain information over broad temporal ranges. We introduce FRAC, a selective SSM architecture derived from fraction

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

A voice agent can handle almost every call on the words alone and still fail the few its sector's rules were written for. Emergency-call standards, fraud guidance, radio phraseology and vulnerability rules recognise that how a caller sounds, or what else is audible, can change the right action. VoxParity tests whether agents act on it. In 183 scenarios from 14 sectors, one transcript stays fixed w

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Video and audio are perceived together, yet most generative models treat them in isolation. We examine methods that model the two modalities jointly, generate one from the other, or edit them in a coupled manner, organized around a single question: how is the output kept coherent across modalities in time and semantics? A unified formulation casts joint generation, cross-modal generation, and join

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Modern AI models are aligned through post-training to adapt them to downstream tasks. Recent work shows that fine-tuning language models on narrow tasks can induce emergent misalignment (EM), causing broadly harmful behaviors beyond the training task. However, EM has been studied almost entirely in text-only tasks, leaving its manifestation in multimodal models unclear. In this paper, we define an

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Long-running LLM agents compress past interactions into persistent memories that may be reused as premises for later tasks. This creates a distinct derivation problem: whether the memory actually follows from what the interaction history supports. Relevant evidence may be scattered across earlier interactions, while compression can introduce relations or event status that the history never establi

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Learned image compression achieves competitive rate-distortion performance, but very-low-bitrate reconstruction remains challenging because the transmitted representation cannot preserve fine textures and local structures. Perceptual and generative codecs synthesize missing details using reconstruction priors, while controllable codecs allow one model to cover different bitrate and reconstruction

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Multi-agent large language model (LLM) debate is often evaluated by whether final answers improve, but movement is not necessarily improvement: the same discussion can rescue an initially wrong majority or destroy an initially correct one. Standard final-accuracy evaluations conflate these opposing mechanisms. We introduce an auditable protocol for homogeneous debate on multiple-choice questions (

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

In multi-agent systems, reliable consultation is challenging because advisor capabilities vary across tasks, and misleading information can make consultation worse than autonomous reasoning. We introduce BaRe-Mem, an online Bayesian reliability memory for multi-agent consultation. It estimates advisor reliability based on the central model's internal belief representations and updates these estima

Sep 27, 2026 source ↗
💬 Hacker News
COMMUNITY DISCUSSION

354 points, 249 comments

Sep 27, 2026 source ↗
🧠 Google Gemini Audio & Chirp
RESEARCH PAPER

In Integrated Sensing and Communications (ISAC), radar sensing must operate under chirp subsampling with up to 90\% missing data. An attention-based baseline, limited to a 52~ms buffer, collapses toward maximum uniform entropy ($H=2.584$ bits) as sparsity increases, failing to capture long-range gait-cycle context. We propose StarBOA, which replaces attention with a causal Mamba state-space model

Sep 27, 2026 source ↗
🧠 Google Gemini Audio & Chirp
RESEARCH PAPER

Marcuse theory of pulse distortion in singlemode fibers provides closed-form results for Gaussian pulses launched from sources of arbitrary spectral width. We extend the theory to supergaussian pulses of arbitrary order with linear or edge-concentrated chirp, single or multiline sources and an arbitrary number of dispersion coefficients. The rms output width is obtained exactly from the moments of

Sep 27, 2026 source ↗
🧠 Google Gemini Audio & Chirp
RESEARCH PAPER

Marcuse theory of pulse distortion in singlemode fibers provides closed-form results for Gaussian pulses launched from sources of arbitrary spectral width. We extend the theory to supergaussian pulses of arbitrary order with linear or edge-concentrated chirp, single or multiline sources and an arbitrary number of dispersion coefficients. The rms output width is obtained exactly from the moments of

Sep 27, 2026 source ↗
🧠 Google Gemini Audio & Chirp
RESEARCH PAPER

We extend Marcuse analysis of pulse fluctuations of randomly phased multimode sources to arbitrary chromatic dispersion, chirp, finite mode linewidth, mode partition noise and finite receiver bandwidth. On long fibers the fluctuations depend only on the shape of the group delay curve, a monotonic delay separates the modes, whereas a symmetric delay leaves pairs of modes with identical intensity pr

Sep 27, 2026 source ↗
🧠 Google Gemini Audio & Chirp
RESEARCH PAPER

With the growing number of binary black hole (BBH) candidates in the Gravitational-Wave Transient Catalog 5.0 (GWTC-5.0), an increasing number of BBH systems with distinct properties have been reported. The individual spins are relatively less constrained in the parameter estimations for most events. While the LIGO-Virgo-KAGRA Collaboration (LVK) adopts a uninformative spin prior by default, some

Sep 27, 2026 source ↗
🤗 Hugging Face OpenLLM
MODEL RELEASE

Reward models underpin the alignment of large language models, yet the dominant designs reduce each prompt--response pair to a point estimate or to a distribution from a fixed parametric family. This is at odds with human preference, which is inherently multimodal: the same response can be reasonably judged in many ways, and no single family covers all of them. To better fit this structure, we int

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
MODEL RELEASE

Self-evolving vision-language models train on questions they generate from unlabeled images. Since these questions have no gold answers, prior methods label them by majority vote over sampled answers or by a model judge. In a human evaluation, we find that 24\% of majority-vote labels and 18\% of model-judge labels produced during self-evolution are wrong. To address this problem, we present Verif

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

An agent can complete a task while exhibiting undesirable behavior during execution. Developers need tests for the specific behaviors encountered in deployment, beyond fixed benchmark suites. We present TraceDance, an agent system that constructs targeted benchmarks from deployment traces for user-specified undesirable behaviors. For efficient construction, Anchor-and-Confirm combines programmable

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

We present VGGT-Diff, a geometry-routed multi-view diffusion model for sparse-view novel view synthesis. Existing novel view synthesis (NVS) methods face a fundamental trade-off: reconstruction-based approaches preserve observed geometry but struggle to synthesize unseen regions, while diffusion-based methods provide strong generative priors yet rely on implicit source-to-query correspondence. VGG

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Speaker verification (SV) models are commonly assumed to better capture nuances among speaker characteristics as verification accuracy improves, leading to their widespread use as automated proxies for human voice similarity in speech generation tasks. However, by establishing a human perceptual alignment metric and conducting systematic analysis, we demonstrate that perceptual alignment is govern

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Personal Graphical User Interface (GUI) agents rely on interaction history to infer what a user wants from ambiguous instructions and to anticipate recurring routines. Existing approaches retrieve task-relevant history and append it to the policy's context, implicitly assuming that experience relevant to a task remains useful for each decision within it. We find that this help is largely spent at

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Multimodal large language models can expose task-relevant evidence through generation, but producing useful evidence does not by itself determine how it enters a retrieval embedding. We study whether the semantic organization of that evidence can also specify where representations are read. To address this question, we introduce EviAlign, which couples Semantic Evidence Generation with Boundary Re

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Data videos communicate data insights through dynamic charts, voice narration, and synchronized animations, and have become a widely adopted form of data storytelling. However, producing them requires expertise in data analysis, narrative design, and video editing. Static visualization tools lack narrative and animation capabilities; authoring tools rely on pre-prepared charts rather than raw data

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Vision-language models (VLMs) can benefit from geometric priors for multi-view spatial reasoning, yet answer-only training does not directly supervise the intermediate geometric estimates and their use in deriving quantitative spatial answers. We hypothesize that spatial chain-of-thought (CoT) supervision becomes more effective when the VLM first jointly learns complementary local geometry and glo

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

As large language models advance, AI agents are moving beyond isolated, domain-specific tasks toward long-horizon, cross-domain workflows. This transition exposes two challenges: increasing harness complexity makes manual design difficult to scale, while tighter coupling to specific domains limits the generality of a single harness. The central question thus shifts from how to engineer a stronger

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Automatically generated environments provide a scalable source of interaction data for training general agents. However, existing approaches mainly generate tasks within a single environment, while real-world workflows require agents to connect information and actions across multiple services. We introduce Compositional Environment Scaling (CompoWorld), which expands the task space by composing a

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Symbolic models make melody, harmony, rhythm, and form explicit but typically stop before a finished recording; audio models produce complete songs while leaving composition implicit. We introduce YuE2, which unifies symbolic and audio music generation at frontier quality through symbolic planning. A single AR-NAR Mixture-of-Transformers (MoT) first writes a readable score specifying melody and ha

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

On-policy distillation (OPD) trains a student on its own responses with token-level feedback from a stronger teacher, yet the teacher can fail on questions the student already answers correctly, and how often each model succeeds varies across tasks. OPD ignores these outcomes and, on average, pushes down even the student's correct responses; gating feedback by student correctness fixes the directi

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

In realistic education, a solution is often expressed not only in words but in a drawing--a circuit, a geometric construction, a function plot--and a teacher must grade the drawing as carefully as the text. Recent advances in unified multimodal models have enabled scientific image generation, yet verifying the correctness of these specialized visual outputs remains a critical bottleneck: errors of

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Information-seeking agents increasingly operate over information spaces that are too large to process exhaustively. Yet many multi-agent systems organize computation around static partitions of the available space, causing coordination to grow with how information is segmented rather than with what the query still requires. We introduce ANTMAN, an adaptive coordination framework that treats evolvi

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Generating responsive listener facial motion is an important task for embodied conversational AI. Two modeling challenges are central: accounting for the timing of speaker cues while maintaining continuity with the listener's ongoing motion, and capturing locally variable facial events alongside the overall motion trajectory. Listener responses may follow preceding cues with a temporal lag, while

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Reinforcement learning with verifiable rewards (RLVR) enhances reasoning in large language models (LLMs) through outcome-level feedback, yet recent approaches to finer-grained credit assignment often require auxiliary models, additional sampling, or privileged information. Although policy entropy provides a readily available signal, prioritizing uncertain positions under both reinforcement and pen

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Real-world tasks often require large language models (LLMs) to learn from complex task-specific context rather than pretrained parametric knowledge. This capability remains a weakness of LLMs, while human annotation for such task contexts is expensive and difficult to scale. Public high-quality documents are an abundant alternative, but much of the public web has already been consumed during pretr

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Low-precision Transformer systems increasingly quantize attention matrix multiplications, while softmax often remains at higher precision. During pretraining, an approximate softmax changes the gradients that train the model as well as its forward computation. We study this interaction with K-interval attention, which approximates the exponential using K+1 grid values. We vary per-row grid calibra

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Reinforcement learning with verifiable rewards (RLVR) often relies on sparse outcome rewards, providing coarse supervision for long-horizon agents. On-policy self-distillation (OPSD) complements this signal with dense privileged feedback. However, we identify Decision--Timestamp Mismatch: privileged guidance may be misaligned with the student's functional decision because the corresponding decisio

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Executable environments are critical for post-training agents on tasks that require tool use and multi-step interaction, but constructing executable tasks together with their environments remains difficult to scale. Skills provide reusable domain knowledge, operational procedures, and tool-use instructions, but a substantial gap remains between the information contained in a skill and a concrete,

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
MODEL RELEASE

World-action models give visual navigation agents a way to anticipate how candidate actions will change future observations and to act from the predicted consequences. For drones, this capability must operate under tight accuracy and efficiency constraints. We present DroneWAM, an efficient world-action model for drone visual navigation. DroneWAM adopts a JEPA-based architecture to model future st

Sep 26, 2026 source ↗
🤗 Hugging Face OpenLLM
MODEL RELEASE

Masked diffusion language models (MDMs) admit flexible generation orders, making the unmasking strategy an inference decision. Existing methods vary in how they prioritize positions, control parallelism, restrict selection regions, revise predictions, or plan future denoising, yet it remains unclear when these choices should change during generation. We study this question through strategy reversa

Sep 26, 2026 source ↗
💬 Hacker News
COMMUNITY DISCUSSION

128 points, 57 comments

Sep 26, 2026 source ↗
🧠 Google Gemini Audio & Chirp
RESEARCH PAPER

We study two bilinearly coupled harmonic oscillators driven by a common time-dependent spring. A fixed normal-mode transformation reduces the pair to two parametric oscillators, each solved exactly by its Lewis-Riesenfeld invariant and Ermakov-Pinney amplitude, including the ladder-operator construction and the Lewis-Riesenfeld phase. For invariant-vacuum inputs the physical two-mode covariance ma

Sep 26, 2026 source ↗
🧠 Google Gemini Audio & Chirp
RESEARCH PAPER

Pulsar timing arrays (PTAs) have found evidence of a gravitational wave background (GWB) consistent with a population of supermassive black hole binaries (SMBHBs), but have not yet resolved a continuous wave (CW) from an individual binary. We present the first SMBHB population constraints incorporating PTA upper limits on CWs, based on the NANOGrav 15-year (NG15) data. Using semi-analytic models t

Sep 26, 2026 source ↗
🏛️ MIT (CSAIL)
RESEARCH PAPER

The PKG Center for Social Impact expands Code.Tulsa experiential learning program.

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL
Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

LLM agents often operate over multi-turn interactions in which user intent changes before execution. We study intent drift: the failure mode in which superseded parts of the user's intent continue to influence the final answer or tool action. We introduce IntentFlux, an executable benchmark that converts verifiable tasks into dialogues with controlled intent changes while preserving their original

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Document rerankers determine what evidence reaches the downstream model in RAG and deep research, yet mainstream rerankers select by relevance matching, and individually relevant documents rarely constitute the complete, complementary, non-redundant set a complex information need demands. Prior work rewards a set by its aggregate rubric score, shifting the objective from ranking documents to compo

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Dense retrieval powers retrieval-augmented generation, semantic search, and question answering, yet the theoretical basis for choosing between shared and dual query-document projections remains unclear. We introduce a bias-variance theory for low-rank bilinear scoring. Shared projections induce positive-semidefinite operators, whereas dual projections realize arbitrary low-rank operators. We deriv

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Smaller activation outliers do not necessarily imply better low-bit quantization: their alignment with the quantizer matters. We introduce PrismQuant, a quantizer-aware rotation framework that aligns the leading activation eigenspace with the constant group subspace of asymmetric grouped INT4. The affine offsets represent the energy in this subspace without widening the range within the group. We

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
MODEL RELEASE

Reward models score responses from large language models (LLMs) and guide LLM training toward human preferences. However, reward models can favor superficial attributes such as length or confidence, leading LLMs to produce higher-scoring but not more correct responses. Existing mitigation methods either retrain the reward model or apply a fixed correction to one known bias, such as a preference fo

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Multidisciplinary tumor boards integrate multimodal clinical observations and longitudinal patient histories through specialist discussions, yet benchmarks rarely capture these real-world trajectories. We introduce OpenTumorBoard, a benchmark with 611 patient cases and 19,157 discussion turns across ten specialist roles, transcribed from 12,534 minutes of publicly available tumor board recordings

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

FullAttn repeatedly exposes the complete causal history to every attention head, creating substantial redundant computation and memory traffic even with IO-efficient dense kernels. We introduce CoWA, a structured attention architecture that distributes access to the causal history across KV heads. All heads share near-diagonal and prefix-sink windows, while complementary long-range windows partiti

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Evaluating recommender systems before deployment requires simulators that remain realistic over long, closed-loop interaction cycles. Current LLM-based agents generally function as surface imitators that generate realistic short-term responses but fail to capture the underlying user dynamics such as fatigue, affect, and shifting preferences. We propose PsyBer-Agent, a psychology-inspired simulator

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Multi-step agents are trained on flat action streams: SFT and RLVR weight every token uniformly and ignore the sub-procedures that recur across tasks, the hierarchy that lets humans plan top-down from reusable routines. This structure sits unused, and flat training uses each scarce trajectory less fully than its content allows. Recent agents do use that structure, but only as LLM-written skills in

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Depth is a natural way to increase the computational capacity in Transformers, yet the contribution of deeper layers can diminish as depth grows larger. Recent approaches enhance normalization (e.g., LayerNorm Scaling) or residual connections (e.g., mHC, AttnRes) to enable better information flow and depth utilization. However, it remains unclear whether they truly translate increased architectura

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

*Reinforcement learning (RL)* can induce substantial reasoning capabilities in large language models (LLMs), but how much of this capability transfers across model scales, and how quickly, remains unclear. We study the scaling properties of *on-policy distillation (OPD)* across *weak-to-strong*, *same-base*, and *strong-to-weak* teacher--student setups. We find that early OPD training dynamics uni

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Audio language models can recognize spoken commands and invoke tools, but an agent must first decide whether the acoustic and conversational context warrants action. We introduce VGBench, a 1,018-item diagnostic benchmark for action-level addressedness across side-talk, self-talk, and speaker-switch scenarios. Each item uses a shared action space comprising silence, a tool call, and a natural-lang

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Spoken conversational systems must recover information from prior interactions (i.e., memory), yet relevant information in speech extends beyond what was said to who said it, how it was spoken, and what was audible, information that exists only in the audio signal and cannot be recovered from a transcript. Beyond what to remember, memory also demands diverse operations: retrieving a single fact, i

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

A foundation model should not act in isolation as an embodied agent. Yet, existing methods often optimize individual components of the agent stack, such as memory, context, skills, or action interfaces, rather than treating the supporting system itself as a unified policy. Moreover, interaction alone does not yield self-improvement unless execution experience is converted into persistent, validate

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Visual token reduction is an effective way to accelerate multimodal large language models (MLLMs), but performance deteriorates rapidly under extremely low token budgets. Existing work has explored both visual-token selection and training-based adaptation to reduced visual inputs. We take a step further by asking how a heavily compressed MLLM should learn from the states induced by its own generat

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Large language model agents can often make reasonable local decisions on short tasks, yet their performance degrades when success requires long sequences of dependent actions and tool calls. During execution, task requirements, historical evidence, and the current execution state may gradually become disconnected, so later decisions can drift from the original objective. We study this problem by i

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Direct On-Policy Distillation (Direct-OPD) transfers reinforcement-learning-induced policy improvements from a small model to a larger student by using the token-level log-ratio between post-RL and pre-RL checkpoints as dense supervision on the student's own rollouts. This transfer rewards the policy shift at every state, yet the log-ratio measures only relative change: it can stay fixed even as t

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Model merging efficiently combines specialized large language models (LLMs) without joint retraining, but can substantially alter expert routing in Mixture-of-Experts (MoE) models. Such routing drift is often interpreted as routing failure, raising a fundamental question that remains unclear: does routing drift after MoE merging actually indicate routing failure, and what evidence should justify r

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Agent skills package instructions, executable code, and task-specific resources into reusable artifacts that agents can improve using execution feedback. The same mechanism also enables attackers to evolve malicious skills, making them more effective and less detectable. However, a candidate skill may pass pre-execution scanning yet fail to realize its target under runtime defenses, while a revisi

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
AGENTIC SYSTEM

Browser-use agents often carry information in their context as they move between websites. While it may be necessary for task completion, it also creates a privacy risk, especially when the information contains a private fact regarding the user. For example, an agent may learn a user's affiliation after reading a membership record. If it later selects a registration option specific to that affilia

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
MODEL RELEASE

Looped language models repeatedly apply a weight-shared block to increase effective depth without increasing parameter count, but the resulting T sequential recurrent-block calls per generated token substantially increase decoding latency. To address the issue, we introduce Wavefront Decoding (WFD), a training-free self-speculative decoding framework designed for looped language models. WFD exploi

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
MODEL RELEASE

Natural-language service requests can require a language-model decision before execution starts, consuming part of the request's latency budget. We integrate Jev's decision-oriented application programming interface (API) into edge service orchestration to reduce this overhead while retaining service completion. The integration extracts four to eight bounded intent fields and applies a shared vali

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

FullAttn often assigns negligible normalized mass to much of the causal score space, yet dense kernels execute the complete post-score path after forming each QK tile. We introduce MALA, a fused attention primitive that preserves score access to every legal causal interaction and uses normalized contribution to allocate post-score computation. Forward uses its evolving online-softmax normalizer, w

Sep 25, 2026 source ↗
🧠 Google Gemini Audio & Chirp
RESEARCH PAPER

Real-time full-duplex speech models can listen while speaking, enabling natural interaction without rigid turn boundaries. Existing benchmarks evaluate turn-taking, interruption handling and multi-round dialogue, but largely centre on a designated user rather than an assistant participating in a shared conversation among several people. We introduce Duplex-MPE to evaluate when such an assistant sh

Sep 25, 2026 source ↗
⚡ OpenAI
MODEL RELEASE

With Codex, GPT-Live-1, and GPT-6 Astra, Proaction builds, operates, and sells modern fleet management faster.

Sep 25, 2026 source ↗
📦 AWS (Bedrock & Trainium)
INFRASTRUCTURE

Learn how to scale Mixture-of-Experts (MoE) reinforcement learning on Amazon EKS using Elastic Fabric Adapter (EFA) and DeepEP. This post presents an architecture that combines Amazon EKS, EFA, and Amazon S3 and increased aggregate reinforcement learning rollout throughput by 40% for large-scale RLHF and GRPO training.

Sep 25, 2026 source ↗
📦 AWS (Bedrock & Trainium)
INFRASTRUCTURE

Learn how to run SkyRL, an open-source reinforcement learning framework, on Amazon SageMaker HyperPod to post-train a Qwen3-VL-8B vision-language model with GRPO. This walkthrough covers building the container image, launching a Ray cluster from SageMaker Studio, submitting and monitoring the job, and hosting the trained LoRA adapter for inference.

Sep 25, 2026 source ↗
📦 AWS (Bedrock & Trainium)
INFRASTRUCTURE

NarrateAI delivers production-ready LLM quality assurance on Amazon Bedrock. This post details five techniques—adaptive pipeline orchestration, cross-account multi-model failover, real-time streaming evaluation, composite evaluation, and data accuracy verification—that reach about 99% numerical accuracy while streaming responses in real time.

Sep 25, 2026 source ↗
📦 AWS (Bedrock & Trainium)
INFRASTRUCTURE

Deploy the publicly available Qwen3-TTS-12Hz-1.7B-Base text-to-speech model from Amazon SageMaker JumpStart to a fully managed, real-time endpoint, and clone a voice from a short reference clip. Cross-lingual cloning preserves the speaker's identity across languages.

Sep 25, 2026 source ↗
🤗 Hugging Face OpenLLM
BENCHMARK EVAL

Interactive CAPTCHAs remain challenging for computer-use agents, while existing datasets face trade-offs among type coverage, interaction fidelity, and trajectory supervision. To address these gaps, we present CaptchaArena, the first large-scale, fine-grained training dataset for interactive CAPTCHA solving. It contains 50K puzzles across 20 CAPTCHA types and 5 interaction modes, with every soluti

Sep 25, 2026 source ↗
☁️ Google Cloud (GCP)
MODEL RELEASE

Reinforcement learning (RL) has been a keystone of modern LLM post-training, but it demands large training clusters and access to model internals that external customers can't have with proprietary models like Gemini. So here at Google Cloud, we packaged it into a manag

Sep 25, 2026 source ↗
📦 AWS (Bedrock & Trainium)
INFRASTRUCTURE

Learn how Datacor built a self-service rental analytics experience for gas and welding distributors by embedding Amazon Quick Sight dashboards and natural language querying into its TrackAbout platform, powered by an automated cross-cloud data pipeline and multi-tenant row-level security.

Sep 25, 2026 source ↗
📦 AWS (Bedrock & Trainium)
INFRASTRUCTURE

Amazon SageMaker HyperPod and Cloud Native Qumulo let you place training compute in one AWS Region while keeping your dataset in another. This post shares the architecture and validation results from a cross-Region training run, where a remote cluster matched a co-located cluster's throughput after a brief NeuralCache warmup.

Sep 25, 2026 source ↗
💬 Hacker News
COMMUNITY DISCUSSION

426 points, 739 comments

Sep 25, 2026 source ↗
🚁 Skydio
LAB UPDATE
Sep 25, 2026 source ↗
🚁 Skydio
AGENTIC SYSTEM
Sep 25, 2026 source ↗
🌲 Stanford (HAI)
RESEARCH PAPER
Sep 25, 2026 source ↗
🏆 LMSYS Chatbot Arena
MODEL RELEASE
Sep 25, 2026 source ↗
🔮 Cohere
BENCHMARK EVAL
Sep 25, 2026 source ↗
⚖️ Harvey AI
BENCHMARK EVAL
Sep 25, 2026 source ↗

9551 articles sourced historically · 100 per page