Knowledge catalogue
arXiv:2604.06228v1 Announce Type: cross Abstract: We introduce probabilistic language tries (PLTs), a unified representation that makes explicit the prefix structure implicitly defined by any generati
arXiv:2604.06204v1 Announce Type: cross Abstract: Personalization is essential for Large Language Model (LLM)-based agents to adapt to users' preferences and improve response quality and task performa
arXiv:2601.16294v2 Announce Type: replace-cross Abstract: General Matrix Multiplication (GEMM) is the cornerstone of HPC workloads and Deep Learning. State-of-the-art vendor libraries tune tensor layo
arXiv:2604.06644v1 Announce Type: cross Abstract: As deep learning inference is increasingly deployed in shared and cloud-based settings, a growing concern is input repurposing, in which data submitte
What's Changed openai: allow Responses effort on non-thinking models by @hoyyeva in #19010 llama-server: let llama-server infer the draft speculative type by @dhiltgen in #19064 mlx: add PPLX Decider
Hey all, been meaning to post this for a while. I've been building an inference engine based off Strata called Xolotl that runs DeepSeek-V4.1-Flash, all 552B of it, on one gaming PC. My setup is a sin
arXiv:2610.20641v1 Announce Type: new Abstract: Long chain-of-thought decoding is memory-bound: the KV cache of the generated tokens grows linearly with the test-time compute being spent. Evicting cac
arXiv:2610.21527v1 Announce Type: new Abstract: Layer normalization (LN) and root mean square normalization (RMSNorm) depend on their inputs and remain nonlinear at inference. Inserting either next to
arXiv:2610.21211v1 Announce Type: new Abstract: Proactive robots should anticipate user needs and provide assistance before being explicitly asked. A straightforward approach is to infer human intenti
arXiv:2610.20785v1 Announce Type: new Abstract: Large language models are increasingly used in social interactions, where appropriate responses require recognizing implicit cues, inferring mental stat
arXiv:2610.22137v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) achieve strong performance through instruction tuning, yet real-world applications often require them to contin
arXiv:2610.21126v1 Announce Type: new Abstract: Sparse KV compression reduces long-context inference costs by retaining selected historical states, yet these states typically keep their coordinates fr
arXiv:2610.22245v1 Announce Type: new Abstract: Small language models are increasingly deployed on edge devices and robotic systems to meet cost and latency constraints, yet their limited capabilities
arXiv:2610.22130v1 Announce Type: new Abstract: Key-value (KV) cache management has become a critical bottleneck for scaling Large Language Models (LLMs) to long-context scenarios due to linear memory
arXiv:2610.20636v1 Announce Type: cross Abstract: Sampling from continuous flow-based generators such as flow matching models requires numerical ODE or SDE integration, making inference cost depend on
arXiv:2610.21165v1 Announce Type: new Abstract: Long-context capability has become essential for large language models (LLMs) to handle complex tasks, yet continuously expanding the context window doe
arXiv:2610.22221v1 Announce Type: new Abstract: Physical understanding is crucial for decision making, yet vision models struggle to infer properties such as damping that govern how materials behave.
arXiv:2610.20659v1 Announce Type: cross Abstract: Posterior inference for random fields from sparse observations presents two major challenges: accurately characterizing complex spatial uncertainty an
arXiv:2610.21283v1 Announce Type: new Abstract: Code world models represent world dynamics through explicit state and executable rules. We investigate how to coordinate object representations, behavio
arXiv:2610.21434v1 Announce Type: cross Abstract: Vision-language-action (VLA) policies generate action sequences that reduce repeated inference, but deciding how much of each sequence to execute is c
arXiv:2610.21129v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) dominate video generation but suffer from high inference cost due to the quadratic complexity of self-attention. Sparse at
arXiv:2610.22364v1 Announce Type: cross Abstract: Predicting how the world responds to an action requires more than what can be seen: robots must account for environmental factors that are neither dir
arXiv:2604.03867v2 Announce Type: replace Abstract: Steering vectors have emerged as a lightweight and effective approach for aligning large language models (LLMs) at inference time, enabling modulati
arXiv:2610.14818v1 Announce Type: new Abstract: Agentic AI moves generative AI applications toward systems that coordinate reasoning, enterprise context, model inference, and external actions. Integra
arXiv:2610.19007v1 Announce Type: new Abstract: World models are a powerful means of reasoning and planning, but many of these action-conditioned predictive models are high dimensional and computation
arXiv:2511.17937v2 Announce Type: replace Abstract: Alignment faking is a form of strategic deception in AI in which models selectively comply with training objectives when they infer that they are in
arXiv:2610.17310v1 Announce Type: new Abstract: Language-model agents are expected to adapt to others whose behavior changes through interaction. Yet adaptation may rely on learned behavioral patterns
arXiv:2610.20460v1 Announce Type: new Abstract: Safely executing long-horizon multi-arm tasks online in complex dynamic environments remains challenging. We propose a new distributed dynamic Gaussian
arXiv:2610.19801v1 Announce Type: new Abstract: An agent that drives an LLM sends the model the same conversation again and again, and each turn adds only a little text at the end. Inference engines r
arXiv:2610.17869v1 Announce Type: new Abstract: Multi-agent Large Language Model (LLM) systems typically commit to a deliberation protocol before inference. A fixed protocol cannot allocate computatio
Fascinating paper from Google DeepMind. They studied a market where AI agents bid to answer each user prompt. Each agent bids its expected reward minus its inference cost. A first-price auction is sim
arXiv:2610.15129v1 Announce Type: new Abstract: Human social perception is incremental: we infer intent before an utterance is complete, revise our interpretation as new cues arrive, and attend to spe
arXiv:2610.15091v1 Announce Type: cross Abstract: Argument structures represent how individual arguments interact within a discourse. However, leveraging these structures to infer meaningful knowledge
arXiv:2610.17757v1 Announce Type: new Abstract: Large language model agents can follow complex human instructions to solve real-world tasks. In practice, however, initial instructions are often incomp
arXiv:2604.03414v2 Announce Type: replace Abstract: Video Large Language Models (Video LLMs) achieve strong performance on video understanding tasks but suffer from high inference costs due to the lar
arXiv:2602.02326v3 Announce Type: replace Abstract: If multilingual language model representations contain separable language-associated structure, then shifting between languages may require only sim
arXiv:2610.19827v1 Announce Type: cross Abstract: LLMs absorb vast knowledge from training data, yet their inherently probabilistic nature offers no guarantee that this knowledge will surface in their
arXiv:2610.18141v1 Announce Type: new Abstract: Omnimodal large language models (OLLMs) are susceptible to cross-modal hallucinations under audio-visual interference. We find that, for a substantial f
arXiv:2604.01567v2 Announce Type: replace Abstract: A central challenge in mobile manipulation is preserving multiple plausible action modes while remaining reactive during execution. For example, gra
I saw u/lkarlslund 's post just over a week ago regarding Ninfer6000 (a fork of Ninfer specifically tuned for 6000 blackwell and Qwen3.8-Flash-Next) and figured 'Hey I'm an idiot & bought one of those
arXiv:2610.04561v2 Announce Type: replace Abstract: Differentiable programming connects scientific computation with gradient-based inference, learning and design. Extending these capabilities across a
arXiv:2610.16288v2 Announce Type: new Abstract: Frontier LLM agents perform complex interactive tasks, but their inference costs motivate transferring their experience to smaller open-source agents. D
arXiv:2610.17665v2 Announce Type: new Abstract: Can vision-language models turn 2D observations into 3D understanding that supports precise action? This requires inferring object geometry, anticipatin
arXiv:2610.20137v1 Announce Type: new Abstract: Current video object removal methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction.
arXiv:2610.19369v1 Announce Type: new Abstract: Pedestrian tracking in video is important for applications such as surveillance and scene analysis, but it becomes more challenging in crowded scenarios
arXiv:2610.16084v1 Announce Type: new Abstract: Activation steering adds a vector to a language model's internal representations at inference time. It is a lightweight alternative to fine-tuning for b
arXiv:2610.16927v1 Announce Type: new Abstract: Short-video search requires compact query rewriters that infer personalized intent from brief, ambiguous queries under strict latency constraints. The c
https://preview.redd.it/kudj7xii5ivh1.png?width=1508&format=png&auto=webp&s=07712e81310b81aceb2cf8f4d8a7c2eadeb0c304 Just built a new PC, full parts list is here. I am using Deadcode's Radiance infere
arXiv:2602.07496v2 Announce Type: replace Abstract: Inverse Reinforcement Learning (IRL) seeks to infer reward functions from expert demonstrations. When demonstrations originate from multiple experts
arXiv:2610.16891v1 Announce Type: new Abstract: Inferring tumor-growth laws from sparse, noisy observations requires more than accurate curve fitting. We study an AI-assisted workflow involving symbol
arXiv:2610.14997v1 Announce Type: new Abstract: While asynchronous execution enables VLA models to operate in real-time environments by predicting the next chunk during execution, it inevitably introd
arXiv:2610.17966v1 Announce Type: new Abstract: Long-context inference makes the key-value (KV) cache a major memory bottleneck for large language models. We propose BELT, a low-rank KV cache compress
arXiv:2610.16813v1 Announce Type: new Abstract: Vision foundation models (VFMs) provide transferable visual representations, but their inference cost limits deployment in many settings. Fine-tuning sp
arXiv:2610.14672v1 Announce Type: new Abstract: Training-free sparse attention is a practical route to efficient video diffusion transformer inference, yet existing methods typically fix the competiti
arXiv:2610.15640v1 Announce Type: new Abstract: Small language models (SLMs) used as on-device agents must balance accuracy and latency as their context grows. Mixed precision helps manage this tradeo
arXiv:2610.14025v1 Announce Type: new Abstract: Activation steering controls large language model behavior by adding a direction to hidden activations during inference. For steering to work well, that
arXiv:2610.15794v1 Announce Type: new Abstract: Flow matching is a common generative recipe for robot foundation models. Vision-language-action models (VLAs) generate action chunks, while world-action
arXiv:2610.16447v1 Announce Type: cross Abstract: The estimation of heterogeneous treatment effects is a central objective of causal inference. However, state-of-the-art algorithms to solve this task
arXiv:2610.16574v1 Announce Type: cross Abstract: Accurately assessing the convergence of Monte Carlo Markov Chains is crucial for ensuring their validity in Bayesian inference problems. However, conv
arXiv:2610.17552v1 Announce Type: new Abstract: Recent video super-resolution (VSR) models achieve efficient one-step generation through diffusion distillation. However, high-resolution inference rema