Search: “models”

A Single Layer to Explain Them All:Understanding Massive Activations in Large Language Models

arXiv:2605.08504v1 Announce Type: new Abstract: We investigate the origins of massive activations in large language models (LLMs) and identify a specific layer named the extbf{Massive Emergence Layer

researcharxiv-cs-cl

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Advancing AI for materials with MatterSim: experimental synthesis, faster simulation, and multi-task models

DGX agent

MatterSim is expanding what AI can do for materials science—from faster large-scale simulations to MatterSim-MT, a new multi-task model for simulating properties beyond potential energy surfaces alone

researchmicrosoft-research

12 May 2026

Tools

[AINews] Thinking Machines' Native Interaction Models - TML-Interaction-Small 276B-A12B - advances SOTA Realtime Voice and kills standard VAD

Thinking Machines released TML-Interaction-Small, a 276B parameter model with a 12B active subset designed for real-time voice interactions that reportedly surpasses standard voice activity detection

toolslatent-space

Beta Sampling is All You Need: Efficient Image Generation Strategy for Diffusion Models using Stepwise Spectral Analysis

arXiv:2407.12173v2 Announce Type: replace-cross Abstract: Generative diffusion models have emerged as a powerful tool for high-quality image synthesis, yet their iterative nature demands significant c

BoostAPR: Boosting Automated Program Repair via Execution-Grounded Reinforcement Learning with Dual Reward Models

arXiv:2605.09134v1 Announce Type: new Abstract: Reinforcement learning for program repair is hindered by sparse execution feedback and coarse sequence-level rewards that obscure which edits actually f

CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Models

arXiv:2605.08735v1 Announce Type: new Abstract: Recent 'Thinking with Video' approaches use Video Generation Models (VGMs) for visual reasoning by producing temporally coherent Chain-of-Frames as reas

DAPE: Dynamic Non-uniform Alignment and Progressive Detail Enhancement Techniques for Improving the Performance of Efficient Visual Language Models

arXiv:2605.08902v1 Announce Type: cross Abstract: In recent years, pre-trained visual-linguistic models have demonstrated tremendous potential, becoming a crucial foundational framework for numerous d

Energy-based models for diagnostic reconstruction and analysis in a laboratory plasma device

arXiv:2605.08645v1 Announce Type: cross Abstract: Energy-based models (EBMs) provide a powerful and flexible way of learning a joint probability distribution over data by constructing an energy surfac

researcharxiv-cs-lg

Enhancing Consistency Models for Multi-Agent Trajectory Prediction

arXiv:2605.08572v1 Announce Type: new Abstract: Diffusion models for multi-agent trajectory prediction are limited by iterative denoising, which causes inference latency that hinders their use in time

agentsarxiv-cs-cv

ExtraVAR: Stage-Aware RoPE Remapping for Resolution Extrapolation in Visual Autoregressive Models

arXiv:2605.10045v1 Announce Type: new Abstract: Visual Autoregressive (VAR) models have emerged as a strong alternative to diffusion for image synthesis, yet their fixed training resolution prevents d

Model Releases

Flame3D: Zero-shot Compositional Reasoning of 3D Scenes with Agentic Language Models

model-releasesarxiv-cs-ai

arXiv:2605.09218v1 Announce Type: cross Abstract: 3D scene understanding spans reasoning about free space, object grounding, hypothetical object insertions, complex geometric relationships, and integr

Gate-and-Merge: Zero-shot Compositional Personalization of Vision Language Models

arXiv:2605.08702v1 Announce Type: cross Abstract: This paper tackles compositional personalization of vision-language models (VLMs). In this problem, multiple user-defined concepts must be recognized

Model Releases

Geometry-Aware Discretization Error of Diffusion Models

model-releasesarxiv-cs-lg

arXiv:2605.08392v1 Announce Type: new Abstract: Practical diffusion sampling is a numerical approximation problem: under a fixed inference budget, one must simulate a reverse-time ODE or SDE using onl

i like that there are models called bert and ernie, but in all seriousness, this update looks impressive

i like that there are models called bert and ernie, but in all seriousness, this update looks impressive ERNIE 5.1 is here 🚀 ERNIE 5.1 significantly reduces pretraining cost while compressing total pa

agentsyohei-nakajima--x

Large Language Models for Sequential Decision-Making: Improving In-Context Learning via Supervised Fine-Tuning

arXiv:2605.09009v1 Announce Type: cross Abstract: Large language models (LLMs) have shown remarkable in-context learning (ICL) capabilities, yet their potential for sequential decision-making remains

Metropolis-Adjusted Diffusion Models

arXiv:2605.09654v1 Announce Type: cross Abstract: Sampling from score-based diffusion models incurs bias due to both time discretisation and the approximation of the score function. A common strategy

safetyarxiv-cs-lg

Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning Models

arXiv:2602.01698v3 Announce Type: replace Abstract: Large Reasoning Models (LRMs) have recently achieved strong mathematical and code reasoning performance through Reinforcement Learning (RL) post-tra

researcharxiv-cs-cl

Self-Captioning Multimodal Interaction Tuning: Amplifying Exploitable Redundancies for Robust Vision Language Models

arXiv:2605.08145v1 Announce Type: cross Abstract: Current vision language models face hallucination and robustness issues against ambiguous or corrupted modalities. We hypothesize that these issues ca

Industry

Talked to a friend at a top AI lab. Their whole team is former journalists, training models on poems, summaries, and creative writing. I use…

industryallie-k--miller--x

Talked to a friend at a top AI lab. Their whole team is former journalists, training models on poems, summaries, and creative writing. I use AI every day and can see that it tends to flatten my writin

TARO: Temporal Adversarial Rectification Optimization Using Diffusion Models as Purifiers

arXiv:2605.08440v1 Announce Type: cross Abstract: Adversarial purification with diffusion models seeks to project adversarial examples back toward the data manifold, but balancing semantic preservatio

Towards Robust Surgical Automation via Digital Twin Representations from Foundation Models

arXiv:2409.13107v3 Announce Type: replace Abstract: Large language model-based (LLM) agents are emerging as a powerful enabler of robust embodied intelligence due to their capability of planning compl

agentsarxiv-cs-ro

Training-Free Cultural Alignment of Large Language Models via Persona Disagreement

arXiv:2605.10843v1 Announce Type: cross Abstract: Large language models increasingly mediate decisions that turn on moral judgement, yet a growing body of evidence shows that their implicit preference

ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models

arXiv:2605.10106v1 Announce Type: cross Abstract: Recent advances in Multi-modal Large Language Models (MLLMs) target 3D spatial intelligence, yet the progress has been largely driven by post-training

agentsarxiv-cs-ai

ViSurf: Visual Supervised-and-Reinforcement Fine-Tuning for Large Vision-and-Language Models

arXiv:2510.10606v4 Announce Type: replace Abstract: Post-training Large Vision-and-Language Models (LVLMs) typically involves Supervised Fine-Tuning (SFT) for knowledge injection or Reinforcement Lear

When Language Overwrites Vision: Over-Alignment and Geometric Debiasing in Vision-Language Models

arXiv:2605.08245v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) increasingly power high-stakes applications, from medical imaging to autonomous systems, yet they routinely hallucinate,

CASCADE: Case-Based Continual Adaptation for Large Language Models During Deployment

arXiv:2605.06702v1 Announce Type: new Abstract: Large language models (LLMs) have become a central foundation of modern artificial intelligence, yet their lifecycle remains constrained by a rigid sepa

agentsarxiv-cs-ai

Conservative Flows: A New Paradigm of Generative Models

arXiv:2605.06905v1 Announce Type: new Abstract: Modern generative modeling is dominated by transport from a noise prior to data. We propose an alternative paradigm in which generation is performed by

researcharxiv-cs-lg

Emergence of Distortions in High-Dimensional Guided Diffusion Models

arXiv:2602.00716v4 Announce Type: replace-cross Abstract: Classifier-free guidance (CFG) is the de facto standard for conditional sampling in diffusion models, yet it often reduces sample diversity. U

applicationsarxiv-cs-lg

Equivalence of Coarse and Fine-Grained Models for Learning with Distribution Shift

arXiv:2605.07005v1 Announce Type: cross Abstract: Recent work on provably efficient algorithms for learning with distribution shift has focused on two models: PQ learning (Goldwasser et al. (2020)) an

researcharxiv-cs-lg

HEART: Hyperspherical Embedding Alignment via Kent-Representation Traversal in Diffusion Models

arXiv:2605.07973v1 Announce Type: new Abstract: Text-to-image diffusion models can generate visually stunning images, yet, controlling what appears and how it appears, remains surprisingly difficult,

safetyarxiv-cs-cv

Memory-Efficient Looped Transformer: Decoupling Compute from Memory in Looped Language Models

arXiv:2605.07721v1 Announce Type: cross Abstract: Recurrent LLM architectures have emerged as a promising approach for improving reasoning, as they enable multi-step computation in the embedding space

Mixture of Masters: Sparse Chess Language Models with Player Routing

arXiv:2602.04447v2 Announce Type: replace-cross Abstract: Modern chess language models are dense transformers trained on millions of games played by thousands of high-rated individuals. However, these

Modality Gap-Driven Subspace Alignment Training Paradigm For Multimodal Large Language Models

arXiv:2602.07026v2 Announce Type: replace-cross Abstract: Despite the success of multimodal contrastive learning in aligning visual and linguistic representations, a persistent geometric anomaly, the

Neural CDEs as Correctors for Learned Time Series Models

arXiv:2512.12116v3 Announce Type: replace Abstract: Learned time-series models, whether continuous or discrete, are widely used for forecasting the states of dynamical systems but suffer from error ac

applicationsarxiv-cs-lg

One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policy

arXiv:2605.07931v1 Announce Type: cross Abstract: Vision-language-action (VLA) models increasingly rely on auxiliary world modules to plan over long horizons, yet how such modules should be parameteri

SARA: Semantically Adaptive Relational Alignment for Video Diffusion Models

arXiv:2605.07800v1 Announce Type: new Abstract: Recent video diffusion models (VDMs) synthesize visually convincing clips, yet still drop entities, mis-bind attributes, and weaken the interactions spe

safetyarxiv-cs-cv

Skip-It? Theoretical Conditions for Layer Skipping in Vision-Language Models

arXiv:2509.25584v2 Announce Type: replace Abstract: Vision-language models achieve incredible performance across a wide range of tasks, but their large size makes inference costly. Recent work has sho

The inability of AI models to produce creative variation is a huge gap. The fact that they generate similar ideas limits their ability to do…

applicationsethan-mollick--x

The inability of AI models to produce creative variation is a huge gap. The fact that they generate similar ideas limits their ability to do science & the same-y writing limits their usefulness in man

The US Commerce Department removed from its website details about its May 5 agreement with Google, xAI, and Microsoft to test their AI models (Courtney Rozen/Reuters)

Courtney Rozen / Reuters: The US Commerce Department removed from its website details about its May 5 agreement with Google, xAI, and Microsoft to test their AI models — The U.S. Commerce Department r

applicationstechmeme

Local Ai

Topology-Enhanced Alignment for Large Language Models: Trajectory Topology Loss and Topological Preference Optimization

arXiv:2605.07172v1 Announce Type: new Abstract: Alignment of large language models (LLMs) via SFT and RLHF/DPO typically ignores the global geometry of the representation space, relying instead on loc

local-aiarxiv-cs-cl

Understanding Performance Collapse in Layer-Pruned Large Language Models via Decision Representation Transitions

arXiv:2605.07271v1 Announce Type: cross Abstract: Layer pruning efficiently reduces Large Language Model (LLM) computational costs but often triggers sudden performance collapse. Existing representati

Tools

Frontier labs are betting AGI models will be so good you won't ever want to customize them. We think different. Building on a closed platfor…

Frontier labs are betting AGI models will be so good you won't ever want to customize them. We think different. Building on a closed platform means renting your intelligence. The landlord sets the ter

toolsfireworks-ai--x

9 May 2026

Adapting Medical Vision Foundation Models for Volumetric Medical Image Segmentation via Active Learning and Selective Semi-supervised Fine-tuning

arXiv:2509.10784v3 Announce Type: replace-cross Abstract: Medical vision foundation models remain limited in downstream tasks, particularly volumetric medical image segmentation. While fine-tuning on

Model Releases

Gradients with Respect to Semantics Preserving Embeddings Tell the Uncertainty of Large Language Models

model-releasesarxiv-cs-cl

arXiv:2605.04638v1 Announce Type: new Abstract: Uncertainty quantification (UQ) is an important technique for ensuring the trustworthiness of LLMs, given their tendency to hallucinate. Existing state-

Local Intrinsic Dimension Unveils Hallucinations in Diffusion Models

arXiv:2605.05026v1 Announce Type: new Abstract: Diffusion models are prone to generating structural hallucinations - samples that match the statistical properties of the training data yet defy underly

ReasoningGuard: Safeguarding Large Reasoning Models with Inference-time Safety Aha Moments

arXiv:2508.04204v2 Announce Type: replace Abstract: Large Reasoning Models (LRMs) have demonstrated impressive performance in reasoning-intensive tasks, but they remain vulnerable to harmful content g

safetyarxiv-cs-cl

UAV-VL-R1: Generalizing Vision-Language Models via Supervised Fine-Tuning and Multi-Stage GRPO for UAV Visual Reasoning

arXiv:2508.11196v2 Announce Type: replace Abstract: Recent advances in vision-language models (VLMs) have demonstrated strong generalization in natural image tasks. However, their performance often de

safetyarxiv-cs-cv

Can Multimodal Large Language Models Understand Pathologic Movements? A Pilot Study on Seizure Semiology

arXiv:2605.03352v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated robust capabilities in recognizing everyday human activities, yet their potential for analyzi