Search: “models”

On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters

arXiv:2606.02437v1 Announce Type: cross Abstract: Parameter-efficient fine-tuning (PEFT) is usually treated as a cheaper alternative to full fine-tuning. We study a broader role: small trainable adapt

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Optimizing Diversity and Quality through Base-Aligned Model Collaboration

DGX agent

arXiv:2511.05650v2 Announce Type: replace-cross Abstract: Alignment has greatly improved large language models (LLMs)' output quality at the cost of diversity, yielding highly similar outputs across g

safetyarxiv-cs-ai

2 Jun 2026

Perception First: A Frontier Native-Video Model with Self-Consistency for Implicit Video Question Answering

model-releasesarxiv-cs-cv

arXiv:2606.01485v1 Announce Type: new Abstract: We describe our submission to the VRR Challenge @ CVPR 2026, built on the ImplicitQA / VRR-QA benchmark~ite{implicitqa}: multiple-choice video question

Reconsidering Positional Supervision in Masked Diffusion Language Model Training

arXiv:2601.22947v2 Announce Type: replace Abstract: Masked diffusion language models (MDLMs) generate text by unmasking tokens in parallel and have recently emerged as alternatives to autoregressive l

safetyarxiv-cs-cl

Revisiting Parameter-Based Knowledge Editing in Large Language Models: Theoretical Limits and Empirical Evidence

arXiv:2606.00570v1 Announce Type: cross Abstract: Parameter-based knowledge editing updates the internal knowledge of large language models (LLMs) via localized weight modifications and has attracted

Self-Regulating Annealing in Heavy-Tailed Diffusion Models

arXiv:2606.01645v1 Announce Type: cross Abstract: Diffusion models have emerged as a leading framework for deep generative modeling. While the standard Gaussian formulation is theoretically convenient

SentGuard: Sentence-Level Streaming Guardrails for Large Language Models

arXiv:2606.02041v1 Announce Type: new Abstract: Large language models increasingly stream long, reasoning-intensive responses in real time, making when to moderate as critical as whether to moderate.

Silent Failures in Federated Personalization of Foundation Models

arXiv:2606.00947v1 Announce Type: cross Abstract: Foundation models are increasingly personalized on decentralized private data through federated learning and are now deployed at scale under growing r

SmartThinker: Progressive Chain-of-Thought Length Calibration for Efficient Large Language Model Reasoning

arXiv:2603.08000v2 Announce Type: replace Abstract: Large reasoning models (LRMs) like OpenAI o1 and DeepSeek-R1 achieve high accuracy on complex tasks by adopting long chain-of-thought (CoT) reasonin

SurrogateSHAP: Training-Free Contributor Attribution for Text-to-Image (T2I) Models

arXiv:2601.22276v2 Announce Type: replace-cross Abstract: As Text-to-Image (T2I) diffusion models are increasingly used in real-world creative workflows, a principled framework for valuing contributor

safetyarxiv-cs-cv

The Shape of Wisdom: Decision Trajectories in Language Models

arXiv:2606.01202v1 Announce Type: new Abstract: Language models do not simply choose an answer at the output layer. In a 9,000-trajectory MMLU study across Qwen2.5-7B-Instruct, Llama-3.1-8B-Instruct,

Towards Lightweight Reliability: Using Soft Prompts for Hallucination Mitigation in Large Language Models

arXiv:2606.00919v1 Announce Type: new Abstract: Large language models (LLMs) have seen widespread adoption across various domains, yet their reliability is frequently undermined by hallucinations - re

Unlearning Isn't Invisible: Detecting Unlearning Traces in LLMs from Model Outputs

arXiv:2506.14003v5 Announce Type: replace Abstract: Machine unlearning (MU) for large language models (LLMs), commonly referred to as LLM unlearning, seeks to remove specific undesirable data or knowl

Vision-language Models for Driver Monitoring Systems: A Driver Activity Description Dataset

model-releasesarxiv-cs-cv

arXiv:2606.02273v1 Announce Type: new Abstract: Understanding subtle driver actions is essential for building reliable driver monitoring systems. Existing visionlanguage models (VLMs) are trained on g

World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications

arXiv:2606.00133v1 Announce Type: new Abstract: World models, internal simulators that learn the structure and dynamics of an environment, have emerged as a central paradigm in the pursuit of artifici

safetyarxiv-cs-lg

3ViewSense: Spatial and Mental Perspective Reasoning from Orthographic Views in Vision-Language Models

arXiv:2603.07751v2 Announce Type: replace-cross Abstract: Current Large Language Models have achieved Olympiad-level logic, yet Vision-Language Models paradoxically falter on elementary spatial tasks

researcharxiv-cs-cl

Benchmarking and Enhancing Text-to-Image Models for Generating Visual Representations in Early Arithmetic Education

arXiv:2605.31212v1 Announce Type: cross Abstract: AI systems are increasingly used to support educational content creation, yet it remains unclear whether they can generate outputs that faithfully rep

Bottom-up Policy Optimization: Your Language Model Policy Secretly Contains Internal Policies

arXiv:2512.19673v3 Announce Type: replace-cross Abstract: Existing reinforcement learning (RL) approaches treat large language models (LLMs) as a unified policy, overlooking their internal mechanisms.

dgMARK: Decoding-Guided Watermarking for Diffusion Language Models

arXiv:2601.22985v2 Announce Type: replace Abstract: We propose dgMARK, a decoding-guided watermarking method for discrete diffusion language models (dLLMs). Unlike autoregressive models, dLLMs can gen

Differentially Private Preference Data Synthesis for Large Language Model Alignment

arXiv:2605.30808v1 Announce Type: cross Abstract: Preference alignment is a crucial post-training step for large language models (LLMs) to ensure their outputs align with human values. However, post-t

Domain Adaptation and Reasoning Frameworks in Language Models: A Controlled Experiment with Historical Cosmology

arXiv:2605.30415v1 Announce Type: cross Abstract: We investigate how domain adaptation reshapes explanatory behavior in language models using historical cosmology as a controlled setting. In Phase 1,

Dual Mechanisms of Value Expression: Intrinsic vs. Prompted Values in Large Language Models

arXiv:2509.24319v4 Announce Type: replace-cross Abstract: Large language models can express values in two main ways: (1) intrinsic expression, reflecting the model's inherent values learned during tra

Hardware

Elastic ViTs from Pretrained Models without Retraining

arXiv:2510.17700v2 Announce Type: replace Abstract: Vision foundation models achieve remarkable performance but are only available in a limited set of pre-determined sizes, forcing sub-optimal deploym

hardwarearxiv-cs-cv

Applications

Enhancing Computer Vision Model Generalization in Warehouse Facilities: A Case Study on Anomaly Detection in Vertical Material Handling Systems

arXiv:2605.31487v1 Announce Type: new Abstract: Deploying computer vision models in Warehouse Facilities traditionally requires extensive resources for camera mounting, image collection, annotation, t

applicationsarxiv-cs-cv

Fine-Tuning Improves Information Conveyance in Language Models

arXiv:2605.30844v1 Announce Type: cross Abstract: Fine-tuning is often believed to reduce uncertainty and diversity in large language models, but existing analyses overlook output length, a key confou

Local Ai

Graph Energy Matching: Transport-Aligned Energy-Based Modeling for Graph Generation

arXiv:2603.23398v2 Announce Type: replace-cross Abstract: Generative modeling of discrete data, such as graphs, underpins many scientific and industrial applications, including molecular discovery and

local-aiarxiv-cs-ai

Language Models Can Resolve Reference Compositionally, But It's Not Their Native Strength: The Case of the Personal Relation Task

arXiv:2605.31480v1 Announce Type: new Abstract: Do neural models, such as Large Language Models, genuinely acquire compositional abilities for interpretation of natural language? When we talk about se

researcharxiv-cs-cl

Model Monotonicity in Autobidding Auctions: When Do Better Predictions Lead to Better Outcomes?

arXiv:2605.31036v1 Announce Type: cross Abstract: Online advertising platforms rely on machine learning models to predict click-through rates (pCTR) and conversion rates (pCVR) for auction mechanisms.

MultiPriv: Benchmarking Individual-Level Privacy Reasoning in Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2511.16940v3 Announce Type: replace Abstract: Modern Vision-Language Models (VLMs) pose significant individual-level privacy risks by linking fragmented multimodal data to identifiable individua

Applications

Performance and Complexity Trade-off Optimization of Speech Models During Training

arXiv:2601.13704v3 Announce Type: replace-cross Abstract: In speech machine learning, neural network models are typically designed by choosing an architecture with fixed layer sizes and structure. The

applicationsarxiv-cs-ai

SAEmnesia: Erasing Concepts in Diffusion Models with Supervised Sparse Autoencoders

arXiv:2509.21379v3 Announce Type: replace-cross Abstract: Concept unlearning in diffusion models is hampered by feature splitting, where concepts are distributed across many latent features, making th

Sequential Least-Squares Estimators with Fast Randomized Sketching for Linear Statistical Models

model-releasesarxiv-cs-lg

arXiv:2509.06856v2 Announce Type: replace-cross Abstract: We propose a novel randomized framework for the estimation problem of large-scale linear statistical models, namely Sequential Least-Squares E

Smaller Models are Natural Explorers for Policy-Level Diversity in GRPO

arXiv:2605.30789v1 Announce Type: cross Abstract: We identify a new dimension for enhancing rollout diversity in Group Relative Policy Optimization (GRPO) for LLMs. While GRPO relies on diverse rollou

Structured interactions improve distributed coordination beyond model scaling in a real-world multi-robot system

arXiv:2605.30383v1 Announce Type: cross Abstract: Scaling individual robot capabilities is common but costly. Here we investigate a system-level design question in real-world multi-robot coordination:

The Illusion of Generalization in Tabular Language Models

model-releasesarxiv-cs-lg

arXiv:2602.04031v2 Announce Type: replace Abstract: Tabular Language Models (TLMs) have been claimed to achieve strong generalization for tabular prediction. We conduct a systematic re-evaluation of T

Unlearning in Diffusion Models: A Unified Framework with KL Divergence and Likelihood Constraints

arXiv:2605.30825v1 Announce Type: cross Abstract: Unlearning in diffusion models aims to remove undesirable data or concepts while preserving the utility of pretrained models -- two fundamentally conf

Vision-Language Models Suppress Female Representations Under Ambiguous Input

arXiv:2605.31556v1 Announce Type: cross Abstract: Alignment teaches vision-language models (VLMs) to avoid expressing demographic biases, and when gender is clearly visible they largely succeed. Far l

World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry

arXiv:2604.01985v2 Announce Type: replace-cross Abstract: General-purpose world models promise scalable policy evaluation, optimization, and planning, yet achieving the required level of robustness re

Agents

A Deep Learning Model of Mental Rotation Informed by Interactive VR Experiments

arXiv:2512.13517v2 Announce Type: replace-cross Abstract: Mental rotation -- the ability to compare objects seen from different viewpoints -- is a fundamental example of mental simulation and spatial

agentsarxiv-cs-lg

Access Sets Matter: Budgeting Expert Reads for Scalable Weight-Space Model Merging

model-releasesarxiv-cs-lg

arXiv:2605.29489v1 Announce Type: new Abstract: Weight-space model merging is usually formulated as an algebraic operation on checkpoints, yet at LLM scale the limiting resource is often the set of ex

Auditing Training Data in Generative Music Models via Black-Box Membership Inference

arXiv:2605.29202v1 Announce Type: new Abstract: Recent advances in text-to-music generation enable high-fidelity synthesis of structured musical audio, raising growing concerns about data provenance,

safetyarxiv-cs-lg

Benchmarking Positional Encoding Strategies for Transformer-Based EEG Foundation Models

arXiv:2605.29754v1 Announce Type: new Abstract: Electroencephalography (EEG) is a widely used non-invasive technique for measuring brain activity in brain-computer interface (BCI) applications. Superv

BioRefusalAudit: Auditing Biosecurity Refusal Depth Using General and Domain-Fine-Tuned Sparse Autoencoders

arXiv:2605.30162v1 Announce Type: new Abstract: Biosecurity evaluations of language models typically ask whether models produce hazardous output. This paper asks a complementary question: when a model

DLM-SWAI: Steering Diffusion Language Models Before They Unmask

arXiv:2605.29626v1 Announce Type: cross Abstract: Steering language model generation toward desired textual properties is essential for practical deployment, and inference-time methods are particularl

Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding

arXiv:2605.29707v1 Announce Type: new Abstract: Speculative decoding accelerates LLM inference by drafting multiple tokens and verifying them in parallel with the target model. However, its practical

researcharxiv-cs-cl

Tutorials

ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models

arXiv:2605.29438v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models are a powerful paradigm for generalist robotic control. However, their high computational cost and limited control f

tutorialsarxiv-cs-ro

Large-Scale AI and Foundation Models for Neuroscience: A Comprehensive Review

arXiv:2510.16658v3 Announce Type: replace Abstract: The development of large-scale artificial intelligence (AI) models is influencing neuroscience research by enabling end-to-end learning from raw bra

LLMSurgeon: Diagnosing Data Mixture of Large Language Models

arXiv:2605.30348v1 Announce Type: cross Abstract: The pretraining data mixture of Large Language Models (LLMs) constitutes their 'digital DNA', shaping model behaviors, capabilities, and failure modes