Search: “models”

Perturbation is All You Need for Extrapolating Language Models

arXiv:2605.04344v1 Announce Type: cross Abstract: We introduce a simple yet powerful framework for training large language models. In contrast to the standard autoregressive next-token prediction base

applicationsarxiv-cs-lg

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Positional Encoding in Transformer-Based Time Series Models: A Survey

DGX agent

arXiv:2502.12370v3 Announce Type: replace Abstract: Recent advancements in transformer-based models have greatly improved time series analysis, providing robust solutions for tasks such as forecasting

researcharxiv-cs-lg

7 May 2026

Agents

ProgramBench: Can Language Models Rebuild Programs From Scratch?

arXiv:2605.03546v1 Announce Type: cross Abstract: Turning ideas into full software projects from scratch has become a popular use case for language models. Agents are being deployed to seed, maintain,

agentsarxiv-cs-ai

Proximal Projection for Doubly Sparse Regularized Models

arXiv:2605.05093v1 Announce Type: cross Abstract: Regularization is often used in high-dimensional regression settings to generate a sparse model, which can save tremendous computing resources and ide

applicationsarxiv-cs-lg

Towards General Preference Alignment: Diffusion Models at Nash Equilibrium

arXiv:2605.04494v1 Announce Type: cross Abstract: Reinforcement learning from human feedback (RLHF) has been popular for aligning text-to-image (T2I) diffusion models with human preferences. As a main

safetyarxiv-cs-cv

Visual Disentangled Diffusion Autoencoders: Scalable Counterfactual Generation for Foundation Models

arXiv:2601.21851v2 Announce Type: replace Abstract: Foundation models, despite their robust zero-shot capabilities, remain vulnerable to spurious correlations and 'Clever Hans' strategies. Existing mi

researcharxiv-cs-lg

Adaptive 3D-RoPE: Physics-Aligned Rotary Positional Encoding for Wireless Foundation Models

arXiv:2605.00968v1 Announce Type: cross Abstract: Positional encoding plays a pivotal role in determin?ing the extrapolation and generalization performance of wireless foundation models for channel st

Aligning Inductive Bias for Data-Efficient Generalization in State Space Models

arXiv:2509.20789v4 Announce Type: replace Abstract: The remarkable success of modern AI has been closely tied to scaling laws, yet the finite supply of high-quality data makes data efficiency--learnin

safetyarxiv-cs-lg

An End-to-End Framework for Building Large Language Models for Software Operations

arXiv:2605.02906v1 Announce Type: new Abstract: In the field of software operations, Large Language Models (LLMs) have attracted increasing attention. However, existing research has not yet achieved e

researcharxiv-cs-lg

Local Ai

Benchmarking Local Language Models for Social Robots using Edge Devices

arXiv:2605.03111v1 Announce Type: cross Abstract: Social-educational robots designed for socially interactive pedagogical support, such as the Robot Study Companion (RSC), rely on responsive, privacy-

local-aiarxiv-cs-cl

Automated Interpretability and Feature Discovery in Language Models with Agents

arXiv:2605.01555v1 Announce Type: new Abstract: We introduce an autonomous multiagent framework for mechanistic interpretability that automates both explaining and finding internal features in large l

CombinationTS: A Modular Framework for Understanding Time-Series Forecasting Models

model-releasesarxiv-cs-lg

arXiv:2605.01231v1 Announce Type: new Abstract: Recent progress in time-series forecasting has led to rapidly increasing architectural complexity, yet many reported State-of-the-Art gains are statisti

Extracting memorized pieces of (copyrighted) books from open-weight language models

arXiv:2505.12546v5 Announce Type: replace Abstract: Plaintiffs and defendants in copyright lawsuits over generative AI often make sweeping, opposing claims about the extent to which large language mod

Led to Mislead: Adversarial Content Injection for Attacks on Neural Ranking Models

arXiv:2605.01591v1 Announce Type: cross Abstract: Neural Ranking Models (NRMs) are central to modern information retrieval but remain highly vulnerable to adversarial manipulation. Existing attacks of

applicationsarxiv-cs-cl

Multi-Rater Calibrated Segmentation Models

arXiv:2605.02437v1 Announce Type: new Abstract: Objective: Accurate probability estimates are essential for the safe deployment of medical image segmentation models in clinical decision-making. Howeve

Watch Your Step: Information Injection in Diffusion Models via Shadow Timestep Embedding

arXiv:2605.00935v1 Announce Type: cross Abstract: Diffusion models have become the foundation of modern generative systems, with most research focusing primarily on improving generation efficiency and

Concolic Testing on Individual Fairness of Neural Network Models

model-releasesarxiv-cs-lg

arXiv:2509.06864v2 Announce Type: replace Abstract: This paper introduces PyFair, a formal framework for evaluating and verifying individual fairness of Deep Neural Networks (DNNs). By adapting the co

Diffusion Models for Solving Inverse Problems via Posterior Sampling with Piecewise Guidance

arXiv:2507.18654v2 Announce Type: replace-cross Abstract: Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured

Tutorials

Efficient Mutation Testing of Quantum Machine Learning Models

arXiv:2605.00107v1 Announce Type: cross Abstract: Quantum machine learning integrates the strengths of quantum computing and machine learning, enabling models to learn complex features using fewer par

tutorialsarxiv-cs-lg

From Local to Global to Mechanistic: An iERF-Centered Unified Framework for Interpreting Vision Models

arXiv:2605.00474v1 Announce Type: new Abstract: Modern vision models achieve remarkable accuracy, but explaining where evidence arises, what the model encodes, and how internal computations assemble t

Probing Multimodal Large Language Models on Cognitive Biases in Chinese Short-Video Misinformation

arXiv:2601.06600v2 Announce Type: replace Abstract: Short-video platforms have become major channels for misinformation, where deceptive claims frequently leverage visual experiments and social cues.

SC-Taxo: Hierarchical Taxonomy Generation under Semantic Consistency Constraints using Large Language Models

arXiv:2605.00620v1 Announce Type: new Abstract: Scientific literature is expanding at an unprecedented pace, making it increasingly challenging to efficiently organize and access domain knowledge. A h

Trees to Flows and Back: Unifying Decision Trees and Diffusion Models

arXiv:2605.00414v1 Announce Type: new Abstract: Decision trees and diffusion models are ostensibly disparate model classes, one discrete and hierarchical, the other continuous and dynamic. This work u

researcharxiv-cs-lg

This is a good explanation of why the gap between open and closed models is larger than it appears in benchmarks. I would add in that curren…

applicationsethan-mollick--x

This is a good explanation of why the gap between open and closed models is larger than it appears in benchmarks. I would add in that current open models are also more fragile than closed: they handle

3 May 2026

Analytical Correction for Subsampling Bias in Drifting Models

arXiv:2604.27239v1 Announce Type: new Abstract: Drifting models are capable one-step generative models trained to follow a drifting field. The field combines attractive and repulsive softmax-weighted

safetyarxiv-cs-lg

Debiasing Reward Models via Causally Motivated Inference-Time Intervention

arXiv:2604.27495v1 Announce Type: cross Abstract: Reward models (RMs) play a central role in aligning large language models (LLMs) with human preferences. However, RMs are often sensitive to spurious

Geometry-Calibrated Conformal Abstention for Language Models

arXiv:2604.27914v1 Announce Type: new Abstract: When language models lack relevant knowledge for a given query, they frequently generate plausible responses that can be hallucinations, rather than adm

researcharxiv-cs-cl

Policy-Grounded Safety Evaluation of 20 Large Language Models

arXiv:2507.14719v2 Announce Type: replace Abstract: As large language models (LLMs) become increasingly integrated into real-world applications, scalable and rigorous safety evaluation is essential. T

Creating highly efficient agents: 450M tool-calling tokens distilled for post-training from top open-source models

model-releaseslambda-labs

Harnesses If you've used Claude Code or Codex, you've used a harness. A harness is the infrastructure layer that wraps an AI coding agent and decides how it operates, what it can touch, and how you me

Data-Centric Foundation Models in Computational Healthcare: A Survey

arXiv:2401.02458v3 Announce Type: replace-cross Abstract: The advent of foundation models (FMs) as an emerging suite of AI techniques has struck a wave of opportunities in computational healthcare. Th

For better or worse, regulation for closed-source models served by a few (quite large) companies is easy. It is not as easy to imagine how y…

For better or worse, regulation for closed-source models served by a few (quite large) companies is easy. It is not as easy to imagine how you regulate open-source models that can be served by a range

safetyethan-mollick--x

Information Extraction from Electricity Invoices with General-Purpose Large Language Models

arXiv:2604.25927v1 Announce Type: new Abstract: Information extraction from semi-structured business documents remains a critical challenge for enterprise management. This study evaluates the capabili

Tools

Introducing Silico: the platform for building AI models with the precision of written software. Silico lets researchers and engineers see in…

Introducing Silico: the platform for building AI models with the precision of written software. Silico lets researchers and engineers see inside their models, debug failures, and intentionally design

toolslinus-lee--x

Tutorials

Language Diffusion Models are Associative Memories Capable of Retrieving Unseen Data

arXiv:2604.26841v1 Announce Type: cross Abstract: When do language diffusion models memorize their training data, and how to quantitatively assess their true generative regime? We address these questi

tutorialsarxiv-cs-ai

Sociodemographic Biases in Educational Counselling by Large Language Models

arXiv:2604.25932v1 Announce Type: cross Abstract: As Large Language Models (LLMs) are increasingly integrated into educational settings, understanding their potential biases is critical. This study ex

ADE: Adaptive Dictionary Embeddings -- Scaling Multi-Anchor Representations to Large Language Models

arXiv:2604.24940v1 Announce Type: new Abstract: Word embeddings are fundamental to natural language processing, yet traditional approaches represent each word with a single vector, creating representa

// Latent Agents // Multi-agent debate makes models reason better. It also burns tokens generating long transcripts before any answer comes …

// Latent Agents // Multi-agent debate makes models reason better. It also burns tokens generating long transcripts before any answer comes out. This new research distills the entire debate into a sin

safetydair-ai--x

Prefill-Time Intervention for Mitigating Hallucination in Large Vision-Language Models

arXiv:2604.25642v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) have achieved remarkable progress in visual-textual understanding, yet their reliability is critically undermined b

Privileged Foresight Distillation: Zero-Cost Future Correction for World Action Models

arXiv:2604.25859v1 Announce Type: new Abstract: World action models jointly predict future video and action during training, raising an open question about what role the future-prediction branch actua

researcharxiv-cs-ro

Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Models

arXiv:2604.25636v1 Announce Type: new Abstract: Unified multimodal models (UMMs) integrate visual understanding and generation within a single framework. For text-to-image (T2I) tasks, this unified ca

safetyarxiv-cs-cv

Rethinking Layer Redundancy in Large Language Models: Calibration Objectives and Search for Depth Pruning

arXiv:2604.24938v1 Announce Type: cross Abstract: Depth pruning improves the inference efficiency of large language models by removing Transformer blocks. Prior work has focused on importance criteria

researcharxiv-cs-cl

Vision SmolMamba: Spike-Guided Token Pruning for Energy-Efficient Spiking State-Space Vision Models

arXiv:2604.25570v1 Announce Type: new Abstract: Spiking Transformers have shown strong potential for long-range visual modeling through spike-driven self-attention. However, their quadratic token inte

A Theoretical Framework for Auxiliary-Loss-Free Load Balancing of Sparse Mixture-of-Experts in Large-Scale AI Models

model-releasesarxiv-cs-ai

arXiv:2512.03915v3 Announce Type: replace-cross Abstract: In large-scale AI training, Sparse Mixture-of-Experts (s-MoE) layers enable scaling by activating only a small subset of experts per token. An

Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigation

arXiv:2604.24361v1 Announce Type: new Abstract: Large language models (LLMs) have achieved strong performance in general machine translation, yet their ability in culture-aware scenarios remains poorl

researcharxiv-cs-cl

Hardware

FreeScale: Distributed Training for Sequence Recommendation Models with Minimal Scaling Cost

arXiv:2604.24073v1 Announce Type: cross Abstract: Modern industrial Deep Learning Recommendation Models typically extract user preferences through the analysis of sequential interaction histories, sub

hardwarearxiv-cs-ai

Tutorials

LunarDepthNet: Generation of Digital Elevation Models using Deep Learning and Monocular Satellite Images

arXiv:2604.22848v1 Announce Type: new Abstract: Recent times have seen an increase in demand of high quality Digital Elevation Models (DEMs) for the lunar surface, because they are highly important fo

tutorialsarxiv-cs-cv

Modular Sensory Stream for Integrating Physical Feedback in Vision-Language-Action Models

arXiv:2604.23272v1 Announce Type: new Abstract: Humans understand and interact with the real world by relying on diverse physical feedback beyond visual perception. Motivated by this, recent approache

applicationsarxiv-cs-ro

OntoLogX: Ontology-Guided Knowledge Graph Extraction from Cybersecurity Logs with Large Language Models

model-releasesarxiv-cs-ai

arXiv:2510.01409v2 Announce Type: replace Abstract: System logs represent a valuable source of Cyber Threat Intelligence (CTI), capturing attacker behaviors, exploited vulnerabilities, and traces of m