Search: “framework”

SSD: Spatially Speculative Decoding Accelerates Autoregressive Image Generation

arXiv:2606.20543v2 Announce Type: replace Abstract: Autoregressive image models treat images as 1D token sequences, inheriting the next-token factorization of language models. This flattening discards

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Tutorials

Stay Within Your Bounds: Distance-Guided Decoding for Guaranteed Context-Free Grammar Compliance

DGX agent

arXiv:2608.28229v1 Announce Type: cross Abstract: Grammar-constrained decoding helps large language models produce syntactically valid structured outputs, such as code, JSON, and SQL. For context-free

tutorialsarxiv-cs-cl

31 Aug 2026

Steering Multimodal Large Language Models Decoding for Context-Aware Safety

arXiv:2509.19212v2 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) are increasingly deployed in real-world applications, yet their ability to make context-aware safety decisi

safetyarxiv-cs-cl

Agents

STEGNav: Spatio-Temporal Event Graph Reasoning for Multimodal Lifelong Object Navigation

arXiv:2608.28279v1 Announce Type: new Abstract: Multimodal lifelong navigation requires an agent to autonomously explore unseen environments while sequentially completing navigation tasks specified by

agentsarxiv-cs-ro

Stranger, Fan, or Peer? A Systematic Study on the Role of Interlocutor in Persona-Based Dialogue Generation

arXiv:2608.28467v1 Announce Type: new Abstract: Persona-based dialogue systems are usually conditioned on speaker biography, but dialogues involve at least two participants, and who has access to whos

researcharxiv-cs-cl

SUFLECA: Scaling Up Feature Learning for CAD-to-image Alignment

arXiv:2607.15058v2 Announce Type: replace Abstract: CAD-to-image alignment aims to estimate an object's 9D pose (rotation, translation, and anisotropic scale) from a single RGB image, with application

Talk in Pieces, See in Whole: Disentangled and Hierarchical Representation Learning in Language-based Object Detection

arXiv:2509.24192v2 Announce Type: replace Abstract: Vision-language models (VLMs) have advanced multimodal perception, demonstrated by open-vocabulary object detection with simple language queries. St

Task-State Adaptation with Prototype Memory for Multi-Task Dense Prediction

arXiv:2608.28078v1 Announce Type: new Abstract: Vision foundation backbones provide strong representations for dense prediction, yet a single shared feature still needs to support tasks with different

Temporal Memory-Aware Online Test-Time Adaptation on Dynamic Graphs

arXiv:2608.27948v1 Announce Type: new Abstract: Test-time adaptation (TTA) on graphs aims to adapt a graph neural network (GNN) that is well-trained on the training graph to the test graph, which invo

safetyarxiv-cs-lg

Local Ai

Temporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding

arXiv:2608.27871v1 Announce Type: new Abstract: Long-video understanding remains challenging for Multimodal Large Language Models (MLLMs) due to limited context length. Uniform sampling may miss cruci

local-aiarxiv-cs-cv

Local Ai

Tensor-Accelerated Eager Multi-Resolution Grids for Evolving Large-Scale Substrates

arXiv:2608.27612v1 Announce Type: cross Abstract: In neuroevolution, indirect encoding generates neural network connectivity from a compact genome rather than specifying each connection. ES-HyperNEAT

local-aiarxiv-cs-lg

Tutorials

Texture Image Classification Using DWT AlexNet Feature Fusion and Deep Neural Networks

arXiv:2608.28524v1 Announce Type: new Abstract: Texture image classification plays a significant role in computer vision applications, including industrial inspection, medical image analysis, remote s

tutorialsarxiv-cs-cv

Applications

The Calls are Coming from Inside the Model: Investigating Probe-based Detection of Tool-Calling Errors in LLMs

arXiv:2608.27750v1 Announce Type: cross Abstract: The hidden states of large language models (LLMs) are known to capture rich information relating to model knowledge and behavior that can be hard to e

applicationsarxiv-cs-cl

The Discrete-Log Clock: How a Transformer Learns Modular Multiplication

arXiv:2606.17399v2 Announce Type: replace Abstract: When small transformers grok modular multiplication, prior work reports that the learned embedding has a 'dense' Fourier spectrum requiring all freq

researcharxiv-cs-lg

There and Back Again: Bidirectional Diffusion Bridges for Multimodality Translation

arXiv:2608.27885v1 Announce Type: new Abstract: Multimodality translation (e.g., text-to-image) is a core generative AI task. However, existing approaches (1) follow generative paths that do not direc

researcharxiv-cs-lg

Agents

This WikiSkill paper from Google is a must-read. At a high level, it shows the effectiveness of persistent agents, knowledge bases, and skil…

This WikiSkill paper from Google is a must-read. At a high level, it shows the effectiveness of persistent agents, knowledge bases, and skills. @karpathy popularized LLM Wikis. But this paper provides

agentsdair-ai--x

Token-Budget Distillation: Transferring Full-Token Semantics to Compressed Video Vision-Language Models

arXiv:2608.28138v1 Announce Type: new Abstract: Adapting video vision-language models (VLMs) is computationally expensive because video inputs produce a large number of visual tokens, making both fine

Twin Worlds: Equivariance-Based Abstention for Evidence-Grounded Reasoning

arXiv:2608.28018v1 Announce Type: new Abstract: Knowledge-intensive reasoning requires Large Language Models (LLMs) to ground answers in provided evidence. When evidence is insufficient, it is desirab

researcharxiv-cs-cl

UniLipi: A Unified Multi-Script OCR for Historical Indic Manuscripts

arXiv:2608.28195v1 Announce Type: new Abstract: Optical character recognition (OCR) for handwritten Indic manuscripts is essential for large-scale digitization and computational access to manuscript h

Applications

Var-JEPA: A Variational Formulation of the Joint-Embedding Predictive Architecture - Bridging Predictive and Generative Self-Supervised Learning

arXiv:2603.20111v2 Announce Type: replace Abstract: The Joint-Embedding Predictive Architecture (JEPA) is often seen as a non-generative alternative to likelihood-based self-supervised learning, empha

applicationsarxiv-cs-lg

Video Generative Models as Geometry Learner

arXiv:2608.28549v1 Announce Type: new Abstract: Recent generative approaches to geometry estimation adapt pretrained image diffusion models and treat the task as image-conditioned generation. Leveragi

VidParse: Online Parsing of Egocentric Procedures Like a Pro

arXiv:2608.27562v1 Announce Type: new Abstract: Translating continuous, noisy egocentric video streams into discrete, temporally ordered action steps is fraught with visual challenges. Heavy ego-motio

Visual Token Coding for Video Multimodal Large Language Models

arXiv:2608.28008v1 Announce Type: new Abstract: In this paper, we propose a new token compression paradigm for video Multimodal Large Language Models (MLLMs), termed Visual Token Coding (VTC). Inspire

What Can Low Resource Languages Learn From Each Other?

arXiv:2608.27753v1 Announce Type: new Abstract: Despite the rapid advancement of Vision-Language Models (VLMs), their linguistic reach remains largely confined to high-resource languages, leaving the

When Tokenizers Fail: Byte-Level Chunking for Zero-Shot Transfer to Low-Resource Languages

arXiv:2608.27658v1 Announce Type: new Abstract: Subword tokenization hinders low-resource language processing by imposing frequency patterns from dominant languages onto script-sharing variants. Byte-

safetyarxiv-cs-cl

Local Ai

WilLaGS: Latent-Conditional 3D Appearance Fields for Robust Gaussian Splatting In-the-Wild

arXiv:2608.28240v1 Announce Type: new Abstract: 3D Gaussian Splatting (3DGS) delivers real-time and high-fidelity rendering but remains challenged by unconstrained in-the-wild scenes, where drastic ap

local-aiarxiv-cs-cv

XHotpotQA: A Benchmark for Cross-Lingual Knowledge Composition in Multi-Hop Question Answering

model-releasesarxiv-cs-cl

arXiv:2608.27481v1 Announce Type: new Abstract: Knowledge-intensive multi-hop question answering requires systems to select evidence and compose dependent facts, yet multilingual benchmarks usually tr

use llms to auto annotation your dataset locally

model-releasesr-localllama

hi i make tool for this called llmog it's purpose to make llms free to - auto annotation datasets - reclassification existing yolo datasets running totally local using llama cpp or vllm or use externa

29 Aug 2026

A Point-of-Prescription Safety-Check System for Adverse Drug Reactions in Rural Bangladeshi Hospitals: A Feasibility Study

arXiv:2608.27239v1 Announce Type: cross Abstract: Adverse drug reactions (ADRs) are a major, largely preventable source of patient harm. In high-income settings, electronic health records store a pati

safetyarxiv-cs-lg

A Very Big Video Reasoning Suite

model-releasesarxiv-cs-ai

arXiv:2602.20159v3 Announce Type: replace-cross Abstract: Rapid progress in video models has largely focused on visual quality, leaving their reasoning capabilities underexplored. Video reasoning grou

Activation Outliers Matter: Robust Recovery for Quantized Multimodal LLMs

arXiv:2608.26581v1 Announce Type: new Abstract: Low-bit quantization offers a promising avenue for reducing the computational and memory demands of Multimodal Large Language Models (MLLMs). Recent har

researcharxiv-cs-lg

Active Curriculum Refinement for Reinforcement Learning

model-releasesarxiv-cs-lg

arXiv:2608.26469v1 Announce Type: new Abstract: In many reinforcement learning (RL) domains, environments are connected by prerequisite relations, such as difficulty-increasing edits or parameter incr

Agents

Active sensing to characterize the heterogeneity of plant stress

arXiv:2608.27088v1 Announce Type: cross Abstract: While most phenotyping platforms rely primarily on image-based measurements, advanced plant characterization requires the integration of active physio

agentsarxiv-cs-ai

AdaThinking-E: One-Token Entropy Regulation for Adaptive Thinking

model-releasesarxiv-cs-cl

arXiv:2608.26141v1 Announce Type: new Abstract: Multimodal large language models have demonstrated strong document reasoning capabilities by incorporating explicit thinking processes. While this capab

ADeptS-Bench: Measuring the Trustworthiness of Computer Use Agents Across Devices

model-releasesarxiv-cs-ai

arXiv:2608.26204v1 Announce Type: cross Abstract: Computer Use Agents (CUAs) are increasingly deployed to navigate mobile and desktop applications on behalf of users, yet no benchmark comprehensively

AffectOmni: RL-Verifiable People-Centric Grounded Affective Reasoning for Social and Art-Related Scenes

arXiv:2608.26193v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) achieve strong performance on VQA and scene understanding, yet affective reasoning remains vulnerable to shortc

researcharxiv-cs-ai

AgentFold: Closed-Loop Agentic Search for Protein Folding Model Design

arXiv:2608.26747v1 Announce Type: new Abstract: Scientific LLM agents have shown promise in literature reasoning, tool use, and experiment planning, but it remains unclear whether they can autonomousl

safetyarxiv-cs-ai

AI Control Scientist: LLM-driven Agentic System for Automated Control Design

model-releasesarxiv-cs-ai

arXiv:2608.26780v1 Announce Type: new Abstract: Control system design is critical for modern industry, such as chemical process temperature regulation and aero-engine control. However,traditional cont

AirLLM: Diffusion Policy-based Adaptive LoRA for Remote Fine-Tuning of LLM over the Air

arXiv:2507.11515v2 Announce Type: replace-cross Abstract: Operating Large Language Models (LLMs) on edge devices is increasingly challenged by limited communication bandwidth and strained computationa

safetyarxiv-cs-ai

Aphanta: Diagnosing Task-Aligned Image-Edited Intermediates for Multimodal Reasoning

arXiv:2608.26993v1 Announce Type: new Abstract: Explicit visual intermediates can help multimodal large language models (MLLMs) externalize spatial evidence and updated visual states, but their utilit

Arrive and Survive: Scaling Safe Goal-Conditioned Policy Learning from One-Bit Failure Signals

arXiv:2608.26571v1 Announce Type: new Abstract: Contrastive reinforcement learning (CRL) scales effectively in goal-conditioned tasks by casting policy learning into a self-supervised contrastive obje

safetyarxiv-cs-lg

Automated 2D and 3D Segmentation of AMD and DME Lesions in OCT

arXiv:2608.27095v1 Announce Type: new Abstract: Age-related macular degeneration (AMD) and diabetic macular edema (DME) are leading causes of vision loss, and optical coherence tomography (OCT) is the

Barrier Function Conformal Safety Clearance Certification with CVaR for Driving Trajectory Selection

arXiv:2608.26533v1 Announce Type: cross Abstract: Autonomous driving motion planners generate and select candidate trajectories while accounting for interactions with surrounding agents. However, thes

safetyarxiv-cs-ro

Benchmarking Clinical Decision Pathway Adherence in Large Language Models

model-releasesarxiv-cs-cl

arXiv:2608.26592v1 Announce Type: new Abstract: Following clinical decision pathways (CDPs) defined by clinical practice guidelines is essential for safe and reliable medical decision-making. However,

Applications

Beyond Capability Benchmarks: Learning Operational Fingerprints of LLM Cloud Services from Production Incident Metadata

arXiv:2608.26332v1 Announce Type: new Abstract: Managed LLM services are now part of real production systems, but model selection and service planning still rely heavily on capability benchmarks that

applicationsarxiv-cs-lg

Beyond Reflection: Affirmation as a Promising Behavioral Marker Associated with Quality in Text-Based Counseling

arXiv:2608.26689v1 Announce Type: new Abstract: While AI-assisted text-based counseling is gaining attention, it remains empirically unclear which counselor behaviors are associated with higher dialog

researcharxiv-cs-cl

Beyond Shallow-Water Photorealism: Physically and Sensor-Grounded Simulation for Deep-Sea Robotics

arXiv:2608.26888v1 Announce Type: new Abstract: Many recent underwater simulators emphasize visual realism at the expense of physical fidelity, focusing on shallow-water effects with limited relevance

researcharxiv-cs-ro

Case2Flow: Bridging Patient Cases and Guideline Flowcharts through Multimodal Retrieval

arXiv:2608.26414v1 Announce Type: new Abstract: Medical guidelines encode rich, evidence-based decision logic, yet the specific decision artifact a clinician needs is hard to locate within a guideline

safetyarxiv-cs-cl