Search: “pretraining”

Fused Bayesian Flow Networks for Dual-Target Molecular Design

arXiv:2608.01007v1 Announce Type: new Abstract: Dual-target drug design aims to generate 3D molecules that can simultaneously interact with two target proteins, offering a promising route for discover

Tutorials

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Gecko: Fast Private Inference via Secure Public Encoder Offloading

DGX agent

arXiv:2608.02378v1 Announce Type: new Abstract: Private inference protects both user inputs and server models during neural network inference, but existing solutions remain too slow for practical depl

tutorialsarxiv-cs-lg

4 Aug 2026

Geometry-Guided Layerwise FFN Width Allocation in Transformers

arXiv:2608.02064v1 Announce Type: cross Abstract: Feed-forward networks (FFNs) account for a large fraction of Transformer parameters, yet their hidden width is usually constant across depth. We ask w

researcharxiv-cs-cl

Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Models

model-releasesarxiv-cs-ro

arXiv:2608.02497v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models excel in robotic manipulation but suffer catastrophic performance drops when canonical instructions are simply parap

Inference-Time Policy Alignment for Fair Reinforcement Learning

arXiv:2608.00175v1 Announce Type: new Abstract: Deep reinforcement learning (RL) agents achieve strong performance by optimizing scalar reward functions. However, once deployed, the policies of these

safetyarxiv-cs-lg

Large Causal Models for Temporal Causal Discovery

arXiv:2602.18662v2 Announce Type: replace Abstract: Causal discovery for both cross-sectional and temporal data has traditionally followed a dataset-specific paradigm, where a new model is fitted for

Learning to See Locally and Align Clinically with Pathology Semantics for Radiology Report Generation

arXiv:2608.00279v1 Announce Type: cross Abstract: Recent radiology-adapted vision-language models have achieved strong performance on standard report generation benchmarks, yet their robustness and ge

LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference

arXiv:2608.02515v1 Announce Type: new Abstract: Long-running assistants and agents consume interaction streams that eventually outgrow the context. Existing context retention, summarization, and retri

Mitigating Visual Hallucinations in Multimodal Systems through Retrieval-Augmented Reliability-Aware Inference

arXiv:2606.15782v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have demonstrated strong capabilities in vision-language understanding and natural-language response

QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Prediction

arXiv:2608.01186v1 Announce Type: new Abstract: While feed-forward 3D Gaussian Splatting (3DGS) enables efficient 3D reconstruction, achieving high-fidelity rendering remains challenging. Existing pix

RamanPFN: learning from Raman spectral structure with a tabular foundation model

arXiv:2608.02157v1 Announce Type: new Abstract: Raman spectroscopy enables non-destructive, label-free molecular characterization across materials science, biomedicine and process monitoring. Predicti

ReACT-CLIP: Response-Aware Test-Time Defense for Vision--Language Models

arXiv:2608.01067v1 Announce Type: new Abstract: Training-free test-time defenses offer a practical way to improve the adversarial robustness of CLIP-style vision--language models without modifying the

Refine Drugs, Don't Complete Them: Uniform-Source Discrete Flows for Fragment-Based Drug Discovery

arXiv:2509.26405v2 Announce Type: replace Abstract: We introduce InVirtuoGen, a discrete flow generative model for fragmented SMILES for de novo and fragment-constrained generation, and target-propert

Applications

ReMiX-MAE: Learning Missing-Channel Cross-Modal Representations from RGB-Only Clinical Facial Videos for Sympathetic-Mediated Pain Assessment

arXiv:2608.02561v1 Announce Type: new Abstract: Automated pain assessment in real clinics is limited by scarce clinically grounded facial video data with weak labels (often sequence-level self-report)

applicationsarxiv-cs-cv

RING: Retrieval-Internalized Generation for Continual Large-Scale Knowledge Injection

arXiv:2608.01630v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) improves factuality but adds latency and engineering overhead at serving time. We propose RING (Retrieval-Internali

Same Semantics, Different Paths: Self-Improving Alignment for Vision-Text Compression

arXiv:2608.02109v1 Announce Type: new Abstract: Vision-Text Compression (VTC) renders long texts into images and encodes them through the vision encoder (ViT), compressing thousands of text tokens int

Local Ai

SARe: Structure-Aware Generative 3D Fragment Reassembly

arXiv:2603.21611v2 Announce Type: replace Abstract: 3D fragment reassembly estimates the rigid pose of each fragment to recover a complete object from unordered point clouds or meshes. The task become

local-aiarxiv-cs-cv

SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Space

arXiv:2608.01397v1 Announce Type: cross Abstract: World Action Models (WAMs) couple action generation with prediction of future states. Their effectiveness depends on whether future dynamics are model

ST-LoRA: Single Trajectory LoRA Ensemble for Uncertainty Aware Agricultural Segmentation

arXiv:2608.01530v1 Announce Type: new Abstract: Reliable decision-support in digital agriculture requires accurate predictions and well-calibrated uncertainty estimates, particularly for dense predict

TreeProbe : A Tibetan Medicine Benchmark for Cultural Bias in LLMs

arXiv:2608.00640v1 Announce Type: new Abstract: Large language models are increasingly viewed as a potential means of mitigating global health inequities, yet their outputs often reflect dominant high

Two-Stage Bengali Sentiment Classification: Domain Adaptation Through Continual Learning and Parameter-Efficient Fine-Tuning

arXiv:2608.01471v1 Announce Type: new Abstract: Understanding sentiment in low-resource languages remains a key challenge for Natural Language Processing (NLP), particularly when domain-specific data

A Neurosymbolic Approach for Explainable Early Diagnosis of Alzheimer's Disease

arXiv:2607.29530v1 Announce Type: new Abstract: Identifying reliable Alzheimer's disease (AD) markers typically requires manual, labor-intensive transcription and expert analysis, limiting its scale.

Adjudicated Captioning: Multi-Agent Alignment Scoring and Consensus-Distilled Beam Arbitration for Strict Zero-Shot Image Captioning

arXiv:2607.28986v1 Announce Type: cross Abstract: Zero-shot image captioning (ZIC) describes images without paired image-caption supervision during captioner training, relying on text-only corpora and

safetyarxiv-cs-ai

Agents

Auto-JEPA: A Latent World Model of Continuous Intent for End-to-End Autonomous Driving

arXiv:2607.29031v1 Announce Type: cross Abstract: Existing autonomous-driving world models typically perform dense prediction of future videos, occupancy states, BEV representations, or agent motion.

agentsarxiv-cs-ai

Can Synthetic Data Overcome the Generalization Limits of AI-Based Flower and Pod Detection Across Cowpea Breeding Genotypes and Environments?

arXiv:2607.28796v1 Announce Type: new Abstract: High-throughput phenotyping requires AI-enabled computer vision models that generalize across genotypes, locations, and growing seasons, yet such models

Can Zero-Shot LLMs Predict Child Malnutrition? A Fairness and Temporal Robustness Study

arXiv:2607.29082v1 Announce Type: new Abstract: Child malnutrition remains a major public health challenge in low- and middle-income countries, particularly in South Asia, where early identification o

safetyarxiv-cs-cl

Distilling Knowledge from Large Language Models into Lightweight Reinforcement Learning Agents for Autonomous Cyber Operations

arXiv:2607.28826v1 Announce Type: new Abstract: Autonomous Cyber Operations (ACO) are increasingly important for defending enterprise networks as cyber threats continue to evolve in sophistication. AC

Do Medical Foundation Models Generalize on the African Brain?

arXiv:2607.28771v1 Announce Type: new Abstract: Medical foundation models (FMs) are increasingly used for brain MRI analysis. However, their evaluation remains dominated by high-resource datasets, lea

Evidence-Type Competition: When Can Interventional Data Teach Language Models Causal Direction?

arXiv:2607.29484v1 Announce Type: new Abstract: Interventional data is widely regarded as the gold standard for teaching models causal reasoning. We test this assumption in a fully controlled syntheti

researcharxiv-cs-cl

Few-shot Deep Learning for Phase-Amplitude Aberration Correction in Transcranial Focused Ultrasound

arXiv:2607.29182v1 Announce Type: cross Abstract: Transcranial focused ultrasound (tFUS) is a non-invasive technique that delivers focused acoustic energy through the skull for neuromodulation and the

safetyarxiv-cs-lg

Tutorials

Maximum Entropy Behavior Exploration for Sim2Real Zero-Shot Reinforcement Learning

arXiv:2603.25464v2 Announce Type: replace-cross Abstract: Zero-shot reinforcement learning (RL) algorithms aim to learn a family of policies from a reward-free dataset, and recover optimal policies fo

tutorialsarxiv-cs-ai

PTP: Previous-Token Prediction based LLM Inversion for Near-Exact Prompt Reconstruction

arXiv:2607.29378v1 Announce Type: new Abstract: Large language models (LLMs) generate text by auto-regressively sampling the next token. This inherently leads to a many-to-many mapping between prompts

researcharxiv-cs-cl

RayViT: Ray-Conditioned Visual Representations for Viewpoint-Robust Imitation Learning

arXiv:2607.29622v1 Announce Type: cross Abstract: Visual imitation learning enables robots to acquire visuomotor skills directly from images, yet RGB observations lack explicit geometric cues, making

Applications

ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts

arXiv:2607.28993v1 Announce Type: cross Abstract: World Action Models (WAMs) have emerged as a promising paradigm by jointly modeling robot actions and future visual dynamics. However, their reliance

applicationsarxiv-cs-cv

Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokens

arXiv:2607.29363v1 Announce Type: cross Abstract: Balancing sequence length, representational capacity, and long-horizon stability is a central problem in autoregressive (AR) speech and audio generati

researcharxiv-cs-ai

StraightDP: Geometry-Aware Differential Privacy for Rectified-Flow Transformers

arXiv:2607.29100v1 Announce Type: cross Abstract: Differentially private (DP) training of text-conditioned generative models suffers a utility cliff at strong privacy. We revisit this problem through

TerraNova: A Foundation Model for the Anthropocene

arXiv:2607.29527v1 Announce Type: cross Abstract: A defining problem of the Anthropocene is to model the physical Earth and human societies as one coupled system, yet no learned representation spans t

safetyarxiv-cs-ai

A Montage-Agnostic Encoder for Calibration-Light Cross-User Gesture Recognition from Surface Electromyography

arXiv:2607.27565v1 Announce Type: new Abstract: Pattern-recognition control promises a myoelectric prosthesis that responds to many intended gestures rather than one or two, but the promise has stayed

Articulated Object Reconstruction from Rest-State Observation

arXiv:2607.27749v1 Announce Type: new Abstract: Building interactive digital twins requires recovering both 3D geometry and the kinematic structures that govern how objects articulate. Yet existing me

EgoGenesis: Egocentric World-Action Modeling with Online Anchored Projective Memory and Action-3D RoPE

arXiv:2607.28243v1 Announce Type: new Abstract: Egocentric video offers rich manipulation experience for embodied AI, yet collecting diverse egocentric data across scenes, objects, motions, and embodi

Hardware

FARI: Robust One-Step Inversion for Watermarking in Diffusion Models

arXiv:2607.26723v1 Announce Type: cross Abstract: Inversion-based watermarking is a promising approach to authenticate diffusion-generated images, yet practical use is bottlenecked by inversion that i

hardwarearxiv-cs-ai

Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfer

arXiv:2607.28394v1 Announce Type: new Abstract: Hand-object interaction (HOI) modeling remains challenging because it requires joint reasoning about hand articulation, object geometry, contact, semant

LLM2Vec-Gen: Generative Embeddings from Large Language Models

arXiv:2603.10913v3 Announce Type: replace Abstract: Fine-tuning LLM-based text embedders via contrastive learning maps inputs and outputs into a new representational space, discarding the LLM's output

Looped Transformers with Source-Centered State Evolution

arXiv:2607.27656v1 Announce Type: cross Abstract: Looped Transformers create a useful train- and test-time compute axis by reusing the same Transformer block over recurrent depth, increasing effective

Agents

One Future, Every Robot: Label-Efficient Collective-State Prediction with Decentralized JEPA

arXiv:2607.28443v1 Announce Type: new Abstract: Can every robot in a swarm predict the same future collective state from only local observations and bandwidth-limited messages? We formulate this as de

agentsarxiv-cs-ro

Rethinking EEG-Based Disease Diagnosis: Decoupling Instance Representation Learning from Subject-Level Supervision

arXiv:2607.27274v1 Announce Type: new Abstract: EEG-based disease diagnosis requires one prediction per subject, yet common pipelines segment recordings into short instances, inherit the subject label

Tutorials

Same Graph Cross-Task Transfer in GNNs: Protocols and Predictors

arXiv:2607.28525v1 Announce Type: new Abstract: Many real-world graphs support multiple predictive tasks over the same underlying structure, creating an opportunity to reuse supervision across node cl

tutorialsarxiv-cs-lg

SE(3)-MeanFlow: Few-Step Protein Backbone Generation on Lie Groups

arXiv:2607.27431v1 Announce Type: new Abstract: Generative modeling of protein backbones promises the de novo design of proteins with prescribed structural and functional properties. Existing diffusio