Data-free On-policy Distillation
arXiv:2609.14193v1 Announce Type: cross Abstract: On-policy distillation (OPD) has become a standard component of frontier post-training pipelines, yet how much its training data actually contributes
Knowledge catalogue
arXiv:2609.14193v1 Announce Type: cross Abstract: On-policy distillation (OPD) has become a standard component of frontier post-training pipelines, yet how much its training data actually contributes
arXiv:2508.02312v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs), now a foundation in advancing natural language processing, power applications such as text generation, machine t
arXiv:2609.15722v1 Announce Type: new Abstract: AI-driven automated decision-making requires both predictive performance and interpretability. Recent advances in interpretable machine learning (IML) p
arXiv:2609.13711v1 Announce Type: new Abstract: Selecting a decentralized Multi-Robot Task Allocation (MRTA) method for embedded deployment on autonomous platforms requires considering more than route
arXiv:2609.14821v1 Announce Type: new Abstract: Earth system modeling is shifting from task-specific predictors toward foundation models with general spatiotemporal representation capabilities. Althou
arXiv:2607.17425v3 Announce Type: replace Abstract: Sparse autoencoders (SAEs) compress model activations into sparse codes, but equal reconstruction error and sparsity can preserve different linearly
arXiv:2602.00377v3 Announce Type: replace Abstract: Existing knowledge probing methods rely on pre-defined queries, limiting extraction to known concepts. We introduce DecompressionLM, a stateless fra
arXiv:2609.13324v1 Announce Type: cross Abstract: Graph-RAG systems often assume pristine data quality, overlooking the severe impact of perturbations in cloud-native databases. This paper proposes a
arXiv:2609.15225v1 Announce Type: new Abstract: Objective: To develop an intelligent framework, termed CUA-Net, for the automated classification of congenital uterine anomalies (CUA) without requiring
arXiv:2606.22906v2 Announce Type: replace-cross Abstract: Large language models have shown strong performance on software engineering (SE) tasks, yet understanding large industrial repositories remain
arXiv:2512.08379v3 Announce Type: replace Abstract: Biosignals collected from wearable devices are widely utilized in healthcare applications. Machine learning models used in these applications often
I liked DeepSeek V4.1 Flash as an agent model but at 16 t/s on ds4 it was painful to sit through a real turn. It seemed some redditors and m3 ultra owners appreciated my glm 53 flash optimizations, so
arXiv:2609.14129v1 Announce Type: cross Abstract: Ultra-High-Definition (UHD) video presents significant challenges for efficient storage and real-time decoding. Learning-based methods, such as Neural
arXiv:2609.13712v1 Announce Type: new Abstract: Many real-world scenarios can be represented using graph-structured data. However, traditional GNNs that transmit messages based on first-order neighbor
arXiv:2609.15803v1 Announce Type: cross Abstract: Long-running AI agents create a control problem: each action they take changes the state, which in turn affects the trajectory of future actions. If t
New York Times: Democrats and Republicans proposed many bills to address major AI threats over the past two years, but they remain stymied by partisan disputes and lobbying — For years, Democrats and
arXiv:2609.14257v1 Announce Type: new Abstract: Semantic text watermarks encode signals in meaning rather than surface token choices, offering robustness to paraphrasing and other semantic-preserving
Dense models activate all of their parameters for each token, whereas a Mixture‑of‑Experts (MoE) model loads all experts into memory but activates only a subset—e.g., Nemotron 3.5 Lightning has 30 B t
arXiv:2609.14715v1 Announce Type: new Abstract: We scale our conventional sub-150M pretraining recipe from 53.5M to 109.7M parameters, holding the method fixed (Qwen3-style decoder with grouped-query
arXiv:2609.15122v1 Announce Type: cross Abstract: Generative CAD models are expected to remain behaviorally correct after parameter edits, so increasing the number of edit checks is often treated as a
arXiv:2607.16196v2 Announce Type: replace Abstract: Soft plush companions provide a safe and intuitive platform for affective human-robot interaction, but their deformable structure and distributed ta
arXiv:2609.15744v1 Announce Type: new Abstract: Advancements in data fusion and real-time analytics technologies have opened new avenues for addressing complex domain challenges. Financial risk early
arXiv:2603.02790v2 Announce Type: replace Abstract: Foundation models are changing the way we develop medical artificial intelligence. By learning broadly generalizable features across diverse data mo
arXiv:2609.13756v1 Announce Type: new Abstract: One in every five vehicle accidents on the road today is caused simply due to driver fatigue. Fatigue or otherwise drowsiness, significantly reduces the
arXiv:2609.13194v1 Announce Type: cross Abstract: A large literature builds physical structure into learned dynamics on the premise that models respecting the underlying physics predict better. We tes
arXiv:2609.14595v1 Announce Type: cross Abstract: Multichannel time-series classification commonly assumes synchronized sensor streams, although latency, clock drift, and preprocessing can introduce r
arXiv:2609.15570v1 Announce Type: new Abstract: World Action Models (WAMs) use video generation models to predict future visual dynamics for robotic manipulation, but iterative denoising introduces ad
arXiv:2606.17995v2 Announce Type: replace-cross Abstract: We study the privacy of releasing functional posterior sample paths from a Gaussian process (GP) when the entire training set including covari
arXiv:2609.13588v1 Announce Type: new Abstract: Control allocation for multirotors with bidirectional propellers is commonly formulated in signed-thrust variables, where the wrench map is linear. The
arXiv:2609.14642v1 Announce Type: new Abstract: Generation of musculoskeletal gait trajectories conditioned on patient-specific parameters remains a key challenge for wearable robotics and rehabilitat
arXiv:2609.13990v1 Announce Type: cross Abstract: Diffusion-based generative models (DMs) have found applications in control problems, and in particular robotics, where the DMs enable exploration of p
arXiv:2609.15357v1 Announce Type: new Abstract: Diffusion models generate images through an iterative diffusion process, and recent studies have demonstrated that the intermediate feature maps produce
arXiv:2509.24975v4 Announce Type: replace-cross Abstract: Diffusion large language models (dLLMs) enable parallel generation and are promising for unit test generation (UTG), where efficient and large
arXiv:2609.14596v1 Announce Type: new Abstract: Training-free diffusion inverse solvers typically choose between local measurement guidance and costly clean-space posterior updates. Independent poster
arXiv:2609.13199v1 Announce Type: cross Abstract: Knowledge distillation aims to improve the performance of lightweight student models by transferring knowledge from larger and more powerful teacher m
arXiv:2506.06977v4 Announce Type: replace-cross Abstract: Domain generalization has become a critical challenge in predictive healthcare, where different patient groups exhibit shifting data distribut
arXiv:2609.15973v1 Announce Type: new Abstract: Foundation models have progressed from learning and reasoning over existing knowledge, to increasingly learning through action, tool use, and outcome fe
arXiv:2609.15903v1 Announce Type: new Abstract: Discrete diffusion and flow models are a promising alternative to autoregressive language models, but compressing many-step sampling into fewer steps ty
arXiv:2609.15975v1 Announce Type: new Abstract: Transformer representations evolve through learned additive transformations that either preserve their current direction or redirect it. We study this e
arXiv:2609.14570v1 Announce Type: cross Abstract: Multi-agent LLM systems combine multiple inference calls, but prior work often confounds how calls are connected with how they are diversified. We stu
arXiv:2606.13105v2 Announce Type: replace Abstract: We revisit the fairness notion of disparate impact for synthetic data generation (SDG), that assesses whether the utility of generated records is th
arXiv:2505.09716v3 Announce Type: replace-cross Abstract: Out-of-distribution (OOD) generalisation is considered a hallmark of human and animal intelligence. To achieve OOD through composition, a syst
arXiv:2609.15266v1 Announce Type: new Abstract: Trajectory curvature constraints are inherent in practical multi-robot systems due to the limited turning capabilities of the robots. Without properly a
arXiv:2609.13909v1 Announce Type: cross Abstract: Continuous-latent Autoregressive Diffusion Transformer (AR-DiT) models have demonstrated immense potential in zero-shot speech generation. However, th
arXiv:2609.13830v1 Announce Type: new Abstract: We present DiVA, a deeply interactive digital life simulator pioneering a new paradigm for long-term, open-ended interactive experiences within digital
arXiv:2609.15609v1 Announce Type: new Abstract: CounterFactual Examples (CFEs) are a cornerstone of eXplainable Artificial Intelligence (XAI), offering local, post hoc, and model-agnostic explanations
arXiv:2609.15383v1 Announce Type: cross Abstract: Language model safety is typically evaluated one interaction at a time. We show that a weaker, unaligned model can split a harmful task into benign-lo
arXiv:2609.15120v1 Announce Type: new Abstract: Benefiting from the powerful generative priors of diffusion models, diffusion-based real-world image super-resolution (Real-ISR) methods have demonstrat
arXiv:2609.13800v1 Announce Type: new Abstract: Routing and cascades reduce tool-agent cost by transferring control across models, but stateful handoffs must preserve accepted choices, realized effect
arXiv:2609.13202v1 Announce Type: new Abstract: Feature engineering has long been a cornerstone of tabular machine learning. Tabular foundation models (TFMs) are pretrained on a wide range of tabular
arXiv:2609.14256v1 Announce Type: new Abstract: Topic models are widely used to analyze public health-related social media short texts, yet their evaluation remains dominated by metrics that focus ent
arXiv:2609.15187v1 Announce Type: new Abstract: Object-Centric Learning (OCL) aims to decompose images into objects without human annotations. A major family of mainstream methods uses Slot Attention
arXiv:2609.13675v1 Announce Type: new Abstract: LiDAR-inertial odometry (LIO) systems differ in whether they continue estimating gravity after initialization. We compare four gravity-bias state config
arXiv:2609.13773v1 Announce Type: cross Abstract: LLM-as-a-Judge evaluators are increasingly used to score open-ended generation, yet a judge's correlation with human ratings on its development set ma
arXiv:2609.14863v1 Announce Type: new Abstract: Smartphone-based Human Activity Recognition (HAR) models often degrade under distribution shifts caused by changes in users, devices, sensor placements,
arXiv:2609.13556v1 Announce Type: cross Abstract: Large Language Models (LLMs) have shown remarkable proficiency on general-purpose tasks, yet their performance often degrades in highly-specialized te
arXiv:2609.14571v1 Announce Type: new Abstract: This study highlights the role of domain-specific pretraining profile (DSPP) in Transformer performance for modeling digital pragmatics in Arabic-Englis
arXiv:2511.13368v3 Announce Type: replace-cross Abstract: Large language models (LLMs) perform strongly across tasks and languages, yet how improvements in one task or language affect other tasks and
arXiv:2609.15559v1 Announce Type: cross Abstract: Grammatical error correction (GEC) evaluation has traditionally relied on reference or edit overlap, which can penalize valid rewrites that differ fro
arXiv:2609.13228v1 Announce Type: new Abstract: Vision Language Models (VLMs) should rely on visual evidence that directly determines the correct answer, but supervision for grounding visual reasoning