Search: “benchmark”

Diagnosing Generalization Boundaries in AI-Based Vulnerability Detection via Calibrated Embedding Distances

arXiv:2610.14296v1 Announce Type: cross Abstract: High benchmark scores in learning-based vulnerability detection mask severe degradation under distribution shifts. This paper demonstrates that calibr

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Efficient Scene-Text Refinement via Pixel-Space Grouped Image Generation

DGX agent

arXiv:2610.18284v1 Announce Type: new Abstract: Generated images often have coherent layouts and visual content, yet local errors in small text and complex characters still limit their readability and

model-releasesarxiv-cs-cv

14 Oct 2026

EmoTrace-Bench: Diagnosing Emotional Expression in Text-to-Video Generation through Controlled Cues and Intensity

arXiv:2610.15452v1 Announce Type: new Abstract: Text-to-video (T2V) models are increasingly used to generate videos with targeted emotional expressions, yet existing evaluation methods mainly rely on

Evaluating Long-Horizon Robot Planning under Uncertainty

model-releasesarxiv-cs-ro

arXiv:2610.17326v1 Announce Type: new Abstract: Household robots must successfully navigate im-perfect circumstances, both in their internal models and the external world. We introduce a benchmark of

Explicitly Aligned Multi-View Breast Cancer Risk Prediction from Variable-Length Screening Histories

arXiv:2610.16329v1 Announce Type: new Abstract: Accurate breast cancer risk prediction from screening mammography is essential for improved risk stratification and personalized screening. It can benef

Fitting Every Hint Is Not Enough: Premature Floods in Recurrent Algorithmic Reasoners

arXiv:2610.14982v1 Announce Type: new Abstract: Recurrent algorithmic reasoners are trained with per-step hints on small graphs and run for many more steps on large ones. On breadth-first search in SA

From Classification to Cross-Modal Understanding: Leveraging Vision-Language Models for Fine-Grained Renal Pathology

arXiv:2511.11984v2 Announce Type: replace Abstract: Fine-grained glomerular subtyping is essential for kidney biopsy interpretation, yet it presents a harder setting than the broad organ- or disease-l

Grok Voice 3.0 in Grok Bot is 🔥 SpaceXSI just launched Grok Voice 3.0, its new speech-to-speech model, which is currently beating GPT Live …

model-releaseselon-musk--x

Grok Voice 3.0 in Grok Bot is 🔥 SpaceXSI just launched Grok Voice 3.0, its new speech-to-speech model, which is currently beating GPT Live 1 and Gemini 3.8 Flash Live on all major benchmarks. I tried

I built a cheap dual 3090 rig from used parts, but why isn't it much faster?

Hey everyone, I recently put together a local LLM machine using mostly second hand hardware. I wanted to experiment with local models for app development without spending a fortune on a new workstatio

InfoVis: Unified Slide Image Generation and Editing

arXiv:2610.16784v1 Announce Type: new Abstract: Generating and editing presentation slides requires models to combine accurate text rendering, instruction following, visual grounding, aesthetic design

IsoVRBench: Video Reward Modeling Without Human Feedback

arXiv:2610.17234v1 Announce Type: cross Abstract: Video reward models are trained and evaluated on human preferences between videos that often differ simultaneously on properties such as prompt alignm

Mean Accuracy Is the Wrong Estimand for a Release Decision

arXiv:2610.16825v1 Announce Type: new Abstract: A release decision about a fine-tuned model is an operational commitment about the next rerun of its training recipe. Yet standard benchmark reporting g

New model from Telperion: Qwen3.8-27B-MLA & Qwen3.8-27B-GLA-g2. 4x smaller KV cache, smarter, and more efficient reasoning.

Hello! We've been busy at Telperion with a lot of experimental research (more coming soon). Today, we're announcing the release of our latent attention variants of Qwen3.8-27B. Our latent attention va

Overcoming Catastrophic Forgetting: Continual Learning for Radar Waveform Classification

arXiv:2610.18404v1 Announce Type: cross Abstract: Automated radar waveform recognition classifies the waveform and modulation type of a received signal. As new waveform variants appear over time, a de

Q-Save: Towards Scoring and Attribution for Generated Video Evaluation

arXiv:2511.18825v3 Announce Type: replace Abstract: Evaluating AI-generated video (AIGV) quality hinges on three crucial dimensions: visual quality, dynamic quality, and text-video alignment. While nu

qwen3.8-flash-next-iq3_s vs -27B-GGUF:UD-Q4_K_XL

Sampling: temp 1.0, top_p 0.95, top_k 20 for both. Run with evalscope over the OpenAI-compatible API: Qwen3.8-Next on Strata (MI50 32GB), Qwen3.8-27B on llama.cpp (RX 7900 XTX 24GB). Caveat: These are

RAIN: Robotic Task Generalization with Region-Aware Interaction Networks

arXiv:2610.14039v1 Announce Type: cross Abstract: Existing vision-language-action (VLA) models benefit from large-scale vision-language pretraining, but tend to memorize training trajectories, limitin

Remember alphaXiv? Their new research agents are told to report on users without telling them with no disclosure [D]

model-releasesr-machinelearning

I was curious about OpenResearch by alphaXiv. 'Turn your coding agents into research agents'? Sounds great! Just what I needed to save time on my experiments. So I copy pasted their repo into Claude a

RIECNN: Real-Time Image Enhanced CNN for Traffic Sign Recognition

arXiv:2610.15127v1 Announce Type: new Abstract: Traffic sign recognition plays a crucial role in the development of autonomous cars to reduce the accident rate and promote road safety. It has been a n

RootSLAM: Square Root Bundle Adjustment for Visual-Inertial SLAM

arXiv:2610.15157v1 Announce Type: cross Abstract: Efficient perception is a prerequisite for the small, low-power devices targeted by robotics, mixed reality, autonomous driving, and drone application

SEAR: Self-Evolving Agentic Robotics

model-releasesarxiv-cs-ro

arXiv:2610.18792v1 Announce Type: new Abstract: Frontier language-model agents can now improve robots on their own: they write control code, test it, and keep what works as skills and memories for the

ShoeFit: A New Dataset and Dual-image-stream DiT Framework for Virtual Footwear Try-On

arXiv:2610.18325v1 Announce Type: new Abstract: Virtual footwear try-on (VFTON), a critical yet underexplored area in virtual try-on (VTON), aims to synthesize faithful try-on results given diverse fo

SliderEdit++: Improved Slider Trajectories in Instruction-Based Image Editing

arXiv:2610.14253v1 Announce Type: new Abstract: Slider-based control aims to give users continuous, fine-grained control over the intensity of individual edits in instruction-based image editing. Howe

ST-GRU PredRNN-V2: A GRU-Based Reformulation of PredRNN-V2 for Video Prediction

arXiv:2610.18645v1 Announce Type: new Abstract: Video prediction requires models to capture complex spatiotemporal dependencies and to retain relevant information over long sequences. PredRNN and its

Local Ai

The Federated Tumor Segmentation and Classification (FeTS++) Challenge

arXiv:2610.18771v1 Announce Type: new Abstract: International challenges have become the standard for developing and benchmarking biomedical image analysis methods using centralized multi-institutiona

local-aiarxiv-cs-cv

Research

Token-Budgeted Candidate Retrieval for 3D Scene-Grounded VLMs: Category Names vs. Pairwise Geometry

arXiv:2610.14207v1 Announce Type: new Abstract: Under a fixed context budget, which objects and relations should a 3D scene-grounded VLM see first? On ScanNet indoor referring benchmarks (Dai et al.,

researcharxiv-cs-cv

Research

Unsupervised Data Drift Monitoring for Deployed Deepfake Speech Detectors

arXiv:2610.16826v1 Announce Type: cross Abstract: Deepfake speech detectors are typically evaluated as binary classifiers on fixed benchmarks, but deployed systems face evolving attacks, codecs, speak

researcharxiv-cs-cv

VideoEvoHarness: Self Evolving Agent Harness from Unlabeled Videos for Video Understanding

arXiv:2610.15389v1 Announce Type: new Abstract: Video understanding agents rely on a harness to acquire evidence, use tools, and reason, but improving it requires substantial effort. Recent self evolu

VisualCoding: Learning Executable Skills for Reliable Visual Reasoning

arXiv:2610.14403v1 Announce Type: new Abstract: Learning reusable skills can improve visual reasoning agents, yet applying a skill still requires the agent to implement or invoke a procedure and produ

Research

When Repeated Measurements Hurt Tabular Foundation Models

arXiv:2610.16801v1 Announce Type: cross Abstract: Tabular foundation models (TFMs) achieve state-of-the-art performance on IID benchmarks, but how do they respond to repeated measurements at the same

researcharxiv-cs-lg

World-T3: Test-Time Training as Persistent Memory for Real-Time Video World Models

arXiv:2610.17434v1 Announce Type: new Abstract: Recent advances in video world models have enabled plausible interactive environments, yet long-horizon generation places a fundamental demand on visual

Tutorials

Azure Content Understanding Prebuilt Analyzers: packaging domain knowledge for document AI

tutorialsmicrosoft-foundry

Learn how Azure Content Understanding prebuilt analyzers combine domain knowledge with grounding and confidence, and what Advanced Contextualization preview benchmarks show about quality, modeled cost

Gemini 4 Argon available on Google Cloud, built to help solve your business’ hardest problems

model-releasesgoogle-cloud-ai

Last week we announced that Gemini Enterprise has evolved to make it even simpler to get work done, and introduced the Gemini agent, your new universal agent for work. It's always on and ready to answ

SonicBoom: 52 tok/s decode on a laptop RTX 3050 (llama.cpp: 45) with the same quantized kernels, the difference is a graph compiler. No Python.

I’ve been building SonicBoom, a native tensor runtime written in C++/CUDA with a C ABI and no Python anywhere in the stack. I just tagged v0.0.1, and the first target is local LLM inference on consume

Where do LLMs actually earn their place in a recommender system? Kim Falk’s new book + 5 ebook giveaway [D]

model-releasesr-machinelearning

Hi r/MachineLearning, Stjepan from Manning here. The mods approved this post, and I appreciate being welcomed back to share another book with you. We’ve just launched AI Recommender Systems: Transform

A Categorical Atlas of Parameter-Efficient Fine-Tuning: Cones, Orbits, and Gauges

arXiv:2610.12728v1 Announce Type: new Abstract: Parameter-efficient fine-tuning has hundreds of methods, usually compared by parameter count and benchmark score. We compare them as maps. A pretrained

AlphaNIST: Emergent Assembly Skills from Binary Task Rewards

arXiv:2610.13354v1 Announce Type: new Abstract: The NIST Assembly Task Board #1 remains a challenging benchmark for learning-based methods in robotic manipulation. Over short horizons, it demands prec

Safety

AutoControl Arena: Synthesizing Executable Test Environments for Frontier AI Risk Evaluation

arXiv:2603.07427v3 Announce Type: replace Abstract: As Large Language Models (LLMs) evolve into autonomous agents, existing safety evaluations face a fundamental trade-off: manual benchmarks are costl

safetyarxiv-cs-ai

Behind-the-Meter Photovoltaic Visibility from Net Smart Meters: Deployment Regimes and Operational Insights

arXiv:2610.12527v1 Announce Type: new Abstract: Distribution operators need visibility of behind-the-meter photovoltaic (PV) generation, yet most residential customers are observed only through net sm

BrokenML: can agents fix broken ML jobs?

Write-up: https://zhebrak.io/posts/brokenml/ Repo: https://github.com/zhebrak/brokenml I built a benchmark to determine the access level agents need to successfully fix broken ML workloads (PyTorch ov

Cross-Behavior Policy Optimization: Unified Learning from Offline Demonstrations and On- and Off-Policy Rollouts via a Shared Regression Target

arXiv:2610.12830v1 Announce Type: new Abstract: Reasoning post-training draws on offline demonstrations and policy-generated rollouts, yet conventional supervised fine-tuning (SFT) followed by reinfor

EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents

arXiv:2610.13021v1 Announce Type: new Abstract: Continual learning requires models to accumulate past experience and transfer it to new tasks. Despite substantial research on continual learning, exist

EvoBelief: Falsifiable World Models for Self-Improving LLM Agents

arXiv:2610.12789v1 Announce Type: new Abstract: Self-evolving LLM agents typically improve how they act through accumulated experience, reflection, or skills. Yet even procedurally capable agents can

Le Chonk cooked on visual grounding. Pinpoints exactly where things are in an image. 42% on Dense 200, ahead of even frontier closed models.…

model-releasesmistral-ai--x

Mistral AI announced its Le Chonk model, which performs visual grounding by accurately locating objects within images. On the Dense 200 benchmark it achieved a 42 % score, outperforming even frontier‑

Machine Learning and Time-Series Foundation Models for Day-Ahead Electricity Forecasting in a University Building

arXiv:2610.12638v1 Announce Type: cross Abstract: Day-ahead electricity forecasts can help building operators schedule heating, ventilation, and other services around anticipated demand. Choosing a fo

Masked Diffusion Language Agents for Tool-Integrated Chemical Reasoning

arXiv:2610.13330v1 Announce Type: new Abstract: Designing tool-integrated reasoning agent systems for complex chemical tasks remains a fundamental challenge. Although recent chemical agents have demon

MC-EvoBench: Auditing Experience-Driven Self-Improvement in Minecraft Agents

arXiv:2610.13829v1 Announce Type: cross Abstract: A central challenge in embodied recursive self-improvement is enabling agents to convert interaction history into capabilities that persist beyond one

OGPO: Offline Goal-conditioned Policy Optimization for Recoverable Vision-Language-Action Models

arXiv:2610.12914v1 Announce Type: new Abstract: Vision-language-action (VLA) models have shown strong promise in robotic manipulation, yet their post-training still predominantly relies on trajectory-