TechniqueRLHF / Alignment8 recent entries14 Apr 2026We benchmarked TranslateGemma against 5 other LLMs on subtitle translation across 6 languages. At first glance the numbers told a clean story, but then human QA added a chapter. [D]This r/MachineLearning discussion post details a hands-on benchmark study in which TranslateGemma — Google's open translation model suite built on Gemma 3, available in 4B, 12B, and 27B sizes and cove→14 Apr 202620M+ Indian legal documents with citation graphs and vector embeddings – potential uses for legal NLP? [D]A r/MachineLearning discussion thread exploring the potential NLP applications of a large-scale dataset comprising over 20 million Indian legal documents, enriched with citation graphs and pre-compute
TechniqueRAG8 recent entries9 Apr 2026Studying Sutton and Barto's RL book and its connections to RL for LLMs (e.g., tool use, math reasoning, agents, and so on)? [D]A Reddit discussion thread on r/MachineLearning in which practitioners explore how foundational concepts from Sutton and Barto's *Reinforcement Learning: An Introduction* — including MDPs, policy g...→13 Apr 2026LLM Dictionary: A reference to contemporary LLM vocabulary [P]This Reddit post on r/MachineLearning presents a community-contributed dictionary of contemporary Large Language Model (LLM) terminology, covering terms related to training, fine-tuning, inference, al→14 Apr 202620M+ Indian legal documents with citation graphs and vector embeddings – potential uses for legal NLP? [D]A r/MachineLearning discussion thread exploring the potential NLP applications of a large-scale dataset comprising over 20 million Indian legal documents, enriched with citation graphs and pre-compute→29 Apr 2026What are people using for low-latency autocomplete in production? [P]Production low-latency autocomplete implementations employ diverse strategies including inference server optimization (tools like vLLM, llama.cpp, NVIDIA Triton), deployment choices (cloud APIs, on-pr→22 May 2026NuExtract3 released: open-weight 4B VLM for Markdown, OCR and structured extraction (self-hostable) [P]NuExtract3 is a unified 4B vision-language reasoning model for document understanding that combines structured information extraction with image-to-Markdown conversion, suitable for OCR and RAG prepro→24 Jul 2026I built an open-source multi-agent SDLC harness that beats a cold Claude Code run on large repos, by learning the repo once. Real benchmarks (incl. where it loses) inside. [P]Built an open-source AI coding agent that was 7%–75% cheaper than a cold 'claude -p' run on 6/6 well-localized tasks across repositories up to ~82k LOC. The biggest difference: Cold agent: 6.83, 207 t→26 Jul 2026Open-weight 4B models approach o3-level medical question answering in Swedish [P]I have been running some experiments with smaller open-weight LLMs on multiple-choice questions of Swedish medical licensing exams. On a dataset called MedQA-SWE, GPT-4 scored 84% accuracy in 2024 and→26 Jul 2026Multi-Tenant SaaS: Which Architecture Would You Choose? [D]NOTE -> I expect answer from people who actually have experience and strong understanding of these. please give something beneficial. I'm building a SaaS platform in Sri Lanka that handles documents a
TechniqueAgents8 recent entries20 Jul 2026Training a harness for model-agnostic and task-environment-agnostic capability improvements with PyTorch-like framework [P]I worked on this project (https://github.com/workofart/harness-training) for the past few months to reframe 'Agent-driven Self-improving Harness' to 'Harness Training'. The idea is simple, the harness→21 Jul 2026My OCR model mislabels section titles as body text. Is a CRF the right fix, or am I overcomplicating it? [P]Hi everyone, I'm working on extracting the hierarchical structure of long PDF documents (legal/regulatory text, lots of numbered sections) and would like to gather some feedback on my approach before →22 Jul 2026SkewAdam: A tiered optimizer that cuts MoE state memory by 97% (fits a 6.7B MoE on a 40GB GPU) [R]Paper:https://arxiv.org/abs/2607.19058 Code (GitHub):https://github.com/nuemaan/skewadam Hi everyone, I just published a preprint on a new optimizer designed to tackle the massive VRAM bottleneck in M→24 Jul 2026I built an open-source multi-agent SDLC harness that beats a cold Claude Code run on large repos, by learning the repo once. Real benchmarks (incl. where it loses) inside. [P]Built an open-source AI coding agent that was 7%–75% cheaper than a cold 'claude -p' run on 6/6 well-localized tasks across repositories up to ~82k LOC. The biggest difference: Cold agent: 6.83, 207 t→26 Jul 2026We compared different LLMs on IMO 2026 [R]There are a few reasons why problems from International Mathematical Olympiad function as a good benchmark for LLMs: - The problems are new, not included in the training data of any model - Hard math →26 Jul 2026I want to use AI coding agents for machine learning projects [D]I'm a software engineer who mainly builds softwaes/applications, and I'm starting to work on machine learning projects. Since ML workloads often require GPUs, I know services like Google Colab and Kag→29 Jul 2026My LLM kept implementing every method it found, so I added research and specification gates[D]While building this workflow a thing that surprised me was that, initially I thought the pipeline was complete: From Goal to → Decompose → Research → Specification → Implementation It successfully bro→29 Jul 2026AI Security Leaderboard: benchmarking model robustness [P]We developed a leaderboard ranking frontier model security. There's no shortage of model capability rankings, but we didn't find anything comparable for model security. Yet security is becoming increa
TechniqueFine-tuning8 recent entries29 Apr 2026Free Registration & $20K Prize Pool: 2nd MLC-SLM Challenge 2026 on Multilingual Speech LLMs [N]The 2nd Multilingual Conversational Speech Language Model (MLC-SLM) Challenge is an open research competition inviting teams worldwide to participate , featuring free registration with a $20K prize po→4 May 2026[P] QLoRA Fine-Tuning of Qwen2.5-1.5B for CEFR English Proficiency Classification (A1–C2) [P]This post likely describes a machine learning project implementing QLoRA (Quantized Low-Rank Adaptation) fine-tuning on the Qwen2.5-1.5B model to classify English language proficiency levels according→21 Jul 2026Reproducing OpenAI’s “persistently beneficial models” - GRPO trait install barely moves. Ideas? [P] [R]TL;DR: I’m reproducing the trait-persistence result from arXiv:2606.24014 on one RTX 3090. Before I can test persistence I need to install a trait via RL — and my GRPO run moves the trait only +2.4 po→26 Jul 2026Open-weight 4B models approach o3-level medical question answering in Swedish [P]I have been running some experiments with smaller open-weight LLMs on multiple-choice questions of Swedish medical licensing exams. On a dataset called MedQA-SWE, GPT-4 scored 84% accuracy in 2024 and→26 Jul 2026Multi-Tenant SaaS: Which Architecture Would You Choose? [D]NOTE -> I expect answer from people who actually have experience and strong understanding of these. please give something beneficial. I'm building a SaaS platform in Sri Lanka that handles documents a→26 Jul 2026I want to use AI coding agents for machine learning projects [D]I'm a software engineer who mainly builds softwaes/applications, and I'm starting to work on machine learning projects. Since ML workloads often require GPUs, I know services like Google Colab and Kag→28 Jul 2026Might need math+code benchmark for frontier model(LLMs Silently Replace Math)[D]Hello guys. I found some problems in current frontier models. And want to share. # math_code_hallucination > Record of a failure caused by combining mathematics and code in a single prompt. --- ## Cas→29 Jul 2026AI Security Leaderboard: benchmarking model robustness [P]We developed a leaderboard ranking frontier model security. There's no shortage of model capability rankings, but we didn't find anything comparable for model security. Yet security is becoming increa
TechniqueMultimodal8 recent entries12 Apr 2026KIV: 1M token context window on a RTX 4070 (12GB VRAM), no retraining, drop-in HuggingFace cache replacement - Works with any model that uses DynamicCache [P]KIV is a project shared on r/MachineLearning presenting a drop-in replacement for HuggingFace's `DynamicCache` that enables up to 1 million token context windows on consumer hardware with only 12GB of→16 Apr 2026Why dynamically routing multi-timescale advantages in PPO causes policy collapse (and a simple decoupled fix) [R]This Reddit post discusses a known instability in PPO when advantage estimates operating across different temporal scales (e.g., short-horizon and long-horizon returns) are dynamically routed or mixed→22 Apr 2026INT3 compression+fused metal kernels [R]INT3 compression with fused Metal kernels enables large language models to compute attention operations directly on compressed (INT3/INT4) key-value cache representations using custom GPU kernels that→22 May 2026NuExtract3 released: open-weight 4B VLM for Markdown, OCR and structured extraction (self-hostable) [P]NuExtract3 is a unified 4B vision-language reasoning model for document understanding that combines structured information extraction with image-to-Markdown conversion, suitable for OCR and RAG prepro→4 Jun 2026Best Visual Reasoning Model in 2026 (Including APIs) [D]Gemini 3.1 Pro and Gemini 3-Pro lead visual reasoning benchmarks , with GPT-5.2, Kimi-K2.5, and GPT-5.2-Pro following . A 2026 evaluation benchmarked 15 leading multimodal models on visual reasoning a→21 Jul 2026My OCR model mislabels section titles as body text. Is a CRF the right fix, or am I overcomplicating it? [P]Hi everyone, I'm working on extracting the hierarchical structure of long PDF documents (legal/regulatory text, lots of numbered sections) and would like to gather some feedback on my approach before →28 Jul 2026How to deal with text only vector search across multimodal embedding space? [D]My data set is a list of images, each equipped with a a couple sentences of text. A user would search primarily with text only. My default approach is using BM25, but how would I facilitate searching →28 Jul 2026Are single GPU research still published in ML/DL and its applications nowadays? Which are the most notable recent ones? [D]ML research is progressing at breakneck speed where frontier labs in both academia and industry have access to considerably large computes (GPUs). Where do small labs or independent researchers go in
TechniqueSafety7 recent entries15 Apr 2026Jailbreaks as social engineering: 5 case studies suggest LLMs inherit human psychological vulnerabilities from training data [D]This r/MachineLearning discussion post examines LLM jailbreaks through the lens of social engineering, arguing that the psychological vulnerabilities found in LLMs are not random artifacts but structu→16 Apr 2026Why dynamically routing multi-timescale advantages in PPO causes policy collapse (and a simple decoupled fix) [R]This Reddit post discusses a known instability in PPO when advantage estimates operating across different temporal scales (e.g., short-horizon and long-horizon returns) are dynamically routed or mixed→16 Apr 2026Built an political benchmark for LLMs. KIMI K2 can't answer about Taiwan (Obviously). GPT-5.3 refuses 100% of questions when given an opt-out. [P]A researcher on r/MachineLearning built a political benchmark to evaluate how various LLMs handle sensitive geopolitical and politically contentious questions. Key findings include that Kimi K2 (Moons→18 Apr 2026easyaligner: Forced alignment with GPU acceleration and flexible text normalization (compatible with all w2v2 models on HF Hub) [P]easyaligner is a forced alignment library designed to be performant and easy to use , leveraging GPU acceleration to align audio with text transcriptions. The tool supports flexible text normalization→25 May 2026Call for Papers - Workshop on Unlearning and Model Editing U&ME at ECCV 2026 [R]This call for papers announces a workshop focused on the growing need for efficient and effective techniques for editing trained models, especially large generative models. The workshop solicits paper→28 Jul 2026PNAS: Over Half of All Academic Articles Now Show LLM Influence—7.3M-Paper Study [R]Largest empirical study of AI penetration in academic publishing ever conducted—51%-by-2025 is the most authoritative quantitative marker yet of how thoroughly LLMs have reshaped scientific writing, a→1 Aug 2026Github repo to learn the OPD/OPSD and how they perform compared to GRPO, on a consumer grade GPU [P]I am trying to learn concepts like On Policy Distillation (OPD), On Policy Self Distillation (OPSD) and how do they compare to RL algorithms like GRPO. There are a lot of papers on this, but because o