CompanyAnthropic8 recent entries18 Aug 2026MedMCP-Calc: Benchmarking LLMs for Realistic Medical Calculator Scenarios via MCP IntegrationarXiv:2601.23049v2 Announce Type: replace Abstract: Medical calculators are fundamental to quantitative, evidence-based clinical practice. However, their real-world use is an adaptive, multi-stage pro→24 Aug 2026Specification Portability Across LLM Development Agents: Cross-Agent Compatibility in Specification-Driven Software MigrationarXiv:2608.21208v1 Announce Type: cross Abstract: This paper investigates cross-agent specification portability using Oracle-to-PostgreSQL migration as a controlled software transformation task. The s
CompanyOpenAI2 recent entries21 Apr 2026SQL Query Engine: A Self-Healing LLM Pipeline for Natural Language to PostgreSQL TranslationarXiv:2604.16511v1 Announce Type: cross Abstract: We present SQL Query Engine, an open-source, self-hosted service that translates natural language questions into validated PostgreSQL queries through →2 Oct 2026Detecting Inconsistencies in Model Specifications with LLM-as-Verifier ReasoningarXiv:2610.01847v1 Announce Type: cross Abstract: Model specifications define how large language models (LLMs) should behave, guiding alignment training, inference-time behavior, and evaluation. Yet t
CompanyGoogle8 recent entries22 Apr 2026Cyber Defense Benchmark: Agentic Threat Hunting Evaluation for LLMs in SecOpsarXiv:2604.19533v1 Announce Type: cross Abstract: We introduce the Cyber Defense Benchmark, a benchmark for measuring how well large language model (LLM) agents perform the core SOC analyst task of th→29 May 2026How Reliable Are AI Attackers Against a Fixed Vulnerable Target? A 400-Run Empirical Study of LLM Penetration Testing ConsistencyarXiv:2605.30096v1 Announce Type: cross Abstract: Large language models (LLMs) can autonomously conduct multi-stage cyber attacks, but the consistency of their offensive behavior under repeated trials→1 Jul 2026A Semantic-Layer-Mediated Agent for Natural Language to SQL over Heterogeneous Enterprise DatabasesarXiv:2606.31041v1 Announce Type: new Abstract: Natural language-to-SQL (NL2SQL) over real-world enterprise databases remains significantly more challenging than on academic benchmarks. Enterprise sch→18 Aug 2026Bounded Semantic Planning and Deterministic Compilation for Reliable Enterprise Text-to-SQLarXiv:2608.16663v1 Announce Type: cross Abstract: Direct text-to-SQL asks a language model to do two jobs: interpret the business question and construct the complete relational query. In enterprise sc→24 Aug 2026Specification Portability Across LLM Development Agents: Cross-Agent Compatibility in Specification-Driven Software MigrationarXiv:2608.21208v1 Announce Type: cross Abstract: This paper investigates cross-agent specification portability using Oracle-to-PostgreSQL migration as a controlled software transformation task. The s→28 Aug 2026DRL: A Deterministic Relational Middleware Layer for Transaction-Safe Enterprise NL2SQL Under Schema-Graph ScalingarXiv:2608.26172v1 Announce Type: cross Abstract: Deploying natural-language interfaces over enterprise OLTP catalogs fails at scale because semantic parsers collapse under schema-graph scaling, infla→15 Sept 2026Exploring Automated Vulnerability Identification in JavaScript Code Using Large Language ModelsarXiv:2609.13816v1 Announce Type: cross Abstract: JavaScript powers approximately 98.8% of all websites, making vulnerabilities in its code a significant security risk, yet existing detection approach→30 Sept 2026Evidence-Guided Schema Normalization for Temporal Tabular ReasoningarXiv:2512.00329v2 Announce Type: replace-cross Abstract: Temporal reasoning over evolving semi-structured tables poses a challenge to current QA systems. We propose an approach that recasts the task
CompanyMeta8 recent entries2 Jun 2026Benchmarking Local LLMs for Natural-Language-to-SQL Querying in Biopharmaceutical Manufacturing: An Empirical Benchmark on Consumer-Grade HardwarearXiv:2606.01338v1 Announce Type: new Abstract: Biopharmaceutical manufacturing organizations operate under regulatory frameworks such as FDA guidance, EU Good Manufacturing Practice (GMP), and the EU→30 Jun 2026How Far Do On-Prem Open LLMs Get on Text-to-SQL? A Cross-Family Size x Technique Frontier on BIRDarXiv:2606.29733v1 Announce Type: new Abstract: Organizations that cannot send data to a cloud API increasingly ask: how good is Text-to-SQL if the model must run on-premises on open weights, and whic→30 Jun 2026Digitizing Coaching Intelligence: An Agentic Framework for Holistic Athlete Profiling using VLM and RAGarXiv:2606.28570v1 Announce Type: cross Abstract: Athlete assessment is a critical process for tracking physical progress and identifying elite talent. However, during mass recruitment drives, traditi→26 Aug 2026Hybrid Semantic Tool Discovery for Enterprise MCP Gateway: Architecture and ImplementationarXiv:2608.23992v1 Announce Type: cross Abstract: Large language model (LLM) agents invoke external tools to retrieve and reason over information beyond pretrained knowledge. The Model Context Protoco→26 Aug 2026ESQ-Bench: A Multi-Tier Enterprise Oracle Benchmark for Evaluating NL2SQL Dialect Generalization and Silent Semantic DivergencearXiv:2608.23569v1 Announce Type: new Abstract: State-of-the-art Natural Language to SQL (NL2SQL) models report execution accuracy exceeding 89 percent on established benchmarks such as Spider and BIR→15 Sept 2026Exploring Automated Vulnerability Identification in JavaScript Code Using Large Language ModelsarXiv:2609.13816v1 Announce Type: cross Abstract: JavaScript powers approximately 98.8% of all websites, making vulnerabilities in its code a significant security risk, yet existing detection approach→1 Oct 2026GrammarRL: Effective Grammar-Constrained Decoding via Reinforcement LearningarXiv:2609.39869v1 Announce Type: new Abstract: Grammar-constrained generation guarantees syntactic validity, but can substantially degrade semantic quality when the model's preferred outputs are poor→5 Oct 2026From Benchmarks to Production: A Text-to-SQL System for Complex Financial DataarXiv:2610.03524v1 Announce Type: new Abstract: General-purpose Text-to-SQL systems achieve strong performance on academic benchmarks like Spider and BIRD, where schemas are relatively shallow and col
CompanyMistral2 recent entries27 Apr 2026TreeCoder: Systematic Exploration and Optimisation of Decoding and Constraints for LLM Code GenerationarXiv:2511.22277v2 Announce Type: replace Abstract: Large language models (LLMs) have shown remarkable ability to generate code, yet their outputs often violate syntactic or semantic constraints when →2 Jun 2026Benchmarking Local LLMs for Natural-Language-to-SQL Querying in Biopharmaceutical Manufacturing: An Empirical Benchmark on Consumer-Grade HardwarearXiv:2606.01338v1 Announce Type: new Abstract: Biopharmaceutical manufacturing organizations operate under regulatory frameworks such as FDA guidance, EU Good Manufacturing Practice (GMP), and the EU
CompanyDeepSeek8 recent entries16 Apr 2026IndicDB -- Benchmarking Multilingual Text-to-SQL Capabilities in Indian LanguagesarXiv:2604.13686v1 Announce Type: new Abstract: While Large Language Models (LLMs) have significantly advanced Text-to-SQL performance, existing benchmarks predominantly focus on Western contexts and →21 Apr 2026NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL SolutionsarXiv:2604.16493v1 Announce Type: cross Abstract: Natural Language to SQL (NL2SQL) technology empowers non-expert users to query relational databases without requiring SQL expertise. While large langu→23 Apr 2026Knapsack Optimization-based Schema Linking for LLM-based Text-to-SQL GenerationarXiv:2502.12911v3 Announce Type: replace Abstract: Generating SQLs from user queries is a long-standing challenge, where the accuracy of initial schema linking significantly impacts subsequent SQL ge→27 Apr 2026TreeCoder: Systematic Exploration and Optimisation of Decoding and Constraints for LLM Code GenerationarXiv:2511.22277v2 Announce Type: replace Abstract: Large language models (LLMs) have shown remarkable ability to generate code, yet their outputs often violate syntactic or semantic constraints when →5 May 2026FlexSQL: Flexible Exploration and Execution Make Better Text-to-SQL AgentsarXiv:2605.02815v1 Announce Type: new Abstract: Text-to-SQL over large analytical databases requires navigating complex schemas, resolving ambiguous queries, and grounding decisions in actual data. Mo→30 Jun 2026Database Context Compression for Text-to-SQL on Real-World Large DatabasesarXiv:2606.28601v1 Announce Type: cross Abstract: Recent progress in Text-to-SQL has been driven by stronger language models and prompting strategies, yet performance on real enterprise benchmarks suc→18 Aug 2026Agentic-SQL Revisited: Autonomy-Based Taxonomy and Empirical Benchmark Analysis for LLM Text-to-SQLarXiv:2608.15389v1 Announce Type: new Abstract: LLM-based Text-to-SQL progress is reported across heterogeneous benchmarks, backbones, and inference protocols, making cross-system comparison fragile. →15 Sept 2026Exploring Automated Vulnerability Identification in JavaScript Code Using Large Language ModelsarXiv:2609.13816v1 Announce Type: cross Abstract: JavaScript powers approximately 98.8% of all websites, making vulnerabilities in its code a significant security risk, yet existing detection approach
CompanyNVIDIA3 recent entries28 Jul 2026IKS-Instruct: A 24,000-Example Multilingual Dataset for Teaching Language Models Indian Knowledge SystemsarXiv:2607.23322v1 Announce Type: new Abstract: Instruction tuning has become the standard method for adapting large language models to follow human intent, yet existing instruction datasets are domin→28 Jul 2026CHS-SQL: A Text-to-SQL approach based on Confidence-Guided Heuristic Search Schema Linking processarXiv:2607.22624v1 Announce Type: new Abstract: Recently, there have been several works in the Text-to-SQL domain that utilize Small Language Models (SLMs) for training. These approaches achieve perfo→3 Sept 2026Enhancing Road Safety Through Multi-Camera Image Segmentation with Post-Encroachment Time AnalysisarXiv:2511.12018v2 Announce Type: replace Abstract: Traffic safety analysis at signalized intersections is essential for reducing vehicle and pedestrian collisions, yet traditional crash-based studies