arxiv-cs-cl: Computational Linguistics & NLP — Knowledge Wiki Overview

Current State

The field of computational linguistics (cs.CL) is dominated by large language model (LLM) research spanning multimodal systems, retrieval-augmented generation, mechanistic interpretability, and domain-specific applications. Research has expanded rapidly from core NLP tasks into specialized verticals including legal, medical, and creative domains. Multilingual capabilities, safety, and architectural efficiency remain central concerns.

Key Developments

• Multimodal LLMs are being extended to audio, ophthalmic imaging, and video editing (CLAP-based retrieval, OphIn-500K)
• Retrieval-Augmented Generation (RAG) is maturing, with emerging security research exposing vulnerabilities like federated routing hijacking
• Mechanistic interpretability is gaining traction, applying tools like sparse autoencoders to understand transformer internals in ASR and NLP models
• Diffusion language models are being explored as latent reasoning architectures alongside autoregressive approaches
• Domain-specific applications are proliferating across legal (German exam grading, Hindi metaphor detection), CAD modeling, and public opinion prediction
• Fine-tuning methods (LoRA, in-context learning, ensembling) are being applied to low-resource and specialized tasks
• Brain-to-language decoding represents an emerging frontier connecting neuroscience and NLP

Key Players/Organizations

• Academic research groups (primary drivers via arXiv preprints)
• Major AI labs (Google, Meta, OpenAI, Microsoft) whose foundational models underpin most applied work
• Domain institutions in law, medicine, and cognitive science collaborating on specialized benchmarks

Outlook

cs.CL research is moving toward tighter multimodal integration, robust and interpretable systems, and verticalized deployment in regulated industries. Security and alignment concerns in RAG and federated systems will intensify. Brain-computer interface applications and diffusion-based language modeling represent high-potential longer-term directions.

Source Entries

• Omni-Embed-Audio: Leveraging Multimodal LLMs for Robust Audio-Text Retrieval
• Pointer-CAD: Unifying B-Rep and Command Sequences via Pointer-based Edges & Faces Selection
• Hylog: A Hybrid Approach to Logging Text Production in Non-alphabetic Scripts
• A Wolf in Sheep's Clothing: Targeted Routing Hijacking in Federated RAG
• Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinions
• ScheMatiQ: From Research Question to Structured Data through Interactive Schema Discovery
• Separating Syntax from Language: A Mechanistic Account of Translation in Multilingual LLMs
• GradeLegal: Automated Grading for German Legal Cases
• Coevolutionary Continuous Discrete Diffusion: Make Your Diffusion Language Model a Latent Reasoner
• OphIn-500K: Curating Web-Scale Visual Instructions for Scaling Ophthalmic Multimodal Large Language Models
• Mechanistic Interpretability of ASR models using Sparse Autoencoders
• Chinese Essay Rhetoric Recognition Using LoRA, In-context Learning and Model Ensemble
• Figurative Justice: Detecting metaphors in Hindi judgements with qualitative assessment and transformers
• Crayotter: Learning Long-Horizon Video Editing Agents via Group-Relative Preference Backpropagation
• Brain-to-Language Decoding: Tasks, Signals, Methods, Evaluation, Practical Use and Beyond