Research
Typed Decision Models on Tabular Data
arXiv:2610.19536v1 Announce Type: new Abstract: Typed decision models are language models that answer a question with a fixed set of possible answers by returning a probability for each answer instead
arXiv:2610.19536v1 Announce Type: new Abstract: Typed decision models are language models that answer a question with a fixed set of possible answers by returning a probability for each answer instead of generating text. We study them on tabular data and compare four decision models with three large language models (LLMs) on row classification, fact verification and anomaly detection. Every request is sent in its original form and under 21 types of rewrite that keep its content, such as renaming the options or writing the table in another format. The decision models perform as well as the LLMs at a lower cost. Three of them are also far more robust to how the question is formulated. No model we test is robust to how the table is organized. For every model, at least a third of the row decisions change under some rewrite of the table or the question. The decisions to which a decision model gives low probability are the ones most likely to change. Decision models are a practical choice for tabular decisions, but their robustness remains an open problem.
Related
- Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluation
- Calibrated Confidence Estimation for Tabular Question Answering
- Selective Reasoning for Typed Decision Models: When to Start, Read, and Stop
- CRAFT: A Unified Counterfactual Reasoning Framework for Tabular Question Answering and Fact Verification
Source: arXiv cs.CL | 2026-10-15