Model Releases
ReguSim: Evaluating LLM Agent Rule Grounding in Financial Compliance
arXiv:2608.19974v1 Announce Type: new Abstract: LLM agents in financial markets may cite rules yet still submit orders that violate executable constraints or misread surveillance evidence. We introduc
arXiv:2608.19974v1 Announce Type: new Abstract: LLM agents in financial markets may cite rules yet still submit orders that violate executable constraints or misread surveillance evidence. We introduce ReguSim, a controlled financial-compliance environment, and ReguBench, a target-marked monitoring benchmark, to separate four artifacts: stated reasoning, attempted action, execution enforcement, and monitor evidence. In trader runs with DeepSeek V4 Pro and Gemini 3.5 Flash, visible rules reduce but do not eliminate rejected actions, and incentive or persona framing shifts behavior. A bridge study shows that trader rationales can mislead an independent monitor unless enforcement evidence is shown. In monitoring, simple structured baselines either match or exceed prompt-only LLMs. The results frame financial compliance evaluation as an audit of rule-grounded actions and evidence use, rather than a single compliance score.
Related
- MarketBench: Evaluating AI Agents as Market Participants
- AUDITFLOW: Executable Symbolic Environments for Structured Financial Reporting Verification
- From Knowing to Doing: A Memory-Controlled Benchmark for LLM Trading Agents on Stock Markets
- ContextCov: Deriving and Enforcing Executable Constraints from Agent Instruction Files
Source: arXiv cs.AI | 2026-08-21