How Does Research Evolve? Tracing Cross-Domain Trajectories in NLP, ML, and CV Through Claim-Grounded Typed Citations

arXiv:2606.22342v2 Announce Type: replace Abstract: How does research evolve, and can we trace it at the level of individual claims? Scientific progress is not simply a uniform accumulation of facts. Existing citation graphs usually collapse these roles into a single homogeneous edge type, limiting how we can analyze scientific progress. We introduce SciTraj, a typed citation corpus for tracing research evolution across natural language processing, machine learning, and computer vision. SciTraj includes 32,559 papers published between 2015 and 2024 and 573,126 directed edges spanning six research-relation types. Unlike traditional citation graphs, each edge is paired with the claim sentence that motivates its label. Claim-driven relations are verified by natural language inference against their local in-paper context. The corpus further organizes these relations into multi-step typed trajectories that trace how ideas develop across papers and over time. We evaluate the corpus along three dimensions. First, a three-annotator pilot achieves Fleiss' kappa=0.74 and 79.9% majority-vote precision for relation labels, indicating substantial agreement and reliable labeling. Second, corpus-level analyses reveal clear disciplinary siloing in the directional flow of research relations. Topic analysis further identifies rapidly growing clusters dominated by vision and LLM-related research and declining clusters associated with several classical machine-learning topics. We further evaluate SciTraj using a temporally split link-prediction benchmark and a year-shuffle falsifiability test that distinguishes genuine temporal signal from year-correlated content. Under this setting, extsc{SciTraj-Pair} performs strongly, but its AUC drops by 0.288 when publication years are shuffled, showing that its predictions depend not only on content but also on the temporal order in which research develops.

Source: arXiv cs.CL | 2026-08-25