Abstract

This is the first research paper to comprehensively study language models against reasoning-reinforced LMs, with an empirical study of 23 foundation LMs over 20 core NLP tasks in finance. FLaME provides a grounded evaluation framework that reveals significant differences in financial reasoning, with leading models achieving accuracy levels near 80%.