Can We Stop the Backtest Yet? Anytime-Valid Promotion Tests for Adaptive Financial Research Agents
Abstract
Adaptive research systems can generate, discard, revise, and monitor trading rules faster than their selection history can be audited. We ask when such a system may promote a frozen rule to governed forward evaluation. The proposed protocol assigns each candidate a predictable, nonrefundable share of one lifetime testing budget and accumulates a bounded, cost-adjusted e-process only from post-registration returns. Under the null that a candidate’s clipped net score has nonpositive conditional mean at every scored date, a conditional Ville argument controls the probability of any false promotion despite dependent rules, adaptive births, and indefinite monitoring. In 3,000 shared-sign null replays of a frozen 24-rule public-market library, repeated unadjusted tests cross at least once on 94.5% of paths, while the funded rule records 0/3,000 crossings. A separate exact mean-zero experiment with adaptive identities and births records 1.77% familywise crossings over 3,000 programs. The 2015–2026 market replay promotes no rule after costs. The result is an auditable promotion primitive for agentic and open-finance infrastructure: executable identity, evidence, budget, and delayed execution are recorded in one append-only ledger.
Keywords
Cite this article
Benhamou, E., Ohana, J. J., Guez, B., Jacquot, T., Setrouk, E., & Saadi, C. (2026). Can We Stop the Backtest Yet? Anytime-Valid Promotion Tests for Adaptive Financial Research Agents. In Proceedings of the International Conference on Open Finance (ICOF 2026) (pp. 10–14). SET Technology. https://doi.org/10.36287/setsci.25.3.001
Article History
- Published
- 6 Oct 2026
License
© 2026 SET Technology. This article is distributed under the terms of the CC BY 4.0.