Friday, 6 November 202612:30 UTCWire updated 12:30 UTC

Follow @0xNotMarc

Notes from the Terminal
Delayed ·

Models & Labs

Julius Research's DeepFinance benchmark for measuring models on PE and IB workflows

Julius Research's DeepFinance benchmark for measuring models on PE and IB workflows

Julius Research says DeepFinance is a benchmark for private equity and investment banking workflows, with average human time of 27.1 hours per task. Mean rubric scores put Claude Opus 5.5 at 54.8%, Claude Sonnet 5.5 at 54.6% and GPT-6 Astra at 54.2%. The 95% CI is 46.2 to 64.4 for Opus, 46.0 to 63.9 for Sonnet and 46.4 to 62.6 for Astra.

NoteThe top three sit close together on this test, so the ranking says little about which model is best.

Read the original