On BenchLocal, which the card calls the community's quality suite for local models, Tess-4.5 passes 133 of 150 scenarios within three tries and 128 on the first try. The card says that is exactly Qwen3.8-27B on both counts[1]. The same table is on the Continuity Research page[2].
| BenchLocal pack, best of three |
Tess-4.5-27B |
Qwen3.8-27B |
| ToolCall-15 |
13 |
13 |
| InstructFollow-15 |
15 |
15 |
| StructOutput-15 |
14 |
14 |
| DataExtract-15 |
14 |
14 |
| ReasonMath-15 |
15 |
15 |
| BugFind-15 |
15 |
15 |
| HermesAgent-20 |
16 |
17 |
| CLI-40 |
31 |
30 |
| Total, best of three |
133 / 150 |
133 / 150 |
| Total, first try |
128 / 150 |
128 / 150 |
The card says Tess-4.5 leads on CLI-40 and is perfect on instruction following, math reasoning and bug finding[1]. In the table, CLI-40 is 31 against 30, and HermesAgent-20 is 16 against 17. InstructFollow-15, ReasonMath-15 and BugFind-15 are 15 for both models. Footnote 1 says best of three is BenchLocal's Pass@3, first try is Pass@1, and the run was one pass per model on the same harness: thinking on, reasoning effort xhigh, temperature 1.0, top_p 0.95, top_k 20, and a 16K thinking budget. It also says that at temperature 1.0 a single run moves by about two scenarios per pack, so a per-pack difference of one or two should be read as a tie. The same footnote says community runs of Qwen3.8-27B with a 64K thinking budget report 129 to 137 on the first try[1]. Those community figures sit above the 128 the card records for both models at the 16K budget. The card cites no third-party result for Tess-4.5.
The token table is from the same run. On each scenario's first attempt, the footnote counts 262,047 completion tokens for Tess-4.5 and 349,009 for Qwen3.8-27B, reasoning included, which the card rounds to 25% fewer. Counting retries, it says Tess-4.5 used 20% fewer: 318,532 against 399,130. The rounded rows are CLI-40 at 149K against 219K (32% fewer), DataExtract-15 at 14K against 25K (43% fewer) and BugFind-15 at 28K against 35K (21% fewer)[1].
The card also says that across 182 scored responses to requests that declared no tools, Tess-4.5 never called a tool it was not given[1]. The Continuity Research page adds a comparison the model card does not: a development run, an earlier checkpoint trained without tool definitions or a working-directory prompt, did that 42 times[2].