Skip to content

Tag: benchmarks

All the articles with the tag "benchmarks".

The Update That Broke Confidence

The Update That Broke Confidence

ยท Updated:

A 2026-09-22 patch left a self-hosted model's weights untouched but made it more confident on nonsense input. Six systems compared, real numbers only.

Jev vs Von vs SemIf: Real Numbers

Jev vs Von vs SemIf: Real Numbers

Jev, Von, and SemIf scored head to head on real commit history: a frozen 4B general model beat a purpose-built 395M decision model on every task tested.