VideosBy Noemi Titarenco

The best harness for DeepSeek Flash 1017 is ... Zcode?

I found FrontierHarness on X today. It compares how 21 coding-agent harnesses work with 5 different open models on 62 tasks, with 4 scored attempts each.

I wanted to run it on PI + some specific compaction extensions but ... running evals is expensive yall!! So I didn't.

FrontierHarness Eval is an independent benchmark. Not sponsored.

Watch the full video on YouTube.

Noemi Titarenco

I spend a lot of time thinking about (software and business) problems - sometimes I get around to writing about it, and you get to read about it here.

More thoughts