While AI Safety debate is ranging, let me change the topic slightly and share something phenomenal I discovered today.
1) Importance of WebSearch
If you replace DeepSeek Harness' default search with
@ExaAILabs , your performance of DS V4.1 Flash model will be consistently at Astra High/Fable level.
@ExaAILabs rocks! Before this, I did not realize Search API can make so much difference to quality of answers and analysis. I thought it to be an undifferentiated product. Earlier during my testing at least 10% of the model used to answer dumb, while other 90% of times it used to be good. But, now it is consistently great. At its max setting, the model is at Astra High level - which is very astonishing.
@teortaxesTex @WilliamBryk
2) Desire to blow your mind:
I was asking a complex tech question to DS V4.1 Flash and I was disagreeing with the model (it was about Huawei's 7.2T NPO Engine specification). It held its ground and it provided this diagram to me. It was pretty good for the answer. I though how amazing Exa is (which it absolutely is), then I realised this diagram was made by DS V4.1 Flash by cutting and pasting diagrams from different sources and adding the red coloured markers. It was f*cking precise!!! This model has so much potential for greatness, on top of being exceedingly fast. These experiences have changed my viewpoint towards flash models. May be flash is all you need!
@zephyr_z9 @jukan05 @vikramskr @iamfabian @austinsemis
3) Fast Fast Deep Deep Research:
I really stopped ChatGPT and Claude's Deep Research because - although it was excellent - it used to take lot of time. With DS V4.1 Flash running nearly at 300+ tokens per second and fast Exa search, I can use DeepSeek Harness's PTC mode (programmatic tool calling) or Agent Team mode (launches subagents) and get very well done research that is very fast (although later is a bit flaky).
Astra Max is something that is industry leading in my opinion, but DS V4.1 Flash with DS Harness is exceptional (cost and speed wise wrt to quality ration is best possible)