가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞)
@teortaxesTex
We're in a race. It's not USA vs China but humans and AGIs vs ape power centralization. @deepseek_ai stan #1#, 2023–Deep Time «C’est la guerre.» ®1
가입 September 2010
3.4K 팔로잉 중    79.9K 팬
that's such a silly eval requirement
You asked for dsh, I added it DeepSeek Harness is the open-source coding agent by @deepseek_ai. It's now on the @huggingface Harness Leaderboard, which compares ten coding agents on the same open models. DSH is statistically tied for first in all five evaluations: DeepSeek-V4.1-Flash and GLM-5.3-Flash at low and high effort, and Flint. It shines on DeepSWE, where agents change code in open-source repositories: 2nd of 10 averaged over the three models, 0.5 points behind Hermes Agent by @NousResearch. On Terminal-Bench's command-line tasks it ranks 6th. One habit explains much of that gap: when DSH finishes a task, it shuts down every background program it started. Three Terminal-Bench tasks ask the agent to start a server, for example a model inference API. The grader tests that server after the agent has finished. With DSH, the server is gone by then. On DeepSeek-V4.1-Flash and GLM-5.3-Flash, DSH passed 2 of 36 attempts on these tasks. @opencode, @pidotdev and Hermes Agent passed all 36. Those three tasks cost DSH 1.5 to 1.7 points in every evaluation. On DeepSeek-V4.1-Flash at high effort, that is more than its 1.3-point gap to the leader. Developer preview: 0.2.2-rc.1. Web search is off because it needs a DeepSeek account key. It costs $0.53 per solved trial, averaged over the three models. Leaderboard:
더 보기