가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Saurav | CloudYeti
@ravsau
AI Advisor & Trainer | AI cost optimization, ROI & team training | Ex-Amazon |
가입 July 2011
241 팔로잉 중    281 팬
I ran an eval to choose between DeepSeek V4 Flash and GPT-6 Luna for one of my projects, and I learned something new. On paper, DeepSeek looks cheaper. The input price is about the same: $0.10 per million tokens for Luna and $0.09 to $0.14 for DeepSeek. Luna's output price is up to 2.8 times higher: $0.50 per million tokens against $0.18 to $0.28 for DeepSeek. In practice, Luna cost less per task, because it is much more token efficient. DeepSeek spent 703 hidden reasoning tokens per call and Luna spent 120. Per call: $0.000385 for DeepSeek and $0.000283 for Luna. Median response time: 24s for DeepSeek and 3.5s for Luna. By the way, running an eval is a single prompt now. This was mine: "Compare DeepSeek V4 Flash and GPT-6 Luna on the top tools in this project, based on usage. Run an eval suite with a judge on my Claude Code subscription, and keep it under $1."
더 보기