TheDavidTai(@TheDavidTai):Since a lot of the community is interested in actual performance of the current community https://t.co/Vysk4vUfOo kernel after 5 days. Here's some quick tests with MTP at depth 3 and temperature 0 on a basic 1024 token programming prompt. You can compare with something like @redp314's vllm tuning here (third screenshot)

TheDavidTai

@TheDavidTai

Founder, hacker, stochastic tool. @microsoft escapee. Currently @eigenlabs. Checkout my github actions emulator:

加入 September 2018

648 正在关注 1.1K 粉丝

TheDavidTai@TheDavidTai

2026.09.15 16:25

Since a lot of the community is interested in actual performance of the current community kernel after 5 days. Here's some quick tests with MTP at depth 3 and temperature 0 on a basic 1024 token programming prompt. You can compare with something like @redp314's vllm tuning here (third screenshot)

显示更多