๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Morgan
@morganlinton
cto @boldmetrics, evals @vulcanbench / not an expert, endlessly curious
๊ฐ€์ž… January 2009
1K ํŒ”๋กœ์ž‰ ์ค‘    47K ํŒฌ
I believe in independent benchmarks. Any model company that tells you not to trust benchmarks, is a company with something to hide imo. Proud of all the support I have seen from just about every ai lab out there supporting me and VulcanBench ๐Ÿ–– The moment we stop trusting public benchmarks, or worse, insulting and attacking the researchers that run them, is the moment we lose our own independence. Hereโ€™s to the bright future of open source, free, independent benchmarks. It is one of my greatest honors to benchmark the frontier, nothing more exciting, except maybe rocket launches ๐Ÿ˜… ๐Ÿš€
๋” ๋ณด๊ธฐ