๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Viv
@Vtrivedy10
applied research @LangChain Labs, prev @awscloud, phd cs @templeuniv
๊ฐ€์ž… February 2013
1.8K ํŒ”๋กœ์ž‰ ์ค‘    16.5K ํŒฌ
the @aiDotEngineer World Fair always one of the best events every year to talk to builders at the frontier of Research, Agents, Evals, Systems, etc A few weeks ago I gave a talk on - Continually Improving Agents - building Agents to understand data from other Agents - & a walkthrough of some of our latest work on data agents & post-training experiments some fun takes: - Every Continual Learning company will be an Observability & Eval company (and vice versa) - Environments & Evals are the currency of agent improvement. Agents are literally following the behaviors encoded in Evals. The best way to make good evals is mining Production data at scale - A good recipe to own your intelligence is using a Harness Eng - PostTrain - Harness sandwich with open models - Model-Harness-Task fit! There is no universal model or universal harness. You can always build a better agent system by optimizing the model and harness for a given task if your team is looking to understand your data at scale, build environment/evals, or just improve your agents - reach out, hmu would love to work with you! ๐Ÿš€
๋” ๋ณด๊ธฐ