Andy Konwinski
@andykonwinski
Joined July 2010
120 Following 12.1K Followers
sure you can use an LLM to do your semantic embedding. it's only 1000x more expensive and slower.
the bigger question is: how long before LLMs can do it better cheaper and faster? Will they ever?
Did LLMs finally subsume embedding models?
We compared 10 LLMs vs. 26 embedding models across 37 MTEB tasks.
LLMs scored 77.6 while embedding models scored 77.2
But the costs are very different. 🧵
Show more
