๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Ishan Mukherjee
@ishanmkh
dad + founder. now: cofounder/ceo @rox_ai past: 4 newcos + 3 bigcos after @mit
๊ฐ€์ž… April 2009
579 ํŒ”๋กœ์ž‰ ์ค‘    1.4K ํŒฌ
Revenue Agent accuracy jumps from 8.9% to 99.9% by swapping it's context source from Salesforce to a knowledge graph - even using a 27B open-weight model at 1/20th the cost. @rox_ai research crew: @damonlin_, @santhoshkumarml, Sanjay Sriram, @shriram_s just published intense but very important work to scale Revenue Agents ๐Ÿ‘‡
๋” ๋ณด๊ธฐ
We spent 11x more tokens on reasoning and got 0% better answers on revenue data ... until we added a knowledge graph. TLDR: our latest research shows that improving data representation increases agent retrieval accuracy more than upgrading the model. We ran 3,100 runs across 8 models answering revenue questions, like deal amounts, contacts, and identifying customer champions. We compared two ways of storing the data: 1. a normal database (SQL) VS. 2. a knowledge graph (relationships pre-mapped) Frontier models hit 8.9% accuracy on the questions using SQL over a relational schema. Cranking Claude Opus 4.8โ€™s reasoning effort from minimum โ†’ maximum accuracy did not help. However, swap raw Salesforce data for a knowledge graph built on lakehouses like @databricks, @Snowflake, @googlecloud's Big Query, or @Azure Data Fabric ... and accuracy jumps from 8.9% to 99.9% - even using a 27B open-weight model at 1/20th the cost. This research shows throwing more compute at your agent cannot fix bad data structure. And is proof a revenue-specific knowledge graph is key to making revenue agents work at scale.
๋” ๋ณด๊ธฐ