I made a page to list verified bots with their user agents and IP ranges.
3 categories:
๐ AI answers (ChatGPT crawls your site to answer)
๐ Indexing (e.g., googlebot)
๐ง Training (labs training LLMs)
I wasn't able to find official IP ranges for Grok /
@xai.
It would be really nice because all other companies have published them, and it's useful for us to know who crawls our sites ๐ท๏ธ