Marc Lou
@marclou
⭐️ $44K/m
📈 $26K/m
🏴☠️ $13K/m
🧑💻 $6K/m
⚡️ $4K/m
🍜 $1K/m
+29
Joined January 2014
1.2K Following 370.7K Followers
I made a page to list verified bots with their user agents and IP ranges.
3 categories:
🌟 AI answers (ChatGPT crawls your site to answer)
🔎 Indexing (e.g., googlebot)
🧠 Training (labs training LLMs)
I wasn't able to find official IP ranges for Grok / @xai.
It would be really nice because all other companies have published them, and it's useful for us to know who crawls our sites 🕷️
Show more
