Register and share your invite link to earn from video plays and referrals.

ρ:ɡeon
@pigeon__s
omnimodality is all you need
Joined October 2020
67 Following    1.7K Followers
As promised, here are some much harder tests. This will be a thread. I think Gemini wins here, actually, because it edited the image more precisely. GPT technically got 1 more right, I think. But it also added more things that weren't there originally than Gemini (although Gemini also added 1 extra set of lines that was never there and also removed 1 line that was there). GPT added and removed and repositioned so many things. It's embarrassing, frankly. The max score you can get here is 19. Gemini got 12 right - 2 completely hallucinated lines = 10. GPT got 13 right - 6 completely hallucinated lines = 7. Really, this is embarrassing for both models. This is literally middle school biology, which they know at, like, Nobel Prize level, and a simple image-editing task, which they also should be good at. TLDR: Gemini got 1 less label right but made WAY fewer editing errors and blatant hallucinations. 1/N
Show more