Midnight reflection: good engineering thinking matters so much when working on LLMs.
Find the actual problem. Describe it precisely. Reduce it to its minimal form. Understand the underlying mechanism. Solve it, validate it, and iterate fast.
Don’t hallucinate the problem.