I need your help.
If you were to say the number one paper that you always go back to it being the OG for your education, what would it be?
It could be Hardware, Systems, ML (optimization etc), LLM etc
Sort of like Ilya Sutkever list given by Hinton.
For me, the most influential paper to me was Shai/Tong’s
We did research when pay was low.
We did research when pay was uncertain.
We did research even when we were lucky enough to be paid well.
One way is to figure out what to work on is to work on things that matter and not think of rewards.
We are still quite early into what makes a frontier model all the way from optimization, architecture and objectives. Big token wants to convince you otherwise.