Andrew M. Dai

@AndrewDai

Co-founder and CEO at Elorian AI. Ex (director) at Google DeepMind after 12y. Gemini Data Area Lead. 戴明博

Palo Alto, CA

Pinned
Andrew M. Dai
@AndrewDai
Apr 9
After almost 12 years in Brain/DeepMind, I’ve finally decided to take the leap. My cofounders: @yinfeiy, Seth and I have kicked-off @ElorianAI. The first multimodal reasoning lab founded and led by former LLM pretraining, data and multimodal leads. youtu.be/YlvfNpOMeOY?si… (1/n)
Elorian is building the foundation of visual reasoning
From youtube.com
81
Andrew M. Dai
@AndrewDai
Sep 14
Everyone knows that next-token prediction scales for language but you need to think outside to find the objective that scales for video and understanding the physical world.
5
Andrew M. Dai
@AndrewDai
Sep 14
Why didn't anyone ping us about pacing the frontier? Then we wouldn't have had to cook so hard this weekend.
3
Andrew M. Dai
@AndrewDai
Sep 11
Next token prediction doesn't work because it accurately models how human brains learn. It works because it's one of the only objectives that scale, unlike some other ones.
Dwarkesh Patel
@dwarkesh_sp
Sep 11
In the early days of OpenAI, @johnschulman2 didn't think next-token prediction was going to lead to intelligence, because it would get swamped by noise. He explains it's always been hard to apriori predict what techniques will elicit out-of-distribution generalization.
00:00
2
Andrew M. Dai
@AndrewDai
Sep 11
Anyone who has trained frontier models can relate to this.
MattyG
@meawoppl
Sep 10
Wife told me these wouldn’t fit. Little did she know I had trained for this moment for years.