Love is a secret inherent to most of the best training runs
I gave a keynote at Reverie where I covered the most important topic in building AI systems of today: love ❤️ and how to get that into space.
youtu.be/tj9I3DrzNvQ
For the next presentation If get invited, I will talk about purpose - if anyone wants to hear me yap.
Great episode!
Next guest up in this weekly series is @kanavg1, cofounder of @coreauto on Friday, Nov 20th at noon.
For this session, we'll be chatting about all things RL (methods, synthetic data, loops, automation etc)
Format:
> 60 minute sessions (IRL only) in SF
> For the first 45 mins, I get to ask the guest spicy questions about their expertise
> For the last 15 mins, they get to ask me anything they want to learn about venture
> All off the record, chatham house rules
> Open to 15 guests who listen in and can ask some of their own questions
Register here if you want to join, and subscribe to the Luma for future guests: luma.com/2enjjc82
Welcome!
John -> Core Automation coreauto.com/
After Microsoft (hunch.net/?p=13764006), I was attracted to a place which was very willing to try new things and exceptionally enabling in doing so.
2
90
6,025
It is a subtle topic, but right now I believe it is clear for everyone in the field that main differentiator in developing AI at this specific moment of 2026 is *how* you use AI to develop it
I asked 51 people in AI who has a good read on RSI (recursive self-improvement) and where it's going:
5 votes:
- Jerry Tworek, Core Automation (@MillionInt)
4 votes:
- Jun Park, Hillclimb (@jparkjmc)
3 votes each:
- John Schulman, Thinking Machines (@johnschulman2)
- Rohan Anil, Core Automation (@_arohan_)
- Daniel Chang, ex-Mercor (@dnnssl2)
- Laksh Aithani, Abundance (@LakshAithani)
- Richard Socher, Recursive (@RichardSocher)
2 votes each:
- Andrej Karpathy, Anthropic (@karpathy)
- Behnam Neyshabur, Mirendil (@bneyshabur)
- Han Fang, Meta Superintelligence Labs (@Han_Fang_)
- Herbie Bradley (@herbiebradley)
- Jennifer Zhou, Preference Model (@chem_safety)
- Paul Christiano, Alignment Research Center (@paulfchristiano)
75 people were picked. The other 62 got 1 vote each and are in the next posts.
51 people voted, each picking from people they've met. I didn't vote.
Some problems can be solved by building gigantic datacenters.
But more often than not, what you actually need is better algorithms.
Hi! this is Rohan Anil, I develop training algorithms among other things - my work trains various frontier models.
At CoreAuto, I was fascinated by the problem of training on compute islands, eventually in space training.
I hope you all enjoy this write up!🪐🛰️
coreauto.com/hitchhikers-gui…
Yeah
This list loses credibility by putting Riley Walz on the same scale as normal cool people.
Everybody else here is awesome, but not at all the same. Its like Forbes 30u30 when they have Elizabeth Holmes and then 29 other people.
They should make his image 2x as bigger and maybe add a rainbow chromatic shader behind him.
17
7,721
How should we rebrand learning that’s actually deep?
13%Deep deep learning
27%Really deep learning
31%Superior learning
29%Deep learning for real
225 votes • Final resultsCore Automation is a deep learning research company with a mission to build systems that automate and optimize work
A decade of learning the hard way.
No pain no train 🚝
Bit more than a decade in training, no pain no train. 💪
@BEBischof nerd sniped me into this talk with offer to have a Cat to give the keynote.
Still Training: A Decade of Learning the Hard Way @ Reverie by LanceDB on Nov 5 in SF 🌉
You get to hear me about distributed training from the trenches:
Hardware codesign, async and sync training -- when we almost decided to put async into chips
From big batch gradient descent with parallel boosting from stochastic optimization with duals to online learning where we had regrets, to higher order methods that scale that was almost second order that nobody believed it.
24
3,373
Wait until you hear what agents found when reading Rohans slack post.
It reinforces the message how special it is to be in a place where alpha is generated.
The more interesting thing I have heard this week is that folks at some labs are mining alpha from my posts, and having their agents work on it. It seems like a great idea, so I am starting to do that as well.
28
9,175
















