Interconnects

Home
Audio
Interviews
Leaderboard
About
Llama 3: Scaling open LLMs to AGI
Llama 3 shows that scaling won't be a limit for open LLM progress in the near future.
 • 
Nathan Lambert
Stop "reinventing" everything to solve alignment
Integrating some non-computing science into reinforcement learning from human feedback (RLHF) can give us the models we want.
 • 
Nathan Lambert
The end of the “best open LLM”
Modeling the compute versus performance tradeoff of many open LLMs.
 • 
Nathan Lambert
Most Popular
View all
The Q* hypothesis: Tree-of-thoughts reasoning, process reward models, and supercharging synthetic data
 • Nathan Lambert
5
Behind the curtain: what it feels like to work in AI right now (April 2023)
 • Nathan Lambert
21
Llama 2: an incredible open LLM
 • Nathan Lambert
7
The AI research job market shit show (and my experience)
 • Nathan Lambert
How RLHF actually works
 • Nathan Lambert
3
State-space LLMs: Do we need Attention?
 • Nathan Lambert
3
We disagree on what open-source AI should mean
How to read what multiple people mean by the word openness and see through the PR speak.
 • 
Nathan Lambert
DBRX: The new best open model and Databricks’ ML strategy
Databricks’ new model is surpassing the performance of Mixtral and Llama 2 70B while still being in a size category that's reasonably accessible.
 • 
Nathan Lambert
1
Evaluations: Trust, performance, and price (bonus, announcing RewardBench)
Evaluation is not only getting harder with modern LLMs, it’s getting harder because it means something different.
 • 
Nathan Lambert
Model commoditization and product moats
Where moats are tested now that so many people have trained GPT4 class models. Claude 3, Gemini 1.5, Inflection 2.5, and Mistral Large are here to…
 • 
Nathan Lambert
The koan of an open-source LLM
A proposal for a new definition of an “open-source” LLM and why no definition will ever just work.
 • 
Nathan Lambert
Interviewing Louis Castricato of Synth Labs and Eleuther AI on RLHF, Gemini Drama, DPO, founding Carper AI, preference data, reward models…
An interview I've wanted to bring you for a while.
 • 
Nathan Lambert
1:26:27
How to cultivate a high-signal AI feed
Basic tips on how to assess inbound ML content and cultivate your news feed.
 • 
Nathan Lambert
Interconnects
Interconnects
Linking important ideas of AI. The border between high-level and technical thinking. Read by leading engineers, researchers, and investors on Wednesday mornings.
Recommendations
View all 13
Latent Space
Latent Space
swyx & Alessio
TechTalks
TechTalks
Ben Dickson
Supervised
Supervised
Matthew Lynley
Deep (Learning) Focus
Deep (Learning) Focus
Cameron R. Wolfe, Ph.D.
Hyperdimensional
Hyperdimensional
Dean W. Ball
Social
Author info
Twitter
Linkedin
© 2024 Nathan Lambert
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture