Ben Prystawski, a PhD candidate in the psychology department at Stanford University who studies the nexus between machine learning and cognitive science, joins us today. The topic of discussion is Ben’s most recent paper, “Why Think Step by Step? “The locality of experience is where reasoning emerges,” he said in a recent presentation at NeurIPS 2023. We begin by discussing some fundamental issues regarding LLM reasoning, such as whether it exists, how to characterize it, and how methods such as chain-of-thought reasoning seem to support it. We next delve into Ben’s article, which tries to explain the effectiveness of step-by-step thinking and shows that the essential feature of LLM training data that makes it possible is local structure.
Training Data Locality
Previous article
Youtube @blockgeni
Israel’s use of AI offers a terrifying glimpse at where warfare could be headed
05:55
The AI Revolution Is destroying Thousands of Languages
06:40
CEO of Ripple predicts crypto market reaching 5 Trillion this year
02:01
Microsoft and OpenAI are Planning a $100 billion Supercomputer
03:37
Crypto Options preferred by Goldman’s Hedge Fund Clients
03:20
New Guidelines on Government Use of AI
02:43
Are College AI Degree Programs Really Worth it ?
03:12
Sam Altman Wants Trillion Dollars to Transform the Chip and AI Business
04:31
China's 1st AI Child
01:37
How Blockchain is changing the Gaming industry
04:54