Here's my full @interconnectsai interview with @goodside. We cover all the reasons why prompting is crucial to keeping up with, and getting the most out of, the rapidly changing AI landscape. We discuss: * Prompting to push the frontier of AI models, * Post-training and prompting interaction, * Prompting base models, * o1, Reflection 70B, reasoning, * Scale’s leaderboard, evaluation tricks, evaluation needs, * PlanSearch paper * Julius AI * “The hottest programming language is english” * “Think silently” instructions * Scale Leaderboard and Humanity’s Last Exam Timestamps: 00:00:00 Introduction 00:02:40 Riley's path to LLMs 00:07:54 Impact of ChatGPT on prompt engineering 00:12:03 OpenAI's o1 00:18:21 Autoregressive inference and prompting sensitivities 00:24:48 Reflection 70B model and its implications 00:28:00 Impact of prompting on evaluation 00:32:43 Prompting vs. Google search 00:46:55 Prompting and RLHF/post-training 00:56:57 Prompting of AI agents 01:01:20 Importance of hands-on experience with language models 01:05:00 Importance and challenges of AI model evaluation

Riley Goodside (@goodside) on the intersection between OpenAI's o1, the RL behind it, and prompting. Full episode monday on @interconnectsai

You should spend more on inference