Introducing REKI, a 2.4B vision-language-action model pretrained on public data only. With a simple design, it rivals larger models trained on in-house data with complex multi-stage pipelines, setting a new Pareto frontier between performance and size. kyutai.org/reki

🏠 Introducing CASA: a new way to input visual information into LLMs. The current default to do that is by inserting image tokens into the text stream, but when using many images in long conversations, this floods the context window and is thus impractical for streaming inputs.🧵