AndreiRadulescu-Banu (@bitdribble) header
AndreiRadulescu-Banu (@bitdribble) profile picture

AI. Robotics. Math.

Lexington, MA
Joined April 2014
Photo by AndreiRadulescu-Banu (@bitdribble)Photo by AndreiRadulescu-Banu (@bitdribble)Photo by AndreiRadulescu-Banu (@bitdribble)Photo by AndreiRadulescu-Banu (@bitdribble)
AndreiRadulescu-Banu retweeted
Imagine being a board member at Nvidia considering potential candidates for CEO, and trying to claim with a straight face that one of the others would do a better job.
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me. I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA. I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation. Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO. Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours. Jensen
435
775
63
14,609
507,731
AndreiRadulescu-Banu retweeted
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models. images.nvidia.com/pdf/Open-W…
16,548
34,447
12,083
193,752
69,461,184
AndreiRadulescu-Banu retweeted
🚨 Anthropic just showed a 27-minute workshop on how to actually do prompts for Claude. Taught by the people who built it. Free. No registration. No paywall. I've seen $300 courses that don't cover what they teach in the first 8 minutes. Watch it and Bookmark it now.
16
55
2
391
137,727
AndreiRadulescu-Banu retweeted
This is insane. Meet Blender MCP, Claude AI can now talk directly to Blender. Instantly turn any prompt or 2D image into stunning 3D scenes. Creativity unlocked.👇
203
645
103
5,062
597,920
AndreiRadulescu-Banu retweeted
Really enjoyed this conversation! would recommend taking a listen
Here's my conversation with the founding team of Cursor, a popular code editor (based on VSCode) that specializes in AI-assisted programming. This is a super technical conversation that is bigger than just about one code editor. It's about the future of programming and, in general, the future of human-AI collaboration. It's here on X in full, and is up on everywhere else. Timestamps: 0:00 - Introduction 0:59 - Code editor basics 3:09 - GitHub Copilot 10:27 - Cursor 16:54 - Cursor Tab 23:08 - Code diff 31:20 - ML details 36:54 - GPT vs Claude 43:28 - Prompt engineering 50:54 - AI agents 1:04:51 - Running code in background 1:09:31 - Debugging 1:14:58 - Dangerous code 1:26:09 - Branching file systems 1:29:20 - Scaling challenges 1:43:32 - Context 1:48:39 - OpenAI o1 2:00:01 - Synthetic data 2:03:48 - RLHF vs RLAIF 2:05:34 - Fields Medal for AI 2:08:17 - Scaling laws 2:17:06 - The future of programming
38
109
1
1,690
306,636
AndreiRadulescu-Banu retweeted
Come join us at MIT this Saturday: app.agihouse.org/events/Agen…
The Harvard/MIT startup scene is absolutely cracked. @cursor_ai, @cognition_labs, @mercor, @Etched all founded by recent grads/dropouts The energy here feels different: no virtue signaling, just insane heads-down building every weekend 😤
1
6
1,901
AndreiRadulescu-Banu retweeted
Happy to release a couple of our reasoning models today (🍓)! At @OpenAI , these new models are becoming a larger contributor to the development of future models. For many of our researchers and engineers, these have replaced a large part of their ChatGPT usage. openai.com/index/learning-to… Instead of blurting out an answer right away, ChatGPT can now think through it first. The best analog is that ChatGPT is evolving from using only System-1 thinking (fast, automatic, intuitive, error-prone) to System-2 thinking (slow, deliberate, conscious, reliable). The allows it to solve things it couldn’t before. From a user experience in ChatGPT today, this is a small step forward. On easy prompts, a user likely won’t notice much of a difference (but you will if you have some gnarly math or coding problems 🙂). But this is an important sign of what’s to come.
53
159
45
1,707
218,611
AndreiRadulescu-Banu retweeted
Some favorite posts about OpenAI o1, as selected by researchers who worked on the model 🧵
142
697
87
6,058
1,247,593
AndreiRadulescu-Banu retweeted
we crossed 1m downloads* of @latentspacepod! celebratory recapisode with @fanahova + special @chatgptapp voice mode demo with @ethansutin! *not even counting spotify which rehosts the file so we dont get stats but estimate 200k
🆕 pod: The Winds of AI Winter! latent.space/p/q2-2024-recap The vibes have shifted... @fanahova and @swyx celebrate 1m downloads and recap the last 3 months in AI! Discussing the Frontier Labs vibe shift between Claude 3.5, Llama 3.1, Apple Intelligence, and the expansion of RAG/Ops into the new war for the LLM OS. Bonus: @ChatGPTapp voice mode demo with @ethansutin!
11
4
3
51
38,011
AndreiRadulescu-Banu retweeted
Why did I deepfake myself? To see if conversing with an AI-generated version of myself can lead to self-reflection, new insights into my thought patterns, and deep truths.
198
536
376
2,577
634,790
AndreiRadulescu-Banu retweeted
Some observations/questions: - Did you know that Gemini traffic is already ~25% of ChatGPT? And Google isn't pushing it through their massive distribution channels yet (Android, Google, GSuite, etc). - Big on X, but Claude usage is still very low. Should Anthropic advertise? - ChatGPT is still the big brand, but usage relatively flat over the last year. Why isn't it growing? Is OpenAI compute limited or demand-limited?
169
110
28
1,332
424,326
AndreiRadulescu-Banu retweeted
GPT-4 Turbo with Vision is now generally available in the API. Vision requests can now also use JSON mode and function calling. platform.openai.com/docs/mod… Below are some great ways developers are building with vision. Drop yours in a reply 🧵
109
416
167
2,300
1,823,546
AndreiRadulescu-Banu retweeted
Unfortunately, Large Language Models will not consistently follow the instructions that you give them. This is a massive problem when you are building AI systems that require a particular type of output from the previous step to feed into the next one! For example, imagine you are building a blog post writing system that first takes a question and retrieved context to output a list of topics. These topics have to be formatted in a particular way, such as a comma-separated list or a JSON of Topic objects, such that the system can continue writing the blog post! 🤝 I am SUPER excited to share the 4th video in my DSPy series, diving into 3 solutions to structuring outputs in DSPy programs: (1) TypedPredictors, (2) DSPy Assertions, and (3) Custom Guardrails with the DSPy programming model! 📖 TypedPredictors follow the line of thinking around JSON mode and using Pydantic BaseModels to interface types and custom objects into a JSON template for LLMs. The output can then be validated to provide a more structured retry prompt to correct the output structure! 🛠️ DSPy Assertions are one of the core building blocks of DSPy, offering an interface to input a boolean-valued function and a retry prompt which is templated alongside the past output to retry the call to the LLM! ⚠️♻️ Custom Guardrails with the DSPy Programming Model are one of the things I love the most about DSPy — we have unlimited flexibility to control these systems however we want. The video will also show you how to write custom guardrails and retry Signatures and discussion around using TypedPredictors for your Custom Guardrails and potentially feeding your Custom Guardrails into a DSPy Assertion. 💥 I had so much fun exploring this topic! Further seeing how well OpenAI’s GPT-4 and GPT-3.5-Turbo, Cohere’s Command R, and Mistral 7B hosted with Ollama perform with each Structured Output strategy! I also found monitoring structured output retries to be another fantastic application of Arize Phoenix! I hope you find the video useful! 🎙️ youtube.com/watch?v=tVw3CwrN…
19
98
8
565
88,341
AndreiRadulescu-Banu retweeted
We are building a new cloud—one that is open source, can run anywhere, and costs 3-10x less. Join our Rebel Alliance, as we launch part of @ycombinator W24! ycombinator.com/launches/KdH…
44
106
44
860
507,491
AndreiRadulescu-Banu retweeted
Claude 3 gets ~60% accuracy on GPQA. It's hard for me to understate how hard these questions are—literal PhDs (in different domains from the questions) with access to the internet get 34%. PhDs *in the same domain* (also with internet access!) get 65% - 75% accuracy.
Today, we're announcing Claude 3, our next generation of AI models. The three state-of-the-art models—Claude 3 Opus, Claude 3 Sonnet, and Claude 3 Haiku—set new industry benchmarks across reasoning, math, coding, multilingual understanding, and vision.
20
199
44
1,410
396,116
AndreiRadulescu-Banu retweeted
BREAKING: Apple has cancelled plans to make a car after realizing it would require windows
1,339
9,037
959
124,725
9,160,604
AndreiRadulescu-Banu retweeted
its just been a month since this post but the GPU Rich War has a new leader - @GroqInc has come out from nowhere* to completely tilt the economics of inference. Only provider in green square on latency vs throughput vs price, because they are not just timesharing H100s like everyone else. They've also price-matched @deepinfra at $0.27 per million Mixtral tokens, which is almost certainly not as low as they could go because of their fundamentally cheaper tokenomics. * not -nowhere- to insiders, but just relatively low profile til now
🆕 The Four Wars of the AI Stack latent.space/p/dec-2023 Our Dec 2023 recap also includes a framework for looking at the key business battlegrounds of all of 2023: In Data: with OpenAI announcing a partnership with Axel Springer (see also its deal with the AP and its Data Partnerships program), the @NYT bringing a lawsuit on OpenAI demanding shutdown of all GPTs, and Apple now offering $50m for data contracts with publishers. Meanwhile there is an undeniable rise in interest in synthetic data both at NeurIPS and at Deepmind. In GPU/Inference: with the price per million Mixtral output tokens starting at ~$2 and rapidly racing down to $0.27 in a week (details below), and fresh benchmark drama between @AnyscaleCompute and other inference providers. New research into new model architectures (Mamba, RWKV), and moving compute off Nvidia (@Modular, tinycorp, Apple MLX) make more out of existing GPU resources. In Multimodality: with Midjourney soft-launching v6, a web UI, and now reported making >$200m/yr, @AssemblyAI raising a $50m Series C for “building the Stripe for AI models”, @Replicate (historically Stable Diffusion-centric) raising a $40m Series B to serve AI Engineers, and @suno_ai_ (upcoming guest!) coming out of stealth and returning to monkey - all steady point solution improvements while OpenAI and Google continue work on God Models that compete with all of them at once. In RAG/Ops: the debate on whether you need a Vector DB, vs power users adopting new vector DBs like turbopuffer; the debate between @langchain (now at v0.1, with TED talk and State of AI survey) vs @llama_index (now with Step-Wise Agent Execution); and continuing LLMOps developments (@HumanLoop’s new .prompt file, Openlayer) vs framework-driven tooling like LangSmith and new approaches like @withmartian (who announced their $9m seed).
13
45
8
432
146,343
AndreiRadulescu-Banu retweeted
⚡️We are excited to announce that our new no-code Enterprise Platform is NOW available in private beta! As RAG apps advance from prototype to production we’ve been overwhelmed by requests for an enterprise grade solution to provide these applications with the data they need. Designed to make it easy to get your data #RAGready, our Platform can preprocess more than 25 file types and soon will be fully #multimodal, also able to ingest audio, video and image files. We ship with a baseline suite of source connectors, including @awscloud S3, @Azure Blob Storage, @onedrive, SFTP, @databricks Delta Table, @googledrive, @salesforce, @elastic, OpenSearch, and @googlecloud storage with many more fast following. Platform transforms your documents into a standardized JSON schema, broken down into semantically coherent elements allowing you to reconstruct your document in the manner most useful to you. Want only the narrative text but not the headers and footers? This is entirely configurable through the UI. Additionally, we generate more than 30 types of metadata for each element to make it easy to curate the data being written downstream and to support metadata filtering during retrieval. Smart chunking and the ability to choose from a range of embedding models are in from launch, delivering a turnkey solution for chunk and embedding experimentation. As for destination connectors, we've got that covered too, with @awscloud S3, @pinecone, @trychroma , @weaviate_io, @googlecloud storage, @MongoDB, @Azure cognitive search, @PostgreSQL, @elastic, OpenSearch, and @databricks Delta Table. And of course, all of this can be scheduled to keep your data continuously hydrated. The private-beta is live today! Sign-up to get access and come build the future of LLM data foundations with us: unstructured.io/platform 🚀 #ETLforLLMs #AI #DataPreprocessing #DataScience #DataTransformation #LLMs #ETL #ML #PreppingData #MachineLearning #RAG #Engineer #Unstructured #Unstructuredio #RetrievalAugmentedGeneration #multimodal #AIJobs
6
19
5
67
21,924
AndreiRadulescu-Banu retweeted
Lance (@RLanceMartin) has done a TON to bring advanced retrieval topics to @langchain and make them easily approachable and understandable This image he put together for our "RAG from Scratch" YouTube series is absolutely 🔥 (YouTube: youtu.be/wd7TZ4w1mSw)
11
85
10
416
135,588
AndreiRadulescu-Banu retweeted
Lots of requests for richer observability in DSPy. In March, @mikeldking & I are holding a DSPy <> @arizeai meetup in SF to show you how to do that w @ArizePhoenix-DSPy integration. Video by @axiomofjoy. Good chance to show something cool with DSPy. What would you like to see?
5
26
7
158
38,965