Anup Bishnoi (@asyncanup) header
Anup Bishnoi (@asyncanup) profile picture

Autonomous Driving, Augmented Reality, Web, Game Dev @ Aurora, Ex-Netflix

Mountain View, CA
Joined May 2014
Photo by Anup Bishnoi (@asyncanup)Photo by Anup Bishnoi (@asyncanup)Photo by Anup Bishnoi (@asyncanup)Photo by Anup Bishnoi (@asyncanup)Photo by Anup Bishnoi (@asyncanup)Photo by Anup Bishnoi (@asyncanup)Photo by Anup Bishnoi (@asyncanup)Photo by Anup Bishnoi (@asyncanup)Photo by Anup Bishnoi (@asyncanup)Photo by Anup Bishnoi (@asyncanup)
Anup Bishnoi retweeted
The 2nd bucket of highly-paid AI talent is emerging: the ones who are deep (enough) into not only pre-training and post-training of LLMs – but with the complementary skills to make LLMs actually work in messy real-world use cases (I don't mean SWE skills here, that's table-stakes). Are they special? Not sure – just very rare right now – need ~10k hours of focused IC practice in real-world scenarios, when “GenAI” itself is barely 3 years old. (Related to the recent “95%” Fortune article, the underlying MIT report, and all the chatter about the GenAI bubble)
3
3
73
45,801
Anup Bishnoi retweeted
My top 5 most memorable “LLMs” launches: 1. text-davinci-002 (first one that really "got it"/worked) 2. GPT4 (biggest step function jump seen till now) 3. Clause 3.5 Sonnet (first true dethroning) 4. o1-pro (clear glimpse of robust human-like reasoning) 5. DeepSeek-R1 (proof open can beat closed)
My top 5 most memorable models from using them at/soonafter launch: 1. Claude 3.5 Sonnet (personality, all round perf) 2. o3 (search behavior + perf) 3. o1 pro (robustness) 4. Gemini 2.5 pro (long context + perf) 5. GPT 4.5 (personality)
1
1
6
446
Anup Bishnoi retweeted
I am at #NeurIPS2024 this week! Key ML areas our group under @timshi_ai at @cresta is working on: - AI Agents than can reason and troubleshoot effectively in complex enterprise domains - Multimodal Knowledge Grounding - LLM-as-a-judge framework that actually works We are hiring!
1
4
11
3,750
Anup Bishnoi retweeted
This, w.r.t. emergence of consciousness. And I think the “deliberate” aspect is key here. GEB talked about it also in “Jumping out of the System” – the need to jump out of the task being performed, survey whats been done, and ensure key requirements (consistency AND efficiency).
Replying to @fchollet
"system 2 as iterated system 1 with a self-consistency guarantee" is something I considered a few years ago as one of two hypotheses, and it led me to an interesting potential interpretation of consciousness -- consciousness is the consistency guarantee. It explains why all system 2 processing involves consciousness. Iterated system 1 with low self-consistency = dream-like, incoherent, ever shifting Iterated system 1 with strong self-consistency guardrails = deliberate, coherent, self-correcting The maintenance of strong self-consistency enforcing feedback loops between iterations is what consciousness emerges from.
1
1
2
386
In the brain, some neurons adapt easily, while others remain resistant to change. This can be likened to our beliefs, where certain deeply ingrained convictions, like the historical belief that the sun revolves around the earth, required substantial evidence and effort to alter. Similarly, in machine learning, we could enhance efficiency by incorporating a "resistance to change" factor for each neuron during training. This factor would determine how readily a neuron or set of neurons can adapt or how firmly they maintain their learned patterns (or weights). By drawing on the concept that some brain regions or neuron patterns encode hard-set beliefs through repeated reinforcement, we can apply this principle to improve the adaptability and stability of artificial neural networks. This could be a pathway for the Alignment Problem. PS: Dropout is a somewhat overlapping, but a completely different concept, introduced for a different need.
2
3
130
Anup Bishnoi retweeted
I am at #NeurIPS2023 this week! Some ML areas our group under @timshi_ai at @cresta is working on: - Domain specific instruction finetuning - Retrieval Augmentation and Knowledge Grounding - Reward modeling and conversation-level outcomes Hit me up for a chat. We are hiring!
5
12
1,123
Psychology says it is okay only if you have read a book or something else but you can also do it yourself or something else or something wrong
Let auto complete educate you about psychology! Psychology says _________ Psychology says that it isn’t working but it isn’t good for you
1
2
And another crazy one on temporal implications. Pulsing appears synchronous or asynchronous… depending on the background! michaelbach.de/ot/lum-induce… h/t @Sir_Daniele
9
47
5
213
Anup Bishnoi retweeted
"Photons are expensive" Sounds like a good prelude to a Nolan movie.
"Photons are expensive" in Autonomous Driving. Why? A thread... (Thoughts my own, not my employer's)
1
1
Anup Bishnoi retweeted
Message for @mrdoob 10 years ago: Yes, making a 3D engine using canvas2d is stupid. But in 10 years you'll watch a simulation in realtime of @NASA landing a rover in Mars that uses that stupid code. eyes.nasa.gov/apps/mars2020/
73
515
50
3,641
*Free* live tutoring in math and SAT (also can volunteer to be a tutor) at: lnkd.in/gpwNK_V Can also help you get into college. Tell every high school student who can benefit! I am also running a Q&A on Schoolhouse on Friday.
4
22
2
83
"When I hear, I forget. When I see, I remember. When I do, I understand.” An old proverb that explains the relevance of engaging our senses for a true learning experience. #education #edutwitter #ar #educators
2
1
3
Anup Bishnoi retweeted
We’re excited to announce the most transformative deal in the AV industry: we’re acquiring Uber ATG. Together, we’ll accelerate our mission to deliver the benefits of self-driving technology safely, quickly, and broadly. Welcome to the Aurora family, ATG. aurora.tech/blog/aurora-is-a…
50
55
158
Anup Bishnoi retweeted
Maybe there’s a limit to what can be automated. Once a task gets complex enough any agent that can do it will also have to be complex enough that it turns sentient, and starts asking for a minimum wage.
1
3
Anup Bishnoi retweeted
Heads up for folks in the USA; If you're not having a food emergency, please don't go to the grocery store on April 1st and 2nd. Wait until the 3rd. People who are on food stamps get their accounts recharged on the first of the month, and have likely been running on fumes.
964
56,457
1,943
145,963
Anup Bishnoi retweeted
Thank you to the 741 supporters who donated nearly $31K during our giving campaign! We couldn't have done it without you. There's still time to give-- bit.ly/arXivDONATE3
2
3
1
13