Anup Bishnoi retweeted
The 2nd bucket of highly-paid AI talent is emerging: the ones who are deep (enough) into not only pre-training and post-training of LLMs – but with the complementary skills to make LLMs actually work in messy real-world use cases (I don't mean SWE skills here, that's table-stakes).
Are they special? Not sure – just very rare right now – need ~10k hours of focused IC practice in real-world scenarios, when “GenAI” itself is barely 3 years old.
(Related to the recent “95%” Fortune article, the underlying MIT report, and all the chatter about the GenAI bubble)
Anup Bishnoi retweeted
My top 5 most memorable “LLMs” launches:
1. text-davinci-002 (first one that really "got it"/worked)
2. GPT4 (biggest step function jump seen till now)
3. Clause 3.5 Sonnet (first true dethroning)
4. o1-pro (clear glimpse of robust human-like reasoning)
5. DeepSeek-R1 (proof open can beat closed)
Anup Bishnoi retweeted
I am at #NeurIPS2024 this week! Key ML areas our group under @timshi_ai at @cresta is working on:
- AI Agents than can reason and troubleshoot effectively in complex enterprise domains
- Multimodal Knowledge Grounding
- LLM-as-a-judge framework that actually works
We are hiring!
Anup Bishnoi retweeted
This, w.r.t. emergence of consciousness. And I think the “deliberate” aspect is key here. GEB talked about it also in “Jumping out of the System” – the need to jump out of the task being performed, survey whats been done, and ensure key requirements (consistency AND efficiency).
Replying to @fchollet
"system 2 as iterated system 1 with a self-consistency guarantee" is something I considered a few years ago as one of two hypotheses, and it led me to an interesting potential interpretation of consciousness -- consciousness is the consistency guarantee. It explains why all system 2 processing involves consciousness.
Iterated system 1 with low self-consistency = dream-like, incoherent, ever shifting
Iterated system 1 with strong self-consistency guardrails = deliberate, coherent, self-correcting
The maintenance of strong self-consistency enforcing feedback loops between iterations is what consciousness emerges from.
Anup Bishnoi retweeted
In the brain, some neurons adapt easily, while others remain resistant to change. This can be likened to our beliefs, where certain deeply ingrained convictions, like the historical belief that the sun revolves around the earth, required substantial evidence and effort to alter.
Similarly, in machine learning, we could enhance efficiency by incorporating a "resistance to change" factor for each neuron during training. This factor would determine how readily a neuron or set of neurons can adapt or how firmly they maintain their learned patterns (or weights).
By drawing on the concept that some brain regions or neuron patterns encode hard-set beliefs through repeated reinforcement, we can apply this principle to improve the adaptability and stability of artificial neural networks. This could be a pathway for the Alignment Problem.
PS: Dropout is a somewhat overlapping, but a completely different concept, introduced for a different need.
Anup Bishnoi retweeted
I am at #NeurIPS2023 this week! Some ML areas our group under @timshi_ai at @cresta is working on:
- Domain specific instruction finetuning
- Retrieval Augmentation and Knowledge Grounding
- Reward modeling and conversation-level outcomes
Hit me up for a chat. We are hiring!
Anup Bishnoi retweeted
Psychology says it is okay only if you have read a book or something else but you can also do it yourself or something else or something wrong
Anup Bishnoi retweeted
And another crazy one on temporal implications. Pulsing appears synchronous or asynchronous… depending on the background! michaelbach.de/ot/lum-induce… h/t @Sir_Daniele
Anup Bishnoi retweeted
Please check out this video on intro to Ramsey numbers we (@AnuragBishnoi , @methodiva and I) made for a contest. Like and share if you can.
youtube.com/watch?v=WN_tQWIk…
Anup Bishnoi retweeted
Ramsey numbers via Game of Thrones, in one minute youtube.com/watch?v=WN_tQWIk…
Anup Bishnoi retweeted
Watch our little explainer on Ramsey Numbers in Game of Thrones, and join Samwell Tarly in the search for R(5) :p
youtu.be/WN_tQWIkeV0
@Aparajitanath9 @AnuragBishnoi @PotukuchiA @asyncanup
#got #Mathematics #video #Math #veritasiumcontest #veritasium #ramsey
Anup Bishnoi retweeted
Message for @mrdoob 10 years ago:
Yes, making a 3D engine using canvas2d is stupid. But in 10 years you'll watch a simulation in realtime of @NASA landing a rover in Mars that uses that stupid code.
eyes.nasa.gov/apps/mars2020/
Anup Bishnoi retweeted
*Free* live tutoring in math and SAT (also can volunteer to be a tutor) at: lnkd.in/gpwNK_V Can also help you get into college. Tell every high school student who can benefit! I am also running a Q&A on Schoolhouse on Friday.
Anup Bishnoi retweeted
"When I hear, I forget.
When I see, I remember.
When I do, I understand.”
An old proverb that explains the relevance of engaging our senses for a true learning experience. #education #edutwitter #ar #educators
Anup Bishnoi retweeted
We will focus on one such platform here — Mobile AR, and the challenges it faces with immersion, and the solutions that worked for us
methodiva.medium.com/rethink…
Anup Bishnoi retweeted
We’re excited to announce the most transformative deal in the AV industry: we’re acquiring Uber ATG. Together, we’ll accelerate our mission to deliver the benefits of self-driving technology safely, quickly, and broadly. Welcome to the Aurora family, ATG. aurora.tech/blog/aurora-is-a…
Anup Bishnoi retweeted
Maybe there’s a limit to what can be automated. Once a task gets complex enough any agent that can do it will also have to be complex enough that it turns sentient, and starts asking for a minimum wage.
Anup Bishnoi retweeted
Heads up for folks in the USA;
If you're not having a food emergency, please don't go to the grocery store on April 1st and 2nd. Wait until the 3rd. People who are on food stamps get their accounts recharged on the first of the month, and have likely been running on fumes.
Anup Bishnoi retweeted
Thank you to the 741 supporters who donated nearly $31K during our giving campaign! We couldn't have done it without you. There's still time to give-- bit.ly/arXivDONATE3




















