All things Artificial Intelligence
Joined October 2010
- Tweets2.8K
- Following397
- Followers19.2K
- Likes204
GFlowNets by Yoshua Bengio's group at the Université de Montréal provides a way for developing neural nets that can reason
arxiv: arxiv.org/abs/2106.04399
"I’m excited by generative flow networks, or GFlowNets, an approach to training deep nets that my group started about a year ago. This idea is inspired by the way humans reason through a sequence of steps, adding a new piece of relevant information at each step. It’s like ...
AI Tribune retweeted
Google research released a paper on a neural net that can forecast rain up to 12 hours ahead, as opposed to using time and compute intensive physics simulations on supercomputers. It can run on a colab notebook!
nature.com/articles/s41467-0…
AI Tribune retweeted
This paper is not receiving enough attention:
GPT 3.5 displays emergent theory of mind
arxiv.org/pdf/2302.02083.pdf
AI Tribune retweeted
I made this binary fundamentals chart for my students.
You can grab a PDF here:
terathon.com/binary_fund.pdf
AI Tribune retweeted
Great article on LLMs - MLE training is exactly lossy data compression! I know RLHF is changing the loss to maximize predicted human ratings, but it still feels like a bit like lipstick on a pig to me (although who doesnt like bbq now and then? ;) newyorker.com/tech/annals-of…
I was going to write about one of Elon's tweets and he made them private! 😐 now I can't find it #ElonMuskTwitter
Automating mundane tasks should be Artificial Intelligence's ultimate goal, allowing us all to retire earlier. Ironic statement made by @elonmusk, a powerful player in the AI ecosystem:
xitter.cf/elonmusk/status/161656…
AI Tribune retweeted
Extracting Training Data from Diffusion Models
Extracts over a thousand training examples from SotA models (e.g. Stable Diffusion), ranging from photographs of individual people to trademarked company logos.
arxiv.org/abs/2301.13188
#FlashbackFriday : See the list of best papers at the British Machine Vision Conference in 2018 aitribune.com/event/2018.108…
AI Tribune retweeted
Best of AI Twitter - January 11-25 (megathread):
Andrej Karpathy builds "GPT from Scratch",
A class-action lawsuit against Stability AI,
Track human pose using WiFi alone,
An LLM-native IDE,
InstructPix2Pix & AdA,
Training a world-class Rocket-league RL bot,
... and more:
1/22
If you think #ChatGPT is going to destroy Google search, have you heard of PaLM from Google Research? It has 540B parameters, almost three times bigger than #gpt3 with 175B parameters
PaLM on AI Tribune 👉 aitribune.com/paper/2022.111…
Abstract on Arxiv 👉 arxiv.org/abs/2204.02311
On the same note, the current #layoffs at Google seems counterintuitive. Maybe someone would eventually put them out of business with the current trends in AI. It is most definitely fascinating to watch what happens in the next few years.