Workshop on Theoretical Foundations of Foundation Models @icmlconf 2024.
Vienna
Joined April 2024
- Tweets38
- Following18
- Followers256
- Likes29
Pinned Tweet
We are happy to announce that the Workshop on
Theoretical Foundations of Foundation Models will take place @icmlconf in Vienna!
For details: sites.google.com/view/tf2m
Organizers: @BerivanISIK, @SZiteng, @BanghuaZ, @eaboix, @nmervegurel, @uiuc_aisecure, @abeirami, @sanmikoyejo
Theoretical Foundations of Foundation Models retweeted
It was a really fun @icmlconf workshop with amazing speakers, panelists, poster presentations, and a highly engaged audience! @tf2m_workshop
Join us for the Workshop on
Theoretical Foundations of Foundation Models @icmlconf tomorrow!
We have a fantastic list of invited speakers:
- @th33rtha
- @DAlistarh
- @jasondeanlee
- @kamalikac
- @tydsh
1/3
Theoretical Foundations of Foundation Models retweeted
It was very fun participating in the @tf2m_workshop. A big thanks to the organizers @BerivanISIK @SZiteng @BanghuaZ Enric Boix-Adsera Merve Gurel Bo Li @abeirami @sanmikoyejo!
It was a really fun @icmlconf workshop with amazing speakers, panelists, poster presentations, and a highly engaged audience! @tf2m_workshop
Theoretical Foundations of Foundation Models retweeted
Missed the speaker dinner but the panel at the Theoretical Foundations of Foundation Models @tf2m_workshop at #ICML2024 was a blast.. Particularly liked the audience question about the implications of Benchmark culture in LLM evaluations..
It was a really fun @icmlconf workshop with amazing speakers, panelists, poster presentations, and a highly engaged audience! @tf2m_workshop
Theoretical Foundations of Foundation Models retweeted
Thanks for inviting me! @tf2m_workshop I am surprised to see a large audience for an invited talk in the theoretical workshop! Maybe it is time to understand the models better in addition to blindly scaling up.
Join us for the Workshop on
Theoretical Foundations of Foundation Models @icmlconf tomorrow!
We have a fantastic list of invited speakers:
- @th33rtha
- @DAlistarh
- @jasondeanlee
- @kamalikac
- @tydsh
1/3
Theoretical Foundations of Foundation Models retweeted
Excited and honored that our new work on token-level generalization bounds for LLMs won a Best Paper Award @tf2m_workshop at ICML!
We investigate generalization in LLMs, e.g., memorization vs. reasoning, through compression bounds at the LLaMA2-70B scale.
A 🧵, 1/8
Theoretical Foundations of Foundation Models retweeted
Kamalika Chaudhuri’s talk is happening now in Straus 2! @kamalikac @tf2m_workshop
Theoretical Foundations of Foundation Models retweeted
A small sample of ICML Workshop (@GRaM_org_ @tf2m_workshop) presentations by Shiye, @kpetrovvic and @fedzbar -- great job all! 🚀
I also contributed a bit but have no pics so far 👀
Theoretical Foundations of Foundation Models retweeted
"The great ICML poster bingo" makes a triumphant return on the last day of #ICML2024 🎲
Six posters, three workshops (@GRaM_org_, @DMLRWorkshop, @tf2m_workshop) and this time I don't have to present three at once 😅 Hope to see you there for some of them!
More details below! 🧵
Theoretical Foundations of Foundation Models retweeted
Join us at TF2M workshop at Strauss 2 with an amazing lineup of speakers and panelists!
Theoretical Foundations of Foundation Models retweeted
We will be presenting this work tomorrow at the @tf2m_workshop in Vienna. Please feel free to come check it out or to DM/email me if interested. Looking forward to it!
Tagging co-authors that are on this app :) @AndreaBanino @_joaogui1 @PetarV_93
👓 👓 👓
Transformers need glasses! 👓
Read on to see how we expose fundamental weaknesses of decoder-only Transformers on important tasks (e.g. copying & counting) + simple ways to make things a bit easier on the Transformer :)
Work led by @fedzbar for his @GoogleDeepMind placement!
Join us for the Workshop on
Theoretical Foundations of Foundation Models @icmlconf tomorrow!
We have a fantastic list of invited speakers:
- @th33rtha
- @DAlistarh
- @jasondeanlee
- @kamalikac
- @tydsh
1/3
A panel discussion on theoretical approaches to efficiency, responsibility, and principled understanding of foundation models, with excellent panelists:
- @th33rtha
- @rzshokri
- @rao2z
- @tomgoldsteincs
- @tydsh
2/3
1
5
598
Two poster sessions with 58 amazing papers and 4 contributed talks! See the list of accepted papers: openreview.net/group?id=ICML…
3/3
Theoretical Foundations of Foundation Models retweeted
Check out our TF2M workshop on Sunday with an amazing list of speakers, panelists, and contributed works: sites.google.com/view/tf2m/s….
The program includes invited talks from
- Ananda Theertha Suresh @th33rtha (Google Research)
- Dan Alistarh @DAlistarh (IST Austria)
- Jason Lee @jasondeanlee (Princeton)
- Kamalika Chaudhuri @kamalikac (UCSD & Meta)
- Yuandong Tian @tydsh (Meta)
Theoretical Foundations of Foundation Models retweeted
Also giving a contributed talk on the learning-theoretic complexity and optimality of ICL at the @tf2m_workshop happy to share our results with the ML theory and LLM community!
Excited to give an oral presentation at #ICML2024 on Tuesday from 4:30 PM (2E Attention, Straus 1-3) on the loss landscape and optimization dynamics of Transformers for in-context learning from a mean-field & feature learning perspective!
Theoretical Foundations of Foundation Models retweeted
📢 Excited to share our work "Active Preference Optimization for Sample Efficient RLHF" accepted at #ICML2024 Theoretical Foundations of Foundation Models (@tf2m_workshop) Workshop! Joint work with @Sayakrayc @SOURADIPCHAKR18 @aldopacchiano
arxiv.org/pdf/2402.10500
🧵(1/6)
ALT Title, Author and Abstract
Theoretical Foundations of Foundation Models retweeted
Check out the list of accepted papers and program for our @icmlconf workshop @tf2m_workshop:
sites.google.com/view/tf2m/s…
We are excited to announce that 58 excellent papers will be presented at the @icmlconf TF2M Workshop. List of accepted papers: openreview.net/group?id=ICML…
You can find the detailed schedule on our website (and below 👇): sites.google.com/view/tf2m
We are excited to announce that 58 excellent papers will be presented at the @icmlconf TF2M Workshop. List of accepted papers: openreview.net/group?id=ICML…
You can find the detailed schedule on our website (and below 👇): sites.google.com/view/tf2m
And a panel discussion on theoretical approaches to efficiency, responsibility, and principled foundations of foundation models.
1
283
Grateful for the generous sponsorship by @GoogleAI 🙏
254