Workshop on Theoretical Foundations of Foundation Models @icmlconf 2024.
Vienna
Joined April 2024
- Tweets38
- Following18
- Followers256
- Likes29
Theoretical Foundations of Foundation Models retweeted
It was a really fun @icmlconf workshop with amazing speakers, panelists, poster presentations, and a highly engaged audience! @tf2m_workshop
Join us for the Workshop on
Theoretical Foundations of Foundation Models @icmlconf tomorrow!
We have a fantastic list of invited speakers:
- @th33rtha
- @DAlistarh
- @jasondeanlee
- @kamalikac
- @tydsh
1/3
Theoretical Foundations of Foundation Models retweeted
It was very fun participating in the @tf2m_workshop. A big thanks to the organizers @BerivanISIK @SZiteng @BanghuaZ Enric Boix-Adsera Merve Gurel Bo Li @abeirami @sanmikoyejo!
It was a really fun @icmlconf workshop with amazing speakers, panelists, poster presentations, and a highly engaged audience! @tf2m_workshop
Theoretical Foundations of Foundation Models retweeted
Missed the speaker dinner but the panel at the Theoretical Foundations of Foundation Models @tf2m_workshop at #ICML2024 was a blast.. Particularly liked the audience question about the implications of Benchmark culture in LLM evaluations..
It was a really fun @icmlconf workshop with amazing speakers, panelists, poster presentations, and a highly engaged audience! @tf2m_workshop
Theoretical Foundations of Foundation Models retweeted
Thanks for inviting me! @tf2m_workshop I am surprised to see a large audience for an invited talk in the theoretical workshop! Maybe it is time to understand the models better in addition to blindly scaling up.
Join us for the Workshop on
Theoretical Foundations of Foundation Models @icmlconf tomorrow!
We have a fantastic list of invited speakers:
- @th33rtha
- @DAlistarh
- @jasondeanlee
- @kamalikac
- @tydsh
1/3
Theoretical Foundations of Foundation Models retweeted
Excited and honored that our new work on token-level generalization bounds for LLMs won a Best Paper Award @tf2m_workshop at ICML!
We investigate generalization in LLMs, e.g., memorization vs. reasoning, through compression bounds at the LLaMA2-70B scale.
A 🧵, 1/8
Theoretical Foundations of Foundation Models retweeted
Kamalika Chaudhuri’s talk is happening now in Straus 2! @kamalikac @tf2m_workshop
Theoretical Foundations of Foundation Models retweeted
A small sample of ICML Workshop (@GRaM_org_ @tf2m_workshop) presentations by Shiye, @kpetrovvic and @fedzbar -- great job all! 🚀
I also contributed a bit but have no pics so far 👀
Theoretical Foundations of Foundation Models retweeted
"The great ICML poster bingo" makes a triumphant return on the last day of #ICML2024 🎲
Six posters, three workshops (@GRaM_org_, @DMLRWorkshop, @tf2m_workshop) and this time I don't have to present three at once 😅 Hope to see you there for some of them!
More details below! 🧵
Theoretical Foundations of Foundation Models retweeted
Join us at TF2M workshop at Strauss 2 with an amazing lineup of speakers and panelists!
Theoretical Foundations of Foundation Models retweeted
We will be presenting this work tomorrow at the @tf2m_workshop in Vienna. Please feel free to come check it out or to DM/email me if interested. Looking forward to it!
Tagging co-authors that are on this app :) @AndreaBanino @_joaogui1 @PetarV_93
👓 👓 👓
Transformers need glasses! 👓
Read on to see how we expose fundamental weaknesses of decoder-only Transformers on important tasks (e.g. copying & counting) + simple ways to make things a bit easier on the Transformer :)
Work led by @fedzbar for his @GoogleDeepMind placement!
Theoretical Foundations of Foundation Models retweeted
Check out our TF2M workshop on Sunday with an amazing list of speakers, panelists, and contributed works: sites.google.com/view/tf2m/s….
The program includes invited talks from
- Ananda Theertha Suresh @th33rtha (Google Research)
- Dan Alistarh @DAlistarh (IST Austria)
- Jason Lee @jasondeanlee (Princeton)
- Kamalika Chaudhuri @kamalikac (UCSD & Meta)
- Yuandong Tian @tydsh (Meta)
Theoretical Foundations of Foundation Models retweeted
Also giving a contributed talk on the learning-theoretic complexity and optimality of ICL at the @tf2m_workshop happy to share our results with the ML theory and LLM community!
Excited to give an oral presentation at #ICML2024 on Tuesday from 4:30 PM (2E Attention, Straus 1-3) on the loss landscape and optimization dynamics of Transformers for in-context learning from a mean-field & feature learning perspective!
Theoretical Foundations of Foundation Models retweeted
📢 Excited to share our work "Active Preference Optimization for Sample Efficient RLHF" accepted at #ICML2024 Theoretical Foundations of Foundation Models (@tf2m_workshop) Workshop! Joint work with @Sayakrayc @SOURADIPCHAKR18 @aldopacchiano
arxiv.org/pdf/2402.10500
🧵(1/6)
ALT Title, Author and Abstract
Theoretical Foundations of Foundation Models retweeted
Check out the list of accepted papers and program for our @icmlconf workshop @tf2m_workshop:
sites.google.com/view/tf2m/s…
We are excited to announce that 58 excellent papers will be presented at the @icmlconf TF2M Workshop. List of accepted papers: openreview.net/group?id=ICML…
You can find the detailed schedule on our website (and below 👇): sites.google.com/view/tf2m
Theoretical Foundations of Foundation Models retweeted
Why do LLMs fail simple completion tasks, but not on a harder task?
Learn about tokenization bias in LLMs and how to fix it by compute exact string probability! arxiv.org/pdf/2406.16829
work w/@HavasiMarton @mattmucklm @karen_ullrich accepted in @tf2m_workshop, ICML2024
(1/4)
Theoretical Foundations of Foundation Models retweeted
Submission due within one week!
🚨 Submissions due on May 29! 🚨
Do you have exciting work on efficient & responsible foundation models or the principled foundations of large models? Submit your work now!
We welcome submissions of work recently published or currently under review at other ML venues. @icmlconf
Theoretical Foundations of Foundation Models retweeted
Submit your #neurips2024 submissions by May 29!
Submit your work by May 29!
We welcome submissions on efficient & responsible foundation models and the principled foundations of large models.
CfP: sites.google.com/view/tf2m/c……
See you in Vienna in July @icmlconf!
Theoretical Foundations of Foundation Models retweeted
Submit your work by May 29!
We welcome submissions on efficient & responsible foundation models and the principled foundations of large models.
CfP: sites.google.com/view/tf2m/c……
See you in Vienna in July @icmlconf!
🚨 Submissions due on May 29! 🚨
Do you have exciting work on efficient & responsible foundation models or the principled foundations of large models? Submit your work now!
We welcome submissions of work recently published or currently under review at other ML venues. @icmlconf
Theoretical Foundations of Foundation Models retweeted
Paper submission & reviewer volunteer form are open!
We welcome submissions that make theoretical contributions to efficiency, responsibility, and principled understanding of foundation models. For more details, check out our call for papers: sites.google.com/view/tf2m/c…
Deadline: May 22nd.
1/2
