Forward Deployed Engineering @openai 🇺🇸🇯🇵🇫🇷
Joined June 2020
- Tweets218
- Following886
- Followers328
- Likes345
Sam Passaglia retweeted
A very good visualization about how more compute can be used to improve solutions on very hard problems!
One of the coolest things about our FDE team is that we get to work side by side with Research on frontier problems. Today we’re announcing a new partnership with Mazda that shows what this looks like in automotive engineering.
Working with Mazda’s aerodynamics engineers, our FDEs used Astra in Codex to build and simulate dozens of variations on the nose of a car. We're excited about the potential applications for LLMs driving these kind of optimizations in manufacuturing, supply chain and more - if you've got these kind of problems, we'd love to hear from you!
Read on here: openai.com/index/acceleratin…
Sam Passaglia retweeted
One of the coolest things about our FDE team is that we get to work side by side with Research on frontier problems. Today we’re announcing a new partnership with Mazda that shows what this looks like in automotive engineering.
Working with Mazda’s aerodynamics engineers, our FDEs used Astra in Codex to build and simulate dozens of variations on the nose of a car. We're excited about the potential applications for LLMs driving these kind of optimizations in manufacuturing, supply chain and more - if you've got these kind of problems, we'd love to hear from you!
Read on here: openai.com/index/acceleratin…
Sam Passaglia retweeted
We’re also working with engineers at Chip Ganassi Racing to turn 3D scans into editable CAD models and manufacturing drawings, and with Mazda to explore new vehicle designs through simulation.
Engineers review the outputs and help identify where the models need to improve.
Sam Passaglia retweeted
ChatGPT and Codex are helping engineers build for the physical world.
We’re sharing our progress across mechanical design, electrical engineering, and simulation—from helping our hardware teams iterate faster to testing new workflows with industry collaborators.
Sam Passaglia retweeted
今回はOpenAIのFDEの方と色々話せたことが1番学びになりました
一般的なCodexでは出来ないことの課題を解決する1番難しいところにチャレンジされてる
#OpenAIDevDayExchange
Sam Passaglia retweeted
Had so much fun hosting this panel “Is Scale Enough?” on Algorithms Day for the Open Problems for AI Summit in Tokyo 🇯🇵 with @kaixhin @EmtiyazKhan @jad_tarifi @SamPassaglia Masanori Koyama 🤖 we discussed definitions of AGI, and how we can advance algorithmic research 🚀
Sam Passaglia retweeted
日英4.4T tokensで学習した日本語ModernBERTを公開しました！！
系列長8192、語彙数は日英10万、パラメータ数130Mながら既存largeモデルと同等以上の性能があります
12データセットによる既存BERT系モデルの網羅的な評価も行いましたので、そちらもぜひ！！
Sam Passaglia retweeted
LLM-jp Chatbot Arena を公開しました。
chatbot-arena.apps.llmc.nii.…
LLM-jp-3 172Bを含む計10モデルと会話できます。収集したデータは LLM-jp から公開予定です。
2/11 (火) 9:00 までの稼働を予定しています。短い期間ですが、ぜひお試しください。
New Differential Transformer paper (@ytz2024 ++) is really cool: they make attention heads differential, computing two attention maps per input and subtracting them.
This improves performance by cancelling out noise, like a humbucking guitar.
arxiv.org/abs/2410.05258
I had such a blast at @tokyoaijp's NLP session last night hearing from our 4 amazing speakers, @lhl @ayase_lab @ayaniwa1213 @loem_ms, and speaking to the ~100 attendees!
Now I'm pumped to organize more events with @kaixhin and @ikulyatin in the future :)
Sam Passaglia retweeted
7th August is our 3rd TAI AAI (@tokyoaijp Advanced AI) session, focused on NLP. Come listen to researchers and engineers from the top Japanese labs presenting their work on LLMs.
Apply to attend: lu.ma/iiu09leb
Organizers: @kaixhin and @SamPassaglia
My team at Elyza has been selected by the Japanese government to receive a major supercomputer grant to develop foundation models!
Excited to put these GPUs to work :)
【お知らせ】経済産業省が立ち上げた「GENIAC」のもと、NEDOが公募した「競争力ある生成AI基盤モデルの開発（助成）」に、ELYZAが採択されたことをお知らせいたします。当社では本採択を受け、日本語処理能力の高いモデル構築に取り組んでまいります。
prtimes.jp/main/html/rd/p/00…
Sam Passaglia retweeted
Today we announced our plans to deepen our investments in Japan, spanning cloud and AI infrastructure, skilling, research, and cybersecurity, as we continue partnering to accelerate the country's AI transformation.
In 1978, @Microsoft made Tokyo its first international office. Today, alongside Japanese Prime Minister Fumio Kishida, we announced a $2.9 billion investment over 2 years to boost our cloud computing and #AI infrastructure, a commitment to innovation and growth with Japan. news.microsoft.com/apac/2024…
Sam Passaglia retweeted
【お知らせ】700億パラメータの日本語LLMを開発し、グローバルモデルに匹敵する性能を達成しました。本モデルを含むモデル群を「ELYZA LLM for JP」シリーズとして順次サービス提供を開始します。
まずはデモサイトで性能をお試しください。
elyza.ai/lp/elyza-llm-for-jp
If you're in Kobe attending NLP 2024, come visit me at ELYZA's booth all week! We have cute stickers.
Sam Passaglia retweeted
So big announcement: thanks to the generous support from @huggingface I am releasing the early modern ChatGPT, MonadGPT huggingface.co/spaces/Pclang…
Any question in English or French will be answered from the perspective of someone living between 1500 and 1750.
Sam Passaglia retweeted
Biden's AI Executive Order is out and it’s terrible for US innovation.
Here are some of the new obligations, which only large incumbents will be able to comply with 👇
A new article for Nature by @robotopia discusses the race to develop home-grown LLMs in Japan! 🐪 There's even a couple quotes from me discussing Rakuda.
nature.com/articles/d41586-0…
Sam Passaglia retweeted
@SamPassaglia We use your Rakuda Benchmark in our blog (written in Japanese.)
Thank you!
先日OSSとして公開した36億・17億パラメータの日本語言語モデル(LLM)をInstruction Tuningで対話性能を向上させたモデルを公開しました！transformersライブラリから利用可能です。
出力例や使い方、性能評価についてLINE Engineering Blogで紹介していますのでご覧ください。
engineering.linecorp.com/ja/…
