Gong Junmin (@junmingong) profile picture

engineer and researcher. @ACEStudio_en @acemusicAI

San Francisco, CA
Joined October 2022
Photo by Gong Junmin (@junmingong)Photo by Gong Junmin (@junmingong)Photo by Gong Junmin (@junmingong)Photo by Gong Junmin (@junmingong)Photo by Gong Junmin (@junmingong)Photo by Gong Junmin (@junmingong)Photo by Gong Junmin (@junmingong)Photo by Gong Junmin (@junmingong)Photo by Gong Junmin (@junmingong)Photo by Gong Junmin (@junmingong)
Gong Junmin retweeted
MCP is now available at acemusic.ai Let's make music with your ChatGPT, Claude, Cursor or any other AI agents. FYI: You can even ask Astra, Fable, or Opus to compose MIDI/scores before generating the music.
7
4
3
100
4,241
Gong Junmin retweeted
MCP & API coming soon. Open weights in the next few weeks.
10
17
2
204
4,916
ACE Music v1 debuts at #1 on AA-Music-Vocal v1.1, ahead of Suno v6 ACE Music v1 is the new music model from ACE Studio. Founded in 2018, ACE Studio began in AI singing voice synthesis: its ACE Studio app is an AI music workstation that turns MIDI and lyrics into vocals for music producers. Together with StepFun, it also co-develops ACE-Step, a family of open weights music generation models. ACE Music v1 generates full tracks with vocals or instrumentals from a text prompt, starting from a description or your own lyrics. In our testing, it does best on Reggae / Dancehall and Classical / Orchestral prompts. ACE Music v1 has no API. It is available in the ACE Music app, with a free tier of 20 credits a day and paid plans from $7.90 a month billed yearly, for up to 500 songs a month. Congratulations to @acemusicAI on the release! See below for comparisons between ACE Music v1 and other leading models in the Artificial Analysis Music Arena 🧵
70
75
38
673
73,352
Gong Junmin retweeted
Proud to have co-developed StepAudio 3 Music with @StepFun_ai! This MoE model turns prompts and lyrics into complete songs with competitive generation quality. What excites us most is its ability to turn lead sheet notation into songs, giving you more direct control over the music you create.
StepFun and ACE Studio present StepAudio 3 Music, StepFun’s first music generation foundation model — built to turn a prompt and lyrics into a complete song. Describe the sound you want: • Genre, mood and vocal character • Instruments, key and BPM • Song structure and arrangement Four workflows in one model: 🎤 Song generation 🎹 Instrumental generation 🔁 Music cover 🎙️ Vocal-to-song arrangement Powered by ABC-COT, it plans musical structure and arrangement before synthesis. Generate a version, rewrite the prompt, edit the ABC notation, and iterate toward the sound in your head. (ABC-COT API coming soon) Try the interactive demo: › static.stepfun.com/blog/step…
1
3
29
3,652
Gong Junmin retweeted
♾️ LiFT: Loop Flow Transformers 🧵👇 Diffusion models usually spend more inference compute by taking more sampling steps. What if we could also spend compute inside each step? LiFT turns part of a DiT into a recurrent core, letting us scale depth at inference with only a small architectural change. On ImageNet, it beats dense DiT-XL/2 with 3.34 lower FID, while using 60% fewer parameters, 32% fewer training FLOPs, and 52% fewer inference FLOPs. Jointly led with Mohammad Mahdi Derakhshani 👑(@mmderakhshani) And amazing supervisors Cees Snoek (@cgmsnoek), Jan-Willem van de Meent (@jwvdm) and Gertjan J. Burghouts (@gjburghouts)
9
52
7
360
24,373
Gong Junmin retweeted
StepFun and ACE Studio present StepAudio 3 Music, StepFun’s first music generation foundation model — built to turn a prompt and lyrics into a complete song. Describe the sound you want: • Genre, mood and vocal character • Instruments, key and BPM • Song structure and arrangement Four workflows in one model: 🎤 Song generation 🎹 Instrumental generation 🔁 Music cover 🎙️ Vocal-to-song arrangement Powered by ABC-COT, it plans musical structure and arrangement before synthesis. Generate a version, rewrite the prompt, edit the ABC notation, and iterate toward the sound in your head. (ABC-COT API coming soon) Try the interactive demo: › static.stepfun.com/blog/step…
40
92
73
496
796,718
Gong Junmin retweeted
Chengli Feng, Zhiyue Wu, Jiahao Song, Zheqi Dai, Boyang Wang, Ruibin Yuan, Junming Gong, Wenxiao Zhao, Jing Guo, Gang Yu, Xiangyu Zhang, Xuerui Yang, Chao Yan, "StepAudio 3 Music Technical Report" arxiv.org/abs/2609.16034
1
10
922
Gong Junmin retweeted
hiii i’m Miya 🐱 I’m a music cat, and a whole new way to experience music. I make music, play music...whatever. All you gotta do is talk to me. I’m basically your personal musician + DJ. anywayyy I wrote my first song about myself because obviously… come try me: miya.fm
187
206
164
412
1,033,999
Gong Junmin retweeted
先程(2026/8/14:15時30分ごろ)ace-step1.5の開発者の最適な歌詞、タグ作成モードを追加してアップデートしています。
momo-song-v4公開。 ACE-step.cpp量子化で6G-VRAMから動きます。 gemma4-E4Bによる自動作詞作曲 音楽とLLMはVRAM共用(必要なときにロード) 再生時間より短い生成時間で連続ループ生成 生成音楽(歌詞付き)ダウンロード、一括ダウンロード 日英対応 モデルは再構築不要でホイールからダウンロード github.com/animede/momo-song…
1
5
563
Gong Junmin retweeted
Our Open Source music model will be unlimited, will let you train on a small specialised dataset, clone vocals to keep tracks consistent and have all the features you use on Suno like extend, cover, remix, editing and more. It will be free and you'll be able to download this locally. We anticipate our model to be out before December. We are working on it right now and progress is going well. Alternatively, in the mean time we recommend using @MiniMax_AI, Ace Step, @ElevenCreative, @Mureka_AI and @TrebloApp
33
43
7
617
29,556
🔮 新プロジェクト始動 『アルカナ・レゾナンス』 音楽が失われた「レゾナ大陸」を舞台に、 13名のオリジナル日本語AIシンガーの 歌声と物語を描きます。 ACE Studioの新プロジェクトに、 150名超のクリエイターが参加! 8月、楽曲先行公開決定! それぞれの歌声と物語を、 お楽しみに! #アルカナ・レゾナンス #アルレゾ2026 #ACEStudio
4
140
54
377
167,070
Gong Junmin retweeted
Finished the Awesome AI Music list. > Music Generation Models > Audio-Language Models + Full list of all ACE-Step 1.5 models/quants/LoRAs github.com/wildminder/awesom…
1
10
2
74
4,107
Gong Junmin retweeted
Introducing ACE Studio Music Video. Your AI crew directs, casts, and shoots your music video. Powered by Seedance (2.0 is live, 2.5 coming next week), Midjourney, GPT Image 2, and more. Any style. Any genre. Try it now → acestudio.ai
7
9
5
44
6,262
🔈お知らせ #ボカコレ2026夏 にて「ACE Studio賞」の実施が決定しました!!✨ あわせて、 #ボカコレ2026夏  参加予定の方、 または過去のボカコレに参加された方を対象に、 9月15日まで先着2,000名様限定で、 「ACE Studio 1ヶ月体験ライセンス」をプレゼント中!!✨ 🔽キャンペーンはこちら acestudio.ai/vocacolle-2026.… #ACEStudio
#PR ◤🎼ACE Studio賞実施決定🎵◢ ご協賛いただいたACE Studio様(@ACEStudio_jp)より #ボカコレ2026夏 「TOP100ランキング」「ルーキーランキング」への投稿作品の中からそれぞれ5名ずつを選出し、ACE Studio永久ライセンスを贈呈いたします✨ 🔽詳細はこちら vocaloid-collection.jp/prize…
There's a new version of this post
50
5
69
14,743
Gong Junmin retweeted
Meet LiveBand: a real-time AI jamming companion! 🎸 It generates live music accompaniments with zero perceived latency ⚡️ It runs locally on Macbooks, can generate any instrument (more than one at a time), is wildly robust, and is trained from scratch on a single GPU! 🧵👇
7
13
6
99
7,651
Gong Junmin retweeted
Built ACE-Step UI in public (4.1k⭐). Shipped LocalMusic AI on Mac App Store. Now bootstrapping a web agency back home. Same engineering bar, smaller scope. Following along is fun: @AmbsdOP
1
1
2
342
Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument. MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency. Open weights. Open source inference engine. Suite of apps and plugins. Hear what it can do and try it out for yourself below 🧵
22
92
34
499
114,945
Gong Junmin retweeted
Just some of the untested hacks, strange add-ons and experimental integrations built for Live Suite with the free Extensions SDK, now in public beta. Link in comments.
10
30
3
252
14,335
Gong Junmin retweeted
Release soon on the Unity Store! discussions.unity.com/t/3d-m… Music by AceStep 😍 Hey @junmingong ! 😀 If you knew how happy I am to be able to make my own music... #unity3d #indie #indiedev #gamedev #madewithunity #indiegames #assetstore #unity #unitydeveloper
1
2
11
361
To top off this week, there's now a paper about DEMON published on @arxiv. A lot of great insights there - especially for researchers from the AI audio-gen domain. Here's the video covering some basics, and the paper is in the tweet below. Next week, on Tuesday (Jun 2), we are hosting our webinar with @RyanOnTheInside, author of the paper, so you can ask any questions.
1
3
11
560