Doing his best Sygyt throat singing… added vocal fold modeling / hat
my vocal synth models the vocal tract as a network of branching acoustic tubes, unlike vocaloid which stitches together and pitch-shifts phoneme recordings. still working on improving naturalness by tuning it against recordings of real singers, but I'm already impressed at how cool it sounds!
1
211
The problem with chasing “feels like talking to a person”… say I present you with two audio clips.
One is a cheerful human sounding voice, one is a bored, apathetic, disinterested voice.
Which is more like talking to a person? What about a person you would want to talk to?
We believe voice is the most natural way to interact with intelligence, so we created Dessa, the most authentic full-duplex speech model ever built. Talking with it feels like talking with a person…full of emotion, nuance, pauses, and a natural cadence.
block.xyz/dessa
Most would say, “I don’t think a robot would choose to sound apathetic and kind of dumb, so this feels more like talking to a person, I guess”
Do that enough times and you have clear data showing how human like it is to sound low energy and disinterested. OpenAI did the same.
185
The biggest problem with AI movies: BAD ACTING
You get “okay” performances even with the best prompt. Uncanny valley stuff
With this workflow, we are one step closer to COMPLETE physical and vocal acting transfer to a character.
No blender required. Kling 3, Seedance 2.5
You can find the workflow in my last post, BUT…
One thing that is easy to miss: set your phone / camera to film at the same frame rate as your final movie (probably 24) or you will end up with some frame issues. You can see that here before she counts down. There’s a weird frame jump from all the frame rate conversions through the process
1
487
Step 3: use Kling 3.0 motion control to swap the motion. Select use the background from the image.
Step 4: use Seedance 2.5 edit to change the audio of her voice. This is the weakest link in this workflow and there is probably a better way. The goal, though, is to keep the IDENTICAL acting delivery, emotion, inflection, timing, etc
1
65









