For a change, a non-lua question (@AFRLme can rest for once) :-P
It's more of a "what has worked for you" kind of a question - I finished drawing a few frames for an animated sequence (realtime, not rendered), and thought I should dump them inside VS and reconstruct the sequence.
But then I realized that timing the frames to the music is a daunting task that I'm not sure how to approach efficiently. I've done it with video in the past, but in VS you don't have a timeline where you can preview the result . How would you people tackle the whole audio to character animation-timing thing?
Here's an example
you have a 10-30sec sequence that you wish to create. The music will be rather theatrical like in the loney tunes/tom&jerry era, reflecting and following the pace/beats of the action on the screen. For the fun of it assume the following one:
«The main character is standing in a dark alley. carefully looks around for hostiles. Slowly opens his trench coat, searches for a while and violently pulls out a smelly shark. He starts saking it around in an uncontrollable fashion. With all the noise, Furious cats jump out of the garbage cans and disappear in all directions. Now it's quiet again, silent. The main character is alone in the scene. He turns towards the camera and says "run pigeons, run: it's Robert Frost"»
I suppose one could either create the music after drawing the sequence but more often than not, the music is already made and you have to time the animation to the music. Don't you agree? Would you precompose the animation/audio in some program like premiere/aftereffects where you can stretch the video and redraw new frames where needed? Until you have the final results that is beat-perfect in your hands before moving to VS to have it replicated? Or would you jump directly inside VS? It seems that you cannot properly preview the animation speed inside the editor, so you have to run the game for that. Would you run the game again and again tweeking frame pauses until you get it right?
So far I've thought of breaking down my sequence into smaller segments, that are linked by a few repeatable frames. For instance the segments of looking around, searching inside his trench coat, shaking the shark and standing silently, could each be looped n-times; as many times needed to have the visuals synchronize to the audio.
But is that all there is?
Any good ideas/tips for syncing the music?