- Posts: 2
- Thank you received: 0
3 Post Moderation Rule for New Boarders (25 Jan 2021)
New boarders will have their posts moderated - Don't worry if you cannot see your post immediately.
isolating lips from lip-sync video?
29 Jan 2017 00:27 #85284
by el.kogan
isolating lips from lip-sync video? was created by el.kogan
Greetings, does anyone have tips on how to isolating lips from lip-sync video?
Final goal: is to isolate the pair of lips and delete the rest of the video so that I can apply the lips to a different background-Preferably the isolation would be hard edge cut with an option to increase surface area so it blurs a bit into the surrounding skin.
I have tried so many motion tracking techniques its making my head spin, all of them end up losing track and leaving me to do very slow progress in individual frames
Here is a video of what I'm working with...
I'm thinking of doing a rerecording this time around by either-
0) asking model to keep face completely still this time
1)Painting the skin around lips green
2)putting small stickers on lips to use as anchors for motion tracking (but then how do I remove these stickers post production for smooth lip color?)
I think the reason why none of these motion trackers or tutorials on it have worked is because the lips (when producing speech) is an object that morphs in all kind of strange ways that usual motion tracking application doesn't.
Thank you for your time!
Final goal: is to isolate the pair of lips and delete the rest of the video so that I can apply the lips to a different background-Preferably the isolation would be hard edge cut with an option to increase surface area so it blurs a bit into the surrounding skin.
I have tried so many motion tracking techniques its making my head spin, all of them end up losing track and leaving me to do very slow progress in individual frames
Here is a video of what I'm working with...
I'm thinking of doing a rerecording this time around by either-
0) asking model to keep face completely still this time
1)Painting the skin around lips green
2)putting small stickers on lips to use as anchors for motion tracking (but then how do I remove these stickers post production for smooth lip color?)
I think the reason why none of these motion trackers or tutorials on it have worked is because the lips (when producing speech) is an object that morphs in all kind of strange ways that usual motion tracking application doesn't.
Thank you for your time!
Please Log in to join the conversation.
- Karsten Schlüter
-
- Offline
- Moderator
-
Less
More
- Posts: 3790
- Thank you received: 718
29 Jan 2017 04:04 #85288
by Karsten Schlüter
Replied by Karsten Schlüter on topic isolating lips from lip-sync video?
Welcome, El, to fcp.co 
… your video is set to 'private' = doesn't show up here, but by your description I guess you like to accomplish what's known as "Annoying Orange" effect? (they haven't invented it, but most popular)
A Frequently asked question, e.g. here
www.fcp.co/fcp-forum/4-final-cut-pro-x-f...image-overlays#74145
Just 'feather' the mask, adjust colours,, and no green needed. Concerning tracking: red lips in a face are excellent to track, just make the track-area bigger …
Tricky: turning heads … as long as you don't have a real 3D Planar Tracker (Mocha+AE) you have to do that manually, a few keyframes?
If you're in full-control of that project, record mouth (and eyes) with a rocket solid position… simplifies workflow.
… your video is set to 'private' = doesn't show up here, but by your description I guess you like to accomplish what's known as "Annoying Orange" effect? (they haven't invented it, but most popular)
A Frequently asked question, e.g. here
www.fcp.co/fcp-forum/4-final-cut-pro-x-f...image-overlays#74145
Just 'feather' the mask, adjust colours,, and no green needed. Concerning tracking: red lips in a face are excellent to track, just make the track-area bigger …
Tricky: turning heads … as long as you don't have a real 3D Planar Tracker (Mocha+AE) you have to do that manually, a few keyframes?
If you're in full-control of that project, record mouth (and eyes) with a rocket solid position… simplifies workflow.
Please Log in to join the conversation.
29 Jan 2017 20:02 #85292
by JoeEditor
Replied by JoeEditor on topic isolating lips from lip-sync video?
Like the opening to Rocky Horror Picture Show. I worked with a gal who used this technique in a short film some years ago.
Face paint the actor with chrome key green. Key it. Fast, easy, cheap.
Lips move in such complex ways so much, tracking would still be a lot of time and work.
And yes, the video you link to is set to Private, as mentioned, and does us no good.
As for the Annoying Orange, I did this free tutorial some time back. Bear in mind there's more than one way to skin this cat, so to speak.
www.macprovideo.com/hub/motion/creating-...nge-effect-in-motion
Face paint the actor with chrome key green. Key it. Fast, easy, cheap.
Lips move in such complex ways so much, tracking would still be a lot of time and work.
And yes, the video you link to is set to Private, as mentioned, and does us no good.
As for the Annoying Orange, I did this free tutorial some time back. Bear in mind there's more than one way to skin this cat, so to speak.
www.macprovideo.com/hub/motion/creating-...nge-effect-in-motion
Please Log in to join the conversation.


