fbpx
3 Post Moderation Rule for New Boarders (25 Jan 2021)

New boarders will have their posts moderated - Don't worry if you cannot see your post immediately.

isolating lips from lip-sync video?

More
29 Jan 2017 00:27 #85284 by el.kogan
Greetings, does anyone have tips on how to isolating lips from lip-sync video?
Final goal: is to isolate the pair of lips and delete the rest of the video so that I can apply the lips to a different background-Preferably the isolation would be hard edge cut with an option to increase surface area so it blurs a bit into the surrounding skin.

I have tried so many motion tracking techniques its making my head spin, all of them end up losing track and leaving me to do very slow progress in individual frames

Here is a video of what I'm working with...


I'm thinking of doing a rerecording this time around by either-
0) asking model to keep face completely still this time
1)Painting the skin around lips green
2)putting small stickers on lips to use as anchors for motion tracking (but then how do I remove these stickers post production for smooth lip color?)

I think the reason why none of these motion trackers or tutorials on it have worked is because the lips (when producing speech) is an object that morphs in all kind of strange ways that usual motion tracking application doesn't.

Thank you for your time!

Please Log in to join the conversation.

More
29 Jan 2017 04:04 #85288 by Karsten Schlüter
Welcome, El, to fcp.co :)

… your video is set to 'private' = doesn't show up here, but by your description I guess you like to accomplish what's known as "Annoying Orange" effect? (they haven't invented it, but most popular)

A Frequently asked question, e.g. here
www.fcp.co/fcp-forum/4-final-cut-pro-x-f...image-overlays#74145

Just 'feather' the mask, adjust colours,, and no green needed. Concerning tracking: red lips in a face are excellent to track, just make the track-area bigger …

Tricky: turning heads … as long as you don't have a real 3D Planar Tracker (Mocha+AE) you have to do that manually, a few keyframes?

If you're in full-control of that project, record mouth (and eyes) with a rocket solid position… simplifies workflow.

Please Log in to join the conversation.

More
29 Jan 2017 20:02 #85292 by JoeEditor
Like the opening to Rocky Horror Picture Show. I worked with a gal who used this technique in a short film some years ago.

Face paint the actor with chrome key green. Key it. Fast, easy, cheap.

Lips move in such complex ways so much, tracking would still be a lot of time and work.

And yes, the video you link to is set to Private, as mentioned, and does us no good.

As for the Annoying Orange, I did this free tutorial some time back. Bear in mind there's more than one way to skin this cat, so to speak.
www.macprovideo.com/hub/motion/creating-...nge-effect-in-motion

Please Log in to join the conversation.