fbpx
3 Post Moderation Rule for New Boarders (25 Jan 2021)

New boarders will have their posts moderated - Don't worry if you cannot see your post immediately.

FCPX plugin to detect speech/lyrics

More
10 May 2023 15:20 #125387 by gdgross
Hi all-

have been getting into making short reels for tiktok with my band, and I'm discovering that tiktok's speech detection algorithm is pretty lousy when it comes to detecting singing, if it even works at all.  

Does anyone know if there is a plugin for fcpx that can detect speech?  And if so, if it works halfway decently with music/singing?  (probably worth a try anyway)

Thanks
Geoff

Please Log in to join the conversation.

More
10 May 2023 17:14 #125392 by joema
It's not a plugin but you can get the MacWhisper AI tool (which is a Mac app), export an SRT file, import that to FCP and it will produce subtitles for dialog or most song lyrics:  goodsnooze.gumroad.com/l/macwhisper

The paid version is only 18 EU, and it is very powerful. There are various models which trade off conversion speed vs accuracy, but even the English "base" version is fast and fairly accurate. The "Large" model can produce transcripts from audio so poor I can barely understand it with my ears. Even the "Large" model is not that slow on a fast machine.

I tested it on a few English-language songs and it seemed to work OK. It can also do other languages, but it does not yet translate. That is planned for a future version.

Please Log in to join the conversation.

More
10 May 2023 22:24 #125399 by gdgross
Cool app, thanks for the heads up joema - i'll give it a spin!

Please Log in to join the conversation.

More
13 Jun 2023 13:36 - 14 Jul 2023 10:35 #125916 by PatriciaKnight
Thank you sir, I never tried it before. I appreciate you for sharing the link. You made my day :) 
Last edit: 14 Jul 2023 10:35 by PatriciaKnight.

Please Log in to join the conversation.

More
13 Jun 2023 15:07 #125918 by thinkfilm
+1 on recommending MacWhisper (Pro).  It is a powerful app now, with a good roadmap for future enhancements.  The developer, Jordi Bruin, is terrific, helpful, and has slate of other useful app/utilities.

Please Log in to join the conversation.