- Posts: 38
- Thank you received: 0
3 Post Moderation Rule for New Boarders (25 Jan 2021)
New boarders will have their posts moderated - Don't worry if you cannot see your post immediately.
FCPX plugin to detect speech/lyrics
10 May 2023 15:20 #125387
by gdgross
FCPX plugin to detect speech/lyrics was created by gdgross
Hi all-
have been getting into making short reels for tiktok with my band, and I'm discovering that tiktok's speech detection algorithm is pretty lousy when it comes to detecting singing, if it even works at all.
Does anyone know if there is a plugin for fcpx that can detect speech? And if so, if it works halfway decently with music/singing? (probably worth a try anyway)
Thanks
Geoff
have been getting into making short reels for tiktok with my band, and I'm discovering that tiktok's speech detection algorithm is pretty lousy when it comes to detecting singing, if it even works at all.
Does anyone know if there is a plugin for fcpx that can detect speech? And if so, if it works halfway decently with music/singing? (probably worth a try anyway)
Thanks
Geoff
Please Log in to join the conversation.
10 May 2023 17:14 #125392
by joema
Replied by joema on topic FCPX plugin to detect speech/lyrics
It's not a plugin but you can get the MacWhisper AI tool (which is a Mac app), export an SRT file, import that to FCP and it will produce subtitles for dialog or most song lyrics:
goodsnooze.gumroad.com/l/macwhisper
The paid version is only 18 EU, and it is very powerful. There are various models which trade off conversion speed vs accuracy, but even the English "base" version is fast and fairly accurate. The "Large" model can produce transcripts from audio so poor I can barely understand it with my ears. Even the "Large" model is not that slow on a fast machine.
I tested it on a few English-language songs and it seemed to work OK. It can also do other languages, but it does not yet translate. That is planned for a future version.
The paid version is only 18 EU, and it is very powerful. There are various models which trade off conversion speed vs accuracy, but even the English "base" version is fast and fairly accurate. The "Large" model can produce transcripts from audio so poor I can barely understand it with my ears. Even the "Large" model is not that slow on a fast machine.
I tested it on a few English-language songs and it seemed to work OK. It can also do other languages, but it does not yet translate. That is planned for a future version.
Please Log in to join the conversation.
10 May 2023 22:24 #125399
by gdgross
Replied by gdgross on topic FCPX plugin to detect speech/lyrics
Cool app, thanks for the heads up joema - i'll give it a spin!
Please Log in to join the conversation.
- PatriciaKnight
-
- Offline
- New Member
-
Less
More
- Posts: 1
- Thank you received: 0
13 Jun 2023 13:36 - 14 Jul 2023 10:35 #125916
by PatriciaKnight
Replied by PatriciaKnight on topic FCPX plugin to detect speech/lyrics
Thank you sir, I never tried it before. I appreciate you for sharing the link. You made my day
Last edit: 14 Jul 2023 10:35 by PatriciaKnight.
Please Log in to join the conversation.
13 Jun 2023 15:07 #125918
by thinkfilm
Replied by thinkfilm on topic FCPX plugin to detect speech/lyrics
+1 on recommending MacWhisper (Pro). It is a powerful app now, with a good roadmap for future enhancements. The developer, Jordi Bruin, is terrific, helpful, and has slate of other useful app/utilities.
Please Log in to join the conversation.




