fbpx

We have all seen a lot of 'virtual choir' videos recently. Oliver Peters took the concept a stage further and edited a whole hour and a half virtual holiday cabaret show. In Final Cut Pro, of course!

The pandemic affected many lives and businesses in 2020, but one sector hit harder than most has been live entertainment. Not just concerts and theater, but it also impacted countless crews and performers working in small shows, theme parks, cruises, clubs, and more. The internet has proven to be a creative outlet for some who have put together all manner of solo and ensemble performances remotely, thanks to webcams, smartphones, and services like Zoom.

TinMen, the creative production company where I hang my hat during the day was approached by one of our regular clients, Katy Harris, to handle the post for a holiday cabaret show for her charity, Les Trèfles du Coeur. Harris’s personal experiences with cancer drove her to found this small charity, which benefits patients undergoing treatment at the St. Louis Hospital in Paris. As a veteran artistic director for live entertainment, Harris has a wide network of performers with whom she’s worked on both sides of the Atlantic. In past years she mounted a live holiday cabaret show in Paris as a fundraiser, which featured some of these entertainers. That wasn’t possible in 2020, and so the internet would have to become the alternative.

(Click for larger images, click again for pixel to pixel)

FCP2020015 cabaret finaletransition 07

Designing a virtual cabaret show

Harris conceived the show as a virtual version of a cabaret, with 22 solo performances, English and French emcees (master of ceremonies), and a 42-voice virtual choir finale. All running about 80 minutes in total. For me, the first challenge seemed to be the virtual choir ending segment. Anyone who thinks this is simply a matter of recording a massive Zoom call is in for a shock!

Initially I thought about using one of the various Final Cut Pro videoconference/video wall Motion templates; but, it quickly became apparent that a manual approach would be better. That’s because the number and arrangement of singers would change at nearly ever measure within the four-minute medley of classic Christmas carols. This ranged from as few as eight up to the full 42 at the end, with various combinations in between.

FCP2020015 cabaret grid 05 

Andre Bohrer, one of our other editors, worked out all of the grid patterns in Adobe Illustrator, generating a series of template files for the various pages. The final design became a pattern of Mondrian-style rectangles within our 16 x 9 video frame. Harris used these JPEGs to assign singers into boxes. She then organized a timeline against the scratch track of the medley in iMovie, which became my template for the final layout.

Remote recordings

Since most performers were working from home, the videos would largely consist of iPhone (or other) recordings. We had instructed them to record in landscape mode, 1920 x 1080 at 29.97fps. Sound quality and sync was obviously a concern, so each sang along to a scratch track of the medley with a countdown at the head. Most wore earbuds (or similar), which allowed them to hear the track from an external source, but record only the clean vocals. The countdown provided a sync reference for me. As long as they counted reasonably in sync with the countdown on the track, then I would have a starting point for later alignment.

Fortunately this plan came together well, with only a couple of vertical submissions. It was, of course, a given that the video and audio quality would vary, depending on the technical skills and the resources of each individual. The video issues with iPhones are obvious, but the vocal recording would also be a challenge. Audio recordings would either come from the on-board or an attached external microphone.

Some of these 42 singers also provided solo numbers for the 22 standalone videos within the show, using this same production approach. These performances ranged from classics, like “The Christmas Song,” to modern numbers, like “Let It Go,” from Frozen. In addition to their clean vocals, the singers also supplied the backing track that they had used - usually a karaoke version of that song. Since these had no countdown, I synced the vocals to the track by ear and musical sense. Although a few of the 22 supplied completely edited and mixed videos, it was up to me to mix the majority.

Editing and mixing the solo acts

iPhone/webcam recordings often present a sync issue, because the native recordings may be at a variable frame rate and not a solid 23.98, 24, 25, 29.97, or 30fps rate. Final Cut deals with this, but once you separate the audio track in an audio application, the project clock is based on sample rate and not frame rate. When you bounce out a solid 48kHz file, it may not sync back up to the picture. After encountering this a couple of times, I opted to first transcode every file to ProResLT - forcing it into a constant 29.97/48kHz file. Even then, audio often needed to be slipped a few frames.

FCP2020015 cabaret logic 04

Each solo performance was built as a standalone element for easier organization within the final rundown. First step - sync the video to the track and exported an FCPXML, which I then imported into Logic Pro. There, I balanced levels and added a variety of plug-ins to both the vocals and the backing track. Typically these included some noise reduction, EQ, compression, and reverb. In a few cases, I also tweaked the vocals with pitch correction/auto-tuning, which is built into Logic Pro. The vocal and music tracks were bounced out separately, so that I maintained control of the final balance back in Final Cut.

There were no internal picture edits, although I added graphic enhancements to each. This is a holiday show and we wanted a lively, playful visual appearance throughout. But not a single background element, which would really become monotonous over 80 minutes. The room backgrounds in these home recordings were a mixed bag, depending on the home or apartment - some more decorated than others. To spruce up the visuals, each video was embellished with different backgrounds, holiday adornments, and simple snow, snowflake, or sparkle animations.

FCP2020015 cabaret solo4pages 09

The project’s graphic designer, Michael Montgomery (Big Dreamer Design, Inc), had supplied some background and animation elements, like the wreath animation used for the opening title and the lower third song and artist titles. Unfortunately, you chew through those pretty quickly when you try to do something different for each of the 22 solo acts, plus emcee intros. To mix it up, I generated elements in Motion and also the free Boris FX Particle Illusion application. I also downloaded a ton of stock animations and some video clips from Envato Elements.

The Christmas medley finale - a virtual choir singalong

This 80-minute cabaret show culminates in a medley of classic Christmas songs in both French and English, arranged and created by Scott Erickson. Building it took a series of steps, since Erickson was going to handle this particular mix. Final Cut Pro’s audio roles feature is perfect for a video like this. Each of the 42 singers was assigned an audio role according to their name.

As I downloaded videos from Harris (who organized the clips and takes), the transcoded versions were placed onto the timeline as connected clips in sync with the medley scratch track. These came in batches and resulted in more or less an alphabetical, vertical sorting on the timeline. At this stage, it didn’t matter which box a person would ultimately appear in, since that arrangement would change throughout. Some singers would appear more often than others. A particular arrangement might be based on French versus English-speaking singers or which performers had appeared together in the same cast at some point in the past.

FCP2020015 cabaret finale4pages 08

To start, each singer was arbitrarily positioned into a grid - seven across with six vertical rows. Once each was in sync, I detached the audio and slipped the picture a few frames when necessary. As each row was filled, those seven were compounded, as were the same set of audio tracks. This was important, because I needed to manage the screen real estate within the interface and handle temporary volume as I added new singers to the group.

I was cutting the video on a 10-core iMac Pro and playback was good up to about 25 real-time layers. By using compound clips, I could easily disable earlier rows as needed, once I exceeded 25. This was important, because I needed fluid playback to judge sync - not only audio/video sync of the clip, but sync against the music and the other signers. Remember, the point is to build a piece that sounds like a coordinated ensemble choir.

FCP2020015 cabaret audiolanes 03

A video in this 42-box, temporary grid layout with my scratch mix was exported for reference. I then broke apart all of the audio compounds to reveal 42 individual audio role lanes. I restored each track’s volume to a normal, isolated level (no effects). These were then exported by roles as separate audio files. This made it easy for Erickson to line up all 42 tracks at the head and be in sync, without the need to deal with AAF, OMF, or XML files.

With the mix for the medley underway, I tackled the picture next. The first step was to break apart all of the compound video clips. Then, drop in the reference video Harris had built for the box layout. At each change in the layout, such as from 20 to 35 boxes on a page, all connected clips were bladed. Once I had added all of the cut points, I next removed clips for any person not appearing in that specific section. Going section by section, I scaled and positioned each person’s clip to fit into their assigned rectangle within that grid page.

FCP2020015 cabaret videoclips 02

One extra visual feature occurs during “Silent Night.” Some clips are treated with a blue color wash, which also changed between measures. This relates to casts that had worked together in previous shows. Once the boxes were all arranged, the template was replaced by our holiday background and transition elements were added. Since this finale was envisioned as an audience singalong, the final picture step was the addition of song lyric subtitles.

Once Erickson finished his mix in Pro Tools, the final composite track came back to me and was married to the final video. For the most part, his mix involved EQ, compression, and reverb. A few harmony parts were also tuned and doubled. But, in general, no real mixing “magic” tricks were required - just mixing talent.

With all of the pieces completed, the last step was to compile these standalone elements into a cohesive cabaret show, including intro, emcees (with French or English subtitles), transitional elements, and additional open, close, and emcee bed music, supplied by Bill Brown.

FCP2020015 cabaret endtag 06

As one can imagine, projects like these take hours of work and include many on both sides of the camera. But it’s always worth it for a great cause.

For more information about the charity: lestreflesducoeur.com

The Christmas Medley: 

Holiday Cabaret de Noël in full: 

  

Written by
Top BloggerThought Leader

Oliver Peters is an experienced film and commercial editor/colorist. In addition, his tech writings appear in numerous industry magazines and websites.

He may be contacted through his website at oliverpeters.com

Log in to comment


martinX's Avatar
martinX replied the topic: #111610 19 Dec 2020 08:32
Nicely done. You must have the patience of a saint.
"Anyone who thinks this is simply a matter of recording a massive Zoom call is in for a shock!"

*Everyone* thinks that, until we set them right. Even then, they still aren't sure if we're telling the truth...
JoeEditor's Avatar
JoeEditor replied the topic: #111611 19 Dec 2020 13:31
I have enough trouble with two or three people on zoom calls I have to record as interviews for TV. That is a scary massive project. Do you still have any hair or resemblance of sanity?
Oliver Peters's Avatar
Oliver Peters replied the topic: #111617 19 Dec 2020 15:42
Hair!? Ha! Well, some. It helps that this sort of a project is also done at a distance with the luxury of a little time. So no client in the room watching the clock. Once you figure out the best way to start, then the pieces fall into place. It's just doing it. It was also great that most are professional entertainers at various levels, so the challenge of singing well and being in time is less of an issue than with pure amateurs. But it's always dicey. One of the standalone videos in the full show is a duet, also done remotely. Fortunately that turned out well, given that they aren't in the room to play off of each other live.
iProVid's Avatar
iProVid replied the topic: #123327 16 Dec 2022 10:21
Love it! A lot of work, but worth it for those lovely happy singers.
Oliver Peters's Avatar
Oliver Peters replied the topic: #123328 16 Dec 2022 14:15
Thanks. Of course, it wouldn't have happened without Katy's (producer) vision. And naturally the talent of the performers. Certainly a silver lining to a stressful period. Glad it's still floating around after 2 years at this point.
sc_fox's Avatar
sc_fox replied the topic: #123333 17 Dec 2022 07:20
You obviously have access to some serious horsepower! I made this free offering at the beginning of the pandemic:
fcpxtemplates.com/sc-multiscreen/
All the videos I made relating to it are also on that page. It may or may not be easier. I wouldn't know because I can't push my hardware that far, but I believe once you get the workflow going...

...You may find it interesting.

I made another effect (I just released: AutoCrop — not free) — all you have to do is draw a box - the media automatically centers within. It has a few other features, like an option to draw a border, panning, etc. With a decent grid, laying out multiple clips is rather quick. It could be complementary to multiscreen, and it can be used to resize clips (with or without scaling) while they play. If you're interested, you can look over the details here: fcpxtemplates.com/autocrop/.

Very nice work BTW!
Oliver Peters's Avatar
Oliver Peters replied the topic: #123337 17 Dec 2022 14:31
Thanks for your comments. Serious horsepower? Well, maybe. This was all done on a 2017 iMac Pro, 10-core, 64GB RAM, Vega 64 16GB GPU. Subsequently, I tested this library when I reviewed the early base model M1 Mac Mini ( fcp.co/final-cut-pro/articles/2364-apple...iew-by-oliver-peters ) and got pretty good performance on it, too. Performance would have been even better on the iMP had the media been on a fast local drive or RAID. I had it all on a 10Gig NAS.

Part of that was to standardize everything as ProResLT files with a common frame rate. Otherwise, I would have been dealing with a wide range of consumer video camera, webcam, and smartphone video files. That would have been a lot more taxing, so my first step was to transcode. Then I also handled any mixing externally in Logic. Generally this was singer plus backing track. The final virtual choir finale was mixed by an outside composer.

I actually did first look at using a motion template for the finale, but ended up chucking the idea for 2 reasons. First, the producer wanted to change the number of boxes, aspect ratios, arrangement of singers, etc multiple times throughout the finale (it's a medley). The second reason was that I needed to be able to slip sync of individual elements when I got the final mix back. Trying to do that with drop-wells just felt too cumbersome. So I decided early on this needed to be done the old fashioned way :) But thanks for the suggestion!

PS: The template wasn't yours, but a different product.
sc_fox's Avatar
sc_fox replied the topic: #123349 18 Dec 2022 22:36
Last night I posted a response... don't know where it went.

I made this to demonstrate the process I was suggesting:


No drop zones. Different aspect ratios can be worked around.

FWIW
Oliver Peters's Avatar
Oliver Peters replied the topic: #123352 19 Dec 2022 01:01
Cool. Looks good. Thanks.
VTC's Avatar
VTC replied the topic: #123387 25 Dec 2022 18:22

I made this to demonstrate the process I was suggesting:

A few suggestions:
1) Ditch the annoying music. Better yet, ditch ANY music. It almost never adds anything positive to the experience unless it's a music video. I muted it 4 seconds in. A voice over describing what's being done is more beneficial, but again, WITHOUT any music bed. There hasn't been a tutorial video yet that's jumped to Oscar level contender because of the accompanying music. If you've never clicked away because there wasn't any music at all to a video it reasons that nobody else does, either.

2) Why not select all vids in the stack and scale in the inspector since the placement fields are identically sized? Then all that's needed is dragging them into position without having the viewer painfully watching them being resized one-by-one-by-one-by-excruciating-one. A reason that the 'scale all' suggestion wouldn't work could be explained in an informative voice over that no doo-wop or bump-thump music by itself could ever convey.

3) I believe those lurking here are generally an intelligent bunch and would grasp the concept if not by watching the first example would certainly catch on by the time the second video is placed. But 12 relocations? This video is easily explained and understood in one minute. Those extra five minutes are not only superfluous but torturous as well. Salesmen learn early on to 'stop talking after the close'. Editors should too. 

Reviewing my own stuff I'll step back to admire what I've done but then realistically critique its' four minutes run time and question if the point can be made just as well in three. If it can be watched 1.5x or 2x speed then clearly the answer is yes. 

Here endeth the lesson... on Christmas.
sc_fox's Avatar
sc_fox replied the topic: #123388 26 Dec 2022 00:48
Maybe you'll like this one better:
Merry Christmas
No audio. 1 frame long.
(Made in Motion.)