A cloud dailies supercomputer workflow

A colleague of mine (Thanks Tim!) sent the link to this today - well worth a read, although it does get a bit technical!

medium.com/@sethgoldin/a-cloud-dailies-s...4xlarge-a82c92f18d33

It’s no effort at all for multiple editors in different cities to just download the proxies. Instead of expending time and labor on loading up and shipping shuttle drives to each editor, and then having those editors ingest from each shuttle drive to their local editing RAIDs, editors can just download the proxies to their editing RAIDs directly from S3. It costs $0.09 per GB to download data from an S3 bucket to the Internet, or even less if all users on the AWS account are cumulatively downloading more than 50 TB for the month.

That’s great if you have a fat pipe to upload but most places in UK don’t. We just did a load of work on an project with m