 Why the heck do you guys need a whole room full of servers just to make YouTube videos? We get asked this and actually a lot of other questions about our data management and our workflow all the time So for the last year actually ever since we got our red cameras I've been meaning to do an update for you guys on how we handle such heavy footage how we share resources with such a large team and How we do all of that while maintaining our rigorous daily release schedule, so When Zhiyun reached out to us asking us to do a feature on their smooth for camera gimbal I thought well hey, there's an opportunity Why don't we grab this thing and take it with us while I show you guys the way that data flows? Through Linus Media Group to become a video on your screen. So while I let you all appreciate the irony of a video about our overly complicated workflow shot on a cell phone with a Simple handheld gimbal. I'll tell you guys a little bit more about the zoom 4 So it's got a highly integrated control panel down here with apps for both iOS and Android that allow you to control your camera It's got focus pull and zoom capabilities It's got the ability to do vertigo shots with one button through the app or manually It's got what they call phone go mode for instant scene transitions, and it's got both a quick standby mode and a one-click mode switch Everything that we shot outside of the intro and this outro right now was filmed on this It's got a no date on it right now But it was shot on an iPhone 10 and I'll let you guys be the judge of the stabilized footage that comes off of it So to demonstrate some of the challenges with working with red footage We're actually going to take that intro that we just shot just now and we're going to ingest the whole thing to show you Guys how we do it now red cameras are not great for recording audio In fact even with an external preamp it is really difficult to get anything resembling usable audio out of the camera directly So recently we finally gave in and resorted to an external audio recorder It really sucks to synchronize audio Especially if you're stuck using the scratch audio that gets recorded directly to the camera And then the SD card out of your external recorder and aligning it manually But we recently got a little doodad called a tentacle sync you get two pieces here a master That sits on our mix pre six and a slave that sits on our camera you synchronize them at the beginning of the day And what they do is they inject what's called timecode? Into the mag and into the SD card so that you can easily synchronize them later on down the line But that is far from the only problem so the thing about the weapon 8k So that's our camera recently renamed the DSMC to helium or something like that is that it records footage They're both the same camera at up to 8k 60 frames per second and with the 480 or 960 gig mags that's up to 300 megabytes per second so to put that in perspective if we were filming a simple tech linked episode Even though we will usually use like a 20 to 1 compression ratio So that's about 4 times the compression that they would probably use on something like a feature film That means that a 10 gig clip could still end up being in the neighborhood of about that's a 10 gig clip That means that a 10 minute clip could still end up being in the neighborhood of around 50 gigs And while it's less of an issue for something like Linus tech tips or tech quickie when you're recording Dailies, and you're expected to release the video on the same day that you film it like with something like a new show So size of files ends up becoming a potential problem So that's why our two ingest stations, which you might recognize from one of our Tech showdown episodes are both equipped with 10 gigabit network cards So one of them has this Asus one which is basically the last generation version of this action one They're both using a quantia chips that allow them to be somehow under $100 for 10 gig networking There are a number of different ways that we ingest footage depending on the type of camera We're using so for red you can see each of our video clips is actually a folder made up of smaller Broken up video clips, so we're going to go ahead and grab that and copy the whole thing into our project folder For this video so that goes in a roll one What we're looking at right here is probably some kind of like weird buffering thing or something But this is about what we'd expect to see in terms of our ingest speeds It's not the full 10 gigabit because that would be in the neighborhood of 1 to 1.1 gigabytes per second But the reality of it is that you're going to run into bottlenecks elsewhere And in fact these red megs even though we're using an eSATA interface for them are just not that fast And they only read it about 230 megs a second Then what we got to do is grab the audio clip off of our SD card that goes into our audio folder right here And that's pretty much the whole process for red footage But for that we wouldn't need powerful machines And there is a reason that each of these is running 64 gigs of RAM and a 10 core extreme edition processor And that's because for our other cameras like the a7s for example we actually use Adobe Prelude, which is an imperfect piece of software, but Has its uses to transcode the footage when we're bringing it in So what we do is we take whatever project it is and this is generally fast as possible We still shoot that on the a7s we create a subfolder And we set it to transcode to Cineform 4k this improves our timeline Performance when we're scrubbing through the clips in Adobe Premiere The other thing that we do is set a second destination for the original files that we're not transcoding Just in case something goes wrong with the transcode Which does happen from time to time and we need to go back and grab the original files Now just to give you some idea Even if we're not using the full potential of this network connection all the time of what it's capable of Let's go ahead and just grab a file off the desktop and show you just what this puppy can do So that is saturating the read speeds of the raid one SSDs that each of these machines are booted off of So that was a 10 gigabyte file Let's go have a look on the other end of this Ethernet cable at how exactly that whole thing comes together now I've shown you guys our server room Fair number of times, but I haven't given you guys an update in quite a while on How exactly it's working in here? So the main server that everyone is editing off of at the same time is this one right here This is Wannock server, and it's running 24 plus one two three four five six seven So it's running 31 Intel 750 series 1.1 terabyte NVMe SSDs and this guy is an absolute monster So if we fire up performance monitor you can see that even though we've got four of our 8-bit servers even though we've got four of our editors in office right now and we're seeing each of them doing 150, 120, 50 megabytes a second of reads this thing is barely suffering and our There we go our Z disk queue depth is only about 0.5 That's the benefit of NVMe is that nice fast responsiveness And in fact when we were still using our SATA SSD server for everyone We were starting to run into issues once we had the room fully staffed over there Where Adobe Premiere would crash, but not just crash Everyone's would crash at the same time and we narrowed that down to slow response times on our NAS So this guy's connected at 40 gigabits per second This one right here has 24 SATA SSDs And this one only gets used this is called QQ server This one only gets used for large projects that only one person needs to work on at a time It's still SSD based so we still don't run into any crashes or any other weird issues like that But it doesn't have quite the snap that an NVMe machine does Now something that we learned a really valuable lesson about I guess it must have been about two years ago Real time data replication and offsite backup And that is where this guy comes in So I want to show you guys a little trick here I don't know if I've ever actually done this demo in a video before I've shown people that have come into our office So I'm going to use my test folder here And I'm going to create a document called test for video right here This is a text file on our main drive Then I'm going to jump over to this hard drive based server under it So this is running 8 8 terabyte drives for a total of 64 terabytes And I'm just going to pull up the Wannock sync folder Get that test folder open Test for video, ba-bam! Just like that So within about 5 to 10 seconds Whether it's a text file or whether it's a large video file The synchronization software that we're running here will automatically dump it over to here So if this crashes, we can actually continue editing videos Within about 10 to 15 minutes of switching over everyone's map drives And another benefit that it gives us is that normally on a network drive When you delete a file, it's just gone But instead, check this out If I delete test for video, I'm actually going to have to do it from a separate server But if I delete test for video Boop! You're gone, you're done! And I go into here That file is going to disappear But what will happen is we can go into the deletions folder and we can rescue it This has actually saved our butts more times than I would like to admit Because stuff does get accidentally deleted Now, all of this is only for active projects that we are working on right now Once we're done with something, it goes on to Petabyte Project And we're actually running both phases of it right now When we originally deployed it, we were only using one of them So we could just save power on hours for all the drives that were in the other one Not the case anymore Petabyte Project is now up to 777 terabytes of total space Of which we've consumed 432 This holds all of our archived projects So that in the event that we want to make a video that refers back to one of our other videos We can grab the original quality files rather than downloading off YouTube like a lot of other YouTubers do Bringing us into this room One of the biggest challenges is not just working with red footage because the files are so heavy One of the biggest problems that we have is that we've got multiple people working off of that same shared NAS all at the same time So this is where the 10 gigabit connections that our editors are also using comes in When we're scrubbing through footage, we can actually see data rates in excess of 2.5 gigabit per second Which is actually peaked at just shy of 4 gigabit per second That, my friends, is why we've got the bangin NAS with the high speed networking So once the edit's done, Taron, or one of our other editors, will export the entire project as an MOV But those are extremely inefficient files So they're great quality, but they're absolutely massive So we're just going to copy that Close in the transcode flow plane, and then you paste it here Now what's going to happen there is that water-cooled server that I built a while ago, the one that's at the very bottom of the rack Is going to see that that file got transferred and then it's going to spit out the correct formats for all the different platforms that we upload to Whether it be YouTube or Flowplane or Facebook or whatever the case may be That way, the editor's machine doesn't get tied up with this So this is cool, once that file's done copying, it does take a second and media encoder is not always perfect Before it'll pick it up, but we use VNC in order to remote into that machine So everyone can go in at the same time on remote desktop connection And make sure that it has actually picked up the project and that it's transcoding to the correct format Okay, cool, the system works So thanks for watching, guys If you disliked this video, you can hit that button But if you liked it, hit like, get subscribed, or maybe consider checking out where to buy the stuff we featured at the link in the video description Also down there is our merch store which has cool shirts like this one and our community forum, which you should totally join