 It's actually kind of amazing how many wires got crossed on this project, but we are finally doing it We are building petabyte project Number two and not a moment too soon We may not even have enough space left on our servers to offload the footage that we are recording Right now and minus you might say you could just stop being such a digital hoarder and oh, I don't know Delete some bloody data But I actually have the perfect counter argument to that You sound like my wife. Just let me have my fun and we're gonna have some fun today ladies and gentlemen because I accidentally have over three petabytes of hard drives Smart deploy makes it easy to handle daily IT tasks like Windows imaging patching updating apps and migrating user data You can do it all over your existing network or the cloud without leaving your desk Get your free offer at smart deploy comm slash minus All right, so the first problem was entirely my fault actually I told Seagate that our goal was to show off one petabyte of usable space in a single for you enclosure Instead of doing it in two enclosures like we did last time and I told them that to do that I would need 75 of their 16 terabyte hard drives to account for the space that we'd lose to formatting overhead and parity data So that's true in 5 ZFS raid Z to arrays we would be able to lose up to two drives per VDEV so that's up to a maximum of 10 of our 75 drives before we would actually lose any data and That would still yield over 950 terabytes of accessible space one small problem though The custom 75 drive chassis that I thought I asked 45 drives for They were like yeah. Yeah there bud your servers in the mail bud. You're welcome bud. They're Eastern Canadian They really do sound like that It's amazing and I was like so is it the 75 drive custom one and they're like what are you talking about there bud? I apparently never clarified. I needed 75 bays so it has 60 so it looks like we're gonna have about 750 terabytes of usable space, but hold on hold on guys the title is not clickbait I am still gonna have one petabyte of raw capacity in here The difference is that we're gonna make up some of that shortfall with solid state All right, so let's take a look at the drives that Seagate sent over here So there's actually more boxes here than I expected Which is interesting So we're all we're all learning things today This can go Here so these are the ones that are right these Are the ones that we can do first this is so hilarious Oh my god, there's so many of them that this is actually like like this will actually build up pretty high I'm not quite sure how it happened, but this was error number two Seagate's iron wolf NAS drives are designed for network attached storage use they're spec'd for a million hours meantime between failure and 180 terabytes of access per year They've got a three-year warranty and they feature Seagate's agile array a combination of hardware and firmware Features that make them perform better in rate arrays They've got RV sensors and better vibration tolerance to improve performance and reliability in multi-drive arrays and a combination of solid performance and power consumption across a wide variety of workloads including Video editing which is our primary concern around here We actually end up editing video directly off of the vault more often than you'd probably think because Whether it's a big project and Monic server has no room or because a sponsor wants a change After the fact or whatever the case may be so thank you Seagate Appreciate you fam these are great drives, and we've recommended them loads of times except for one small problem I really don't know where the communication wires got crossed But these are rated for use in enclosures of up to eight drives at a time Okay, then So Seagate then sent over a few boxes of their Iron Wolf Pro drives putting us up to a total of over two petabytes of storage But those are also only meant to have up to 24 drives in an enclosure I mean honestly speaking I would have been perfectly comfortable with the Iron Wolf Pros They've got an extra two years of warranty compared to the regular Iron Wolf They've got included data rescue service And they've got a greater rating for both their per year use and mean time between failure But thing is we're supposed to be setting a good example for you guys and when I clarified hey guys So the plan is actually to put all the drives into one system. They sent over the big dogs meet the Exos 16 in its top current capacity of 16 terabytes Each of these is rated for a massive 550 terabytes per year of access and 2.5 million hours mean time between failure with all of the vibration sensing and mitigation Technology at Seagate's disposal to rate them then for an unlimited number of drives per enclosure Oh Let's add them to the pile right I Have never seen this much storage in one place in my life This is over three raw petabytes of storage 225 drives times 16 terabytes each the bad news is Seagate says that I have to use the earlier shipments of our drives for other stuff Or send them back so make sure you're subscribed so you don't miss some more NAS building collabs with other youtubers That's one of the ideas that I had Anyway, let's use this opportunity to take a closer look at our enclosure now I am wicked excited about this server, so this Is an early model? This is a prototype of their next generation store in a door There we go Now from the outside this looks like a regular old plain store in a door with 45 drives typical all sheet metal construction and all that good stuff, but Oh That's Different they have stepped up their game So they actually went from a cable based backplane system where every single port was individually wired in to these PCB back planes So this dramatically simplifies the cabling since they're just running one quad port SAS cable for each of the four bays and It also should theoretically improve reliability They've also put in some logic to stagger the spin-ups of the drive So you don't get that same kind of power surge when you first turn on a store nader and all up to 60 drives are like Start like ramping up very cool I'm not ready to actually build this thing up yet though because There is another surprise Now I don't know how much of this came about because of my request or how much they were working on already But what's this then 45 drives has finally joined team red That's right. So we've got an AMD epic processor in here I'm actually not a hundred percent sure exactly what the model number is and then it's equipped with What are we looking at here just shy of a hundred and twenty eight gigs of RAM now There was a bit of a mishap on our unit and this is like an engineering sample board the gigabyte provided So I couldn't really get a new one two of these memory slots are dead, but This is a hard drive based storage system So I'm not actually too worried about the extra couple of channels of memory Killing our system performance like it did in our all and be a mean ass With that said I did allude to needing some SSDs in order to make up the difference in capacity between the 60 drive one and the 75 drive one that I thought 45 drives was working on that is where these come in and I need to actually find out what the devil they are All right, here we go. So there's a feature of ZFS called adaptive replacement cache or arc and Essentially what it does is it takes the most frequently used data from your hard drives and then stores a second copy on your system memory So that you don't have to go all the way out to your spinning discs in order to actually access it and that's especially important for something like running VMs or a database where a lot of the lookups are going to be to the same few entries We're already using that on the existing petabyte project. You know the one with the two bays What we are not using is something called L2 arc or level 2 arc thing is sure you can add hundreds of gigabytes or even terabytes of memory to a system now, but the cost Can be quite prohibitive so you can add hundreds of gigabytes So that is where SSDs come into play. So this right here is a 7.68 Terabyte SSD so nearly 8 terabyte SSD from micron that's yeah It's only SATA 6 gigabit per second But even though that's obviously a lot slower than system memory it's much faster than spinning discs and easily enough to saturate our 10 gigabit or even a 40 gigabit network connection and then Importantly it is much cheaper than just chucking more RAM into the system now something to bear in mind here is that we ended up putting Six of these in here in order to get our raw capacity up to the petabyte that we promised But L2 arc actually does not scale Especially well with a ton of capacity So it's possible that what we'll end up doing is only using some of it cheating a little bit But for the time being hey, we got a petabyte of capacity also Just like arc it only has a copy of the data on it So it doesn't actually count towards your total capacity But these are just minor details like you know, which way the drive goes in for example. I Know I'm gonna get judged so hard for this But while I could put a dual 10 gigabit mezzanine cart in right here in this open gap in the back I have actually decided to use one of our ancient connect X to 40 gig InfiniBand cards because I had a slot that didn't have a cover on it And I don't know what else to do with this ancient thing anyway, and it's I mean, it's 40 gig even though It's an older card. It's plenty for hard drives So that's in there with its 3d printed bracket from that video a long time ago. This is a really nice feature So I've actually done this the janky way just like hot gluing or double-sided taping a fan on top of my HBA cards So these are the controller cards for all these drives We're gonna plug in but hey now there's a you know an officially sanctioned way to do it Sweet so we've got a cooling fan to take care of all of our add-in cards down here very nice Wow Now that they've got so much space here They could definitely modify the chassis and do a third fan here if they really wanted to that's freaking awesome This is an example of a really old story nader. This is from about five years ago. You can see there's a lot of There's a lot of things about it that are a lot worse, so this horrible horrible mounting system for the drives Looks like these rods holding the thing down that wasn't great. You can see there's a lot less space in here Oh, right. I haven't even talked about the new mounting system for the drives Okay, we're gonna do that, but first I want you guys to check out This is how they used to cable it up what a nightmare We've actually done a swap for a dead port on one of these things and it was not a lot of fun this right here is Apparently a 3d printed like kind of friction mount and then that works with the spring mount that they already had on some of the Newer chassis along with that PCB backplane which apparently makes it easier to align the slots perfectly so that it's easier to put the drives in and out so Let's see if that actually worked out All right, so in used to be fine anyway, but oh, okay That's not bad so all that remains now Is to install 60 drives well 58 I already did two You can tell this one is very prototype. It's got lots of scratches and dings and stuff I believe this really was their working sample of it before they sent it over to me You know you can call it used or you could call it pre-tested Home stretch and 960 Terabytes of raw spinning storage along with 46 terabytes of SSD storage for a total of Of one petabyte in a single chassis But I'm not quite done yet right now the one thing that's missing here is a slog device So I already talked about read caching which doesn't really have any dangers associated with it because you're just making Copies of this data to put on your RAM or on your L2 arc But write caching write caching is something you can do with ZFS And you can use your memory for it, but the problem is that in the event of a sudden power loss which? Who knows could happen any in-flight data that's sitting in RAM But hasn't been committed to your hard drives yet will be lost So it might be worthwhile adding something like an Optane SSD to one of our PCI Express slots over here to handle Caching data that is being written so that we won't lose it in the event that it's sitting in RAM limbo And hasn't been committed to persistent storage all that though is going to be reserved for part two Where Anthony and I are going to team up to get this thing up and running on the network so we can start off loading Some of the data from the original vault to the new Consolidated vault yes my friends the capacity of two vaults is now one vault in technology amazing Speaking of amazing technology pulse way is a real-time remote monitoring and management software that helps you fix problems On the go by sending commands from any mobile device It's compatible with Windows Mac and Linux and pulseway single app gives you remote desktop functionality You can get real-time status system resources logged in users network performance You can manage Windows updates and more with pulseway You can create and deploy custom scripts to automate your IT task And you can scan install things update all your systems on the go It's super cool and super powerful and you can try it for free at pulseway.com or through our link in the video description So thanks for watching guys if you're looking for something else to watch why not check out the epic saga That was our NVMe storage server upgrade Yeah, we're basically replacing the whole server room right now if you guys didn't sort of pick up on that