 As promised, I have brought you guys the one and only Petabyte project two and The one and only Anthony Anthony our task today is very simple We have two hours to have this petabyte project deployed So that the editors and the shooters can offload a bunch of footage off of the existing vault On to this one so we can load balance things a little bit easy right easy So uh go Wave the wand What what do you want to do what you do? Well? I don't know I can plug it. I mean it's not it's not powered I can't like just cast a spell and we're gonna do something really similar to what we've got for existing petabyte project where we're gonna do 415 drive V devs in raid z2 so so that you guys know that allows us to lose up to eight drives Total before we'd lose any data and that has come in handy. Yeah, the resilvering was a bit of a nail-biting process Let me tell you that took many weeks. I was thinking of adding an Optane PCI Express card as a slog So that would be a write cache effectively That doesn't depend on DRAM so that in the event of a sudden power loss We would still retain all the data. I don't know how big we did that though 480 gigs that's the smallest Optane drive we have okay, okay, I'll go grab one Don't forget to sign it out. Hey got him. Oh, they break off. Yeah For a server chassis. That's like hundreds of dollars. This is not an amazing experience So we ready to power it up Sure It's actually not even crazy loud no I was expecting much louder did they send the credentials for login well Let's try root and password Okay, we should probably change that I'm a hacker today boys first of all you shouldn't be logged in as root well I mean just for like initial configuration. It's a matter. Yeah, do RM-RF slash Don't do that. Oh wait you were gonna ruin my stuff Now the original plan was for 45 drives to build me a custom 75 drive unit right, but Seagate did send 75 drives So I was kind of thinking you know what would be cool is if we took an old decommissioned store inator and Actually created a new cluster with this one and that one I'd have to upgrade it obviously so we go epic with the other one As well, and what do you think? No, yes good bad. They said not to do it over a petabyte. Let's do it. Hold on a second We might need drivers for that Mellanox one. What are those 10 gigabit cards that are in there? They're just the onboard ones I can try another slot. Okay, you want to throw the power switch to make sure it doesn't wake back up. Yep Now ready That's not a power switch I asked you if there's a power switch well there is a power switch Hey, how's it going? I found another 60 drives tornado. So now we could have matching ones. Are they really matching? Well, if I change out all the hardware in this one, they would be somewhat matching. Yes somewhat Yeah, it's the older model though. I was kind of thinking while you're working on this I refurb this I don't think this should take very long. All we had to do right now is say this last words Let me see if I've got the Mellanox card now. Yeah, there we go Oh nice. So just moving it to the other slot worked. Yeah, I hope that just rebooted on its own Probably fine famous last words Yeah, thanks for that. Oh man. Do you remember when 45 drives used to use non-ferrous screws? Me too. This is super annoying I'm gonna replace every screw in this case when I rebuild this Okay, when I said this probably wasn't gonna take very long I didn't realize that we had to download so many updates. So here we are. Oh failure. Wait, God why? Meanwhile I'm extracting this motherboard. Oh shoot. I didn't unplug the front panel connectors of the 24 pin We are totally not gonna finish this today. Oh Package G deploy because it's not available in the mirror anymore What's G deploy? I have no idea. What the crap? Oh boy That is a dusty server Dusty boy. Ah Go away They're saying to use Gluster Ansible. So I'll just use that Hey, there we go. I feel like I'm playing operation Don't touch the sides Okay, hey, is that all lit up? Yeah, the drives are showed up Wow. Yeah, it was just a different command. Sweet. Thanks Anthony. Go nuts I gotta have fun. That was our motto at Best Buy was have fun while being the best How'd that work out for you? We were the worst performing store in Canada Yeah, like all the contacts are still there if you get enough mounting pressure on the pins It should be able to work. What if we jammed something in there? That might do it. Something non-conductive that just presses against there. I found an old junk 3d print There's actually a bit on this side There's actually a bit on this side too. Whatever hit that thing hit it pretty hard So we just ripped the memory out of it without pulling the tabs first No, I think it was starting transport at some point. Well, they're physically in let's see what happens Show me the 128 gigs Deleting intensifies. Oh, yeah We got it we repaired the memory slot Repaired it's such a dumb fix but is this is totally gonna work. Thankfully hot glue is non-conductive and It melted the filament a little so didn't think of that hot glue. It's it's hot filament It melts our hot glue fix is applied. So this should boot up with 64 gigs of RAM right now. Good Got it The scale of the project has changed a little bit. So we're gonna cheat ever so slightly and pull three And pull three of our 8 terabyte SSDs and put them in this second server We actually pulled out All of the 8 gig sticks of RAM that were in the servers and we are replacing them with 32 gig sticks So each of them is gonna have 256 gigs of RAM, you know, hey, you only live once and I think that's pretty much all that I've changed other than that the last time you guys saw this it had old hardware in it And now it is running brand spanking new 16 core epic hardware and I've got another 256 gigs of RAM that I can throw in this puppy And then oh, okay, but we got 256 gigs of RAM, okay sweet this is working then Theoretically, there's nothing wrong with what I'm doing here But I am officially the jank king this power supply has only two SATA connectors and I need to plug in five drives So get this I'm going SATA male to SATA female to molex male to molex female To quadruple SATA over here that'll power the four regular SATA drives and then I'm using the other one For the Optane drive just kind of jam that in there. Yeah, I mean thankfully SSDs don't take that much power Exactly. That's what I'm talking about. Who's gonna say anything? all of our viewers Yeah, I am just about done building this puppy I've got my SATA cables run just casually doing some cable management with my LTT store.com cable ties fans are clear fans are spinning. Everything's good to go All we got to do is load it up with some drives Oh, I guess I need to find all the drive mounting hardware I put away a panel that has some screws that go with it I put a little magnet on there with all the screws stuck to it. See that free tech tip Day three of this epic shoot. What do you think? Is this just gonna boot up? I would say 95% yes. I mean we haven't even checked the RAM compatibility yet Okay. Well, that's a bad sign. Go ahead and cut go ahead and cut go ahead and cut no dice on getting it to boot So I'm gonna start by ripping some extraneous hardware out and just see if at least we know the CPU and RAM work No, I don't think that's doing any better. Go ahead and cut according to the manual I shouldn't need any of that stuff. Go ahead and cut. Do you want to get a closer look? Ah my foot cut. All right. We're back where we started cut now to just do one HPA at a time One and cut what is this g3d note go ahead and cut Good cut. Oh weird just cut. This is very boring troubleshooting after a BIOS update and a CMOS clear It's up Everything is detected. What do you think? I'm just gonna friction mount it. No. No, I'm gonna put some hot glue along the top of the card edges I'm gonna stick it down on it. Don't worry about it. It's all good I read about it in a textbook somewhere these babies ain't gonna deliver themselves. I Literally cannot tell if you're joking people claim they don't love the gore, but they love the gore it's in it's done We can put drives in it now, right? Yeah. I mean theoretically it's hot plug, right? Heck. Yeah. Oh, right. Okay So no, we should just do this in the server room not right now Okay, so no, we should just do this in the server room that one's a lot harder to remove the drives from and we have to Remove the drives in order to transport it So I think that's the extent of the testing we can do here. What about this? We're gonna have to remove all the drives and then put it back together in there Okay, do we have to put them back in the same order? Yeah, I think so. Okay Unfortunately, we're out of power plugs The good news is I did buy a second one that isn't mounted so we can put that in But the reason I didn't bother doing it was that it was gonna be a royal pain in the butt checklist Put in new PDU for more power move Albion server up Figure out all the KVM cables and labels so that everything corresponds again and then add two more servers easy, right Easy, love it. When you put it like that. Yeah Okay Whoa Wait, nope missed up a bit good in I've had worse man. Am I gonna have to just kind of jam it in there? I'm glad you guys can't see this right now Okay, we've got power. We've got KVM so we can throw them in plug in network and then we're good to go All right. This is awkward mind labeling that why put the rails in pull out just a little there we go easy peasy Let's fill her up boys Wait, this is four why'd I put it here? We got to move it up one go ahead and cut Man now to make transporting this a little bit easier We're going to take out all the drives put them on this little current here and transport this separately We're gonna make the biggest cluster cluster we can by filling it up with some of the drives that we're just gonna return later I guess yeah, I'll just grab it. Sure. Yeah, you know what? I got it. Don't worry about it. No problem. Okay, okay Yeah, boom box. Oh big carry it with two hands. Yeah, that's fine. I'll just do this. That's fine. I got it Oh, I thought you were being no now. The main trick is to put these all in the right spots all the storage will ever need Ever Wow, that's a total capacity of like 300 drives. I noticed that this one's flashing green though. Good cut Let's see. So you change the melanocs card out. Yeah, so we got the static IP 44 and we are able to ping Rock on now. We just need to do the same thing to Delta 3 How long does it take though however long it takes for me to manually oh my god you have to key those in Yeah So we're picking this up tomorrow. Yeah Okay. Yeah, okay works so close The good news is that Anthony found a script that makes it easy to import all the drives And it'll say nothing here buds. Yeah No way, they are the most Eastern Canadian tech company of all time. Wait, so how do we have hold on a second? But that doesn't make any sense because see that's whatever that's have whatever that's doing. I have no idea. It's lifeline time Yo Brett long story short. We tried to use the new script You thought you'd like a remote in now I'm ready to go. Okay, awesome. So it's an older chassis and I repurposed it with new hardware So there's a drive Okay, give me a second. I'm gonna do some open heart surgery here moving all the cables is gonna be a little dumb Don't fix your hardware to fix your software. No big deal. All right You guys having fun yet? Oh Yeah, it's always fun So with you just I know it's kind of annoying but change the cable so that they're in this order And then we'll fix the order of the cards in the DMAF thing 45 drives never fix the software problem with hardware Also 45 drives. Can you unplug literally all the cables and put them in the other way in their defense? This is not a supported configuration So are they just in reverse order on this motherboard because I think super micro numbers them from bottom to top I think so you're coming out for LTX right? Yeah. Hell yeah. Okay, cool. I'll see you then then. Okay, sweet They're all showing up. So it was just a matter of it Was just a matter of reseating all the cables in a different order Sort of Yeah, sure. Yes, so we're ready to pull them together and then start Samba and then we can see over one petabyte accessible over the network We're ready to pull them together They recommend that a single brick shouldn't be more than 100 terabytes in size. Wait, so this is good probes are good Probes are very good. Okay, we just probed our peer probe success. Probe success. Let me do the other way around pure probing Do you want to see it? I do want to see it now. Oh Last time we had a petabyte of raw storage, but because of Overhead loss to redundancy and whatever the case may be we ended up with what like? 600 something. Yeah terabytes this time 1.2 petabytes of storage It's ready. Would you say that's a new PB? It's a PB Personal best. Yeah, definitely. So I'm just gonna take a quick test file here. How about this 3 gig file? We going so yeah, it's not quite 10 gig speeds around 730 750 gigabytes a second, but considering that we're writing to magnetic storage. I am pretty pleased Oh, we never installed pulseway on the server Andy just get Anthony installing pulseway Stop already just like that Delta 3 21 hours of uptime. Don't you wish the cluster setup was that easy? I know right So thanks for watching guys If you enjoyed this maybe check out our video rolling out our high-speed NVMe server It was almost as headache inducing as this one actually more so this this was relatively painless most of the problems were Caused by me deciding that we were gonna roll two servers at once instead of just one. So yeah We're gonna have that video linked below. Thanks Andy. He's been a trooper. He's been a trooper for this