 This is the second fastest server we've ever gotten our hands on. It's for scientific applications and machine learning, and it might actually be better in some ways than the fastest one, which happens to be the petabyte of Flash project over there. Why? Because this one is freaking water-cooled. It's got six GPUs in it. It comes in two flippin' wooden crates. That's really all I know about it, because it's been stuck at the border for over a month due to some kind of stupid COVID delay. So we're gonna open this puppy up and show you exactly what's going on inside. Whoa! Also, it's only four GPUs. Oh, I thought it was six. Yeah, sorry. That's still pretty good. Pretty good, just like our sponsor, SignalRGB. With SignalRGB, you can control and sync your favorite RGB devices all from one app. Best of all, it's free. So download SignalRGB at the link in the video description. So, let's get started. These are wooden crates sealed up with Torx screws. Alex has his way, but I think I'm gonna go try my way. No, don't use that. I can't find a crowbar. There's no way he's getting the crowbar before I'm done. Oh, well, that was no fun. What is in here? Why do we have two boxes? I don't even understand. Yeah, I was gonna say, I don't even understand why there are two boxes. Are these our GPUs? This ain't no ordinary GPU, ladies and gentlemen. Now there's a big difference between the water cooling that we as gaming enthusiasts use and what you'll see in workstation or server or data center applications. I think this is all custom by Kamino. Like, look at this back memory cooler. What boards are these? They have NVLink fingers, so they must be 3090 class. I think they're all A6000s. Yeah, I've been trying to figure out the pricing on this. I don't know yet. It's all just like, you know, if you have to ask, you can't afford it kind of stuff. I didn't think Gigabyte was a Quadro board partner though. Check out these quick connects. Love it. So your cold comes in here, presumably does some stuff, heats up and comes out here. It does look like they're five grand a pop. US. That's like MSRP. They're currently going for like nine grand. If we screw up the packaging enough, we might not be able to ship it back. Oh wow, it really did not make it through there. Thanks Jerry, rig everything box cutter. You can tell it's serious when it just does not look performance at all. 512 gigabytes of DDR4-3200, six A6000 GPUs, two Xeon Platinum 8368Qs, two SFXL power supplies. What are we opening? What the heck is this? It looks like me. Oh my God, it's just power cables. Well that was... Wait, but how many power cables do we need? I'm a little confused because there are multiple power supplies listed on the bomb. Wait, what? What is this? Oh, that's not power cables. Looks like some kind of handle. I think I gave you the light side. Heavy, yep. It's designed to be rack mounted. It comes with rails, but I can feel little nubbins on the bottom. I think they're rubber feet. I guess you can kind of use it however. I mean, that would be a big advantage to going liquid cooling like this with your compute node is that you wouldn't have to put it in a server room. You could actually, ow, have it on your desk without being super disruptive. I mean, yeah, that machine out there might be more powerful, but it's obnoxious to be in the same building as let alone room. Look at this. Wait, it's not just rad. I am really confused. And you're about to be confused too. Let the camera see your confusion. Everything's fine. It's just a very durable lttstore.com water bottle. This particular one belonging to Alex. Well, but yeah, what? It's got GPUs in it already. So what are those? They're GPUs, smart guy. Obviously they're GPUs. It has three power supplies. Shout out Kamino for their custom IO sticker. That's actually a really smart way of branding your machine. What would we use this for? Almost doesn't matter. I'm okay. Well, Kyle has that thing upcoming. He's got that raccoon that's like pooing in his yard and he wants to train like a machine learning model to recognize it and like shoot it with a airsoft gun or something. Apparently it takes like four days to do the training on his like consumer GPU. This you can fit so much machine learning in here. What's the front Alex? I think this is the front. Wait, but is it? No. Yeah, this must be the front. This has to be the front because it's got a thermal sensor in front of the radiator. So you'd want to know your intake temps, right? Oh, wow. Are these ever tight? That stripped one could be a problem. We could end up drilling this out, Alex. Oh, I really don't want to do that. No, it's dead. And it mangled your Torx bit. Oh, great. Turn power supply. Ah, ah, ah. Wait, why are you doing that? I'm powering it up. But I'm about to drill it. I mean, that's fine. What about we don't do that until we know that I didn't- Whoa, here it goes. I guess it's on now. Ah. What? It just had a little panic moment and shut off. Cooling system standby. Wait, is it even full of water? You can see right here, there's a reservoir. The water's right up at the top. I think it's fine. Should I just drill this and get the top off? Yeah. Look at that. Now we're both being productive. Do you want to get footage of him? Wait, stop, Alex. Too late. Brandon, footage. Don't just pretend to have the breakthrough moment again. All right. Hold both buttons to turn on slash off. Cooling system start. Fan RPM monitoring on here. It feels like it's intended to be up like this a little bit. Yeah, kind of. Yeah. Whoa. Lots of bubbles. I mean, surely if they picture it like this and the text is this way, it's intended to be run this way. Ah, there we go. Good thing I didn't stab that. That would have been pretty bad. Wow. Holy crap. Look at that back plate. What are the GPUs that are in here? What was the point of those other ones then? These have HDMI ports on them. So I do not think that these are A6000s. Oh, wait, are those 3090TIs? They could be 3090TIs, but I don't understand why they have these crazy eight pin connector adapter doodads here then. Wait, I don't think I've actually powered on the system, Alex. Like I don't have any lights on the keyboard. This controller system up here is trippy. Here's our temp sensor for the front hanging off of it. And then you can see the 24 pin connector goes into here. Oh crap. Is that USB? Yeah, I don't want to wrench that off too hard. And then you can see fan leads, power, presumably there's a coolant flow rate monitor. All that appears to be completely custom. Should we take a closer look here before we fire it back up? Yeah. These guys have come a long way since the last time we checked out one of their systems. I recognize this triple power supply setup from last time. That's super cool. We've got three 140 millimeter fans. So these are taking advantage of the full four-hue height of the chassis. And then pushing that air through what looks like a triple 120 millimeter radiator, which I honestly gotta say feels a little optimistic in terms of cooling. We've got dual Xeons and then quad GPUs that are all supposed to be cooled by this single thick radiator. I love this distribution block here. For every heat generating device, you can see we've got the cold and hot sides coming into this Delrin distribution plate. And then we've got cold coming out to the components. These are all completely custom water blocks. And then hot coming back to the distribution plate, all joining together and going back to the radiator, which then goes to our pump reservoir combo unit up here. What we don't know is what the heck these things are. There's two pumps in here, by the way. I'm not sure where they are, but that's pretty, oh, there they are. I think they're DDC variants. On off commands not available. Just rip out the power, just there, boom, they're gone. In other news, I checked and we actually have a terabyte of RAM. 64 gigs each. This single DIM has more RAM than your workstation. I wonder how many people are buying this thing. I think it's less about how many people are buying this thing and more about how many of them some people are buying. Is this on or what? Select the input. I don't even have keyboard lights. Interesting. Well, first of all, let's talk about what went wrong yesterday. Oh yeah, let's do that. Did I screw it up? Yes, you did. Oh, was it when I pulled this thing off? It was, yeah. Cool. So it turns out that the power switch is in here. So this starts up the cooling, checks everything, makes sure it's good. Yeah. And then- Power's on the board. Yeah, power's on the board. So it just didn't. Yeah, because when you did this, the power switch connector, you can see a little jumper right in there where you really reefed on it. Cool. Yeah, that was unplugged. Okay. Took a call with the people in Austria. Jake, you spent what, like two, three hours on this? 20 minutes. Oh, only 20 minutes. Not too bad. Literally just put it there. 20 minutes. What? It blue screened? Shut up. I didn't do anything. You just have an aura. No, I don't have an aura. Okay, it's working now. Yay. Just don't touch anything. I'm not touching it. Stop. I'm screwing in a VGA. Look, users use keyboards. Just go to the keyboard, okay? Do I get to know what GPUs they are now? They have the A6000s in there, which means those must be 3090 TIs then. They're actually 3090s. I talked to them and they sent them just so we could show them getting swapped and show how easy it is. Okay, cool. What are we gonna do now? Because my understanding is you've spent some time working on a benchmark that can actually take advantage of all of this GPU compute. How much memory do these fricking things have? 48 gigs each? We have 200 gigabytes of video memory. Like just the CPU screen even. 76 cores, 152 threads. I don't know Intel's lineup very well anymore. So what, these are each 38 cores? Yeah. Is that good? Are they fast? I don't know. Should we test it? Okay, so we're going up against, what do we have here in the reference ones? How does it compare to a 32 core 2990WX? I think favorably. Thank you for that. I wanna feel the heat though. Oh, just watch this for a second. Okay, all right, I'll watch. Okay, it was only necessary to watch for a sec. No meaningful heat buildup was going to occur. All right then. Wow, that's fast. 71,000. What the hell is an 8368? They turboed a 3.7, base 2.6, 270 watt TDP and a maximum memory size of six terabytes each. During Cinebench, they reached a maximum temperature of 55 degrees. They also weren't running very long. Hey, what happened to our power meters? They're right there. We only have two. We also have the sketchy one. Let's use it one more time before we throw it out. Cinebench, here we go. I can pretty much guarantee you that the eight pin CPU power connectors of each of these two power supplies are going to the two eight pin inputs on the motherboard. So we're sitting at about 850 watts right now. Shall we do something to the GPUs? Might as well. Okay, so V-Ray CUDA? Sure. Oh, RTX. Now let's do CUDA. I think that will hit it harder. Here it comes. Oh my God. Holy. How is it not crashing? It's pulling over 2000 watts. We have to be on two separate circuits. We are, yeah. I wanna feel the heat. Yeah, what does 2000 watts from- I'm gonna get a sun pan, boys. This is crazy. We're already at the point where the incoming air is 22 degrees and the outgoing air is 44, which is pretty nuts. And what's crazier is that if you check this out, this V-Ray benchmark only runs for one minute at a time. So we're barely even stressing these GPUs. I have to manually restart it every single time, which means I think it's time for us to switch over to your SOLIDWORKS benchmark. I'm concerned that it's not really going to work. So I've been having a problem in the past. It just like renders a bunch of passes. On this, they take such little time that I've been having trouble getting them all to get fully loaded. To its credit, when I'm not unplugging power supplies, it appears to be rock freaking solid stable. And in terms of balancing the load, here, let's hit it with V-Ray again. No single one of our power supplies is doing an outsized amount of the work when you're hitting the entire system. I think the most is around 850 watts. And given that these are 1000 watt units from Silverstone, that's not bad. I do have concerns about those poor power supplies drawing in like, no, it wouldn't even be 40 degree air because they're on this side of the radiator. So actually they're getting pretty decently cool air. This is weird. Because if you put your hand behind the radiator, it's super hot. But if you put it down where the power supply is, it's still nice and cool. SOLIDWORKS crashed, maybe some kind of driver issue. We're not sure, but Blender's opening. I'm curious, a lot of my laptop benchmarks take about one and a half minutes on really fast ones to like three minutes on like something that's a little bit slower. I'm kind of curious what this'll do. I'm thinking a lot less than that. Holy is it done? No, okay. Wait. Did we just witness a sub eight second Blender BMW render? Samples 3000. Maybe just increase the number of light paths as well. Yeah, total lots. Okay. It still did it in 16 seconds. This is ridiculous. Those 3000 samples and 10 times as many light paths. Okay, can we do like 10,000 samples though? Is it even hitting all of our GPUs? It's not even hitting all the GPUs. Is it possible that's misreporting? Oh, they are all hot. It probably is just misreporting. I think it's misreporting because it just did that in 31.8 seconds. It's gonna be a problem trying to stress this. Classroom. Well, I saw it here first ladies and gentlemen, that is a 15 second classroom benchmark. 14.66 seconds. I normally expect that to be like 10 to 15 minutes. Oh, who would have thought that the render machine is incredible at rendering? From 300 to 10,000 samples. It's still chewing off 20 seconds at a time of the CTA. It's definitely using our cores as for our GPUs where you at each one of these is pulling about 280 Watts. We've been at it a minute. We still have about two minutes and 15 seconds left can confirm we've managed to fully load down the system. 860 Watts on that power supply, 625 there. So that's just shy of 1500, about 2000 Watts total. Yeah, 2100 maybe a peak. Oh wow, it's really hot now that the coolant's heated up. Oh, that radiator is hot to the touch. I'm amazed at how reasonably quiet it is though. Like you could have this in your room. Yeah. And aside from your room being a billion degrees in like 20 minutes, you could live with it. And like GPU has been hitting this for a little while, but they're all at like 65 degrees max while drawing 300 Watts. And that's on top of the CPU, each of which also are doing 300 Watts. Oh, it's done. It finished in three minutes and eight seconds. It looks better though. Well, I'd imagine there's 10,000 samples. Well, look, I've never looked at it rendered like that. Wait, I think you're right. Yeah, I am right. They're NVLink. I think they'll run in four-way SLI. They will. Is that even supported? That's not even supported on the 3090 Ti. I don't know. I don't think so. Now rendering device. Wait, did you already click run? I haven't clicked run. Okay, so there's only one, which would seem to suggest it's gonna hit all four of them. Here we go. Here's where we find out if it's running in four-way SLI. Oh, I'm fidgeting. For some context, I spent a day and a chiller and I'm almost killing a 3090 to get a score of 12,000 in this. 500, 450, 60, holy it's hitting them all. So we're sitting at about 1700 Watts. That's a little lower than what we saw in Blender, but we know, okay, that the CPU is not gonna be hit too hard during the GPU portion. Is this running at 120 frames a second? Yep. It's up to 160 now. What we know is that this will not stress our CPU nearly as much as that Blender render was. So that 300 watt discrepancy is just one of our CPUs sitting idle. These GPUs are going full grunt. I guess we should probably calculate about how much it would cost. 7,500 times two. There's your CPUs. Okay, use a calculator. I give up. So about 60 grand. 60 grand? Don't forget that they just ship you random RTX 3090s. Oh, I think it did crash. It crashed. Oh, she's done bud. In fairness to Camino, four way SLI has not been like properly supported by Nvidia in a very long time. And it's probably a driver issue. Since we're happy with the A6000s in there and we're not gonna swap in the RTX 3090s, I might as well just explain why they included these. It was so that we could show you guys just how easy it is to swap out the cards from your workstation. Camino will provide these pre-done up cards. So basically it's just a one screw, undoing these quick disconnects, slotting in the new GPU. I mean, I guess you should also remove your power connectors at some point. Putting in the new one and then these actually come pre-filled with coolant. So theoretically, there's almost no liquid loss when you go from the old card to the new card and you should almost never have to top up the coolant, which I thought was pretty cool. Attempt number two is running a lot slower. Power usage is lower. It's around 1300 Watts. It must be. Oh, and it's crashed. I don't know if we're getting 3D Mark on this system. I don't know if we're getting away without telling the viewers about our sponsor. Ting Mobile. Do you like saving money? Ting Mobile is a low cost carrier with rates to help you do just that. Almost every phone on the market will work with Ting Mobile and they have the perfect plan for everybody, no matter what your needs are. Start with unlimited talk and text for 10 bucks a month or data plans from $15 a month. Their set 12 plan with 12 gigs of data is only 35 bucks a month. And if you need it, unlimited data plans are $45 a month. You can even share your data on a family plan and save even more. Ting Mobile also offers pay per use plans with their flex plans charging just five bucks per gigabyte. Even with those savings, you still get nationwide coverage and award winning support. Consumer Reports named Ting Mobile their number one carrier in America, which is a very large place. So check them out at linus.ting.com and receive a $25 credit. And if you guys are looking for another video to watch about a system that's even more expensive, you can check out this thing over here.