Joseph Robert Turcotte PRO

Just with regard to your work in general, since I'm not sure where to put a comment, impressive work and impressive hardware collection. I wish I had a pile of decent computers, but have only one gaming PC and hopes of earning a custom HPC, like all of us, I'm sure.

That kind of hardware can benefit from 2PIC, but you're not putting all of the computers in a tub, right? I'm hoping my HPC will be made with a flat motherboard with all embedded components like stacked SRAM right on processors, two embedded GPUs, persistent memory holding everything used commonly to just start processing from off using "hotswapping" immediately, and a phase-change liquid cooling panel on a big copper heatsink with Peltiers sandwiched in for the processors and memory, and fan channels designed for turbulent pressure running on hopefully one jet receiving pre-chilled air from an external chiller, sandwiched in there and turned on as necessary, emulating the same as two-phase immersion cooling, which would be cool (pun intended) to see become a commercial cooling solution. As is, you can hook a "BedJet" to your computer as a cheap phase-change air unit. I use a mini split and a positioned fan system at night to keep costs down. My hope is to have all the air channels to go to one tube, which will go out the window, for my HPC, and not to have to constantly use air anyway.

Keep those cooling and processing energy requirements low, if possible, and keep up the good work!

The specs are updated a little. It will all be flat on the motherboard, even though the card components will all be there. It's going to use a power system to deliver power only when a portion of the motherboard is used, with some shared unified memory, and persistent memory to allow it not to have to load anything up, but rather, just continue processing again. The registers will include ZBT SRAM, stacked where necessary, and some LPDDR, when less power is required, with HBM3 for extreme memory requirements. No reason to use ordinary DDR. The busses will ensure no bottleneck where most would be, which does increase energy consumption. It will be PCIe 6, so have high requirements at times. However, it will have a power supply with a battery, which won't be hooked up to the cooling system or allow heat into the case, but just use fan turbulence to keep it cool enough. This will allow it to produce twice the power when processing heavy loads. The cooling will include phase change (evaporative) liquid cooling sandwiched onto the flat motherboard, phase change air cooling in channels that ensure overall cooling, and Peltiers hit by fans when the heat is high on processors and memory.

To ensure the heat doesn't get too high, Intel CPUs won't be used. Threadripper CPUs (two) will share the load, and offload to one of several NPUs best equipped for the specific AI processing, as needed. The onboard GPU will be the equivalent of an RTX Pro 6000 and an H200, with a low-power inference mode similar to Lovelace. I have worked as a ghostwriter/inventor towards this type of progress, so it's a sort of payment, but also, to be able to process science efficiently, repaying society. The weird thing I asked for, and I did work on it a little, is an OPU, or optical processing unit. It should be used for specific tasks that would take far more energy. It will mostly be water and cooling, like a huge copper heat sink, even though the motherboard will be huge. I asked for a black box I don't need to open, and only one engraving and light, on the power button.

It won't look like much, but it will be something like a full-size DGX Spark that can also do any gaming or video stuff you need. And portions of it will be made available, as they have to do research to make my HPC, which won't be wasted. One goal is to have wireless GPUs running on light and heat, able to be put into a dock somewhere in your house, to upgrade your house with ease.