A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
I was trolling eBay for "GPU servers" and ran across up to 10 pcie slot servers (all Intel).
The prices are not completely too high (in some cases).
Some of the descriptions listed potential GPUs you could install. Apparently 2 slot GPUs.
One listing even mentioned a gtx 1080 ti?
I am presuming the majority of these "real" 2 slot gpus have no internal cooling. Which is how they can get a lot of them in there.
Therefor they are using (noisy) case fans?
Mumble...
Tom M
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
This is an 8 slot MB with 4 additional 1x slots that can used for mining expansion kits.
I bought this system in a case with fans, dual 220 volt PSUs, CPU and a micro SSD. For $50 plus $129 shipping off eBay. The seller was closing these out.
The most important technical feature is all the interfaces are standard. Unlike some of the latest mining MB's which seem to need PSU's that don't have 24 pin power up requirements.
Since it uses standard 6th/7th gen Intel CPUs you are not locked into a soldiered on CPU.
Pros:
It has 8 usable PCIe slots on the MB which can be plugged in directly.
This avoids mining expansion kits and ribbon cables.
If you use strict 2 slot rtx 3080 ti's that are about 10" long you really can put 8 GPU's on the system. And add 4 more GPU's via the Mining expansion kits.
With 4 rtx 3080 ti's installed it is using about 40 percent of the available ram an just under half the CPU resources. The current CPU has two cores.
Cons:
Limited CPU expansion. The maximum this Intel socket version takes is 4c/8t.
This means if a GPU tasks needs heavy CPU processing it may not be runnable on this system.
Limited CPU memory. You have one slot. The 8 mbyte sodium ddr3 ram is commonly available. I am still uncertain if there is a 16 mbyte version.
PCIe speeds are gen1 and 1x with 1 slot exception.
This means any GPU tasks that are bandwidth sensitive will not run very fast on this system.
Examples include gpugrid tasks.
Using 2 standard EVGA 1600 watt PSU's you are limited to 6 - 9 GPU's (3 vga 8 pins or 2 vga 8 pins per GPU) by the 9 vga 8 pins plugins on the PSU. This assumes you don't use both plugs on the PSU power cables.
I was unable to get either MB I had to go into bios/setup mode. I was able to install a new operating system using the bottom USB port under the RJ 47 (Lan) jack if the micro-sata-ssd had no bootable OS. And on to sata HDD's.
The case fans are very loud server fans that howl!
Would I buy this system new? No. However the massive convenience of plugging GPU's directly into the MB should not be ignored.
Respectfully.
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
This is an 8 slot MB with 4 additional 1x slots that can used for mining expansion kits.
I bought this system in a case with fans, dual 220 volt PSUs, CPU and a micro SSD. For $50 plus $129 shipping off eBay. The seller was closing these out.
The most important technical feature is all the interfaces are standard. Unlike some of the latest mining MB's which seem to need PSU's that don't have 24 pin power up requirements.
Since it uses standard 6th/7th gen Intel CPUs you are not locked into a soldiered on CPU.
Pros:
It has 8 usable PCIe slots on the MB which can be plugged in directly.
This avoids mining expansion kits and ribbon cables.
If you use strict 2 slot rtx 3080 ti's that are about 10" long you really can put 8 GPU's on the system. And add 4 more GPU's via the Mining expansion kits.
With 4 rtx 3080 ti's installed it is using about 40 percent of the available ram an just under half the CPU resources. The current CPU has two cores.
Cons:
Limited CPU expansion. The maximum this Intel socket version takes is 4c/8t.
This means if a GPU tasks needs heavy CPU processing it may not be runnable on this system.
Limited CPU memory. You have one slot. The 8 mbyte sodium ddr3 ram is commonly available. I am still uncertain if there is a 16 mbyte version.
PCIe speeds are gen1 and 1x with 1 slot exception.
This means any GPU tasks that are bandwidth sensitive will not run very fast on this system.
Examples include gpugrid tasks.
Using 2 standard EVGA 1600 watt PSU's you are limited to 6 - 9 GPU's (3 vga 8 pins or 2 vga 8 pins per GPU) by the 9 vga 8 pins plugins on the PSU. This assumes you don't use both plugs on the PSU power cables.
I was unable to get either MB I had to go into bios/setup mode. I was able to install a new operating system using the bottom USB port under the RJ 47 (Lan) jack if the micro-sata-ssd had no bootable OS. And on to sata HDD's.
The case fans are very loud server fans that howl!
Would I buy this system new? No. However the massive convenience of plugging GPU's directly into the MB should not be ignored.
Respectfully.
Wouldn't running PCIe speeds at 1x even impact E@H work? Someone else will have to chime in here but that is not a fast interface.
So far my co-team members seem to think not really.
Apparently not brp7 tasks. Might have effected the grp#1 tasks some.
I still need to test the Allsky GPU tasks. I think the bottleneck there will be the two core CPU.
Respectfully.
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
it will matter if you want to use CUDA MPS (running 3x tasks with MPS uses about 20% PCIe 3.0 x16 link), but natively running the standard tasks or the custom app without MPS the PCIe use is pretty low.
I'm not sure which PCIe gen speed that Tom is running on that board whether it's 3.0 or 2.0 or 1.0, but my *guess* is that 2.0+ x1 should be fine.
it will matter if you want to use CUDA MPS (running 3x tasks with MPS uses about 20% PCIe 3.0 x16 link), but natively running the standard tasks or the custom app without MPS the PCIe use is pretty low.
I'm not sure which PCIe gen speed that Tom is running on that board whether it's 3.0 or 2.0 or 1.0, but my *guess* is that 2.0+ x1 should be fine.
As far as I can tell I am running all Gen1 with 1x.
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
I was reading about Blade Servers today. One of my former bosses was involved with one at KU. He was very proud of his data analysis using SQL with it.
The bottom line is they have a strong resemblance to a Raspberry Pi cluster. Which basically means while each individual blade could not reach the heights of a 256 thread server they would be great at volume at the aggregate individual user level (top user report).
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
https://www.columbiamissouria
)
https://www.columbiamissourian.com/news/higher_education/mus-new-hellbender-takes-a-byte-out-of-supercomputing/article_d44fe256-6d36-11ee-96b5-f309e0253a04.html
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
Tom M
)
Look for a used Cray, I saw one one time on sale for $10KUSD
I was trolling eBay for "GPU
)
I was trolling eBay for "GPU servers" and ran across up to 10 pcie slot servers (all Intel).
The prices are not completely too high (in some cases).
Some of the descriptions listed potential GPUs you could install. Apparently 2 slot GPUs.
One listing even mentioned a gtx 1080 ti?
I am presuming the majority of these "real" 2 slot gpus have no internal cooling. Which is how they can get a lot of them in there.
Therefor they are using (noisy) case fans?
Mumble...
Tom M
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
yes, they are server chassis
)
yes, they are server chassis and will be audible from your neighbors house.
_________________________________________________________________________
ONDA B250-D8P-D4 Mining
)
ONDA B250-D8P-D4 Mining MB
https://einsteinathome.org/host/13166221
This is an 8 slot MB with 4 additional 1x slots that can used for mining expansion kits.
I bought this system in a case with fans, dual 220 volt PSUs, CPU and a micro SSD. For $50 plus $129 shipping off eBay. The seller was closing these out.
The most important technical feature is all the interfaces are standard. Unlike some of the latest mining MB's which seem to need PSU's that don't have 24 pin power up requirements.
Since it uses standard 6th/7th gen Intel CPUs you are not locked into a soldiered on CPU.
Pros:
It has 8 usable PCIe slots on the MB which can be plugged in directly.
This avoids mining expansion kits and ribbon cables.
If you use strict 2 slot rtx 3080 ti's that are about 10" long you really can put 8 GPU's on the system. And add 4 more GPU's via the Mining expansion kits.
With 4 rtx 3080 ti's installed it is using about 40 percent of the available ram an just under half the CPU resources. The current CPU has two cores.
Cons:
Limited CPU expansion. The maximum this Intel socket version takes is 4c/8t.
This means if a GPU tasks needs heavy CPU processing it may not be runnable on this system.
Limited CPU memory. You have one slot. The 8 mbyte sodium ddr3 ram is commonly available. I am still uncertain if there is a 16 mbyte version.
PCIe speeds are gen1 and 1x with 1 slot exception.
This means any GPU tasks that are bandwidth sensitive will not run very fast on this system.
Examples include gpugrid tasks.
Using 2 standard EVGA 1600 watt PSU's you are limited to 6 - 9 GPU's (3 vga 8 pins or 2 vga 8 pins per GPU) by the 9 vga 8 pins plugins on the PSU. This assumes you don't use both plugs on the PSU power cables.
I was unable to get either MB I had to go into bios/setup mode. I was able to install a new operating system using the bottom USB port under the RJ 47 (Lan) jack if the micro-sata-ssd had no bootable OS. And on to sata HDD's.
The case fans are very loud server fans that howl!
Would I buy this system new? No. However the massive convenience of plugging GPU's directly into the MB should not be ignored.
Respectfully.
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
Tom M wrote: ONDA
)
Wouldn't running PCIe speeds at 1x even impact E@H work? Someone else will have to chime in here but that is not a fast interface.
So far my co-team members
)
So far my co-team members seem to think not really.
Apparently not brp7 tasks. Might have effected the grp#1 tasks some.
I still need to test the Allsky GPU tasks. I think the bottleneck there will be the two core CPU.
Respectfully.
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
it will matter if you want to
)
it will matter if you want to use CUDA MPS (running 3x tasks with MPS uses about 20% PCIe 3.0 x16 link), but natively running the standard tasks or the custom app without MPS the PCIe use is pretty low.
I'm not sure which PCIe gen speed that Tom is running on that board whether it's 3.0 or 2.0 or 1.0, but my *guess* is that 2.0+ x1 should be fine.
_________________________________________________________________________
Ian&Steve C. wrote: it will
)
As far as I can tell I am running all Gen1 with 1x.
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!
I was reading about Blade
)
I was reading about Blade Servers today. One of my former bosses was involved with one at KU. He was very proud of his data analysis using SQL with it.
The bottom line is they have a strong resemblance to a Raspberry Pi cluster. Which basically means while each individual blade could not reach the heights of a 256 thread server they would be great at volume at the aggregate individual user level (top user report).
https://en.m.wikipedia.org/wiki/Blade_server
A Proud member of the O.F.A. (Old Farts Association). Be well, do good work, and keep in touch.® (Garrison Keillor) I want some more patience. RIGHT NOW!