All things Nvidia GPU

Boca Raton Community HS
Boca Raton Comm...
Joined: 4 Nov 15
Posts: 239
Credit: 10,545,375,586
RAC: 26,263,335

Ian&Steve C. wrote: GV100 is

Ian&Steve C. wrote:

GV100 is pretty much the only option that matches all the specs and capabilities, but there’s no free lunch and they’re all still like $1000+ each  

Agreed- we watch Ebay for used GV100 GPUs that go up and they are never cheap. Even the GP100 is still  relatively expensive.

Tom, 

If you can cool it, the P100 can be a good value (for fp64 work) because you can find them for really, really cheap if you watch for them on Ebay. Ian&Steve C. is right though, you will not have all of the performance (especially with fp32- the P100 is really, really bad). If you plan on using it for work here, the (G)P100 is not a good option, in my opinion. 

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3,945
Credit: 46,713,252,642
RAC: 64,301,095

the biggest reason the GV100

the biggest reason the GV100 is holding value is the 32GB vram for AI stuff. 

Tom recently bought a server chassis that’s designed for these passive data center GPUs, and even has the proper connector for them. (Data center GPUs up until very recently all used the EPS12V/CPU 8-pin connector, and that’s very standard in the enterprise/server space, but different than the VGA/PCIe connectors we use on consumer cards) 

 

but he’s trying to go against the grain and not use the loud server fans because he wants it to be quieter. IMO, it’s not going to work well without the loud fans either way. 

_________________________________________________________________________

Keith Myers
Keith Myers
Joined: 11 Feb 11
Posts: 4,963
Credit: 18,710,811,720
RAC: 6,344,056

Tom M wrote: I am very

Tom M wrote:

I am very interested in finding 2 slot (strickly) GPU's with active cooling with power plugs off of the back.

I know that M4000 and P4000 have this. And I suspect the P100 does.

Any ideas?

I have heard of adapters to switch the top to the back but they would need to be very thin.

I am looking at a GPU space with very constrainted top spacing.

Thank you.

I guess the EVGA Powerlink adapters won't work because they are made for PCIe power pinouts,

Don't know what your definition of 'thin' is though.  The Powerlink adapter is only about 3/4" high.

 

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3,945
Credit: 46,713,252,642
RAC: 64,301,095

based on the pics of the

based on the pics of the chassis and how the GPUs mount, there's almost no room for top mounted cables. certainly not 3/4". maybe 1/8-1/4" if that.

Tom could verify this himself by just installing one of the titan Vs into the chassis and looking at the clearance without cables.

_________________________________________________________________________

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6,435
Credit: 9,565,003,143
RAC: 8,939,675

Ian&Steve C. wrote: based on

Ian&Steve C. wrote:

based on the pics of the chassis and how the GPUs mount, there's almost no room for top mounted cables. certainly not 3/4". maybe 1/8-1/4" if that.

Tom could verify this himself by just installing one of the titan Vs into the chassis and looking at the clearance without cables.

What!  And ruin my anticipation of failure?

No clearance.  Sigh.

I will start packing it up tomorrow for a return on Monday or something.

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

KLiK
KLiK
Joined: 1 Apr 14
Posts: 63
Credit: 427,540,107
RAC: 1,282,053

Tom M wrote: I am very

Tom M wrote:

I am very interested in finding 2 slot (strickly) GPU's with active cooling with power plugs off of the back.

I know that M4000 and P4000 have this. And I suspect the P100 does.

Any ideas?

I have heard of adapters to switch the top to the back but they would need to be very thin.

I am looking at a GPU space with very constrainted top spacing.

Thank you.

I know K5000 & K6000 has that, but also M5000 has it (as I do own it). Now, I do work with RTX 4000 card currently, which also has it!

Also, note: almost all TESLA has it & almost all Quadro / RTX has it (not GeForce RTX)!

 

Had a same problem with C30 workstation, but now work with D30 so plenty of room here! So that is why I have that experiance. ????

James Bradshaw
James Bradshaw
Joined: 1 Mar 14
Posts: 23
Credit: 1,278,351,605
RAC: 2,376,709

Hi all.  Re message that

Hi all.  Re message that GeForce MX550 not working back on 3 July.  Thanks to GWGeorge//Tom M//SanFernandoValley//Klik//IanStevec/// and all.  The MX550 is working.  So sorry for failure to respond to all of you.  I had to deal with severe medical problems and my five ponies in here were basically on auto-pilot.  I tried to set up new acct to test and mangled that....so I tried processing suggestion from Tom M and KliK to try BRP7 only and it worked!  So to anyone else with an MX550 not being used, there is hope.  Unfortunately, production on this machine does not warrant using this one for for Ein and MW at the same time so I will alternate between them as needed.   

mikey
mikey
Joined: 22 Jan 05
Posts: 12,680
Credit: 1,839,082,536
RAC: 3,914

James Bradshaw wrote: Hi

James Bradshaw wrote:

Hi all.  Re message that GeForce MX550 not working back on 3 July.  Thanks to GWGeorge//Tom M//SanFernandoValley//Klik//IanStevec/// and all.  The MX550 is working.  So sorry for failure to respond to all of you.  I had to deal with severe medical problems and my five ponies in here were basically on auto-pilot.  I tried to set up new acct to test and mangled that....so I tried processing suggestion from Tom M and KliK to try BRP7 only and it worked!  So to anyone else with an MX550 not being used, there is hope.  Unfortunately, production on this machine does not warrant using this one for for Ein and MW at the same time so I will alternate between them as needed.   

MW no longer has any gpu tasks so you can keep it here on Einstein full time.

James Bradshaw
James Bradshaw
Joined: 1 Mar 14
Posts: 23
Credit: 1,278,351,605
RAC: 2,376,709

Thanks Mikey.  Understand,

Thanks Mikey.  Understand, but I am running only two projects-Milky and Ein. I have tried to balance out all five hosts running both--CPU on all for Milky and GPU on all for Ein and I end up killing my production for both Mil and Ein.  Am going back to Ein only on four hosts and Milky on one host  That should keep my head above water for Ein.  I think in my case, I just need to save my pennies and get a host with a bunch of CPUs/cores dedicated for Milky...

James Bradshaw
James Bradshaw
Joined: 1 Mar 14
Posts: 23
Credit: 1,278,351,605
RAC: 2,376,709

Mikey, more specific to your

Mikey, more specific to your comment, yes, I can leave the MX550 host on EIN only, so that is a good suggestion.  I have had a problem balancing out usage of my hosts with Milky going CPU only and Ein doing GPU.  Perhaps my problem involves that Ein GPU tasks also use at least some CPU time??  My overall performance took a big hit with Milky/CPU and Ein/GPU conflicts.  

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.