Perseus Arm Survey - very low performance with new nvidia drivers
28 Jul 2013 7:38:08 UTC
Topic 197093
(moderation:
Hello guys,
I have two PCs one with Gentoo amd64 (AMD PhenomII 1090T @ 3.2GHz, nvidia GTX-650) and another with Debian amd64 stable (AMD Athlon X2 @ 2.7GHz, nvidia GT-440).
In both PCs I am running einstein@home with CUDA.
Two months ago I noticed that the performance of the cuda client application of the einstein@home at the PC with Gentoo was very poor compared to the PC with Debian and that the PC with Gentoo was producing computational errors running the cuda client app.
Several days ago I switch the PC with Gentoo to Windows and I noticed a performance boost in cuda client of almost 900% !!!
Today I test several nvidia-drivers in PC with Gentoo and I noticed that for versions 304.88, 310.51 and 313.30 the performance of cuda app is similar to that in windows.
For versions 319.32 and 325.08 the performance of cuda app is 900% worse (4days to complete a wu with errors)!!!
I run some of the cuda-sdk sample applications and some custom matlab code which uses cuda functions and the performance is similar for the several versions of nvidia drivers.
Is anyone notice this performance gap with nvidia-drivers >= 319.32 ???
Perseus Arm Survey - very low performance with new nvidia driver
)
At GPU-Grid the linux drivers since 319 are also extemly slow, so people are staying with 310 and 314's.
MrS
Scanning for our furry friends since Jan 2002
RE: At GPU-Grid the linux
)
So, this is a problem/bug of the nvidia-drivers (>319) and not a problem of the e@h cuda client combined with these drivers.
I will search the nvidia forums for any similar threads...
Thanks,
I'm running 319.32 normally
)
I'm running 319.32 normally on two computers and two different kernels/distributions. I did not notice any slowdown after upgrading.
Must be something else?
Not sure if this helps but
)
Not sure if this helps but I've recently run 2 Binary Radio Pulsar Search (Perseus Arm Survey) v1.33 (BRP4cuda32nv301)using my Nvidia GeForce 540M and 320.49 driver. The advertised run time was 10+ hours for each. Actual run time was ~ 6 hours for each and 3,333 credits for each.
Running Windows 7.
)
Running Windows 7.
RE: Running Windows 7. I
)
I think so far the problem of serious "under performance" with newer NVIDIA drivers seems to be restricted to Linux systems, am I getting this right??
So I guess one would want to focus on things like :
-nvidia driver version
-Kernel version, Linux distribution
-gfx card model
-gfx card max supported PCIe speed
-chipset/CPU max supported PCIe speed
-actually selected PCIe speed (e.g. from nvidia-settings tool)
and try to find a pattern, as some people are seeing this and others don't
Cheers
HB
RE: I think so far the
)
Yes.
MrS
Scanning for our furry friends since Jan 2002
Were you running all 4
)
Were you running all 4 applications before the driver update?
Binary Radio Pulsar Search (Arecibo) | Gamma-ray pulsar search #2 | Binary Radio Pulsar Search (Perseus Arm Survey) | Gravitational Wave S6 Directed Search (CasA)
You have the 6 processors on both of the ones running GT 650's and the 2 I have are GTX 650 Ti and mine are only quad and 3-core with that GPU card.
But I only run the BRP5's (PAS) and I know running all 4 or the different tasks at the same time do have an effect when you are running all of your CPU's
You can take a look at mine if you like but I also don't use linux
One is still XP Pro and the other is Win7 (and I have a couple 550Ti's and a 660Ti and all OC'd)
RE: Were you running all 4
)
Yes, I was running all 4 applications before the update of the nvidia drivers.
I also try to run apps only in 5 of the 6 cores (GTX-650) but there is no effect in the performance with the 319.32 drivers.
The latest statistics for this PC are:
1. 313.30 nvidia drivers & 100% cpu utilization (6 of 6 cores)-> ~19-20h/wu
2. 304.88 nvidia drivers & 100% cpu utilization (6 of 6 cores -> ~19-20h/wu
2. 313.30 nvidia drivers & 85% cpu utilization (5 of 6 cores) -> ~16-17h/wu
3. Windows 7 (same PC) & 100% cpu utilization (6 of 6 cores) -> ~12-13h/wu
There is a big performance gap between linux and windows !!
Also the cpu utilization seems to be affect the gpu performance.
I will try to minimize the cpu utilization to see if the linux performance will match the performance of windows...
Magic, this problem only
)
Magic, this problem only applies to Linux!
MrS
Scanning for our furry friends since Jan 2002