After much fruitless experiments, my conclusion is:
1) FGRP3 runs OK, with both Windows & Linus distros, if AMD ATI GPU card has 2048 MB or more;
2) Maximum Allocation Memory is restricted, probably by the Linux GPU driver (OPenCL ?), to 134217728 bytes for 1024 MB GPU cards;
3) FGRP3 runs OK with Windows even if you have a GPU card with 1024 MB of memory.
Note: you can follow the discussion, if you want to, in the following link: AMDusers Forum
Rationale for the Windows/1024 MB capability:
Just to quench my curiosity, I moved the 'Caicos'/HD6450 GPU card to an Inspiron 530 (circa 2008) computer running Windows 7 32-bit:
Operating System Microsoft Windows 7
Home Premium x86 Edition, Service Pack 1, (06.01.7601.00)
BOINC client version 7.2.42
Memory 3326.18 MB
Cache 1024 KB
Swap space 6641.46 MB
After installing AMD driver (Catalyst package 14.4), BOINC was started with one FGRP3 WU and guess what? It runs OK (no error)!.
Note: AMD SDK 2.x and app_config.xml were not installed.
439831720 7182523 8 Jun 2014 18:18:08 UTC 22 Jun 2014 18:18:08 UTC In progress --- --- --- --- Gamma-ray pulsar search #3 v1.11 (FGRPopencl-ati)
clinfo (truncated) shows:
Device Type: CL_DEVICE_TYPE_GPU
Device ID: 4098
Board name: AMD RADEON HD 6450
.
Max memory allocation: 536870912 50% of total memory!
.
Global memory size: 1073741824
It appears that the Maximum Allocation Memory limitation is restricted to Linux distros!
I believe I have SOLVED my problem with Gamma-ray pulsar search #3 v1.11 (FGRPopencl-ati) on Linux (Fedora Core 20) giving a computation error after about 15 seconds. It used to fail thus ...
7.2.42
process exited with code 65 (0x41, -191)
22:52:32 (22507): [normal]: This Einstein@home App was built at: Feb 18 2014 15:42:42
22:52:32 (22507): [normal]: Start of BOINC application '../../projects/einstein.phys.uwm.edu/hsgamma_FGRP3_1.11_x86_64-pc-linux-gnu__FGRPopencl-ati'.
command line: ../../projects/einstein.phys.uwm.edu/hsgamma_FGRP3_1.11_x86_64-pc-linux-gnu__FGRPopencl-ati --inputfile ../../projects/einstein.phys.uwm.edu/LATeah0092C.dat --outputfile results.cand.out --alpha 1.85606135223 --delta -0.187105282293 --pcutfu 0.06251659 --skyRadius 1.402826e-02 --f0start 32 --f0Band 64 --firstSkyPoint 114840 --numSkyPoints 99 --f1dot -3.37e-10 --f1dotBand 1e-12 --df1dot 8.207629151e-15 --ephemdir ../../projects/einstein.phys.uwm.edu/JPLEPH --Tcoh 524288.0 --toplist 5 --cohFollow 1 --numCells 1 --useWeights 1 --Srefinement 1 --CohSkyRef 1 --cohfullskybox 1 --interbinning 2 --useDiriWin 10 --mmfu 0.15 --reftime 55471 --debug 1 --device 0
output files: 'results.cand.out' '../../projects/einstein.phys.uwm.edu/LATeah0092C_96.0_114840_-3.36e-10_2_0' 'results.cand.out.cohfu' '../../projects/einstein.phys.uwm.edu/LATeah0092C_96.0_114840_-3.36e-10_2_1'
22:52:32 (22507): [debug]: Flags: X64 SSE SSE2 GNUC X86 GNUX86
22:52:32 (22507): [debug]: glibc version/release: 2.18/stable
22:52:32 (22507): [debug]: Set up communication with graphics process.
boinc_get_opencl_ids returned [0xb45480 , 0x7f49891f8380]
Using OpenCL platform provided by: Advanced Micro Devices, Inc.
Using OpenCL device "Juniper" by: Advanced Micro Devices, Inc.
Max allocation limit: 134217728
% Opening inputfile: ../../projects/einstein.phys.uwm.edu/LATeah0092C.dat
% Total amount of photon times: 10000
% Preparing toplist of length: 5
read_checkpoint(): Couldn't open file 'results.cand.out.cpt': No such file or directory (2)
% fft_size: 33554432 (0x2000000)
% Sky point 1/99
% Creating FFT plan.
Error allocating device memory: 268435456 bytes (error: -61)
22:52:33 (22507): [CRITICAL]: ERROR: MAIN() returned with error '1'
FPU status flags:
mv: cannot stat âresults.cand.outâ: No such file or directory
mv: cannot stat âresults.cand.outâ: No such file or directory
mv: cannot stat âresults.cand.outâ: No such file or directory
mv: cannot stat âresults.cand.outâ: No such file or directory
mv: cannot stat âresults.cand.outâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
22:52:45 (22507): [normal]: done. calling boinc_finish(65).
22:52:45 (22507): called boinc_finish
]]>
My current environment is this (from boinc.log) ...
23-Jun-2014 08:42:34 [---] Starting BOINC client version 7.2.42 for x86_64-pc-linux-gnu
23-Jun-2014 08:42:34 [---] log flags: file_xfer, sched_ops, task
23-Jun-2014 08:42:34 [---] Libraries: libcurl/7.32.0 NSS/3.16.1 Basic ECC zlib/1.2.8 libidn/1.28 libssh2/1.4.3
23-Jun-2014 08:42:34 [---] Data directory: /var/lib/boinc
23-Jun-2014 08:42:34 [---] CAL: ATI GPU 0: ATI Radeon HD 5700/6750/6770 series (Juniper) (CAL version 1.4.1848, 1024MB, 970MB available, 50 GFLOPS peak)
23-Jun-2014 08:42:34 [---] OpenCL: AMD/ATI GPU 0: ATI Radeon HD 5700/6750/6770 series (Juniper) (driver version 1348.5, device version OpenCL 1.2 AMD-APP (1348.5), 1024MB, 970MB available, 50 GFLOPS peak)
23-Jun-2014 08:42:34 [---] OpenCL CPU: AMD Athlon(tm) II X4 635 Processor (OpenCL driver vendor: Advanced Micro Devices, Inc., driver version 1348.5 (sse2), device version OpenCL 1.2 AMD-APP (1348.5))
23-Jun-2014 08:42:34 [---] Host name: xxxxxx
23-Jun-2014 08:42:34 [---] Processor: 4 AuthenticAMD AMD Athlon(tm) II X4 635 Processor [Family 16 Model 5 Stepping 2]
23-Jun-2014 08:42:34 [---] Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm 3dnowext 3dnow constant_tsc rep_good nopl nonstop_tsc extd_apicid pni monitor cx16 popcnt lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt hw_pstate npt lbrv svm_lock nrip_save
23-Jun-2014 08:42:34 [---] OS: Linux: 3.14.4-200.fc20.x86_64
23-Jun-2014 08:42:34 [---] Memory: 3.86 GB physical, 3.89 GB virtual
23-Jun-2014 08:42:34 [---] Disk: 241.34 GB total, 73.18 GB free
23-Jun-2014 08:42:34 [---] Local time is UTC +1 hours
The solution for me was to amend /usr/lib/systemd/system/boinc-client.service to include the line...
Environment="GPU_MAX_HEAP_SIZE=100"
The contents of that entire file now reads ...
[Unit]
Description=Berkeley Open Infrastructure Network Computing Client
After=network.target
I have tried using Fedora 20 (Xfce, 64-bit) but I couldn't install AMD ATI driver
(14.4), probably because AMD driver doesn't support kernel versions greater than release 3.11 as is the case of Fedora 20.
How did you manage to overcome this limitation?
I noticed that you included "GPU_MAX_HEAP_SIZE=100" in '/usr/lib/systemd/system/boinc-client.service' and not in the traditional way of doing it, i.e., as export GPU_MAX_HEAP_SIZE=100 (terminal) or including GPU_MAX_HEAP_SIZE=100 in ~./profile.
What is the version (2.x) of the installed AMD SDK?
After much fruitless
)
After much fruitless experiments, my conclusion is:
1) FGRP3 runs OK, with both Windows & Linus distros, if AMD ATI GPU card has 2048 MB or more;
2) Maximum Allocation Memory is restricted, probably by the Linux GPU driver (OPenCL ?), to 134217728 bytes for 1024 MB GPU cards;
3) FGRP3 runs OK with Windows even if you have a GPU card with 1024 MB of memory.
Note: you can follow the discussion, if you want to, in the following link:
AMDusers Forum
Rationale for the Windows/1024 MB capability:
Just to quench my curiosity, I moved the 'Caicos'/HD6450 GPU card to an Inspiron 530 (circa 2008) computer running Windows 7 32-bit:
Operating System Microsoft Windows 7
Home Premium x86 Edition, Service Pack 1, (06.01.7601.00)
BOINC client version 7.2.42
Memory 3326.18 MB
Cache 1024 KB
Swap space 6641.46 MB
After installing AMD driver (Catalyst package 14.4), BOINC was started with one FGRP3 WU and guess what? It runs OK (no error)!.
Note: AMD SDK 2.x and app_config.xml were not installed.
439831720 7182523 8 Jun 2014 18:18:08 UTC 22 Jun 2014 18:18:08 UTC In progress --- --- --- --- Gamma-ray pulsar search #3 v1.11 (FGRPopencl-ati)
clinfo (truncated) shows:
Device Type: CL_DEVICE_TYPE_GPU
Device ID: 4098
Board name: AMD RADEON HD 6450
.
Max memory allocation: 536870912 50% of total memory!
.
Global memory size: 1073741824
It appears that the Maximum Allocation Memory limitation is restricted to Linux distros!
Sergio.
Free-DC statistics
I believe I have SOLVED my
)
I believe I have SOLVED my problem with Gamma-ray pulsar search #3 v1.11 (FGRPopencl-ati) on Linux (Fedora Core 20) giving a computation error after about 15 seconds. It used to fail thus ...
process exited with code 65 (0x41, -191)
22:52:32 (22507): [normal]: This Einstein@home App was built at: Feb 18 2014 15:42:42
22:52:32 (22507): [normal]: Start of BOINC application '../../projects/einstein.phys.uwm.edu/hsgamma_FGRP3_1.11_x86_64-pc-linux-gnu__FGRPopencl-ati'.
command line: ../../projects/einstein.phys.uwm.edu/hsgamma_FGRP3_1.11_x86_64-pc-linux-gnu__FGRPopencl-ati --inputfile ../../projects/einstein.phys.uwm.edu/LATeah0092C.dat --outputfile results.cand.out --alpha 1.85606135223 --delta -0.187105282293 --pcutfu 0.06251659 --skyRadius 1.402826e-02 --f0start 32 --f0Band 64 --firstSkyPoint 114840 --numSkyPoints 99 --f1dot -3.37e-10 --f1dotBand 1e-12 --df1dot 8.207629151e-15 --ephemdir ../../projects/einstein.phys.uwm.edu/JPLEPH --Tcoh 524288.0 --toplist 5 --cohFollow 1 --numCells 1 --useWeights 1 --Srefinement 1 --CohSkyRef 1 --cohfullskybox 1 --interbinning 2 --useDiriWin 10 --mmfu 0.15 --reftime 55471 --debug 1 --device 0
output files: 'results.cand.out' '../../projects/einstein.phys.uwm.edu/LATeah0092C_96.0_114840_-3.36e-10_2_0' 'results.cand.out.cohfu' '../../projects/einstein.phys.uwm.edu/LATeah0092C_96.0_114840_-3.36e-10_2_1'
22:52:32 (22507): [debug]: Flags: X64 SSE SSE2 GNUC X86 GNUX86
22:52:32 (22507): [debug]: glibc version/release: 2.18/stable
22:52:32 (22507): [debug]: Set up communication with graphics process.
boinc_get_opencl_ids returned [0xb45480 , 0x7f49891f8380]
Using OpenCL platform provided by: Advanced Micro Devices, Inc.
Using OpenCL device "Juniper" by: Advanced Micro Devices, Inc.
Max allocation limit: 134217728
% Opening inputfile: ../../projects/einstein.phys.uwm.edu/LATeah0092C.dat
% Total amount of photon times: 10000
% Preparing toplist of length: 5
read_checkpoint(): Couldn't open file 'results.cand.out.cpt': No such file or directory (2)
% fft_size: 33554432 (0x2000000)
% Sky point 1/99
% Creating FFT plan.
Error allocating device memory: 268435456 bytes (error: -61)
22:52:33 (22507): [CRITICAL]: ERROR: MAIN() returned with error '1'
FPU status flags:
mv: cannot stat âresults.cand.outâ: No such file or directory
mv: cannot stat âresults.cand.outâ: No such file or directory
mv: cannot stat âresults.cand.outâ: No such file or directory
mv: cannot stat âresults.cand.outâ: No such file or directory
mv: cannot stat âresults.cand.outâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
mv: cannot stat âresults.cand.out.cohfuâ: No such file or directory
22:52:45 (22507): [normal]: done. calling boinc_finish(65).
22:52:45 (22507): called boinc_finish
]]>
My current environment is this (from boinc.log) ...
The solution for me was to amend /usr/lib/systemd/system/boinc-client.service to include the line...
Environment="GPU_MAX_HEAP_SIZE=100"
The contents of that entire file now reads ...
[Service]
Nice=10
User=boinc
PermissionsStartOnly=yes
ExecStartPre=/bin/sleep 1
Environment="GPU_MAX_HEAP_SIZE=100"
ExecStartPre=/usr/bin/touch /var/log/boinc.log /var/log/boincerr.log
ExecStartPre=/usr/bin/chown boinc:boinc /var/log/boinc.log /var/log/boincerr.log
ExecStart=/usr/bin/boinc --dir /var/lib/boinc
ExecReload=/usr/bin/boinccmd --read_cc_config
ExecStopPost=/bin/rm -f /var/lib/boinc/lockfile
[Install]
WantedBy=multi-user.target
My jobs now complete OK e.g.http://einsteinathome.org/task/442206217
I hope this is of use to someone.
Congratulations! I have
)
Congratulations!
I have tried using Fedora 20 (Xfce, 64-bit) but I couldn't install AMD ATI driver
(14.4), probably because AMD driver doesn't support kernel versions greater than release 3.11 as is the case of Fedora 20.
How did you manage to overcome this limitation?
I noticed that you included "GPU_MAX_HEAP_SIZE=100" in '/usr/lib/systemd/system/boinc-client.service' and not in the traditional way of doing it, i.e., as
export GPU_MAX_HEAP_SIZE=100 (terminal) or including GPU_MAX_HEAP_SIZE=100 in ~./profile.
What is the version (2.x) of the installed AMD SDK?
Best regards,
Sergio.
Free-DC statistics