CPU tasks.

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5872
Credit: 117767272027
RAC: 34793305

Tom M wrote:Apparently Linux

Tom M wrote:
Apparently Linux Gamma-Ray#5 cpu tasks have the following results on two different Amd model cpus.

A more likely explanation for the difference could be that the two machines were analysing different data files at the time you recorded the results.  The first part of a task name (eg something like LATeah1026F_... ) indicates that  such tasks would be using a data file named LATeah1026F.dat.

Quite often successive data files do give similar crunch times, particularly if the file sizes are the same.  Recently there has been a reasonable turnover in these files and the sizes have been markedly different.  For example, the LATeah1025F.dat, issued May 21 had a size of 368,588 bytes whilst the next in the series LATeah1026F.dat issued May 24 had a size of 5,134,792 bytes - very much larger.  I don't really know the factors that do affect crunch time, but I wouldn't be surprised if file size was one of them.

The only way to have a fair comparison is to choose results for the same data file.  Such results do tend to have a pretty constant crunch time on specific hardware - perhaps a slightly rising crunch time as the frequency term in the task name increases.  So, for a really rigorous comparison, use tasks having the same data file and frequency, which is the 2nd field in the task name.

If it does turn out that the results from both CPUs were for the same data file, then it was a surprisingly large difference, much more than I would have expected.

Cheers,
Gary.

Rolf
Rolf
Joined: 7 Aug 17
Posts: 27
Credit: 135377187
RAC: 0

For FGRP tasks on CPU, don't

For FGRP tasks on CPU, don't forget to create a wisdom file, it speeds up processing a lot.

On my 2700X, when running 5 FGRP tasks in parallel, execution times are either 1 h 20 min or around 4 h. There seems to be two flavors of FGRP tasks coming currently.

mikey
mikey
Joined: 22 Jan 05
Posts: 12702
Credit: 1839106099
RAC: 3617

Rolf wrote: For FGRP tasks

Rolf wrote:

For FGRP tasks on CPU, don't forget to create a wisdom file, it speeds up processing a lot.

On my 2700X, when running 5 FGRP tasks in parallel, execution times are either 1 h 20 min or around 4 h. There seems to be two flavors of FGRP tasks coming currently.

What is "a wisdom file"?

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6467
Credit: 9593748510
RAC: 6489572

mikey wrote: Rolf

mikey wrote:

Rolf wrote:

For FGRP tasks on CPU, don't forget to create a wisdom file, it speeds up processing a lot.

On my 2700X, when running 5 FGRP tasks in parallel, execution times are either 1 h 20 min or around 4 h. There seems to be two flavors of FGRP tasks coming currently.

What is "a wisdom file"?

And how do you create it?

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

Rolf
Rolf
Joined: 7 Aug 17
Posts: 27
Credit: 135377187
RAC: 0

How to create a wisdom.dat

How to create a wisdom.dat file and where to put that file, see first post in this link

https://einsteinathome.org/content/gamma-ray-pulsar-search-fgrpb1-cpu-app-version-108

I recommend running the command at the same time as you have some load on the CPU, it gives the best result in my experience. So run the command while at the same time processing a few FGRP tasks ideally. There is a discussion about this in the same thread I think - if in doubt you can try it out yourself, just create several wisdom.dat files and see which one is best.

Keith Myers
Keith Myers
Joined: 11 Feb 11
Posts: 4968
Credit: 18767159373
RAC: 7119363

Thanks for the tip.  I never

Thanks for the tip.  I never realized there was a wisdom binary available for profiling in Linux. Ran it on both the hosts and chopped 20-30 minutes off the crunch time.

 

cecht
cecht
Joined: 7 Mar 18
Posts: 1537
Credit: 2914111988
RAC: 2120096

Yes, great tip! Just ran

Yes, great tip! Just ran wisdom and the first gamma ray pulsar search #5 v1.08 task came in with a time 40 min. less than the average of the three shortest tasks from the previous 20 tasks crunched without wisdom. That's on a 4-thread Pentium running a single CPU task while the AMD GPU ran 3x pulsar tasks. I'll try to remember to report some average times later.

Thank you ROLF!

 

Ideas are not fixed, nor should they be; we live in model-dependent reality.

Keith Myers
Keith Myers
Joined: 11 Feb 11
Posts: 4968
Credit: 18767159373
RAC: 7119363

My first estimate must have

My first estimate must have been with partially completed tasks started without a wisdom file.  Now that I have completed some more tasks started from the beginning with a wisdom file, it looks like the improvement is on the order of around 60 minutes on average.

Thank you ROLF!

 

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6467
Credit: 9593748510
RAC: 6489572

Rolf wrote: How to create a

Rolf wrote:

How to create a wisdom.dat file and where to put that file, see first post in this link

https://einsteinathome.org/content/gamma-ray-pulsar-search-fgrpb1-cpu-app-version-108

I recommend running the command at the same time as you have some load on the CPU, it gives the best result in my experience. So run the command while at the same time processing a few FGRP tasks ideally. There is a discussion about this in the same thread I think - if in doubt you can try it out yourself, just create several wisdom.dat files and see which one is best.

 

Ok, what am I missing?

tom@TheMonolith:~/Desktop/BOINC/projects/einstein.phys.uwm.edu$ ./fftwf-wisdom_FGRP5_1.08_x86_64-pc-linux-gnu -o FGRPB1wisdom.dat rib67108864

When I run this command it goes away and doesn't come back until I do a control C?

Tom M

 

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6467
Credit: 9593748510
RAC: 6489572

Tom M wrote: Rolf

Tom M wrote:

Rolf wrote:

How to create a wisdom.dat file and where to put that file, see first post in this link

https://einsteinathome.org/content/gamma-ray-pulsar-search-fgrpb1-cpu-app-version-108

I recommend running the command at the same time as you have some load on the CPU, it gives the best result in my experience. So run the command while at the same time processing a few FGRP tasks ideally. There is a discussion about this in the same thread I think - if in doubt you can try it out yourself, just create several wisdom.dat files and see which one is best.

 

Ok, what am I missing?

tom@TheMonolith:~/Desktop/BOINC/projects/einstein.phys.uwm.edu$ ./fftwf-wisdom_FGRP5_1.08_x86_64-pc-linux-gnu -o FGRPB1wisdom.dat rib67108864

When I run this command it goes away and doesn't come back until I do a control C?

Tom M

 

What I was missing is that it could take an hour or more to generate.

I think.

Tom M

 

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.