All workunit generators reside on the affected server which we can only restore as soon as all data was transferred from it, it's file system got redone and the data got transferred back. Also, one of the download servers is now used for the uploads and we used the opportunity to improve its XFS fs as well before taking it partially online. That entailed a full data shift as well. All of this is still ongoing (see above). Again, we'll update you guys here as soon as we have more news - as we've done so far. Just be patient.
Can we ask for more technical detailes and solutions you've made due this outstanding challenge, like a BBC's chronicles of disasters. I think it will be highly appreciated by the volunteers.
You may certainly ask but please respect that our priorities are focusing on project management/maintenance right now, and probably for the foreseeable future as well :-) Apart from that we already gave a number of technical details. In the end it's just a reformatting of the main filesystem (as outlined above) and the use of a different temp. upload server.
I have two machines. The one with the Nvidia 550i card appears to be back to normal, however, the machine with 2 GPUs is clogged and showing no signs of getting better. I went to the message log after hitting "Update" and found the following error messages:
Tue 13 Jan 2015 10:08:17 AM EST | Einstein@Home | update requested by user
Tue 13 Jan 2015 10:08:19 AM EST | Einstein@Home | Sending scheduler request: Requested by user.
Tue 13 Jan 2015 10:08:19 AM EST | Einstein@Home | Not requesting tasks: too many uploads in progress
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | Scheduler request completed
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/stat_icon
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einsteinbinary_BRP4_02
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einsteinbinary_BRP4_00
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einstein_S6CasA_01
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einstein_S6CasA_00
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einstein_S6CasA_03
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einsteinbinary_BRP4_04
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einstein_S6CasA_04
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einstein_S6CasA_02
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einsteinbinary_BRP4_01
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einsteinbinary_BRP4_03
All of the WU's displayed in the Tasks window show "Uploading" (and have been for quite a while).
The other machine never showed these error messages. Should I give things more time or should I write these WU's off and hit project reset?
If you reset then you will loose all of the completed tasks and waste the time spent crunching them.
I would set "no new tasks" until the uploads are completed and the tasks reported and maybe after that reset the project.
Before that a reboot of the machine might get things going again.
Well, it looks like all of my machines have finished uploading, except for the two that broke down over the last couple of days. So, I now have some troubleshooting of my own to do.
RE: Any news on BRP work
)
All workunit generators reside on the affected server which we can only restore as soon as all data was transferred from it, it's file system got redone and the data got transferred back. Also, one of the download servers is now used for the uploads and we used the opportunity to improve its XFS fs as well before taking it partially online. That entailed a full data shift as well. All of this is still ongoing (see above). Again, we'll update you guys here as soon as we have more news - as we've done so far. Just be patient.
Thanks,
Oliver
Einstein@Home Project
Can we ask for more technical
)
Can we ask for more technical detailes and solutions you've made due this outstanding challenge, like a BBC's chronicles of disasters. I think it will be highly appreciated by the volunteers.
You may certainly ask but
)
You may certainly ask but please respect that our priorities are focusing on project management/maintenance right now, and probably for the foreseeable future as well :-) Apart from that we already gave a number of technical details. In the end it's just a reformatting of the main filesystem (as outlined above) and the use of a different temp. upload server.
Oliver
Einstein@Home Project
new server is up, eh? i was
)
new server is up, eh? i was wondering why all my uploads are going through flawlessly now! great job guys!
Congratulations on the
)
Congratulations on the progress.
I have two machines. The one with the Nvidia 550i card appears to be back to normal, however, the machine with 2 GPUs is clogged and showing no signs of getting better. I went to the message log after hitting "Update" and found the following error messages:
Tue 13 Jan 2015 10:08:17 AM EST | Einstein@Home | update requested by user
Tue 13 Jan 2015 10:08:19 AM EST | Einstein@Home | Sending scheduler request: Requested by user.
Tue 13 Jan 2015 10:08:19 AM EST | Einstein@Home | Not requesting tasks: too many uploads in progress
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | Scheduler request completed
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/stat_icon
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einsteinbinary_BRP4_02
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einsteinbinary_BRP4_00
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einstein_S6CasA_01
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einstein_S6CasA_00
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einstein_S6CasA_03
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einsteinbinary_BRP4_04
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einstein_S6CasA_04
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einstein_S6CasA_02
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einsteinbinary_BRP4_01
Tue 13 Jan 2015 10:08:21 AM EST | Einstein@Home | [error] Can't create link file projects/einstein.phys.uwm.edu/slideshow_einsteinbinary_BRP4_03
All of the WU's displayed in the Tasks window show "Uploading" (and have been for quite a while).
The other machine never showed these error messages. Should I give things more time or should I write these WU's off and hit project reset?
Thanks for any help you can provide.
Regards,
Steve
If you reset then you will
)
If you reset then you will loose all of the completed tasks and waste the time spent crunching them.
I would set "no new tasks" until the uploads are completed and the tasks reported and maybe after that reset the project.
Before that a reboot of the machine might get things going again.
Well, it looks like all of my
)
Well, it looks like all of my machines have finished uploading, except for the two that broke down over the last couple of days. So, I now have some troubleshooting of my own to do.
Thanks for the suggestions.
)
Thanks for the suggestions. I did try a re-boot but no joy. I will set it for "no new tasks" and hope that what I have will get uploaded.
Regards,
Steve
All of my work has now been
)
All of my work has now been reported so now the question is when will new work be issued?
Last I heard was the Gravity
)
Last I heard was the Gravity wave tasks are available right now and the rest hopefully by tomorrow.
See Olivers post earlier in this thread.