Error: Scheduler request failed: HTTP file not found

Bigeagle
Bigeagle
Joined: 3 Apr 07
Posts: 12
Credit: 52111466
RAC: 76970
Topic 227057

I had Einstein@home inactive for a few years with boinc just running. Now i wanted to get some WUs from Einstein but only get the following error.
22.02.2022 14:14:44 | Einstein@Home | Scheduler request failed: HTTP file not found

Without further information i have no clue what fails there. No custom configuration as far as i can see.
Maybe someone here has an idea?

I could try the 'did you turn it off and on again' style solution and remove and readd the whole project.

Richard Haselgrove
Richard Haselgrove
Joined: 10 Dec 05
Posts: 2143
Credit: 2979884093
RAC: 771357

Please tell us a bit more

Please tell us a bit more about your setup - which operating system, which version of BOINC? If possible, post the first 20-30 lines shown in the Event Log after BOINC starts up.

If you're using Windows, updating BOINC to version 7.16.20 may help.

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 4045
Credit: 48050419445
RAC: 34890070

is the Europe server still

is the Europe server still having issues? he's in Germany. There was some issue a few days ago with file downloads from the Europe server.

_________________________________________________________________________

ES-Six
Joined: 6 Oct 18
Posts: 18
Credit: 30421405
RAC: 15490

I think it's related to this

I think it's related to an issue I encountered, the download server is impacted, but the scheduler may be impacted by the replication issue :)

You can find a complete details of the investigation on this thread :

https://einsteinathome.org/fr/content/project-files-stuck-download

 

Mirror server in Europe is having an issue with the replication (HTTP 404 not found error).

Impacted Mirror server in europe : einstein2.aei.uni-hannover.de

Main server in america : einstein-dl.syr.edu (unreachable from europe)

 

As temporary fix, I tested using a VPN in america to be able to use the main server (einstein-dl.syr.edu).

Note : if you intend to use a VPN in America : BOINC may take some time to switch between servers, you may need to restart BOINC and wait some minutes to make it use the main server.

 

If you wan't to have a more verbose log in BOINC, you can enable HTTP debug logs :

Options > Event logs... > check "http_debug"

Then run project update

Richard Haselgrove
Richard Haselgrove
Joined: 10 Dec 05
Posts: 2143
Credit: 2979884093
RAC: 771357

I think the Hannover download

I think the Hannover download server is working again - I got a new skygrid file from Einstein2 @ Hannover overnight:

<file>
    <name>skygrid_635Hz_m0.002.dat</name>
    <nbytes>132497626.000000</nbytes>
    <max_nbytes>0.000000</max_nbytes>
    <md5_cksum>ccda014eadd1a467c618d1b89dd55204</md5_cksum>
    <status>1</status>
    <download_url>http://einstein2.aei.uni-hannover.de/EinsteinAtHome/download/13d/skygrid_635Hz_m0.002.dat</download_url>
    <download_url>http://einstein-dl.syr.edu/download/13d/skygrid_635Hz_m0.002.dat</download_url>
</file>

I suggested the version upgrade in case it's the certificate expiry problem (either of them ...). I think that's the error message you get if the 'master file' fetch fails.

Bigeagle
Bigeagle
Joined: 3 Apr 07
Posts: 12
Credit: 52111466
RAC: 76970

Oh, i totally forgot the

Oh, i totally forgot the information part. I'm sorry.

I was using BOINC 7.16.11 which told me that no updates were available.
I'm still on Win 7 professional x64 but that may change soon.

After updating to BOINC 7.16.20 and activating the http debug i see where it fails.

22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:    Trying 130.75.116.40...
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  Connected to einstein.phys.uwm.edu (130.75.116.40) port 80 (#15)
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: POST /EinsteinAtHome_cgi/cgi HTTP/1.1
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Host: einstein.phys.uwm.edu
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.16.20)
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Accept: */*
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Accept-Encoding: deflate, gzip
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Accept-Language: de_DE
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Content-Length: 16316
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Content-Type: application/x-www-form-urlencoded
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Expect: 100-continue
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server:
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: HTTP/1.1 301 Moved Permanently
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Date: Tue, 22 Feb 2022 18:39:47 GMT
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Server: Apache
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Location: https://einsteinathome.org/EinsteinAtHome_cgi/cgi
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Content-Length: 257
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Connection: close
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Content-Type: text/html; charset=iso-8859-1
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server:
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: <html><head>
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: <title>301 Moved Permanently</title>
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: </head><body>
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: <h1>Moved Permanently</h1>
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: <p>The document has moved <a href="https://einsteinathome.org/EinsteinAtHome_cgi/cgi">here</a>.</p>
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: </body></html>
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  Closing connection 15
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  Issue another request to this URL: 'https://einsteinathome.org/EinsteinAtHome_cgi/cgi'
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  Found bundle for host einsteinathome.org: 0x32851c0 [can pipeline]
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  Re-using existing connection! (#14) with host einsteinathome.org
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  Connected to einsteinathome.org (130.75.116.40) port 443 (#14)
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: POST /EinsteinAtHome_cgi/cgi HTTP/1.1
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Host: einsteinathome.org
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.16.20)
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Accept: */*
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Accept-Encoding: deflate, gzip
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Referer: http://einstein.phys.uwm.edu/EinsteinAtHome_cgi/cgi
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Accept-Language: de_DE
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Content-Length: 16316
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Content-Type: application/x-www-form-urlencoded
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server: Expect: 100-continue
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Sent header to server:
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: HTTP/1.1 100 Continue
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  We are completely uploaded and fine
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: HTTP/1.1 404 Not Found
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Date: Tue, 22 Feb 2022 18:39:47 GMT
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Server: Apache
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Expires: Sun, 19 Nov 1978 05:00:00 GMT
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Last-Modified: Tue, 22 Feb 2022 18:39:47 GMT
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Cache-Control: store, no-cache, must-revalidate
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Cache-Control: post-check=0, pre-check=0
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: X-Content-Type-Options: nosniff
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: X-Frame-Options: sameorigin
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Content-Type: text/html; charset=utf-8
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Set-Cookie: SESS3e782c8988cf3721b1565654f7f6d21b=nmcmcgrqjp388mukgl7s29tiv0; expires=Thu, 17-Mar-2022 22:13:07 GMT; Max-Age=2000000; path=/; domain=einsteinathome.org; secure
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Vary: Accept-Encoding
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Content-Encoding: gzip
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server: Content-Length: 1698
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Received header from server:
22.02.2022 18:39:47 | Einstein@Home |
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  Connection #14 to host einsteinathome.org left intact
22.02.2022 18:39:48 | Einstein@Home | Scheduler request failed: HTTP file not found
 

So a 301 leading to an 404. So unless i'm overlooking something that will hopefully just take some time to get fixed.

Richard Haselgrove
Richard Haselgrove
Joined: 10 Dec 05
Posts: 2143
Credit: 2979884093
RAC: 771357

From that log, it's not

From that log, it's not entirely clear what stage in the process you'd reached. I don't see the actual name of the file which it says has moved. Perhaps it would help if you could post a simpler log, without the extra debug detail, so we can orient ourselves?

Is this a new machine to the project, or one of the ones which you've used in the past? If it's been run here before, but then been given a rest, project changes may have got in the way. Some security procedures had to be changed to comply with GDPR.

In general, Einstein's servers are very reliable, and work is flowing normally. We did have a bit of a glitch last week, but this doesn't feel like the same problem.

Bigeagle
Bigeagle
Joined: 3 Apr 07
Posts: 12
Credit: 52111466
RAC: 76970

I'm sorry again for didn't

I'm sorry again for didn't copy the whole part.
Then there seems to be some more messages in the stdoutdae.txt then what i get from copying the messages out of the 'messages' window. So it gets even more text for the whole process.

It requested https://einsteinathome.org/rss_main.php and got that. After that it seems to request http://einstein.phys.uwm.edu/EinsteinAtHome_cgi/cgi which failed as could be seen in the log above. Adjacent lines for orientation.

'22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  Closing connection 15
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  Issue another request to this URL: 'https://einsteinathome.org/EinsteinAtHome_cgi/cgi'
22.02.2022 18:39:47 | Einstein@Home | [http] [ID#1] Info:  Found bundle for host einsteinathome.org: 0x32851c0 [can pipeline]'

Without the http-debug it is very short

23-Feb-2022 01:12:16 [Einstein@Home] update requested by user
23-Feb-2022 01:12:17 [Einstein@Home] Sending scheduler request: Requested by user.
23-Feb-2022 01:12:17 [Einstein@Home] Requesting new tasks for NVIDIA GPU
23-Feb-2022 01:12:18 [Einstein@Home] Scheduler request failed: HTTP file not found

The url http://einstein.phys.uwm.edu/EinsteinAtHome_cgi/cgi is the scheduler url in the client_state.xml. Is the url wrong? Maybe i should indeed just remove and readd the project.
The machine has run boinc since 2013 and had einstein@home on 'request no new tasks' since 2018 i think.

Richard Haselgrove
Richard Haselgrove
Joined: 10 Dec 05
Posts: 2143
Credit: 2979884093
RAC: 771357

Bigeagle wrote:The url

Bigeagle wrote:

The url http://einstein.phys.uwm.edu/EinsteinAtHome_cgi/cgi is the scheduler url in the client_state.xml. Is the url wrong? Maybe i should indeed just remove and readd the project.
The machine has run boinc since 2013 and had einstein@home on 'request no new tasks' since 2018 i think.

Mine is <scheduler_url>https://scheduler.einsteinathome.org/EinsteinAtHome_cgi/cgi</scheduler_url>

Note the https

Yes - I think remove/readd is a good idea.

Bigeagle
Bigeagle
Joined: 3 Apr 07
Posts: 12
Credit: 52111466
RAC: 76970

That worked. It could have

That worked. It could have been so easy but nice to know where the error was.

Thanks for the help!

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.