Thread 'Getting Download Failures'

Message boards : Number crunching : Getting Download Failures
Message board moderation

To post messages, you must log in.

AuthorMessage
entity

Send message
Joined: 31 Dec 24
Posts: 19
Credit: 5,859,336
RAC: 72,501
Message 253 - Posted: 3 May 2025, 22:33:37 UTC
Last modified: 3 May 2025, 22:42:22 UTC

I have received about 5 download errors in the past hour. Only on the Calculate Tuples tasks.

Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Giving up on download of wu_99255_get_sym_tuples.txt: permanent HTTP error
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Finished download of wu_105190_21_get_sym_tuples.txt (30 bytes)
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Finished download of wu_398026_19_get_sym_tuples.txt (30 bytes)
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Finished download of wu_1241841_get_sym_tuples.txt (32 bytes)
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Finished download of wu_105188_21_get_sym_tuples.txt (30 bytes)
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Finished download of wu_397584_19_get_sym_tuples.txt (30 bytes)
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Finished download of wu_1241922_get_sym_tuples.txt (32 bytes)
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Started download of wu_1241923_get_sym_tuples.txt
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Started download of wu_397908_19_get_sym_tuples.txt
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Started download of wu_93534_get_sym_tuples.txt
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Started download of wu_105215_21_get_sym_tuples.txt
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Started download of wu_398034_19_get_sym_tuples.txt
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Started download of wu_95256_get_sym_tuples.txt
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Started download of wu_105194_21_get_sym_tuples.txt
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Started download of wu_397959_19_get_sym_tuples.txt
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Starting task Rymtup19_1745290668_0
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Starting task SymTuples_1745033427_0
Sat 03 May 2025 05:25:02 PM CDT | odlk2025 | Starting task Qymtup21_1745620230_0
Sat 03 May 2025 05:25:03 PM CDT | odlk2025 | Finished download of wu_1241923_get_sym_tuples.txt (32 bytes)
Sat 03 May 2025 05:25:03 PM CDT | odlk2025 | Finished download of wu_397908_19_get_sym_tuples.txt (30 bytes)
Sat 03 May 2025 05:25:03 PM CDT | odlk2025 | Giving up on download of wu_93534_get_sym_tuples.txt: permanent HTTP error
Sat 03 May 2025 05:25:03 PM CDT | odlk2025 | Finished download of wu_105215_21_get_sym_tuples.txt (30 bytes)
Sat 03 May 2025 05:25:03 PM CDT | odlk2025 | Finished download of wu_398034_19_get_sym_tuples.txt (30 bytes)
Sat 03 May 2025 05:25:03 PM CDT | odlk2025 | Giving up on download of wu_95256_get_sym_tuples.txt: permanent HTTP error
Sat 03 May 2025 05:25:03 PM CDT | odlk2025 | Finished download of wu_105194_21_get_sym_tuples.txt (30 bytes)
Sat 03 May 2025 05:25:03 PM CDT | odlk2025 | Finished download of wu_397959_19_get_sym_tuples.txt (30 bytes)

WU download error: couldn't get input files:
<file_xfer_error>
<file_name>wu_94132_get_sym_tuples.txt</file_name>
<error_code>-224 (permanent HTTP error)</error_code>
<error_message>permanent HTTP error</error_message>
</file_xfer_error>

Normally don't get them.
ID: 253 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Volunteer moderator
Project scientist
Avatar

Send message
Joined: 24 Dec 24
Posts: 257
Credit: 4,971,066
RAC: 30,840
Message 254 - Posted: 4 May 2025, 7:48:04 UTC - in response to Message 253.  

Judging by the numbers, these are very old tasks.

Perhaps there was an unsuccessful replication of the task.
The TBEG BOINC project maintains the database
https://boinc.tbrada.eu/spt/explore.php
ID: 254 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
entity

Send message
Joined: 31 Dec 24
Posts: 19
Credit: 5,859,336
RAC: 72,501
Message 255 - Posted: 4 May 2025, 20:12:07 UTC - in response to Message 254.  

Part of the problem is, the max number of errors allowed is set to high. It is set to 40. It should be set to something more reasonable like 5 or 8. The system is going to keep sending the work out until it has accumulated 40 download errors.

name SymTuples_1736504104
application Calculate Tuples
created 10 Jan 2025, 10:15:04 UTC
minimum quorum 1
initial replication 1
max # of error/total/success tasks 40, 43, 2
ID: 255 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
entity

Send message
Joined: 31 Dec 24
Posts: 19
Credit: 5,859,336
RAC: 72,501
Message 256 - Posted: 5 May 2025, 13:50:48 UTC - in response to Message 255.  
Last modified: 5 May 2025, 13:52:08 UTC

Seems like this is a continuation of a previously reported problem. I should have done a better search job instead of opening a new issue. My recommendation is for ALL contributors to de-select the Calculate Tuples application. If they aren't interested in fixing the problem after 4 months then we shouldn't be interested in donating to the app.
ID: 256 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan

Send message
Joined: 30 Dec 24
Posts: 23
Credit: 205,504
RAC: 1,335
Message 270 - Posted: 22 May 2025, 15:23:15 UTC

When are these old tasks from JANUARY with the Download failures ever going to be REMOVED (or missing link fixed)? It is a waste of our and your projects computing time, resources, etc.

Most recent example;
SymTuples_1736507138_15
Workunit 148961

That _15 on the end of the name indicates 15 different times attempted download failed!

As previously mentioned it's going to take 40 retries to completely & finally be removed from the server:
max # of error/total/success tasks 40, 43, 2

ID: 270 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
entity

Send message
Joined: 31 Dec 24
Posts: 19
Credit: 5,859,336
RAC: 72,501
Message 271 - Posted: 22 May 2025, 18:37:10 UTC - in response to Message 270.  

This is why it won't be added to the official BOINC project list. They don't have an administrator that participates and fixes problems.
ID: 271 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Volunteer moderator
Project scientist
Avatar

Send message
Joined: 24 Dec 24
Posts: 257
Credit: 4,971,066
RAC: 30,840
Message 272 - Posted: 22 May 2025, 22:43:01 UTC - in response to Message 271.  
Last modified: 23 May 2025, 18:04:13 UTC

In reply to entity's message of 22 May 2025:
This is why it won't be added to the official BOINC project list. They don't have an administrator that participates and fixes problems.

No BOINC project works without errors and without problems!

By the way, some crunchers have some problems, and others do not.

For example

I'm running exclusively Linux (Ubuntu and Fedora) and have processed 8760 tasks and haven't seen a single Exceeded Time Limit message.

https://boinc.mak.termit.me/odlk2025/forum_thread.php?id=32&postid=266

No administrator can fix all crunchers' problems.

Read what reasons David Anderson gave the first time.
https://boinc.progger.info/odlk/forum_thread.php?id=310#15675

Now the reasons are different.

If there is a third request, they will come up with new reasons.
But there will be no third request!

The project works and produces results.
The project is stably provided with tasks.
There are no failures on the server (the project does not crash).

I recommend crunchers who have unfixable problems to participate only in those BOINC projects that are included in the official list.
They will not have any problems in these projects!
The TBEG BOINC project maintains the database
https://boinc.tbrada.eu/spt/explore.php
ID: 272 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Conan

Send message
Joined: 30 Dec 24
Posts: 10
Credit: 758,866
RAC: 7,717
Message 275 - Posted: 8 Jun 2025, 10:25:35 UTC

Still getting this Down Load Error on the SymTuples work units only, 19Tuples and 21Tuples are fine and work OK, just not the SymTuples

WU download error: couldn't get input files:
<file_xfer_error>
<file_name>wu_94132_get_sym_tuples.txt</file_name>
<error_code>-224 (permanent HTTP error)</error_code>
<error_message>permanent HTTP error</error_message>
</file_xfer_error>


Have had many hundreds of these over the past months, they all fail now.

Created on the 2/6/25 and sent out on the 7/6/25

Thanks

Conan
ID: 275 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
entity

Send message
Joined: 31 Dec 24
Posts: 19
Credit: 5,859,336
RAC: 72,501
Message 276 - Posted: 8 Jun 2025, 14:07:08 UTC - in response to Message 275.  

Known issue that they won't fix. I have had 4346 of them in the last few weeks. I have decided to brute force through them and it seems to have worked for the most part. I don't get near as many as I used to. I may go close to 3 or 4 days without getting them. Once I start getting them it is usually an indication that we have reached an end of a batch of work. I start getting the download failures but also a bunch of resends about the same time. Then the work distribution ceases for that app for about a day. I then switch to the Calc19tuples during the 24 hour outage and then switch back when the Calctuples work distribution resumes.

This project has many other problems in addition to the download failures that never seem to be addressed. I crunch here until I reach my goals for the project and then switch out to something else.
ID: 276 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileNatalia Makarova
Volunteer moderator
Project scientist
Avatar

Send message
Joined: 24 Dec 24
Posts: 257
Credit: 4,971,066
RAC: 30,840
Message 278 - Posted: 8 Jun 2025, 17:27:42 UTC - in response to Message 276.  

In reply to entity's message of 8 Jun 2025:
Known issue that they won't fix. I have had 4346 of them in the last few weeks. I have decided to brute force through them and it seems to have worked for the most part. I don't get near as many as I used to. I may go close to 3 or 4 days without getting them. Once I start getting them it is usually an indication that we have reached an end of a batch of work. I start getting the download failures but also a bunch of resends about the same time. Then the work distribution ceases for that app for about a day. I then switch to the Calc19tuples during the 24 hour outage and then switch back when the Calctuples work distribution resumes.

This project has many other problems in addition to the download failures that never seem to be addressed. I crunch here until I reach my goals for the project and then switch out to something else.

You can support the project in a non-BOINC format.

Please see the thread
https://boinc.mak.termit.me/odlk2025/forum_thread.php?id=43

You will have no problems with individual tasks.
The TBEG BOINC project maintains the database
https://boinc.tbrada.eu/spt/explore.php
ID: 278 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan

Send message
Joined: 30 Dec 24
Posts: 23
Credit: 205,504
RAC: 1,335
Message 352 - Posted: 3 Jul 2025, 3:25:26 UTC

New download failure due to missing file(s) on your SERVER.
Task 162405
Name: SymTuples_1736513136_0
Stderr output
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
WU download error: couldn't get input files:
<file_xfer_error>
<file_name>wu_93181_get_sym_tuples.txt</file_name>
<error_code>-224 (permanent HTTP error)</error_code>
<error_message>permanent HTTP error</error_message>
</file_xfer_error>

</message>
]]>


ID: 352 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dingo
Avatar

Send message
Joined: 24 Mar 25
Posts: 1
Credit: 130,196
RAC: 22
Message 389 - Posted: 12 Jul 2025, 4:28:34 UTC

I am getting them as well

Name	SymTuples_1736506386_24
Workunit	148315
Created	2 Jul 2025, 17:10:46 UTC
Sent	12 Jul 2025, 4:00:25 UTC
Report deadline	19 Jul 2025, 4:00:25 UTC
Received	12 Jul 2025, 4:02:29 UTC
Server state	Over
Outcome	Computation error
Client state	Downloading
Exit status	-186 (0xFFFFFF46) ERR_RESULT_DOWNLOAD
Computer ID	2693
Run time	0 sec
CPU time	0 sec
Validate state	Invalid
Credit	0.00
Device peak FLOPS	4.81 GFLOPS
Application version	Calculate Tuples v2.95
windows_x86_64
Stderr output
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<message>
WU download error: couldn't get input files:
<file_xfer_error>
  <file_name>wu_101795_get_sym_tuples.txt</file_name>
  <error_code>-224 (permanent HTTP error)</error_code>
  <error_message>permanent HTTP error</error_message>
</file_xfer_error>
</message>
]]>
ID: 389 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Number crunching : Getting Download Failures

©2025 Natalia Makarova and Co