Discussion related to cado-nfs

[hermann@stamm-wilbrandt.de]

I used 3 computers:

gandalf 24C/48T, factors RSA_120 in 0:48:18 alone
elrond 24C/48T, factors RSA-120 in 0:45:58 alone
7600x 6C/12T, factors RSA-120 in 0:57:19 alone

So far so good.

Following
https://mersenneforum.org/showthread.php?t=23091
I started

./cado-nfs.py ...RSA-120... server.whitelist=192.168.178.1/24,127.0.0.1 
server.port=56789 server.ssl=no --server

on gandalf.

Then I started on

elrond: for((i=1; i<=24; ++i)); do ./cado-nfs-client.py 
--server=http://gandalf:56789 & done
7600x: for((i=1; i<=6; ++i)); do ./cado-nfs-client.py 
--server=http://gandalf:56789 & done

and last but not least on gandalf:

for((i=1; i<=24; ++i)); do ./cado-nfs-client.py 
--server=http://gandalf:56789 & done

That was successful, I captured smartphone video of the 4 windows in 
action.
Factoring RSA-120 completed in 0:25:06, distributed phase ended after 
17:30min.


7600x computer is more than double single core performance than the 
other two.
So I wanted to start the server on 7600x because of that instead of 
gandalf.

When doing that I got GLIBC error messages for downloading executables.
Reason was that 7600x did run Ubuntu 22.04 desktop, while the other two 
run Ubuntu 20.04 server.

So I installed Ubuntu 20.04 server on 2nd SSD of 7600x computer.
But gandalf makes problems.
When I use gandalf as server, I can run clients on all three machines 
without issue.

When I start server on 7600x, elrond can use client against 7600x and 
that works fine.
When I start server on elrond, 7600x can use client against elrond and 
that works fine.

Regardless of server, gandalf errors.


Below are elrond server as well as gandalf client messages (no 7600x 
here), what is the -4 problem? How to resolve?


elrond server messages (I pressed return in that window before starting 
ganadlf single client), for factoring RSA-59:

hermann@elrond:~/cado-nfs$ ./cado-nfs.py 
71641520761751435455133616475667090434063332228247871795429 
server.whitelist=192.168.178.1/24,127.0.0.1 server.port=56789 
server.ssl=no --server
Info:root: Using default parameter file ./parameters/factor/params.c60
Info:root: No database exists yet
Info:root: Created temporary directory /tmp/cado.qo66b8z7
Info:Database: Opened connection to database /tmp/cado.qo66b8z7/c60.db
Info:root: Set tasks.linalg.bwc.threads=24 based on detected physical 
cores
Info:root: Set tasks.threads=48 based on detected logical cpus
Info:root: tasks.threads = 48 [via tasks.threads]
Info:root: tasks.polyselect.threads = 2 [via tasks.polyselect.threads]
Info:root: tasks.sieve.las.threads = 2 [via tasks.sieve.las.threads]
Info:root: tasks.linalg.bwc.threads = 24 [via tasks.linalg.bwc.threads]
Info:root: tasks.sqrt.threads = 8 [via tasks.sqrt.threads]
Info:root: Command line parameters: ./cado-nfs.py 
71641520761751435455133616475667090434063332228247871795429 
'server.whitelist=192.168.178.1/24,127.0.0.1' server.port=56789 
server.ssl=no --server
Info:root: If this computation gets interrupted, it can be resumed with 
./cado-nfs.py /tmp/cado.qo66b8z7/c60.parameters_snapshot.0
Info:Server Launcher: Adding elrond to whitelist to allow clients on 
localhost to connect
Info:HTTP server: Using non-threaded HTTP server
Info:HTTP server: Using whitelist: 192.168.178.1/24,127.0.0.1,elrond
Info:Lattice Sieving: param rels_wanted is 0
Info:Complete Factorization / Discrete logarithm: Factoring 
71641520761751435455133616475667090434063332228247871795429
Info:HTTP server: serving at http://elrond:56789 (0.0.0.0)
Info:HTTP server: For debugging purposes, the URL above can be accessed 
if the server.only_registered=False parameter is added
Info:HTTP server: You can start additional cado-nfs-client.py scripts 
with parameters: --server=http://elrond:56789
Info:HTTP server: If you want to start additional clients, remember to 
add their hosts to server.whitelist
Info:Polynomial Selection (size optimized): Starting
Info:Polynomial Selection (size optimized): 0 polynomials in queue from 
previous run
Info:Polynomial Selection (size optimized): Adding workunit 
c60_polyselect1_0-5000 to database
Info:Polynomial Selection (size optimized): Adding workunit 
c60_polyselect1_5000-10000 to database

Info:HTTP server: 192.168.178.178 Sending workunit 
c60_polyselect1_0-5000 to client gandalf.db5dc9b4
Info:HTTP server: 192.168.178.178 Sending workunit 
c60_polyselect1_5000-10000 to client gandalf.db5dc9b4
Error:Polynomial Selection (size optimized): Program run on 
gandalf.db5dc9b4 failed with exit code -4
Info:Polynomial Selection (size optimized): Marking workunit 
c60_polyselect1_0-5000 as not ok (50.0% => ETA Unknown)
Info:Polynomial Selection (size optimized): Resubmitting workunit 
c60_polyselect1_0-5000 as c60_polyselect1_0-5000#2
Error:Polynomial Selection (size optimized): Program run on 
gandalf.db5dc9b4 failed with exit code -4
Info:Polynomial Selection (size optimized): Marking workunit 
c60_polyselect1_5000-10000 as not ok (100.0% => ETA Sun Aug  6 09:12:14 
2023)
Info:Polynomial Selection (size optimized): Resubmitting workunit 
c60_polyselect1_5000-10000 as c60_polyselect1_5000-10000#2
^CInfo:HTTP server: Got notification to stop serving Workunits
Info:HTTP server: Shutting down HTTP server
Critical:Complete Factorization / Discrete logarithm: Received 
KeyboardInterrupt. Terminating
Info:root: Computation data kept in /tmp/cado.qo66b8z7
Error occurred, terminating
hermann@elrond:~/cado-nfs$



gandalf client messages:

hermann@gandalf:~/cado-nfs$ ./cado-nfs-client.py 
--server=http://elrond:56789
INFO:root:Starting client gandalf.db5dc9b4
INFO:root:Python version is 3.8.10
INFO:root:Using work-around <class 
'__main__.Version3FixedBytesGenerator'> for buggy BytesGenerator
INFO:root:spin=0 is_wu=True blog=0
INFO:root:Downloading 
http://elrond:56789/cgi-bin/getwu?clientid=gandalf.db5dc9b4 to 
download/WU.gandalf.db5dc9b4261539515 (cafile = None)
INFO:root:_urlopen_maybe_https
INFO:root:_urlopen_maybe_https returns
INFO:root:_native_get_file(http://elrond:56789/cgi-bin/getwu?clientid=gandalf.db5dc9b4) 
-> download/WU.gandalf.db5dc9b4261539515
INFO:root:fd = 4
INFO:root:lock acquired
INFO:root:copy done
INFO:root:lock release
INFO:root:download/polyselect already exists, not downloading
INFO:root:Result file gandalf.db5dc9b4.work/c60.polyselect1.0-5000 does 
not exist
INFO:root:Running download/polyselect -P 420 -N 
71641520761751435455133616475667090434063332228247871795429 -degree 4 -t 
2 -admin 0 -admax 5000 -incr 60 -nq 64
INFO:root:[Sun Aug  6 07:12:14 2023] Subprocess has PID 74953
ERROR:root:Command resulted in exit code -4
INFO:root:Attaching file gandalf.db5dc9b4.work/c60.polyselect1.0-5000 to 
upload
INFO:root:Uploading results: backlog has 1 entries
INFO:root:      c60_polyselect1_0-5000  -->  http://elrond:56789
INFO:root:_urlopen_maybe_https
INFO:root:_urlopen_maybe_https returns
INFO:root:Upload of c60_polyselect1_0-5000 succeeded.
INFO:root:Cleaning up for workunit c60_polyselect1_0-5000
INFO:root:Removing result file 
gandalf.db5dc9b4.work/c60.polyselect1.0-5000
INFO:root:spin=0 is_wu=True blog=0
INFO:root:Downloading 
http://elrond:56789/cgi-bin/getwu?clientid=gandalf.db5dc9b4 to 
download/WU.gandalf.db5dc9b4518360980 (cafile = None)
INFO:root:_urlopen_maybe_https
INFO:root:_urlopen_maybe_https returns
INFO:root:_native_get_file(http://elrond:56789/cgi-bin/getwu?clientid=gandalf.db5dc9b4) 
-> download/WU.gandalf.db5dc9b4518360980
INFO:root:fd = 4
INFO:root:lock acquired
INFO:root:copy done
INFO:root:lock release
INFO:root:download/polyselect already exists, not downloading
INFO:root:Result file gandalf.db5dc9b4.work/c60.polyselect1.5000-10000 
does not exist
INFO:root:Running download/polyselect -P 420 -N 
71641520761751435455133616475667090434063332228247871795429 -degree 4 -t 
2 -admin 5000 -admax 10000 -incr 60 -nq 64
INFO:root:[Sun Aug  6 07:12:14 2023] Subprocess has PID 74955
ERROR:root:Command resulted in exit code -4
INFO:root:Attaching file 
gandalf.db5dc9b4.work/c60.polyselect1.5000-10000 to upload
INFO:root:Uploading results: backlog has 1 entries
INFO:root:      c60_polyselect1_5000-10000  -->  http://elrond:56789
INFO:root:_urlopen_maybe_https
INFO:root:_urlopen_maybe_https returns
INFO:root:Upload of c60_polyselect1_5000-10000 succeeded.
INFO:root:Cleaning up for workunit c60_polyselect1_5000-10000
INFO:root:Removing result file 
gandalf.db5dc9b4.work/c60.polyselect1.5000-10000
INFO:root:spin=0 is_wu=True blog=0
INFO:root:Downloading 
http://elrond:56789/cgi-bin/getwu?clientid=gandalf.db5dc9b4 to 
download/WU.gandalf.db5dc9b4901941277 (cafile = None)
INFO:root:_urlopen_maybe_https
ERROR:root:Download failed, URL error: HTTP Error 404: No work available
ERROR:root:Waiting 10.0 seconds before retrying
^CTraceback (most recent call last):
  File "./cado-nfs-client.py", line 2261, in <module>
    client_ok = client.process()
  File "./cado-nfs-client.py", line 1978, in process
    self.workunit = downloader.get_wu_full()
  File "./cado-nfs-client.py", line 1817, in get_wu_full
    workunit = self._get_wu()
  File "./cado-nfs-client.py", line 1805, in _get_wu
    return self._get_fresh_wu()
  File "./cado-nfs-client.py", line 1744, in _get_fresh_wu
    peer = self.get_missing_file(url,
  File "./cado-nfs-client.py", line 1668, in get_missing_file
    peer = self.get_file(urlpath, filename, options=options,
  File "./cado-nfs-client.py", line 1575, in get_file
    time.sleep(wait)
KeyboardInterrupt

hermann@gandalf:~/cado-nfs$ for((i=1; i<=24; ++i)); do 
./cado-nfs-client.py --server=http://7600x:56789 & done



Regards,

Hermann.