Discussion related to cado-nfs

[eric.jeancolas@free.fr]

Whaoo, thank you for your responsiveness.
I don't know why the file was corrupted when built. An I/O check, a neutrino 
that hit my CPU, or whatsoever...
After your instructions, the file was not corrupted any longer.
But when I restarted, I got another error further (see stdout hereunder)
Maybe because I made several tests before I sent you my feedback.
Or maybe because I have another factorization running.
Anyway I will rerun the factorization from scratch. 
As I have another factorization running, I will not be able to give you any 
feedback before next Wednesday.
Best regards.

./cado-nfs.py /tmp/cado.qnpox55b/c140.parameters_snapshot.0
Info:root: No database exists yet
Info:Database: Opened connection to database /tmp/cado.qnpox55b/c140.db
Info:root: tasks.polyselect.threads = 2
Info:root: tasks.sieve.las.threads = 2
Info:root: Command line parameters: ./cado-nfs.py 
/tmp/cado.qnpox55b/c140.parameters_snapshot.0
Info:root: If this computation gets interrupted, it can be resumed with 
./cado-nfs.py /tmp/cado.qnpox55b/c140.parameters_snapshot.2
Info:Server Launcher: Adding ng-All-Series to whitelist to allow clients on 
localhost to connect
Info:HTTP server: Using non-threaded HTTPS server
Info:HTTP server: Using whitelist: localhost,ng-All-Series
Info:Complete Factorization: Factoring 
114092790024322036665919359655432984163277313962134547254404440195422458391584434451220692010515202678454628424122139839393927744958571074477
Warning:Complete Factorization: The start time of the last cado-nfs.py run 
was recorded, but not its end time, maybe because it died unexpectedly.
Warning:Complete Factorization: Elapsed time of last run is not known and 
will not be counted towards total.
Info:HTTP server: serving at https://ng-All-Series:33927 (0.0.0.0)
Info:HTTP server: For debugging purposes, the URL above can be accessed if 
the server.only_registered=False parameter is added
Info:HTTP server: You can start additional cado-nfs-client.py scripts with 
parameters: --server=https://ng-All-Series:33927 
--certsha1=16320c277442762847795111a151213b1524ce0e
Info:HTTP server: If you want to start additional clients, remember to add 
their hosts to server.whitelist
Info:Client Launcher: Client localhost on host localhost with PID 21750 
already running
Info:Client Launcher: Client localhost+2 on host localhost with PID 21753 
already running
Info:Client Launcher: Client localhost+3 on host localhost with PID 21756 
already running
Info:Client Launcher: Client localhost+4 on host localhost with PID 21759 
already running
Info:Client Launcher: Client localhost+5 on host localhost with PID 21762 
already running
Info:Client Launcher: Client localhost+6 on host localhost with PID 21765 
already running
Info:Client Launcher: Running clients: localhost (Host localhost, PID 21750), 
localhost+2 (Host localhost, PID 21753), localhost+3 (Host localhost, PID 
21756), localhost+4 (Host localhost, PID 21759), localhost+5 (Host localhost, 
PID 21762), localhost+6 (Host localhost, PID 21765)
Info:Polynomial Selection (size optimized): Starting
Info:Polynomial Selection (size optimized): 100 polynomials in queue from 
previous run, worst lognorm 37.740000
Info:Polynomial Selection (size optimized): Already finished - nothing to do
Info:Polynomial Selection (size optimized): Aggregate statistics:
Info:Polynomial Selection (size optimized): potential collisions: 65655.1
Info:Polynomial Selection (size optimized): raw lognorm (nr/min/av/max/std): 
66463/42.200/50.441/55.590/0.953
Info:Polynomial Selection (size optimized): optimized lognorm 
(nr/min/av/max/std): 66463/40.800/45.220/51.110/1.323
Info:Polynomial Selection (size optimized): Total time: 60621.7
Info:Polynomial Selection (root optimized): Starting
Info:Polynomial Selection (root optimized): Best polynomial previously found 
in /tmp/cado.qnpox55b/c140.upload/c140.polyselect2.yguiwty8.opt_48 has 
Murphy_E = 7.5e-10
Info:Polynomial Selection (root optimized): Already finished - nothing to do
Info:Polynomial Selection (root optimized): Best overall polynomial was 3-th 
in list after size optimization
Info:Polynomial Selection (root optimized): Aggregate statistics:
Info:Polynomial Selection (root optimized): Total time: 11336.6
Info:Polynomial Selection (root optimized): Rootsieve time: 11333.9
Info:Generate Factor Base: Starting
Info:Generate Factor Base: Total cpu/real time for makefb: 23.31/2.83168
Info:Generate Free Relations: Starting
Info:Generate Free Relations: Total cpu/real time for freerel: 411.3/37.4115
Info:Lattice Sieving: Starting
Info:Lattice Sieving: We want 25172582 relations
Info:Lattice Sieving: Reached target of 25172582 relations, now have 25440595
Info:Lattice Sieving: Aggregate statistics:
Info:Lattice Sieving: Total number of relations: 25440595
Info:Lattice Sieving: Average J: 3793.09 for 954185 special-q, max bucket 
fill: 0.688696
Info:Lattice Sieving: Total CPU time: 2.67465e+06s
Info:Filtering - Duplicate Removal, splitting pass: Starting
Info:Filtering - Duplicate Removal, splitting pass: No new files to split
Info:Filtering - Duplicate Removal, splitting pass: Relations per slice: 0: 
12723950, 1: 12716645
Info:Filtering - Duplicate Removal, splitting pass: Total cpu/real time for 
dup1: 191.17/376.338
Info:Filtering - Duplicate Removal, splitting pass: Aggregate statistics:
Info:Filtering - Duplicate Removal, splitting pass: CPU time for dup1: 375.6s
Info:Filtering - Duplicate Removal, removal pass: Starting
Info:Filtering - Duplicate Removal, removal pass: No new files for slice 0, 
nothing to do
Info:HTTP server: 127.0.0.1 Sending workunit c140_sieving_26170000-26180000 
to client localhost+2
Info:HTTP server: 127.0.0.1 Sending workunit c140_sieving_26180000-26190000 
to client localhost+3
Info:HTTP server: 127.0.0.1 Sending workunit c140_sieving_26190000-26200000 
to client localhost
Info:Filtering - Duplicate Removal, removal pass: 10579655 unique relations 
remain on slice 1
Info:Filtering - Duplicate Removal, removal pass: Of 258952 newly added 
relations 199791 were unique (ratio 0.771537)
Info:Filtering - Duplicate Removal, removal pass: 21166842 unique relations 
remain in total
Info:Filtering - Duplicate Removal, removal pass: Total cpu/real time for 
dup2: 1174.13/1031.1
Info:Filtering - Singleton removal: Starting
Info:Filtering - Singleton removal: Reading 21166842 unique and 121591 free 
relations, total 21288433
Warning:Command: Process with PID 3611 finished with return code -11
Traceback (most recent call last):
  File "./cado-nfs.py", line 122, in <module>
    factors = factorjob.run()
  File "./scripts/cadofactor/cadotask.py", line 5429, in run
    last_status, last_task = self.run_next_task()
  File "./scripts/cadofactor/cadotask.py", line 5504, in run_next_task
    return [task.run(), task.title]
  File "./scripts/cadofactor/cadotask.py", line 3503, in run
    stats = self.parse_stdout(stdout)
  File "./scripts/cadofactor/cadotask.py", line 3653, in parse_stdout
    (self.title, self.programs[0][0].name, final_values_line))
Exception: Filtering - Singleton removal: output of purge did not contain 
'Final values:'




----- Mail original -----
De: "paul zimmermann" <Paul.Zimmermann@inria.fr>
À: "eric jeancolas" <eric.jeancolas@free.fr>
Cc: cado-nfs-discuss@lists.gforge.inria.fr
Envoyé: Mercredi 20 Février 2019 21:56:28
Objet: Re: [Cado-nfs-discuss] return code -6 , exit code -6

       Dear Eric,

> I use cado-nfs-2.3.0 for factoring c120 to c160 numbers.
> It has always been working fine for about 30 numbers so far.

great!

> This is the first time I get an error. [...]
> Any other idea to understand what's going on?

it seems the file dup1.0.0000.gz is corrupted. You can try to rebuild it
as follows:

1) look in /tmp/cado.qnpox55b for a file named c140.dup1.stdout.1.
   Copy and execute the first line from this file (after # (2acb184f4)).
   This should create again the file dup1.0.0000.gz. You can then check it is
   valid with gzip -t.
2) restart the factorization with:
   cado-nfs.py /tmp/cado.qnpox55b/c140.parameters_snapshot.0

If this does not work, please tell us.

Paul Zimmermann