Discussion related to cado-nfs

[Dennis Clarke <dclarke@blastwave.org>]

On 4/19/19 4:32 PM, Emmanuel Thomé wrote:
> Parameter files are provided only for 60 digits and up (and also for 30
> digits, but that is an exception we use only for testing). It would be
> feasible to fill this gap, but in this size range, qs is obviously a
> better alternative.
>
> I agree that the error message could certainly be more polite...

Seems really big numbers are a problem also :

nix$ /usr/bin/time -p /usr/bin/nice -n +19 ./cado-nfs.py 
46979456894555104376348061128818736834683233445508426434910891216933137932795235258532415417078413982950462649291680116415533192303358215736593956417994750205257150937406422457529901628917888316357401 
-t 1
Info:root: Using default parameter file ./parameters/factor/params.c200
Info:root: No database exists yet
Info:root: Created temporary directory /var/tmp/dclarke/cado.sj7y78j3
Info:Database: Opened connection to database 
/var/tmp/dclarke/cado.sj7y78j3/c200.db
Info:root: Set tasks.threads=1 based on --server-threads 1
Info:root: tasks.threads = 1 [via tasks.threads]
Info:root: tasks.polyselect.threads = 1 [via tasks.polyselect.threads]
Info:root: tasks.sieve.las.threads = 1 [via tasks.sieve.las.threads]
Info:root: tasks.linalg.bwc.threads = 1 [via tasks.threads]
Info:root: tasks.sqrt.threads = 1 [via tasks.threads]
Info:root: slaves.scriptpath is /home/dclarke/local/build/cado-nfs
Info:root: Command line parameters: ./cado-nfs.py 
46979456894555104376348061128818736834683233445508426434910891216933137932795235258532415417078413982950462649291680116415533192303358215736593956417994750205257150937406422457529901628917888316357401 
-t 1
Info:root: If this computation gets interrupted, it can be resumed with 
./cado-nfs.py /var/tmp/dclarke/cado.sj7y78j3/c200.parameters_snapshot.0
Info:Server Launcher: Adding nix to whitelist to allow clients on 
localhost to connect
Info:HTTP server: Using non-threaded HTTPS server
Info:HTTP server: Using whitelist: localhost,nix
Critical:Parameters: Required parameter qmin not found under path 
tasks.polyselect
Traceback (most recent call last):
  File "./cado-nfs.py", line 116, in <module>
    path_prefix = [])
  File "./scripts/cadofactor/cadotask.py", line 5605, in __init__
    path_prefix=polyselpath)
  File "./scripts/cadofactor/cadotask.py", line 2202, in __init__
    path_prefix=path_prefix)
  File "./scripts/cadofactor/cadotask.py", line 1496, in __init__
    path_prefix=path_prefix)
  File "./scripts/cadofactor/cadotask.py", line 1056, in __init__
    self.params = self.parameters.myparams(self.paramnames)
  File "./scripts/cadofactor/cadoparams.py", line 789, in myparams
    return self.parameters.myparams(keys, path)
  File "./scripts/cadofactor/cadoparams.py", line 169, in myparams
    self._convert_types(result, keys, splitpath, found_at_path)
  File "./scripts/cadofactor/cadoparams.py", line 626, in _convert_types
    raise KeyError(msg)
KeyError: 'Required parameter qmin not found under path tasks.polyselect'
Command exited with non-zero status 1
real 2.92
user 0.51
sys 0.08
nix$

However quite large seems to be no problem.
Factoring 
6513516734600035718300327211250928237178281758494417357560086828416863929270451437126021949850746389 

seems to work fine.

nix$
nix$ /usr/bin/time -p /usr/bin/nice -n +19 ./cado-nfs.py 
6513516734600035718300327211250928237178281758494417357560086828416863929270451437126021949850746389 
-t 1
Info:root: Using default parameter file ./parameters/factor/params.c100
Info:root: No database exists yet
Info:root: Created temporary directory /var/tmp/dclarke/cado.ibomf2ji
Info:Database: Opened connection to database 
/var/tmp/dclarke/cado.ibomf2ji/c100.db
Info:root: Set tasks.threads=1 based on --server-threads 1
Info:root: tasks.threads = 1 [via tasks.threads]
Info:root: tasks.polyselect.threads = 1 [via tasks.polyselect.threads]
Info:root: tasks.sieve.las.threads = 1 [via tasks.sieve.las.threads]
Info:root: tasks.linalg.bwc.threads = 1 [via tasks.threads]
Info:root: tasks.sqrt.threads = 1 [via tasks.threads]
Info:root: slaves.scriptpath is /home/dclarke/local/build/cado-nfs
Info:root: Command line parameters: ./cado-nfs.py 
6513516734600035718300327211250928237178281758494417357560086828416863929270451437126021949850746389 
-t 1
Info:root: If this computation gets interrupted, it can be resumed with 
./cado-nfs.py /var/tmp/dclarke/cado.ibomf2ji/c100.parameters_snapshot.0
.
.
.
Info:Linear Algebra: mksol: N=1000 ; ETA (N=3000): Sun Apr 21 23:06:01 
2019 [0.036 s/iter]
Info:Linear Algebra: mksol: N=1000 ; ETA (N=3000): Sun Apr 21 23:07:49 
2019 [0.072 s/iter]
Info:Linear Algebra: mksol: N=977 ; ETA (N=3000): Sun Apr 21 23:09:39 
2019 [0.109 s/iter]
Info:Quadratic Characters: Starting
Info:Square Root: Starting
Info:Square Root: Creating file of (a,b) values
Info:Square Root: finished
Info:Square Root: Factors: 11 109 5419 79481 
12612868752726608676534011211161792825225468670101915251045116250013903143003646733006649
Info:Polynomial Selection (size optimized): Aggregate statistics:
Info:Polynomial Selection (size optimized): potential collisions: 5781.44
Info:Polynomial Selection (size optimized): raw lognorm 
(nr/min/av/max/std): 5771/33.040/38.091/38.930/0.691
Info:Polynomial Selection (size optimized): optimized lognorm 
(nr/min/av/max/std): 5771/32.690/36.787/38.920/0.977
Info:Polynomial Selection (size optimized): Total time: 88.23
Info:Polynomial Selection (root optimized): Aggregate statistics:
Info:Polynomial Selection (root optimized): Total time: 51.93
Info:Polynomial Selection (root optimized): Rootsieve time: 51.66
Info:Generate Factor Base: Total cpu/real time for makefb: 0.66/0.671431
Info:Generate Free Relations: Total cpu/real time for freerel: 17.54/17.1051
Info:Lattice Sieving: Aggregate statistics:
Info:Lattice Sieving: Total number of relations: 2434823
Info:Lattice Sieving: Average J: 1024 for 87005 special-q, max bucket 
fill -bkmult 1.0,1s:1.058450
Info:Lattice Sieving: Total time: 4755.63s
Info:Filtering - Duplicate Removal, splitting pass: Total cpu/real time 
for dup1: 3.36/8.66293
Info:Filtering - Duplicate Removal, splitting pass: Aggregate statistics:
Info:Filtering - Duplicate Removal, splitting pass: CPU time for dup1: 
8.399999999999999s
Info:Filtering - Duplicate Removal, removal pass: Total cpu/real time 
for dup2: 20.4/23.1955
Info:Filtering - Duplicate Removal, removal pass: Aggregate statistics:
Info:Filtering - Duplicate Removal, removal pass: CPU time for dup2: 
19.399999999999995s
Info:Filtering - Singleton removal: Total cpu/real time for purge: 
13.31/16.1994
Info:Filtering - Merging: Total cpu/real time for merge: 71.23/75.7246
Info:Filtering - Merging: Total cpu/real time for replay: 6.26/5.70511
Info:Linear Algebra: Total cpu/real time for bwc: 351.56/356.6
Info:Linear Algebra: Aggregate statistics:
Info:Linear Algebra: Krylov: WCT time 186.49, iteration CPU time 0.03, 
COMM 0.0, cpu-wait 0.0, comm-wait 0.0 (6000 iterations)
Info:Linear Algebra: Lingen CPU time 11.37, WCT time 11.63
Info:Linear Algebra: Mksol: WCT time 106.86, iteration CPU time 0.03, 
COMM 0.0, cpu-wait 0.0, comm-wait 0.0 (3000 iterations)
Info:Quadratic Characters: Total cpu/real time for characters: 6.32/6.81588
Info:Square Root: Total cpu/real time for sqrt: 0.02/0.017874
Info:HTTP server: Shutting down HTTP server
Info:Complete Factorization: Total cpu/elapsed time for entire 
factorization: 14040.3/5464.46
Info:root: Cleaning up computation data in /var/tmp/dclarke/cado.ibomf2ji
11 109 5419 79481 
12612868752726608676534011211161792825225468670101915251045116250013903143003646733006649
real 5467.48
user 497.84
sys 5.54
nix$

So that is impressive.


> Regarding one of your earlier e-mails, don't mix "cmake" and "make". The
> steps called "Configure" and "Compile" must be followed in order, and
> then "Install" if you so wish.

Right. Thank you. sorted that out.  Will there be a tarball release at 
some point or just git ?

Dennis