Discussion related to cado-nfs

[Emmanuel Thomé <Emmanuel.Thome@inria.fr>]

This is a different problem.

Add the line:

    tasks.qmin=50000000

to the file parameters/factor/params.c200. (and prepare for a long
computation).

This will be fixed eventually, e.g. by using a reasonable rule of thumb
for the default value.

E.

On Sun, Apr 21, 2019 at 07:08:45PM -0400, Dennis Clarke wrote:
> On 4/19/19 4:32 PM, Emmanuel Thomé wrote:
> > Parameter files are provided only for 60 digits and up (and also for 30
> > digits, but that is an exception we use only for testing). It would be
> > feasible to fill this gap, but in this size range, qs is obviously a
> > better alternative.
> > 
> > I agree that the error message could certainly be more polite...
> > 
> 
> Seems really big numbers are a problem also :
> 
> nix$ /usr/bin/time -p /usr/bin/nice -n +19 ./cado-nfs.py 
> 46979456894555104376348061128818736834683233445508426434910891216933137932795235258532415417078413982950462649291680116415533192303358215736593956417994750205257150937406422457529901628917888316357401
> -t 1
> Info:root: Using default parameter file ./parameters/factor/params.c200
> Info:root: No database exists yet
> Info:root: Created temporary directory /var/tmp/dclarke/cado.sj7y78j3
> Info:Database: Opened connection to database
> /var/tmp/dclarke/cado.sj7y78j3/c200.db
> Info:root: Set tasks.threads=1 based on --server-threads 1
> Info:root: tasks.threads = 1 [via tasks.threads]
> Info:root: tasks.polyselect.threads = 1 [via tasks.polyselect.threads]
> Info:root: tasks.sieve.las.threads = 1 [via tasks.sieve.las.threads]
> Info:root: tasks.linalg.bwc.threads = 1 [via tasks.threads]
> Info:root: tasks.sqrt.threads = 1 [via tasks.threads]
> Info:root: slaves.scriptpath is /home/dclarke/local/build/cado-nfs
> Info:root: Command line parameters: ./cado-nfs.py 
> 46979456894555104376348061128818736834683233445508426434910891216933137932795235258532415417078413982950462649291680116415533192303358215736593956417994750205257150937406422457529901628917888316357401
> -t 1
> Info:root: If this computation gets interrupted, it can be resumed with
> ./cado-nfs.py /var/tmp/dclarke/cado.sj7y78j3/c200.parameters_snapshot.0
> Info:Server Launcher: Adding nix to whitelist to allow clients on localhost
> to connect
> Info:HTTP server: Using non-threaded HTTPS server
> Info:HTTP server: Using whitelist: localhost,nix
> Critical:Parameters: Required parameter qmin not found under path
> tasks.polyselect
> Traceback (most recent call last):
>   File "./cado-nfs.py", line 116, in <module>
>     path_prefix = [])
>   File "./scripts/cadofactor/cadotask.py", line 5605, in __init__
>     path_prefix=polyselpath)
>   File "./scripts/cadofactor/cadotask.py", line 2202, in __init__
>     path_prefix=path_prefix)
>   File "./scripts/cadofactor/cadotask.py", line 1496, in __init__
>     path_prefix=path_prefix)
>   File "./scripts/cadofactor/cadotask.py", line 1056, in __init__
>     self.params = self.parameters.myparams(self.paramnames)
>   File "./scripts/cadofactor/cadoparams.py", line 789, in myparams
>     return self.parameters.myparams(keys, path)
>   File "./scripts/cadofactor/cadoparams.py", line 169, in myparams
>     self._convert_types(result, keys, splitpath, found_at_path)
>   File "./scripts/cadofactor/cadoparams.py", line 626, in _convert_types
>     raise KeyError(msg)
> KeyError: 'Required parameter qmin not found under path tasks.polyselect'
> Command exited with non-zero status 1
> real 2.92
> user 0.51
> sys 0.08
> nix$
> 
> However quite large seems to be no problem.
> Factoring 
> 6513516734600035718300327211250928237178281758494417357560086828416863929270451437126021949850746389
> 
> seems to work fine.
> 
> nix$
> nix$ /usr/bin/time -p /usr/bin/nice -n +19 ./cado-nfs.py 
> 6513516734600035718300327211250928237178281758494417357560086828416863929270451437126021949850746389
> -t 1
> Info:root: Using default parameter file ./parameters/factor/params.c100
> Info:root: No database exists yet
> Info:root: Created temporary directory /var/tmp/dclarke/cado.ibomf2ji
> Info:Database: Opened connection to database
> /var/tmp/dclarke/cado.ibomf2ji/c100.db
> Info:root: Set tasks.threads=1 based on --server-threads 1
> Info:root: tasks.threads = 1 [via tasks.threads]
> Info:root: tasks.polyselect.threads = 1 [via tasks.polyselect.threads]
> Info:root: tasks.sieve.las.threads = 1 [via tasks.sieve.las.threads]
> Info:root: tasks.linalg.bwc.threads = 1 [via tasks.threads]
> Info:root: tasks.sqrt.threads = 1 [via tasks.threads]
> Info:root: slaves.scriptpath is /home/dclarke/local/build/cado-nfs
> Info:root: Command line parameters: ./cado-nfs.py 
> 6513516734600035718300327211250928237178281758494417357560086828416863929270451437126021949850746389
> -t 1
> Info:root: If this computation gets interrupted, it can be resumed with
> ./cado-nfs.py /var/tmp/dclarke/cado.ibomf2ji/c100.parameters_snapshot.0
> .
> .
> .
> Info:Linear Algebra: mksol: N=1000 ; ETA (N=3000): Sun Apr 21 23:06:01 2019
> [0.036 s/iter]
> Info:Linear Algebra: mksol: N=1000 ; ETA (N=3000): Sun Apr 21 23:07:49 2019
> [0.072 s/iter]
> Info:Linear Algebra: mksol: N=977 ; ETA (N=3000): Sun Apr 21 23:09:39 2019
> [0.109 s/iter]
> Info:Quadratic Characters: Starting
> Info:Square Root: Starting
> Info:Square Root: Creating file of (a,b) values
> Info:Square Root: finished
> Info:Square Root: Factors: 11 109 5419 79481 
> 12612868752726608676534011211161792825225468670101915251045116250013903143003646733006649
> Info:Polynomial Selection (size optimized): Aggregate statistics:
> Info:Polynomial Selection (size optimized): potential collisions: 5781.44
> Info:Polynomial Selection (size optimized): raw lognorm (nr/min/av/max/std):
> 5771/33.040/38.091/38.930/0.691
> Info:Polynomial Selection (size optimized): optimized lognorm
> (nr/min/av/max/std): 5771/32.690/36.787/38.920/0.977
> Info:Polynomial Selection (size optimized): Total time: 88.23
> Info:Polynomial Selection (root optimized): Aggregate statistics:
> Info:Polynomial Selection (root optimized): Total time: 51.93
> Info:Polynomial Selection (root optimized): Rootsieve time: 51.66
> Info:Generate Factor Base: Total cpu/real time for makefb: 0.66/0.671431
> Info:Generate Free Relations: Total cpu/real time for freerel: 17.54/17.1051
> Info:Lattice Sieving: Aggregate statistics:
> Info:Lattice Sieving: Total number of relations: 2434823
> Info:Lattice Sieving: Average J: 1024 for 87005 special-q, max bucket fill
> -bkmult 1.0,1s:1.058450
> Info:Lattice Sieving: Total time: 4755.63s
> Info:Filtering - Duplicate Removal, splitting pass: Total cpu/real time for
> dup1: 3.36/8.66293
> Info:Filtering - Duplicate Removal, splitting pass: Aggregate statistics:
> Info:Filtering - Duplicate Removal, splitting pass: CPU time for dup1:
> 8.399999999999999s
> Info:Filtering - Duplicate Removal, removal pass: Total cpu/real time for
> dup2: 20.4/23.1955
> Info:Filtering - Duplicate Removal, removal pass: Aggregate statistics:
> Info:Filtering - Duplicate Removal, removal pass: CPU time for dup2:
> 19.399999999999995s
> Info:Filtering - Singleton removal: Total cpu/real time for purge:
> 13.31/16.1994
> Info:Filtering - Merging: Total cpu/real time for merge: 71.23/75.7246
> Info:Filtering - Merging: Total cpu/real time for replay: 6.26/5.70511
> Info:Linear Algebra: Total cpu/real time for bwc: 351.56/356.6
> Info:Linear Algebra: Aggregate statistics:
> Info:Linear Algebra: Krylov: WCT time 186.49, iteration CPU time 0.03, COMM
> 0.0, cpu-wait 0.0, comm-wait 0.0 (6000 iterations)
> Info:Linear Algebra: Lingen CPU time 11.37, WCT time 11.63
> Info:Linear Algebra: Mksol: WCT time 106.86, iteration CPU time 0.03, COMM
> 0.0, cpu-wait 0.0, comm-wait 0.0 (3000 iterations)
> Info:Quadratic Characters: Total cpu/real time for characters: 6.32/6.81588
> Info:Square Root: Total cpu/real time for sqrt: 0.02/0.017874
> Info:HTTP server: Shutting down HTTP server
> Info:Complete Factorization: Total cpu/elapsed time for entire
> factorization: 14040.3/5464.46
> Info:root: Cleaning up computation data in /var/tmp/dclarke/cado.ibomf2ji
> 11 109 5419 79481 
> 12612868752726608676534011211161792825225468670101915251045116250013903143003646733006649
> real 5467.48
> user 497.84
> sys 5.54
> nix$
> 
> So that is impressive.
> 
> 
> > Regarding one of your earlier e-mails, don't mix "cmake" and "make". The
> > steps called "Configure" and "Compile" must be followed in order, and
> > then "Install" if you so wish.
> 
> Right. Thank you. sorted that out.  Will there be a tarball release at some
> point or just git ?
> 
> Dennis
> 
> _______________________________________________
> Cado-nfs-discuss mailing list
> Cado-nfs-discuss@lists.gforge.inria.fr
> https://lists.gforge.inria.fr/mailman/listinfo/cado-nfs-discuss