Subject: Discussion related to cado-nfs
List archive
- From: Tyler Busby <tylerbusby333@gmail.com>
- To: cado-nfs@inria.fr
- Subject: [cado-nfs] CADO-NFS LA Errors
- Date: Sun, 26 May 2024 12:06:35 -0400
- Authentication-results: mail2-smtp-roc.national.inria.fr; spf=None smtp.pra=tylerbusby333@gmail.com; spf=Pass smtp.mailfrom=tylerbusby333@gmail.com; spf=None smtp.helo=postmaster@mail-lf1-f45.google.com
- Ironport-data: A9a23:Bvej6KvMUbCbzGo0uBrvhPQyaOfnVMxaMUV32f8akzHdYApBsoF/q tZmKW/TP/7cM2L0Kdtxa9i1oUsBu5fTzINiQAFqr3gyRiMWgMeUXt7xwmXYb3rDdJWbJK5Ex 5xDMYeYdJhcolv0/ErF3m3J9CEkvU2wbuOgTrSCYEidfCc8IA85kxVvhuUltYBhhNm9Emult Mj7yyHlEAbNNwVcbCRMu8pvlDs15K6u4G5C4ARnDRx2lAa2e0c9XMp3yZ6ZdCOQrrl8RoaSW +vFxbelyWLVlz9F5gSNz94X2mVTKlLjFVDmZkh+A8BOsTAezsAG6ZvXAdJHAathZ5plqPgqo DlFncTYpQ7EpcQgksxFO/VTO3kW0aGrZNYriJVw2CCe5xSuTpfi/xlhJAYqD9Qqy+hqPWAQp fwZJT4PMTTflcvjldpXSsE07igiBMziPYdavn85iD+FULApRpfMR6iM7thdtNsyrpoWTLCOO oxAN2UpMEmojx5nYj/7DLoijeOlnHPiaDdJ8wnOjaUy6mnXigd21dABNfKMJIPWGp8PxBbwS mTu9F30PAExH8Ok63mk2S2q1vLMhgXhcddHfFG/3qU32QXMlzJ75ActfVCyrf78jEClc8lOL lQdvCsot6k7skKxJuQRRDW9qX+A+xoSAp9eT7B85waKxa7ZpQ2eAwDoUwKtdvRhqP1vdw0ky 2OIwYPpBDFhsuKxFWC0o+L8QSyJBQAZKmoLZCkhRAQD4sX+rIxbsv4pZoY9eEJSpo2qcQwc0 wy3QD4Ca6L/ZPPnOo2+9FHDxjai/93HElNz6QLQUWaoqAh+YeZJhrBEC3CKsZ6sz67AETFtW UTofeDAtoji6rnTz0SwrB0lRu3B2hp8GGS0baRTN5cg7S+x3HWoYJpd5jpzTG8wbZ9aJ2GwM BGO5lgPjHO2AJdMRf8oC25WI5R6pZUM6fy8Bpg4k/IXPsYuLlbdrEmCm2bLgzq1ziDAbp3Ty b/ALJ/0UidEYUiW5DWxQOgZ3PcqwCt4rV4/triqpylLJYG2PSbPIZ9caAXmRrlgsMus/l+Jm /4BbJDi40sEAIXDjtz/q9F7waYidihlW/gbaqV/Koa+H+aRMDt9UK+MmOx5K9YNcmY8vr6gw 0xRk3RwkDLX7UAr4y3TApy6QOq3B8gtnmFxJiE2I1ej1l4qZIvlvu9VdII6cfNjvKZvxOJ9B atNMciRIOV9ehKe8RQkbL75sNNDcjavjlmwJCaLWmU0UKNhYA3rweXaWDXT2hMANQeJkPcvg qaB01rbSKUTRg45A8fxbumu/myLvnMcubxTWhLIK+ZMZE/DwZhOFB2pqMRqJctWeBPJ6QaH5 lzHHTYZuuj/jIsn+/bZha2/jtmIEskvOmF4DmXk/bKNGi2CxVWawKhES/StUQHGcWHJpJWZe uReys/jPM09nFplt5R2F5Bpx/kc4+TDiqB7zAM+Oln2dHWuV61dJ0eZ0fl1tqFiwqFTvS20U Bmt/vhYIbC4B9P3ImUOJQYKbvWx6t9Mo2P8tc8KGUTd4DN72JGlUk8IZhmFt3F7HYtPaYggx b8shd4S5wmBkSEVC9ehjB1P1mGyP3cFArQGtJYbPdfRsTAV6Gp+OL7SNiynx6u0SYRoElIrK Tqqlqb9l+xi5k7dQUESS1nJ/8Rg3Korhj4b7WUsBVqznvj9usQWxzxUqDQ+cRRUxE5I0sV1I WlaCHd2LqSvoRZtiNRyYGS3PwRnGhei21fQzmERnzbzVHiYVW3qLUw8N92S/UsfzXluQzhD8 Jycy0fnSTzPfvyt+gcXRmhetKXFYfFq0w/NiuSLPp6gJIYrRyjhjouFR3s6mzG+Dewf3ET49 PRXpsBuYqjFBAssiqwcCazB8J8PSRqBdVdwcds48IwnRWjjKSyPgx6QIEWMe+RIFfzA0Wm8L +dMfstvdRCP5ByinwAhJ5wnAuFLxaYyxd84ZLnUC3YMsOKfohpXoZvgzHXCq1Fxcep+s/QWC 933TC2DIFyylHEPum7qret4AESaT+QARjXB2LGSzL1UObMF6PphYGMj4IuS5n+1CjZqzziQn QHEZpLV8dBc9JRRr9PSNZtHViqJKoLVdeWX8QqMncxEQvHRPOzv6Q4EiFnVED5HHLkWWuYtz LSEj8Hq7RmUoJc3TGHrtJ2THIZZ5ciJfbR2M+CmCFJ4jCe9SMvXzB9bwF+BKLtNi8J72sa8Y hmRMe+cSIYwYMhM41FwcA1cIgY5J4WsSZm4vgK7jfCHKiZF4Dz9NNn9qEPYNzBKRBEHK7jVK 1HRqf2xwvt6sY4VJhsPJ88+Mq9COFW5BJcXLYzghwK5UFutrEiJ4Ib5tBwa7jrONHmIPeD67 b/BRTn8bB6Cg77J/v4Ir71NugArM1gljdkSZk49//tEuwK+BkMCLsUfNswiIbNQmSrQypr5R W/saE0PNCbDZglHIC7MuInbYgSiB+IwY4azYnRj+k6PcC65Cb+RGLYrpG8q/35yfSCl1+29b 80X/nrrJBWq35V1XqAp6+emhft8jObvrp7SFZsRT+Spa/rfPVkL6JClNA9EVCiCF8+U0UuXe C46QmdLREz9Qkn0eSqll7i5BzlB1A4DDR1xBctM/Dobk4qexexEjvb4PokfF5UdOd8SKudmq WzfHgOwDqP/5pDXkaQsstMtx6RzDJpn2yR8wLDLHWUvok171ojr0w7uU8bCoAHONTOzy2/gq wQ=
- Ironport-hdrordr: A9a23:P6ig5KlKq7TQqG2x1fpbJSn6lvbpDfIh3DAbv31ZSRFFG/Fw9v re+8jzsCWftN9/YgBCpTntAsm9qBDnlKKdg7NhX4tKNTOO0ACVxepZnO7fKlPbaknDHy1muZ uIsZISNDQ9NzdHZA/BjjWFLw==
- Ironport-phdr: A9a23:sgQ4aBLpvWGb8iIbOdmcuKNsWUAX0o4c3iYr45Yqw4hDbr6kt8y7e hCFtLM30wWCDNmTwskHotSVmpijY1BI2YyGvnEGfc4EfD4+ouJSoTYdBtWYA1bwNv/gYn9yN s1DUFh44yPzahANS47xaFLIv3K98yMZFAnhOgppPOT1HZPZg9iq2+yo9JDffQFFiCCjbb5wM hm6ogHcu8YLioZ+N6g9zQfErXRPd+lK321kIk6dkQjh7cmq5p5j9CpQu/Ml98FeVKjxYro1Q 79FAjk4Km45/MLkuwXNQguJ/XscT34ZkgFUDAjf7RH1RYn+vy3nvedgwiaaPMn2TbcpWTS+6 qpgVRHlhDsbOzM/7WrajNF7gqBGrxK7vxFwzI7abo+WOvRjYK3SYcgXSnBdUstLTSFNHp+wY okJAuEcPehYtY79p14WoBWgBQisAP3gyiVVjXLrwK06yP8uEAHb1wEnA9IPsHDUo8vvNKgJT OC117LHzDXNYv5Y1zrw84fIchU7rvGNWbJ8a9beyU4qFw7ciFibtIPqMS+P2OsXr2ib8/RvV fipi2M/pQx9vjyiy9oyh4TKho8YxFLJ+Ct3zos6ONG0VFJ3bNqkHZZety+XK4R7T8E+Tmxrt yg3y78LtJq0ciQW1ZkqxhjSYOGJfYiP5xLsTueRITFgiX1+drOwmwy+8VCkyuD6S8K6005Ko zJbntXQsn0BzR/e58idRvdg/0qs2yyD2g/T5+xCPEs5i67bK4M6wr4siJUTq1nNHi73mUrol KKaakMp8fWy5ev9eLXpvJqcOpd0ig7gNqQundSyAeEiPQgPW2iX4OC81LP+8UHgTrVHgf07n rPWsJDdIsQbqaq5DBFP3ok/7Ba/Ci+q0NUenXYZMFJIYAyLg5TtNl3UI/31De2zj0mtnTpp3 fzLMb3sDo3ILnfZkbfhebh961RbyAo21d1f+5JVCrUfL/LpQUDxqcfYAQQ5MgG6zevqBs5w1 owbWW2VA6+ZNLnevkOP5uIqO+WMYpQaty7nK/c5//7ukWM5mVgFcKW0xZcXcmy3Hux6I0WFZ nrhmssOHn0XsQo5VeDqjlOCUSVIanapX6M84yk7B5i8AYfCQICtmr2B0z2hEp1YfGAVQmyLR Hzhe4LBXfkXQCOUOM5o1DIeBpa7TIp06QCquRWy4ad8JPucrjEJsZ/53sVu7fyIzkoa+jl9D sDb2GaIGTIn1lgUTiM7ifgs6Xd2zU2OhPAQa51wENVS46kMSQImLdvGyOc8DdnuWwXHd9PPS VC8Q9zgDytiBskpzYooZEBwU86nkgiFxzCjVqMEk7GRDoEv+LOHhCPZKMN0ynKA364k3BE9W sUaDWS9neZk8hTLQYvAkkGXjaGvILgN2CPX/nqYx3vV5xpwXwt5UKGDVncaNQPNtdqswETEQ ve1DKg/dAtMzcnXMqxRdtjglklLXt/mMdXaJma/wiK+WUvOybSLY47nPW4a2U0xEWAilAYet TaDPAk6XGK6pn7GSSZpHhTpal/t9u93rDW6SFU1xkeEdR8p0b394RMTifGGLpFblrsZpCcsr Sl1F1ehzprXDdSHvQ9oYKRbZ5s0/l5G0WvTswE1MIanKuhugVsXcgI/uE2LtV0/FpREnNIgs Wgg3VEpcoqX1VpAc3WT2pWxcrzbJ2/u/Qy+PrbM0wK7sp7e8aMO5fIk7lT76VvxRwxyrjM+j YYTjybPg/eCRBAfWp/wTEstoh1zprWAJzI4+5uRz3pnd6+9rj7F3dstQuoj0BepOdlFY8bmX Ef/FdMXA8+2JakkgV+sO1gYLeRf7qQpJMm3LKDd8KGuNedk2jmhiC4UheI1mlLJ7Cd6RuPSi twZ0vWVxAGaTD3t1wz6ms/ykIFAIzoVGyDsrEqsTJ4Ubap0c4ERDG6oKMDi3dRyianmXHtA/ UKiDVcLsCOwUSKbdEe1nQhZ1EBN5GeihTP91Tt/1TcgsquY2iXKheXkbhsOfGBRFiFuilLlI I78iN5/PgDgcxktmQGv+F3w1vMA/4xwKmDSRQFDeC2+I2x5U6S2v6aPeIYVsMJu4XgRCbrjJ wzHArfm6wMXySbiA3dTyFVZP3mxt5P1kgY7wGORIXBvrWbILMR5xBPR/tvZFrZa2jsLQjU9i CGCXADteYn0u4zKyNGf77PbNSrpTJBYfCj1wJnVsSK64TcvGhijh7WpndahFwEm0Cj93t0sV CPSrR+6bJO4ssbyee9hYERsA0fxrsRgHYQr2JchgJwK02UBjITOpiEvnmL6MNEd0qX7JiloJ 3ZD05vO7Q7p1Vc2ZG6Yw4/jXGiGyNo6PIKSbWYf2yZ75MdPQvTxjvQMjW5+pVy2qhjUaP52k 2IGyPcg33UdhvkApAsnyijOSqBXB0RTOjbg0giZ993r5rsCf36hKPLjsSg21cDkFryJpRtQH Wr0aot3VzEl9d1xaRrNyCGhsdyiIYiIK4hP6VvM1E2cx+lNdMBvyrxQ3nEhYDyl+yVikr9e7 1Qm3Inm7tbZbTw1puThREYfbGW9ZttPqG+zy/wCz4DGh8b3Wc85UjQTAMm3F7TxTHRL5K6hb 0HXQFhe4j+aAeaNQlPZsR076SqJS9fyaTmWPCVLlI0yAkDCewoPxlhTBmxyn4ZlRFn1n4q4I Rs/vnZJoQemz3kEguNwa0ulCjaZ9FruM21kDsDYdUUe7xketR2Mb4rDvqQqTnseptr4/USMM jDJPV0WSztSCwrfXRa7eeD/gLuIu/6RAu70RxfXSZOJr+EWF/KBxJb1l5Bj4y7JLMKEeH9rE /w83ENHG3F/AcXQ3TsVGWQRkGrWYsiXqQ3ZmGU/p92j8PntRAPk5JeeQ7pUP9J1/hmqgKCFf +eOjSd9IDxc29sC33jNgLQY2VcTjWlpeVzPWfwYsjXRSavLhqJNJxsSaic2MMURqqxgg09CP snUjt6z3bl9z7Y0B1pDSV39i5SpaMgNcATffBvMAEeGMqjDJCWemZmmJ/PhD+QO06MI6k7V2 37TCULoMzWdmiO8UhmuNbsJlySHJFlEv4r7dB9xCG/lRdagaxuhMdYxgydlpN98zn7MK2MYN iBxNk1XqbjFpz9JhvhlEXFa5Gs+drKslCOQ7u2eIZET+6gOYGw8h6dB7XI2xqEApjlDX+Bwk TDOo8RGplinlqyLxGMiXkYT7DlMg42PsANpPqCTpfwiET7UuRkK62uXEREDodBoX8but65nw d/KjKvvKT1G/ro8EuMTAsHVLISMN39zaHIB+RbRBQoBCDqlbCTR2xEbn/aV+XmY6JM9r8q08 HLrYrBeXV0xUPgdDxY9dOE=
- Ironport-sdr: 66535e18_GARxcreSoYQh+rZNhJIo0B7Ilp2oKa7iManR1zuFfocqRgt jIHDhctKZjxcwy65BNDAeKyyYE/cVrFKHAQQ1LA==
I've been having issues with the CADO-NFS linear algebra step recently. It will seemingly die at a random point (but usually once every time I run an SNFS job), but be recoverable and complete LA if restarted again, here's the most recent death:
It seems bwc.pl doesn't account for the possibility of this happening, and it just kills the overall script, and nothing informative seems to be output to any of the logs. Does anybody know what might be causing this? Perhaps an automatic retry or more informative logging needs to be added in this case.
Info:Filtering - Merging: Merged matrix has 2336636 rows and total weight 284561353 (121.8 entries per row on average)
Info:Complete Factorization / Discrete logarithm: Filtering - Merging
Info:Filtering - Merging: Total cpu/real time for merge: 457.83/67.7782
Info:Filtering - Merging: Total cpu/real time for replay: 68.71/63.6312
Info:Linear Algebra: Starting
Info:Linear Algebra: krylov: N=3000 ; ETA (N=75000): Sun May 26 06:55:09 2024 [0.069 s/iter]
Info:Linear Algebra: krylov: N=6000 ; ETA (N=75000): Sun May 26 06:46:58 2024 [0.062 s/iter]
Info:Linear Algebra: krylov: N=9000 ; ETA (N=75000): Sun May 26 06:41:30 2024 [0.058 s/iter]
Info:Linear Algebra: krylov: N=12000 ; ETA (N=75000): Sun May 26 06:48:51 2024 [0.064 s/iter]
Info:Linear Algebra: krylov: N=15000 ; ETA (N=75000): Sun May 26 07:01:52 2024 [0.074 s/iter]
Info:Linear Algebra: krylov: N=18000 ; ETA (N=75000): Sun May 26 07:10:54 2024 [0.081 s/iter]
Info:Linear Algebra: krylov: N=21000 ; ETA (N=75000): Sun May 26 07:17:03 2024 [0.086 s/iter]
Info:Linear Algebra: krylov: N=24000 ; ETA (N=75000): Sun May 26 07:21:48 2024 [0.090 s/iter]
Info:Linear Algebra: krylov: N=27000 ; ETA (N=75000): Sun May 26 07:25:17 2024 [0.093 s/iter]
Info:Linear Algebra: krylov: N=30000 ; ETA (N=75000): Sun May 26 07:28:09 2024 [0.095 s/iter]
Info:Linear Algebra: krylov: N=33000 ; ETA (N=75000): Sun May 26 07:30:33 2024 [0.097 s/iter]
Warning:Command: Process with PID 304895 finished with return code 1
Error:Linear Algebra: Program run on server failed with exit code 1
Error:Linear Algebra: Command line was: /home/tbusby/cado-nfs/build/bubtop/linalg/bwc/bwc.pl :complete 'thr=16' 'm=64' 'n=64' 'nullspace=left' 'interval=3000' 'matrix=/home/tbusby/cado-nfs/v2.-1.915/v2.-1.915.sparse.bin' 'wdir=/home/tbusby/cado-nfs/v2.-1.915/v2.-1.915.bwc' 'interleaving=0' 'cpubinding=/home/tbusby/cado-nfs/parameters/misc/cpubinding.conf' 2> /home/tbusby/cado-nfs/v2.-1.915/v2.-1.915.bwc.stderr.1
Error:Linear Algebra: Stderr output (last 10 lines only) follow (stored in file /home/tbusby/cado-nfs/v2.-1.915/v2.-1.915.bwc.stderr.1):
Error:Linear Algebra: #############################################################################
Error:Linear Algebra: /home/tbusby/cado-nfs/build/bubtop/linalg/bwc/krylov cpubinding=/home/tbusby/cado-nfs/parameters/misc/cpubinding.conf interleaving=0 n=64 nullspace=left interval=3000 wdir=/home/tbusby/cado-nfs/v2.-1.915/v2.-1.915.bwc matrix=/home/tbusby/cado-nfs/v2.-1.915/v2.-1.915.sparse.bin prime=2 thr=4x4 m=64 ys=0..64 start=0
Error:Linear Algebra: # (270f78085) /home/tbusby/cado-nfs/build/bubtop/linalg/bwc/krylov cpubinding=/home/tbusby/cado-nfs/parameters/misc/cpubinding.conf interleaving=0 n=64 nullspace=left interval=3000 wdir=/home/tbusby/cado-nfs/v2.-1.915/v2.-1.915.bwc matrix=/home/tbusby/cado-nfs/v2.-1.915/v2.-1.915.sparse.bin prime=2 thr=4x4 m=64 ys=0..64 start=0
Error:Linear Algebra: # Compiled with gcc 11.4.0
Error:Linear Algebra: # Compilation flags (C) -std=c99 -W -Wall -O2 -msse3 -mssse3 -msse4.1 -mpopcnt -mavx -mavx2 -mpclmul
Error:Linear Algebra: # Compilation flags (C++) -export-dynamic -std=c++17 -Wno-c++11-compat -W -Wall -O2 -Wno-literal-suffix -msse3 -mssse3 -msse4.1 -mpopcnt -mavx -mavx2 -mpclmul
Error:Linear Algebra: /home/tbusby/cado-nfs/build/bubtop/linalg/bwc/krylov: exited with status 1
Error:Linear Algebra: aborted on subprogram error at /home/tbusby/cado-nfs/build/bubtop/linalg/bwc/bwc.pl line 529.
Error:Linear Algebra: ...propagated at /home/tbusby/cado-nfs/build/bubtop/linalg/bwc/bwc.pl line 1616.
Error:Linear Algebra:
It seems bwc.pl doesn't account for the possibility of this happening, and it just kills the overall script, and nothing informative seems to be output to any of the logs. Does anybody know what might be causing this? Perhaps an automatic retry or more informative logging needs to be added in this case.
-Tyler
- [cado-nfs] CADO-NFS LA Errors, Tyler Busby, 05/26/2024
- Re: [cado-nfs] CADO-NFS LA Errors, Emmanuel Thomé, 05/27/2024
Archive powered by MHonArc 2.6.19+.