Skip to Content.
Sympa Menu

cado-nfs - Re: [Cado-nfs-discuss] Restarting linear algebra after running out of storage

Subject: Discussion related to cado-nfs

List archive

Re: [Cado-nfs-discuss] Restarting linear algebra after running out of storage


Chronological Thread 
  • From: David Willmore <davidwillmore@gmail.com>
  • To: Emmanuel Thomé <Emmanuel.Thome@inria.fr>
  • Cc: cado-nfs-discuss@lists.gforge.inria.fr
  • Subject: Re: [Cado-nfs-discuss] Restarting linear algebra after running out of storage
  • Date: Tue, 10 Dec 2019 21:50:19 -0500
  • Authentication-results: mail3-smtp-sop.national.inria.fr; spf=None smtp.pra=davidwillmore@gmail.com; spf=Pass smtp.mailfrom=davidwillmore@gmail.com; spf=None smtp.helo=postmaster@mail-qk1-f172.google.com
  • Ironport-phdr: 9a23:O6H8MxN0RrzPSXN0vqsl6mtUPXoX/o7sNwtQ0KIMzox0Iv7zrarrMEGX3/hxlliBBdydt6sfzbOH7+u8AyQp2tWoiDg6aptCVhsI2409vjcLJ4q7M3D9N+PgdCcgHc5PBxdP9nC/NlVJSo6lPwWB6nK94iQPFRrhKAF7Ovr6GpLIj8Swyuu+54Dfbx9HiTagb75+Ngi6oAHeu8UZjoZuNLs6xwfUrHdPZ+lY335jK0iJnxb76Mew/Zpj/DpVtvk86cNOUrj0crohQ7BAAzsoL2465MvwtRneVgSP/WcTUn8XkhVTHQfI6gzxU4rrvSv7sup93zSaPdHzQLspVzmu87tnRRn1gyocKTU37H/YhdBxjKJDoRKuuRp/w5LPYIqIMPZyZ77Rcc8GSWZEWMtaSi5PDZ6mb4YXAOUBM+RXoYnzqVUNsBWwGxWjCuz0xz9Un3/7x7E23/g9HQzE2gErAtIAsG7TrNXwLKocX/q6zLfJzTrecvhZ2Tb96IzMchAkpvGMR6x/etfWxEYyDQzFkFSQppHrPjOU0uQNt22b7+16Ve2xkGMnpARxrSKuxscokIXGmoUVylXd+Ch/3Y07JsW4RVZlbdK4FJZcrSKXOotsTs88XW1kpjw2xqAEtJKleiUB1Y4pyATFa/OddoiF+hLjW/iVITd/nH9lfaiwhxe28US50+38VdS43E9EriZYkNTAqGoB1xPU6siARft9+lmu1SyT2ADU7+FIOUE0lazFJJ492rM8iIYfvEDZEiL1mEj6lrGaels69uSy9ujqYKvqqoeZN4BuiwH+Nqoumta4AeQ9KgUBQnKU+fq91LL+80z5QbFKjvkzkqneqpDVO98WpqG8AwBP04Yj7wyzACuh0NQdhXUHNk5KeAqbj4j1PFHDOOz3Au2ijFSriTtrwf7GPqb4DprQL3jDi6vufatm605H0wczydFf54lICrEaOv7zVUHxtNvCDh82LQO42efnCNNn1oMfQ22DGKGZMLmB+WOPs88qJuCKeYIRjwr9LP2kr6rDiHown0IQee+V3ZwSZVi5GO5nKgOXeyy/rM0GFDImtxQ/QKTViVmGVDlJaj7mU6si5z0kCYaiCIDZS6iihbWA2GGwGZgANTMOMUyFDXq9L9bMYPwLci/HZ5Y5ymVVB4jkcJco0FSVjCG/zrNmKuTO/ShB7MDs0dF046vYkhRgrGUoXfTY6HmESiRPpk1NXyU/hfktrkl0y1PF2q990aQBSI5joshRWwJ/Dqbyiux3D9eoBFDEd9aNDU+lG5CoWG5rCN02xNAKbgB2HNDw1h0=
  • List-archive: <http://lists.gforge.inria.fr/pipermail/cado-nfs-discuss/>
  • List-id: A discussion list for Cado-NFS <cado-nfs-discuss.lists.gforge.inria.fr>

And it ends in sadness because of user error. I'll be rerunning it
with the correct settings (and a proper temp dir). I'll know more in
a week. Thanks again for the assistance.

On Mon, Dec 9, 2019 at 4:01 PM Emmanuel Thomé <Emmanuel.Thome@inria.fr> wrote:
>
> Hi,
>
> Glad that you were able to solve your problem.
>
> For the record:
>
> On Mon, Dec 09, 2019 at 02:09:33PM -0500, David Willmore wrote:
> > Writing balancing data to c155.sparse.4x6.bin
> > write(cached matrix file): No space left on device
> > write(cached matrix file): No space left on device
> > write(cached matrix file): No space left on device
> > write(cached matrix file): No space left on device
> > /home/willmore/factoring/cado-nfs-2.3.0/build/blade/linalg/bwc/prep:
> > exited with status 1
> > aborted on subprogram error at
> > /home/willmore/factoring/cado-nfs-2.3.0/build/blade/linalg/bwc/bwc.pl
> > line 512.
> > ...propagated at
> > /home/willmore/factoring/cado-nfs-2.3.0/build/blade/linalg/bwc/bwc.pl
> > line 1406.
>
> In this situation, the cached matrix files that are written in the
> directory c155.bwc/c155.sparse.4x6/ are unusable and must be
> redone. It would have been sufficient to just remove that directory, as
> the cached matrix files would have been recomputed by whatever bwc binary
> was left to call (prep).
>
> And it's an obvious misfeature that cado-nfs does the write to the final
> path of the cached matrix file, in fact. Instead, it should write to a
> temp file, and attempt a filesystem reame (mv) operation, which is atomic
> in most cases. However, in cases where the filesystem is full, we would
> just be trading an error message for another one anyway.
>
> E.
>
> >
> > > From Paul.Zimmerman@inria.fr
> > > you can restart the linear algebra directly by running the bwc.pl
> > > command
> > > at the top of c155.bwc.stdout.1.
> > > ...
> > > All files of the same type should have the same size. If one is short,
> > > just remove it (or move it to another place) and restart the bwc.pl
> > > command.
> >
> > Nice to hear from you again, Paul. It's been a long time.
> >
> > That seems to have done it. I've moved all of those files out as they
> > were of several different lengths and restarted the command.
> >
> > It's running now. Will this complete the factorization or will I need
> > to manually perform any other steps after this?
> >
> > Thank you both for your help! I'll share my results with the group if
> > anyone is interested.
> >
> > Cheers,
> > David Willmore
> >
> > On Mon, Dec 9, 2019 at 8:46 AM Emmanuel Thomé <Emmanuel.Thome@inria.fr>
> > wrote:
> > >
> > > On Mon, Dec 09, 2019 at 06:27:52AM -0500, David Willmore wrote:
> > > > Upon restarting the cado-nfs.py script with the location of the
> > > > recovery parameter file, I was told that there was a short read from
> > > > the .prep file. Moving that out of the way and restarting resulted in
> > > > the same error.
> > >
> > > Can you give the exact error message please ? You can probably find it
> > > in
> > > files called c155.bwc.std*
> > >
> > > You might want to try to remove the cache directories c155.bwc/c155.*x*/
> > > ; those are likely to contain files that were written incompletely.
> > >
> > > E.




Archive powered by MHonArc 2.6.19+.

Top of Page