Skip to Content.
Sympa Menu

cado-nfs - Re: [cado-nfs] dup1 bug when processing over 2^26 relations

Subject: Discussion related to cado-nfs

List archive

Re: [cado-nfs] dup1 bug when processing over 2^26 relations


Chronological Thread 
  • From: Robert Balfour <rhb11931@gmail.com>
  • To: Paul Zimmermann <Paul.Zimmermann@inria.fr>
  • Cc: cado-nfs@inria.fr
  • Subject: Re: [cado-nfs] dup1 bug when processing over 2^26 relations
  • Date: Thu, 5 Aug 2021 14:01:18 +0100
  • Authentication-results: mail3-smtp-sop.national.inria.fr; spf=None smtp.pra=rhb11931@gmail.com; spf=Pass smtp.mailfrom=rhb11931@gmail.com; spf=None smtp.helo=postmaster@mail-yb1-f173.google.com
  • Ironport-hdrordr: A9a23:U+x5WamWG0riO02yTtWSk8I32pPpDfIt3DAbv31ZSRFFG/Fw5Pre+MjzsiWE7wr5OUtQ/OxoV5PgfZqxz/FICMwqTNWftWrdyQiVxeNZg7cKqgeIcxEWtNQw6U4HScND4bbLZ2SS4/yW3OD1KbYd/OU=
  • Ironport-phdr: A9a23:h6kHEBBjh70+HSh1J19fUyQU7kMY04WdBeb1wqQuh78GSKm/5ZOqZBWZua81ygGYFtiAo9t/yMPu+5j6XmIB5ZvT+FsjS7drEyE/tMMNggY7C9SEA0CoZNTjbig9AdgQHAQ9pyLzPkdaAtvxaEPPqXOu8zESBg//NQ1oLejpB4Lelcu62/6u95HJYghFgDWxbLN8IR6rsQjfq84ajJd4JK0s0BXJuHxIe+pXxWNsO12emgv369mz8pB+7Sleouot+MFcX6r0eaQ4VqFYAy89M28p/s3rtALMQhWJ63ABT2gZiBtIAwzC7BHnQpf8tzbxu+Rh1CWGO8D9UKs5Uiq+4ah1VBDoiT8HNz8n/2HRlsxwl79QrBa4qxBi34LYfISZOfxjda3fYNwaX3JMUclfVyNDAo2yYYgBAfcfM+lEtITyvUcCoAGkCAWwGO/iyDlFjWL2060g1OQhFBnL0hAnH90VrnvUtsn1P7oPXO+vyKnIwzLDb+5M2Tzg74XIaBAhruqRUb5tdcfcx1QjGhjKjlWVs4PlPjeV2v4RvGic6uptTOSigHMopA9tuDag3NssipXXiYIPzFDJ7Tt0zYQ6K9O2VEN2fcKpHpteuSyUOYZ7Qt0vTmV1tCs6yrMIt5y2cicXxJkp2hLSdeCKfYiW7h/nVOucIyt0inxjdbmihBiy6VCtxvPgWsSwylpHrSpInsPSunwQ0xHf8NWLR/lz80qnxD2BzRrc6vteLkAxjafbK4Auwro3lpcLtETMBC72mEHvgK6WbUoo5/Gk6+r6brjkqJKQLYB0igb5MqQhnsywH/40PRQJX2ie4ei81bvj8lPlQLhSkPE6jq3UvIrZKMkbvKK1HRJZ34I55xqiDTqr3swUnXwdI1JEfBKHgZLpO1bLIP3gF/e/g0+jnCp2y/3CMLDtH47ALnfGkLj7fLZ971RQxxY0zdBa/55UEK0OIOrvWk/ts9zVFh44Mw2xw+biFtp9zIYeVniUD66YMaPStESH5vg1LOWWZY8Vviz9K/k/6PL0g385g0cXfbO10psPdHC4AvNmLl2FbnX2n9gBFn4GvgwwTOzxk1CCSj5SZ3OqX60m/D07CYSmDZ3CRo+3mrCB0j27TdVqYTV+A02IWUXpcoCJQfIFbiTadvdojzhCZ7mkToI70Biosif7zaBmJ6za4HtLm4jk0Y1P4Ofejw163zVwAcOAySnZVWF+xzpZHGYe06V2oEg7wVCGh/sry8dEHMBesqsaGjwxMoTRmqkjU4iasufpcdKASVLgSdKjU2lZpj0ZzNoHYkI7ENKn3EmrN8uCBrYUk/maDsVx/PuDhD7+IMFyz3uA364k3QFOfw==

Dear Paul et al,

Any progress on finding the source of this bug?

Best regards,
Robert

On Mon, Jul 26, 2021 at 3:32 PM Paul Zimmermann <Paul.Zimmermann@inria.fr> wrote:
       Hi,

I am able to reproduce the issue. It seems to happen since the following
commit:

commit c3079ff3ce67dd801915dbd335b210e8570bea68
Author: Emmanuel Thomé <Emmanuel.Thome@inria.fr>
Date:   Sat Apr 3 15:58:22 2021 +0200

    fopen_maybe_compressed: always use a temp file when writing

Emmanuel, do you have any clue?

Paul

> From: Robert Balfour <rhb11931@gmail.com>
> Date: Mon, 26 Jul 2021 03:06:11 +0100
>
>
> [1:multipart/alternative Hide]
>
>
> [1/1:text/plain Show]
>
>
> [1/2:text/html Hide Save:noname (3kB)]
>
> Dear all,
>
> In recent revisions of CADO (revision 4ef6307d and the latest revision) I am
> seeing a bug, on at least some numbers, when dup1 tries to process more than
> 2^26 = 67108864 relations. dup1.stdout.1 ends abruptly with
>
> # Read 67108864 relations in 135.7s -- 62.5 MB/s -- 494715.5 rels/s
>
> while dup1.stderr.1 ends with the following:
>
> code BUG() : condition rc == 0 failed in split_iter_open_next_file at
> /store/charybdis/cado_4ef6307d/cado-nfs/filter/dup1.c:111 -- Abort
>
> I tried altering the contents of dup1.filelist.1 and found that the bug
> appears precisely when the files contain more than 2^26 relations. So that
> you can attempt to reproduce this, I have attached a parameter file that
> produces the bug when run with the 149-digit number
>
> N =
> 30451074702779672217829979074588808155199316436755065947683534426904549869449262327316787277317820182752090699957549708141192736670950500076802512839
>
>
> I have also heard from another user who has experienced the same bug with
> revision 90dd8db3.
>
> Best regards,
> Robert Balfour
>
> [2:application/octet-stream Show Save:c150.params (2kB)]
>



Archive powered by MHonArc 2.6.19+.

Top of Page