Re: [Starpu-devel] starpu / guix on plafrim partition dedicated for the November HPC school

[Emmanuel Agullo <Emmanuel.Agullo@inria.fr>]

Dear Nathalie, dear all,

Thanks very much once again for the great and accurate support!

Best,

Manu

Nathalie Furmento <nathalie.furmento@labri.fr> writes:

> Hello,
>
> The problem has been fixed. Thanks a lot to Manu for finding out the
> problem, and to Ludo and Brice for your help in wizarding StarPU's code.
>
> However, it's still not possible to fully run StarPU on a single-core
> machine without a /sys directory. We will keep investigating that problem.
>
> In the meantime, i could run
>
> guix build starpu
>
> on the PlaFRIM training machine (with a slightly degraded check
> process), and the package starpu@1.3 is ready to be used.
>
> Cheers,
>
> Nathalie
>
> On 24/10/2019 19:50, Emmanuel Agullo wrote:
>> Dear Nathalie,
>>
>> Thanks much for having fixed the issue (due to the fact that guix was
>> building starpu on a virtual machine with a single core available
>> and that that case was not tested, if I understood correctly the
>> results of your investigations), for the new relase (1.3.3) of StarPU
>> and for its integration in guix-hpc!
>> https://gitlab.inria.fr/guix-hpc/guix-hpc/commit/6554347b87c43640d769bc4bc80bec6688b79c3f
>>
>> Yet, the build seems to have a remaining issue, and the log (extraction
>> below) seems to be related once again to the fact that there is only
>> one CPU core available (hence ... no workers) in the build environment.
>>
>> Once again, thanks very much for the great support.
>>
>> With best regards,
>>
>> Manu
>>
>> --
>>
>> ============================================================================
>> Testsuite summary for StarPU 1.3.3
>> ============================================================================
>> # TOTAL: 214
>> # PASS:  156
>> # SKIP:  56
>> # XFAIL: 1
>> # FAIL:  1
>> # XPASS: 0
>> # ERROR: 0
>> ============================================================================
>> See tests/test-suite.log
>> Please report to starpu-devel@lists.gforge.inria.fr
>> ============================================================================
>> make[5]: *** [Makefile:9002: test-suite.log] Error 1
>> make[5]: Leaving directory 
>> '/tmp/guix-build-starpu-1.3.3.drv-0/source/tests'
>> make[4]: *** [Makefile:9110: check-TESTS] Error 2
>> make[4]: Leaving directory 
>> '/tmp/guix-build-starpu-1.3.3.drv-0/source/tests'
>> make[3]: *** [Makefile:10791: check-am] Error 2
>> make[3]: Leaving directory 
>> '/tmp/guix-build-starpu-1.3.3.drv-0/source/tests'
>> make[2]: *** [Makefile:8894: check-recursive] Error 1
>> make[2]: Leaving directory 
>> '/tmp/guix-build-starpu-1.3.3.drv-0/source/tests'
>> make[1]: *** [Makefile:10793: check] Error 2
>> make[1]: Leaving directory 
>> '/tmp/guix-build-starpu-1.3.3.drv-0/source/tests'
>> make: *** [Makefile:833: check-recursive] Error 1
>>
>> Test suite failed, dumping logs.
>>
>> --- ./tests/test-suite.log 
>> --------------------------------------------------
>>
>> ========================================
>>    StarPU 1.3.3: tests/test-suite.log
>> ========================================
>>
>> # TOTAL: 214
>> # PASS:  156
>> # SKIP:  56
>> # XFAIL: 1
>> # FAIL:  1
>> # XPASS: 0
>> # ERROR: 0
>>
>> .. contents:: :depth: 2
>>
>> SKIP: main/bind
>> ===============
>>
>> #Execution_time_in_seconds 0.033840 ./main/bind
>> SKIP main/bind (exit status: 77)
>>
>> FAIL: main/starpu_worker_exists
>> ===============================
>>
>> failure with can_always_execute
>> #Execution_time_in_seconds 0.034313 ./main/starpu_worker_exists
>> `./main/starpu_worker_exists' exited with return code 1
>> FAIL main/starpu_worker_exists (exit status: 1)
>>
>> [...]
>>
>> SKIP: datawizard/readonly
>> =========================
>>
>> copy 0
>> [starpu][_starpu_task_insert_v] submission of task 0x419ca0 with codelet 
>> 0x4040c0 failed (symbol `none') (err: ENODEV)
>> WARNING: No one can execute this task
>> #Execution_time_in_seconds 0.033982 ./datawizard/readonly
>> SKIP datawizard/readonly (exit status: 77)
>>
>> SKIP: datawizard/invalidate_pending_requests
>> ============================================
>>
>> #Execution_time_in_seconds 0.032424 
>> ./datawizard/invalidate_pending_requests
>> SKIP datawizard/invalidate_pending_requests (exit status: 77)
>>
>> XFAIL: errorcheck/invalid_blocking_calls
>> ========================================
>>
>> /tmp/guix-build-starpu-1.3.3.drv-0/source/src/.libs/libstarpu-1.3.so.2(starpu_data_acquire_on_node+0x565)[0x7ffff7f0b255]
>> /tmp/guix-build-starpu-1.3.3.drv-0/source/tests/errorcheck/.libs/invalid_blocking_calls[0x401685]
>> /tmp/guix-build-starpu-1.3.3.drv-0/source/src/.libs/libstarpu-1.3.so.2(+0xdf03c)[0x7ffff7f4203c]
>> /tmp/guix-build-starpu-1.3.3.drv-0/source/src/.libs/libstarpu-1.3.so.2(_starpu_cpu_driver_run_once+0x164)[0x7ffff7f42574]
>> /tmp/guix-build-starpu-1.3.3.drv-0/source/src/.libs/libstarpu-1.3.so.2(_starpu_cpu_worker+0x2d)[0x7ffff7f4271d]
>> /gnu/store/ahqgl4h89xqj695lgqvsaf6zh2nhy4pj-glibc-2.29/lib/libpthread.so.0(+0x8015)[0x7ffff7afa015]
>> /gnu/store/ahqgl4h89xqj695lgqvsaf6zh2nhy4pj-glibc-2.29/lib/libc.so.6(clone+0x3f)[0x7ffff7a1091f]
>>
>> [starpu][starpu_data_acquire_on_node][assert failure] Acquiring a data 
>> synchronously is not possible from a codelet or from a task callback, use 
>> starpu_data_acquire_cb instead.
>>
>> invalid_blocking_calls: datawizard/user_interactions.c:334: 
>> starpu_data_acquire_on_node: Assertion 
>> `_starpu_worker_may_perform_blocking_calls()' failed.
>> [error] `./errorcheck/invalid_blocking_calls' killed with signal 6; test 
>> marked as failed
>> while looking for core file of ./errorcheck/invalid_blocking_calls: 
>> core.32549: No such file or directory
>> while looking for core file of ./errorcheck/invalid_blocking_calls: core: 
>> No such file or directory
>> #Execution_time_in_seconds 0.107065 ./errorcheck/invalid_blocking_calls
>> XFAIL errorcheck/invalid_blocking_calls (exit status: 1)
>>
>> SKIP: overlap/gpu_concurrency
>> =============================
>>
>> [...]
>>
>>
>> --- ./tools/test-suite.log 
>> --------------------------------------------------
>>
>> ========================================
>>    StarPU 1.3.3: tools/test-suite.log
>> ========================================
>>
>> # TOTAL: 4
>> # PASS:  4
>> # SKIP:  0
>> # XFAIL: 0
>> # FAIL:  0
>> # XPASS: 0
>> # ERROR: 0
>>
>> .. contents:: :depth: 2
>>
>> command "make" "check" failed with status 2
>> builder for `/gnu/store/75lm27wdcm9dwrjxabiiyi3ha4cfrgl4-starpu-1.3.3.drv' 
>> failed with exit code 1
>> la compilation de 
>> /gnu/store/75lm27wdcm9dwrjxabiiyi3ha4cfrgl4-starpu-1.3.3.drv a échoué
>> Aucun journal de compilation pour « 
>> /gnu/store/75lm27wdcm9dwrjxabiiyi3ha4cfrgl4-starpu-1.3.3.drv ».
>> guix build: erreur : build of 
>> `/gnu/store/75lm27wdcm9dwrjxabiiyi3ha4cfrgl4-starpu-1.3.3.drv' failed
>>
>>
>> In case it may be useful, here is the channels.scm used for this "guix
>> build starpu" test.
>>
>> [hpcs-agullo@miriel001 hou10ni_school_2019]$ guix describe 
>> --format=channels
>> (list (channel
>>         (name 'guix-hpc)
>>         (url "https://gitlab.inria.fr/guix-hpc/guix-hpc.git";)
>>         (commit
>>           "c70ab156deef43e8e9a09947ab15b0e1cc579b29"))
>>       (channel
>>         (name 'guix-hpc-non-free)
>>         (url "https://gitlab.inria.fr/guix-hpc/guix-hpc-non-free.git";)
>>         (commit
>>           "0822b7eebb63e2360125e017934ba817686d9669"))
>>       (channel
>>         (name 'guix)
>>         (url "https://git.savannah.gnu.org/git/guix.git";)
>>         (commit
>>           "bfaa06171842225c8bf4c839e35ac36a0b2c2d59")))
>>
>>
>>
>>
>>
>> Emmanuel Agullo <Emmanuel.Agullo@inria.fr> writes:
>>
>>> Dear Nathalie,
>>>
>>> Thanks much for considering this issue.
>>>
>>> Yes, it's here:
>>>
>>>> eagullo@tek9:/tmp/toto$ guix describe --format=channels
>>>> (list (channel
>>>>         (name 'guix-hpc-non-free)
>>>>         (url "https://gitlab.inria.fr/guix-hpc/guix-hpc-non-free.git";)
>>>>         (commit
>>>>           "0822b7eebb63e2360125e017934ba817686d9669"))
>>>>       (channel
>>>>         (name 'guix-hpc)
>>>>         (url "https://gitlab.inria.fr/guix-hpc/guix-hpc.git";)
>>>>         (commit
>>>>           "b24a8fa55bfd4a0987320e0e45d3a85f0920427c"))
>>>>       (channel
>>>>         (name 'guix)
>>>>         (url "https://git.savannah.gnu.org/git/guix.git";)
>>>>         (commit
>>>>           "bfaa06171842225c8bf4c839e35ac36a0b2c2d59")))
>>> Just need to copy and paste it on ~/.config/guix/channels.scm
>>> and "guix pull".
>>>
>>> And then the "guix build starpu" should be available.
>>>
>>> Thanks once again!
>>>
>>> Best,
>>>
>>> Manu