Re: [Starpu-devel] starpu / guix on plafrim partition dedicated for the November HPC school

[Emmanuel Agullo <Emmanuel.Agullo@inria.fr>]

Dear Nathalie,

Thanks much for having fixed the issue (due to the fact that guix was
building starpu on a virtual machine with a single core available
and that that case was not tested, if I understood correctly the
results of your investigations), for the new relase (1.3.3) of StarPU
and for its integration in guix-hpc!
https://gitlab.inria.fr/guix-hpc/guix-hpc/commit/6554347b87c43640d769bc4bc80bec6688b79c3f

Yet, the build seems to have a remaining issue, and the log (extraction
below) seems to be related once again to the fact that there is only
one CPU core available (hence ... no workers) in the build environment.

Once again, thanks very much for the great support.

With best regards,

Manu

--

============================================================================
Testsuite summary for StarPU 1.3.3
============================================================================
# TOTAL: 214
# PASS:  156
# SKIP:  56
# XFAIL: 1
# FAIL:  1
# XPASS: 0
# ERROR: 0
============================================================================
See tests/test-suite.log
Please report to starpu-devel@lists.gforge.inria.fr
============================================================================
make[5]: *** [Makefile:9002: test-suite.log] Error 1
make[5]: Leaving directory '/tmp/guix-build-starpu-1.3.3.drv-0/source/tests'
make[4]: *** [Makefile:9110: check-TESTS] Error 2
make[4]: Leaving directory '/tmp/guix-build-starpu-1.3.3.drv-0/source/tests'
make[3]: *** [Makefile:10791: check-am] Error 2
make[3]: Leaving directory '/tmp/guix-build-starpu-1.3.3.drv-0/source/tests'
make[2]: *** [Makefile:8894: check-recursive] Error 1
make[2]: Leaving directory '/tmp/guix-build-starpu-1.3.3.drv-0/source/tests'
make[1]: *** [Makefile:10793: check] Error 2
make[1]: Leaving directory '/tmp/guix-build-starpu-1.3.3.drv-0/source/tests'
make: *** [Makefile:833: check-recursive] Error 1

Test suite failed, dumping logs.

--- ./tests/test-suite.log --------------------------------------------------

========================================
   StarPU 1.3.3: tests/test-suite.log
========================================

# TOTAL: 214
# PASS:  156
# SKIP:  56
# XFAIL: 1
# FAIL:  1
# XPASS: 0
# ERROR: 0

.. contents:: :depth: 2

SKIP: main/bind
===============

#Execution_time_in_seconds 0.033840 ./main/bind
SKIP main/bind (exit status: 77)

FAIL: main/starpu_worker_exists
===============================

failure with can_always_execute
#Execution_time_in_seconds 0.034313 ./main/starpu_worker_exists
`./main/starpu_worker_exists' exited with return code 1
FAIL main/starpu_worker_exists (exit status: 1)

[...]

SKIP: datawizard/readonly
=========================

copy 0
[starpu][_starpu_task_insert_v] submission of task 0x419ca0 with codelet 
0x4040c0 failed (symbol `none') (err: ENODEV)
WARNING: No one can execute this task
#Execution_time_in_seconds 0.033982 ./datawizard/readonly
SKIP datawizard/readonly (exit status: 77)

SKIP: datawizard/invalidate_pending_requests
============================================

#Execution_time_in_seconds 0.032424 ./datawizard/invalidate_pending_requests
SKIP datawizard/invalidate_pending_requests (exit status: 77)

XFAIL: errorcheck/invalid_blocking_calls
========================================

/tmp/guix-build-starpu-1.3.3.drv-0/source/src/.libs/libstarpu-1.3.so.2(starpu_data_acquire_on_node+0x565)[0x7ffff7f0b255]
/tmp/guix-build-starpu-1.3.3.drv-0/source/tests/errorcheck/.libs/invalid_blocking_calls[0x401685]
/tmp/guix-build-starpu-1.3.3.drv-0/source/src/.libs/libstarpu-1.3.so.2(+0xdf03c)[0x7ffff7f4203c]
/tmp/guix-build-starpu-1.3.3.drv-0/source/src/.libs/libstarpu-1.3.so.2(_starpu_cpu_driver_run_once+0x164)[0x7ffff7f42574]
/tmp/guix-build-starpu-1.3.3.drv-0/source/src/.libs/libstarpu-1.3.so.2(_starpu_cpu_worker+0x2d)[0x7ffff7f4271d]
/gnu/store/ahqgl4h89xqj695lgqvsaf6zh2nhy4pj-glibc-2.29/lib/libpthread.so.0(+0x8015)[0x7ffff7afa015]
/gnu/store/ahqgl4h89xqj695lgqvsaf6zh2nhy4pj-glibc-2.29/lib/libc.so.6(clone+0x3f)[0x7ffff7a1091f]

[starpu][starpu_data_acquire_on_node][assert failure] Acquiring a data 
synchronously is not possible from a codelet or from a task callback, use 
starpu_data_acquire_cb instead.

invalid_blocking_calls: datawizard/user_interactions.c:334: 
starpu_data_acquire_on_node: Assertion 
`_starpu_worker_may_perform_blocking_calls()' failed.
[error] `./errorcheck/invalid_blocking_calls' killed with signal 6; test 
marked as failed
while looking for core file of ./errorcheck/invalid_blocking_calls: 
core.32549: No such file or directory
while looking for core file of ./errorcheck/invalid_blocking_calls: core: No 
such file or directory
#Execution_time_in_seconds 0.107065 ./errorcheck/invalid_blocking_calls
XFAIL errorcheck/invalid_blocking_calls (exit status: 1)

SKIP: overlap/gpu_concurrency
=============================

[...]


--- ./tools/test-suite.log --------------------------------------------------

========================================
   StarPU 1.3.3: tools/test-suite.log
========================================

# TOTAL: 4
# PASS:  4
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0

.. contents:: :depth: 2

command "make" "check" failed with status 2
builder for `/gnu/store/75lm27wdcm9dwrjxabiiyi3ha4cfrgl4-starpu-1.3.3.drv' 
failed with exit code 1
la compilation de 
/gnu/store/75lm27wdcm9dwrjxabiiyi3ha4cfrgl4-starpu-1.3.3.drv a échoué
Aucun journal de compilation pour « 
/gnu/store/75lm27wdcm9dwrjxabiiyi3ha4cfrgl4-starpu-1.3.3.drv ».
guix build: erreur : build of 
`/gnu/store/75lm27wdcm9dwrjxabiiyi3ha4cfrgl4-starpu-1.3.3.drv' failed


In case it may be useful, here is the channels.scm used for this "guix
build starpu" test.

[hpcs-agullo@miriel001 hou10ni_school_2019]$ guix describe --format=channels
(list (channel
        (name 'guix-hpc)
        (url "https://gitlab.inria.fr/guix-hpc/guix-hpc.git";)
        (commit
          "c70ab156deef43e8e9a09947ab15b0e1cc579b29"))
      (channel
        (name 'guix-hpc-non-free)
        (url "https://gitlab.inria.fr/guix-hpc/guix-hpc-non-free.git";)
        (commit
          "0822b7eebb63e2360125e017934ba817686d9669"))
      (channel
        (name 'guix)
        (url "https://git.savannah.gnu.org/git/guix.git";)
        (commit
          "bfaa06171842225c8bf4c839e35ac36a0b2c2d59")))





Emmanuel Agullo <Emmanuel.Agullo@inria.fr> writes:

> Dear Nathalie,
>
> Thanks much for considering this issue.
>
> Yes, it's here:
>
>> eagullo@tek9:/tmp/toto$ guix describe --format=channels
>> (list (channel
>>         (name 'guix-hpc-non-free)
>>         (url "https://gitlab.inria.fr/guix-hpc/guix-hpc-non-free.git";)
>>         (commit
>>           "0822b7eebb63e2360125e017934ba817686d9669"))
>>       (channel
>>         (name 'guix-hpc)
>>         (url "https://gitlab.inria.fr/guix-hpc/guix-hpc.git";)
>>         (commit
>>           "b24a8fa55bfd4a0987320e0e45d3a85f0920427c"))
>>       (channel
>>         (name 'guix)
>>         (url "https://git.savannah.gnu.org/git/guix.git";)
>>         (commit
>>           "bfaa06171842225c8bf4c839e35ac36a0b2c2d59")))
>
> Just need to copy and paste it on ~/.config/guix/channels.scm
> and "guix pull".
>
> And then the "guix build starpu" should be available.
>
> Thanks once again!
>
> Best,
>
> Manu