Re: [starpu-devel] Subject: Feedback on ImportError when importing "starpu" in Python

[高家隆 <gaojialong@nudt.edu.cn>]

1. The symbol isn't in the library, for echo nothing by command" objdump -T 
/usr/local/lib/libstarpu-1.4.so.1 | grep starpu_save_history_based_model"

2. As for the reason, from the document, I also realised that the function of 
Starpu should already cover the distributed part(SimGrid), and it can not 
only do the calculation of the actual device but also do the simulation. But 
because I paid attention to SimGrid first, and then noticed Starpu from the 
homepage, why I chose SimGrid support when compiling, I also hope to continue 
to use the previous actor and link model.


> -----原始郵件-----
> 發件人: "Nathalie Furmento" <nathalie.furmento@labri.fr>
> 發送時間:2023-11-06 18:49:05 (星期一)
> 收件人: 高家隆 <gaojialong@nudt.edu.cn>
> 抄送: starpu-devel@inria.fr
> 主題: Re: [starpu-devel] Subject: Feedback on ImportError when importing 
> "starpu" in Python
> 
> No, we asked if the symbol is in the library ?
> 
> objdump -T /usr/local/lib/libstarpu-1.4.so.1 | grep 
> starpu_save_history_based_model
> 
> Thanks !
> 
> 
> Le 06/11/2023 à 11:41, 高家隆 a écrit :
> > Sure, I find this function in 
> > starpu/src/core/perfmodel/perfmodel_history.c line1227 (Under MACRO 
> > #ifndef STARPU_SIMGRID)
> > and the branch and commit we can see:
> > ---------------------------------------------------------------------------------
> > starpu$ git log
> > commit 0ed088ceff3cdb71dd2c355caf5098e4f0213c81 (HEAD -> master, 
> > origin/master, origin/HEAD)
> > Author: Nathalie Furmento <nathalie.furmento@labri.fr>
> > Date:   Thu Nov 2 16:40:16 2023 +0100
> >
> >      fixes for parallel workers
> >
> > commit f5192aaceaa7dfcc0fcaa57f192156e534198011
> > Author: Nathalie Furmento <nathalie.furmento@labri.fr>
> > Date:   Thu Nov 2 13:59:52 2023 +0000
> >
> >      Specify the number of cores in the architecture name
> >      
> >      This changes the name of the combination written in the perfmodel 
> > file to include its number of cores. Files with the previous format can 
> > still be read and loaded correctly and files written with the new format 
> > can be read with a previous code.
> >
> > commit 0e3a32b5292558a044b4b3fa0eb49245ad3f0d09
> > Author: Nathalie Furmento <nathalie.furmento@labri.fr>
> > Date:   Thu Nov 2 11:49:29 2023 +0100
> >
> >      check function hwloc_type_sscanf is available
> > -----------------------------------------------------------------------------
> >
> >
> >> -----原始郵件-----
> >> 發件人: "Nathalie Furmento" <nathalie.furmento@labri.fr>
> >> 發送時間:2023-11-06 18:27:57 (星期一)
> >> 收件人: 高家隆 <gaojialong@nudt.edu.cn>
> >> 抄送: "StarPU Support Team" <starpu-devel@inria.fr>
> >> 主題: Re: [starpu-devel] Subject: Feedback on ImportError when importing 
> >> "starpu" in Python
> >>
> >> Can you check that the starpu_save_history_based_model symbol really is 
> >> in the libstarpu that is actually getting loaded ?
> >>
> >> and please also tell us which branch / commit version of StarPU you are 
> >> using ?
> >>
> >> Cheers,
> >>
> >> Nathalie
> >>
> >> Le 06/11/2023 à 10:40, 高家隆 a écrit :
> >>> by running "ldd 
> >>> /usr/local/lib/python3.10/site-packages/starpu/starpupy.cpython-310-x86_64-linux-gnu.so"
> >>> here is what I got:
> >>>   linux-vdso.so.1 (0x00007ffd3f9db000)
> >>>   libstarpu-1.4.so.1 => /usr/local/lib/libstarpu-1.4.so.1 
> >>> (0x00007efe50600000)
> >>>   libpython3.10.so.1.0 => /lib/x86_64-linux-gnu/libpython3.10.so.1.0 
> >>> (0x00007efe50000000)
> >>>   libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007efe4fc00000)
> >>>   libOpenCL.so.1 => 
> >>> /usr/local/cuda/targets/x86_64-linux/lib/libOpenCL.so.1 
> >>> (0x00007efe4f800000)
> >>>   libfxt.so.2 => /lib/x86_64-linux-gnu/libfxt.so.2 (0x00007efe50a61000)
> >>>   libsimgrid.so.3.34.1 => /opt/simgrid/lib/libsimgrid.so.3.34.1 
> >>> (0x00007efe4f000000)
> >>>   libstdc++.so.6 => /lib/x86_64-linux-gnu/libstdc++.so.6 
> >>> (0x00007efe4ec00000)
> >>>   libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007efe50978000)
> >>>   libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 
> >>> (0x00007efe50958000)
> >>>   libexpat.so.1 => /lib/x86_64-linux-gnu/libexpat.so.1 
> >>> (0x00007efe50927000)
> >>>   libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007efe5090b000)
> >>>   /lib64/ld-linux-x86-64.so.2 (0x00007efe50aab000)
> >>>   libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007efe50904000)
> >>>   libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 
> >>> (0x00007efe508ff000)
> >>>   libboost_context.so.1.74.0 => 
> >>> /lib/x86_64-linux-gnu/libboost_context.so.1.74.0 (0x00007efe505fb000)
> >>>   libboost_stacktrace_backtrace.so.1.74.0 => 
> >>> /lib/x86_64-linux-gnu/libboost_stacktrace_backtrace.so.1.74.0 
> >>> (0x00007efe505e5000)
> >>>   libns3.39-csma-default.so => /usr/local/lib/libns3.39-csma-default.so 
> >>> (0x00007efe4ff8f000)
> >>>   libns3.39-network-default.so => 
> >>> /usr/local/lib/libns3.39-network-default.so (0x00007efe4e800000)
> >>>   libns3.39-point-to-point-default.so => 
> >>> /usr/local/lib/libns3.39-point-to-point-default.so (0x00007efe4ff08000)
> >>>   libns3.39-core-default.so => /usr/local/lib/libns3.39-core-default.so 
> >>> (0x00007efe4e400000)
> >>>   libns3.39-applications-default.so => 
> >>> /usr/local/lib/libns3.39-applications-default.so (0x00007efe4fa87000)
> >>>   libns3.39-internet-default.so => 
> >>> /usr/local/lib/libns3.39-internet-default.so (0x00007efe4dc00000)
> >>>   libns3.39-wifi-default.so => /usr/local/lib/libns3.39-wifi-default.so 
> >>> (0x00007efe4d200000)
> >>>   libns3.39-mobility-default.so => 
> >>> /usr/local/lib/libns3.39-mobility-default.so (0x00007efe4fe46000)
> >>>   libevent-2.1.so.7 => /lib/x86_64-linux-gnu/libevent-2.1.so.7 
> >>> (0x00007efe4fa33000)
> >>>   libgfortran.so.5 => /lib/x86_64-linux-gnu/libgfortran.so.5 
> >>> (0x00007efe4ce00000)
> >>>   libns3.39-stats-default.so => 
> >>> /usr/local/lib/libns3.39-stats-default.so (0x00007efe4f727000)
> >>>   libgsl.so.27 => /lib/x86_64-linux-gnu/libgsl.so.27 
> >>> (0x00007efe4ca00000)
> >>>   libgslcblas.so.0 => /lib/x86_64-linux-gnu/libgslcblas.so.0 
> >>> (0x00007efe4f6e5000)
> >>>   libns3.39-mpi-default.so => /usr/local/lib/libns3.39-mpi-default.so 
> >>> (0x00007efe4f697000)
> >>>   libmpi_cxx.so.40 => /lib/x86_64-linux-gnu/libmpi_cxx.so.40 
> >>> (0x00007efe4fe2c000)
> >>>   libmpi.so.40 => /lib/x86_64-linux-gnu/libmpi.so.40 
> >>> (0x00007efe4eec9000)
> >>>   libns3.39-bridge-default.so => 
> >>> /usr/local/lib/libns3.39-bridge-default.so (0x00007efe4ee9c000)
> >>>   libns3.39-traffic-control-default.so => 
> >>> /usr/local/lib/libns3.39-traffic-control-default.so (0x00007efe4eaba000)
> >>>   libns3.39-energy-default.so => 
> >>> /usr/local/lib/libns3.39-energy-default.so (0x00007efe4e77d000)
> >>>   libns3.39-spectrum-default.so => 
> >>> /usr/local/lib/libns3.39-spectrum-default.so (0x00007efe4c86d000)
> >>>   libns3.39-antenna-default.so => 
> >>> /usr/local/lib/libns3.39-antenna-default.so (0x00007efe4ee6d000)
> >>>   libns3.39-propagation-default.so => 
> >>> /usr/local/lib/libns3.39-propagation-default.so (0x00007efe4e6d1000)
> >>>   libquadmath.so.0 => /lib/x86_64-linux-gnu/libquadmath.so.0 
> >>> (0x00007efe4e689000)
> >>>   libsqlite3.so.0 => /lib/x86_64-linux-gnu/libsqlite3.so.0 
> >>> (0x00007efe4c720000)
> >>>   libopen-pal.so.40 => /lib/x86_64-linux-gnu/libopen-pal.so.40 
> >>> (0x00007efe4e34d000)
> >>>   libopen-rte.so.40 => /lib/x86_64-linux-gnu/libopen-rte.so.40 
> >>> (0x00007efe4db43000)
> >>>   libhwloc.so.15 => /lib/x86_64-linux-gnu/libhwloc.so.15 
> >>> (0x00007efe4e62d000)
> >>>   libevent_core-2.1.so.7 => 
> >>> /lib/x86_64-linux-gnu/libevent_core-2.1.so.7 (0x00007efe4ee38000)
> >>>   libevent_pthreads-2.1.so.7 => 
> >>> /lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7 (0x00007efe4fa2e000)
> >>>   libudev.so.1 => /lib/x86_64-linux-gnu/libudev.so.1 
> >>> (0x00007efe4ea90000)
> >>>
> >>> And the default version seems to be starpu-1.4.
> >>>
> >>>
> >>>> -----原始郵件-----
> >>>> 發件人: "Samuel Thibault" <samuel.thibault@inria.fr>
> >>>> 發送時間:2023-11-06 17:31:54 (星期一)
> >>>> 收件人: 高家隆 <gaojialong@nudt.edu.cn>
> >>>> 抄送: starpu-devel@inria.fr
> >>>> 主題: Re: [starpu-devel] Subject: Feedback on ImportError when importing 
> >>>> "starpu" in Python
> >>>>
> >>>> Hello,
> >>>>
> >>>> 高家隆, le lun. 06 nov. 2023 14:51:20 +0800, a ecrit:
> >>>>>         File 
> >>>>> "/usr/local/lib/python3.10/site-packages/starpu/__init__.py", line
> >>>>>       17, in <module>
> >>>>>           from . import starpupy
> >>>>>       ImportError: /usr/local/lib/python3.10/site-packages/starpu/
> >>>>>       starpupy.cpython-310-x86_64-linux-gnu.so: undefined symbol:
> >>>>>       starpu_save_history_based_model
> >>>> This looks like you are mixing different versions of StarPU?
> >>>>
> >>>> You can make sure which libstarpu is actually used by running
> >>>>
> >>>> ldd 
> >>>> /usr/local/lib/python3.10/site-packages/starpu/starpupy.cpython-310-x86_64-linux-gnu.so
> >>>>
> >>>> and check that the starpu_save_history_based_model symbol really is in
> >>>> the libstarpu that is actually getting loaded, or fix your
> >>>> LD_LIBRARY_PATH in order to load the proper version.
> >>>>
> >>>> Samuel
> >>
> >> -- 
> >> Dr Nathalie Furmento               Ingénieure de recherche CNRS
> >> http://www.labri.fr/~furmento/     LaBRI - Université Bordeaux
> 
> 
> -- 
> Dr Nathalie Furmento               Ingénieure de recherche CNRS
> http://www.labri.fr/~furmento/     LaBRI - Université Bordeaux