Re: [Starpu-devel] Error find_cpu_from_numa_node: Assertion `current' failed.

[Amani Alonazi <amani.alonazi@kaust.edu.sa>]

Reserving the entire node doesn't solve the issue with the current system. I cannot disable the cgroups of resources. I disabled hwloc but the error now from pthreads:

starpu_pthread_t self = starpu_pthread_self();
res = pthread_setaffinity_np(self, sizeof(aff_mask), &aff_mask);
if (res)
 {
                const char *msg = strerror(res);
                _STARPU_MSG("pthread_setaffinity_np: %s\n", msg);
                STARPU_ABORT(); << fails here
}

any idea how to solve it?

On Wed, Mar 27, 2019 at 12:38 AM Amani Alonazi <amani.alonazi@kaust.edu.sa> wrote:

Sure that’s a better easy solution.

Many thanks! 

A.

On 27 Mar 2019, at 12:30 AM, Brice Goglin <Brice.Goglin@inria.fr> wrote:

I don't know, I work on the hwloc side, I don't know how StarPU should be fixed for this case.

For now, you may avoid the issue by reserving entire nodes.

Brice

Le 26/03/2019 à 22:20, Amani Alonazi a écrit :

Hi!

Yes, there are CPU-less NUMA nodes because of cgroups. Will configuring starpu without hwloc solve the issue?

Many thanks!

On Tue, Mar 26, 2019 at 11:53 PM Brice Goglin <Brice.Goglin@inria.fr> wrote:

Hello

What does lstopo say on this machine? (inside the same reservation)

Do you have CPU-less NUMA nodes? (maybe because of cgroups)

That's the only idea that came to my mind when looking at the code.

Brice

Le 26/03/2019 à 21:46, Amani Alonazi a écrit :

Dear Samuel and Starpu-dev,

I am facing an error at the initilization step of StarPU. The error is: core/perfmodel/perfmodel_bus.c:598: find_cpu_from_numa_node: Assertion `current' failed.

raise () from /lib64/libc.so.6
abort () from /lib64/libc.so.6
in __assert_fail_base () from /lib64/libc.so.6
in __assert_fail () from /lib64/libc.so.6
in find_cpu_from_numa_node (obj=0x49a5b7f0) at core/perfmodel/perfmodel_bus.c:598
in measure_bandwidth_between_numa_nodes_and_dev (dev=0, dev_timing_per_numanode=0x200000357338 <cudadev_timing_per_numa>, type=0x20000030cf50 "CUDA") at core/perfmodel/perfmodel_bus.c:633
in measure_bandwidth_between_host_and_dev (dev=0, dev_timing_per_numa=0x200000357338 <cudadev_timing_per_numa>, type=0x20000030cf50 "CUDA") at core/perfmodel/perfmodel_bus.c:654
in benchmark_all_gpu_devices () at core/perfmodel/perfmodel_bus.c:784
in generate_bus_affinity_file () at core/perfmodel/perfmodel_bus.c:1029
in _starpu_bus_force_sampling () at core/perfmodel/perfmodel_bus.c:2931
in check_bus_config_file () at core/perfmodel/perfmodel_bus.c:2036
in _starpu_load_bus_performance_files () at core/perfmodel/perfmodel_bus.c:2959
in starpu_initialize (user_conf=0x490f02b0, argc=0x0, argv=0x0) at core/workers.c:1400
in starpu_init (user_conf=0x490f02b0) at core/workers.c:1213

How can I solve it? Is it connected with hwloc?

Many thanks,

--

Amani

---

This message and its contents, including attachments are intended solely for the original recipient. If you are not the intended recipient or have received this message in error, please notify me immediately and delete this message from your computer system. Any unauthorized use or distribution is prohibited. Please consider the environment before printing this email.

_______________________________________________
Starpu-devel mailing list
Starpu-devel@lists.gforge.inria.fr
https://lists.gforge.inria.fr/mailman/listinfo/starpu-devel

---

This message and its contents, including attachments are intended solely for the original recipient. If you are not the intended recipient or have received this message in error, please notify me immediately and delete this message from your computer system. Any unauthorized use or distribution is prohibited. Please consider the environment before printing this email.

--

Amani

---

This message and its contents, including attachments are intended solely for the original recipient. If you are not the intended recipient or have received this message in error, please notify me immediately and delete this message from your computer system. Any unauthorized use or distribution is prohibited. Please consider the environment before printing this email.