Re: [Starpu-devel] StarPU changeable sizes and StarPU purge

[Rabab Al-omairy <rabab.omairy@kaust.edu.sa>]

Dear Samuel,

Your answer is really appreciated.

On Thu, Jan 9, 2020 at 8:51 PM Samuel Thibault <samuel.thibault@inria.fr> wrote:

Hello,

Rabab Al-omairy, le dim. 01 déc. 2019 22:03:43 +0300, a ecrit:
> after matrix compression each tile ends up having different sizes.
[...]
> However, on distributed memory on which tiles are 2D cyclically
> distributed among mpi nodes I have  the following error:
>
> [1][starpu_mpi][_starpu_mpi_test_detached_requests][assert failure] MPI_Test
> returning MPI_ERR_TRUNCATE: message truncated

Mmm, indeed, the distributed support for matrices was not extended to
support tiles with varying size. Here the receiver is expecting a full
size since it doesn't know the size is smaller.

I have added some experimental support in the master. In order to try it
you need to uncomment the //#define DYNAMIC_MATRICES in both
src/datawizard/interfaces/matrix_interface.c and mpi/src/starpu_mpi_datatype.c
 

That is however for now incompatible with OOC support with O_DIRECT
enabled.

 

I will try your suggestion and let you know.

> For some matrix size which I can say matrix with medium size, I
> have the following message which cause application to stuck and not continue
> execution.
>
> [starpu][starpu_memchunk_tidy] Low memory left on node RAM 0 (6405MiB over
> 128808MiB).

So StarPU is lacking memory. Do you have OOC enabled?

 

I am not enabling OOC.

Samuel

--

Best Regards,

Rabab Alomairy

PhD Student

King Abdullah University of Science and Technology

Kingdom of Saudi Arabia
Extreme Computing Research Center
Al-Khawarizmi (Bldg.1)
Floor 0, Office 0203-WS06 

Mobile KSA: +966 (0) 548884792

E-mail: rabab.omairy@kaust.edu.sa

---

This message and its contents, including attachments are intended solely for the original recipient. If you are not the intended recipient or have received this message in error, please notify me immediately and delete this message from your computer system. Any unauthorized use or distribution is prohibited. Please consider the environment before printing this email.