Objet : Developers list for StarPU
Archives de la liste
Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems
Chronologique Discussions
- From: Samuel Thibault <samuel.thibault@inria.fr>
- To: Hatem Ltaief <hatem.ltaief@kaust.edu.sa>
- Cc: Kadir Akbudak <kadir.akbudak@kaust.edu.sa>, Aniello Esposito <esposito@cray.com>, "starpu-devel@lists.gforge.inria.fr" <starpu-devel@lists.gforge.inria.fr>, Aleksandr Mikhalev <aleksandr.mikhalev@kaust.edu.sa>, "Sameh M. Abdulah" <sameh.abdulah@kaust.edu.sa>
- Subject: Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems
- Date: Thu, 26 Apr 2018 17:08:41 +0200
- Authentication-results: mail2-smtp-roc.national.inria.fr; spf=None smtp.pra=samuel.thibault@inria.fr; spf=Neutral smtp.mailfrom=samuel.thibault@ens-lyon.org; spf=Pass smtp.helo=postmaster@hera.aquilenet.fr
- Ironport-phdr: 9a23:ED7OtBESZHkc7wIwXmtyFZ1GYnF86YWxBRYc798ds5kLTJ7zpMqwAkXT6L1XgUPTWs2DsrQY07GQ6/iocFdDyK7JiGoFfp1IWk1NouQttCtkPvS4D1bmJuXhdS0wEZcKflZk+3amLRodQ56mNBXdrXKo8DEdBAj0OxZrKeTpAI7SiNm82/yv95HJbAhEmDSwbaluIBmqsA7cqtQYjYx+J6gr1xDHuGFIe+NYxWNpIVKcgRPx7dqu8ZBg7ipdpesv+9ZPXqvmcas4S6dYDCk9PGAu+MLrrxjDQhCR6XYaT24bjwBHAwnB7BH9Q5fxri73vfdz1SWGIcH7S60/VC+85Kl3VhDnlCYHNyY48G7JjMxwkLlbqw+lqxBm3oLYfJ2ZOP94c6jAf90VWHBBU95fWSJBHI2ycogBD+QOMulEsobypVwOohWlCAmwGO/j1iNEimPs0KEk1ekqDAHI3BYnH9ILqHnasc/6NKIPUe+ryKnD0CvNb/NX2Tjm8ofIbxQhoe2RVr93asre00wvFx7bgVWUs4DlIzOV1uUWvGeB8upgUf6vhnUmqwF3uDivx90jhpPHhoIP013J8zhyzoUtJdCgVUJ2Yt6pHIFOuyyUOYZ6WN4uT310tCog17EKoYO3cScWxJg9xRPSaeaLf5WG7x75UOucIDF1j29/dr2lnRa9602gx/X8Vsaq1FZKqTJIktnSuXAXzRPf8NKISuJg/keg3TaAyQbT5f9YIUwum6rbMYYtwr82lpUNrUTOBjL6lUb2gaOMaEkp9Oal5/76brn6upOQLZJ4hhn7Mqs0m8y/Beo4MhIJX2ie4em8z6fs/UjkQLpUiv06iLXZsJDbJcsAvKG5HgtV0po45hmhCTemy80UnX0HLVJCfhKLlY/pO0vBIPzgF/ewn0yskCt3x/DBJrDhGYnNIWLZkLf5YLZx8lNTxxQtzd9B45JZEbUBIPPoWk/tr9zUFBA5MwKzw+b9B9VyyJkSWWOJAq+DMaPdq0WE5uw1I7rEWIhAmD/hJv1tw+LnjHI30QsddLWk2N0TdHm5E/pOIEyEemaqj9scV3wD6FkQVuvv3WaLVCNeYz6OX6M27yw/FMryFo7GW42pxqCB3S2yA5lKTmFAEFGFV3nyIdbXE8wQYT6fd5cy2gcPUqKsHsp4jUn35V3KjoF/J++RwRU28Jfq1dx7/erWzE1g+DpvSsCM1GfLSHt7zDlRG20GmZtnqEk48W+tlLBiiqUAR91V/fJAFAkgZ8aFkr5KTuvqUweERe+nDVarRtL/UGMxQ8g4hdYXfkd5FtOvklbNxXjzDg==
- List-archive: <http://lists.gforge.inria.fr/pipermail/starpu-devel/>
- List-id: "Developers list. For discussion of new features, code changes, etc." <starpu-devel.lists.gforge.inria.fr>
- Organization: I am not organized
Hello,
Hatem Ltaief, le jeu. 26 avril 2018 14:57:42 +0000, a ecrit:
> The profiles indicate that most of the time is being spent into internal
> StarPU
> functions:
> || 42.6% | 79,366.5 | 851.5 | 1.1% | _starpu_get_worker_task
> || 2.2% | 4,111.3 | 114.7 | 2.8% | _starpu_handle_pending_node_data_requests
> || 1.9% | 3,523.9 | 145.1 | 4.1% | _starpu_cpu_worker
> || 1.9% | 3,507.2 | 130.8 | 3.7% | _starpu_cpu_driver_run_once
> || 1.9% | 3,469.6 | 128.4 | 3.7% | _starpu_may_pause
Note that these are "idle" functions actually, i.e. StarPU is just
looking for things to do due to lack of parallelism. This is not a sign
of overhead.
> We reduced then the number of worker threads per node to 16 and 8: we
> recover
> our parallel efficiency up to a decent level!
But did it achieve the computation faster?
In other words, you may just not have enough parallelisme to feed all
these threads.
> we would expect threads to stay idle and not consume resources.
To provide good latency, StarPU does not leave resources idle, they take
work to be done as quickly as possible.
Samuel
- [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems, Hatem Ltaief, 26/04/2018
- Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems, Samuel Thibault, 26/04/2018
- Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems, Hatem Ltaief, 26/04/2018
- Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems, Samuel Thibault, 26/04/2018
- Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems, Hatem Ltaief, 26/04/2018
- Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems, Sameh Abdulah, 26/04/2018
- Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems, Samuel Thibault, 26/04/2018
- Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems, Samuel Thibault, 26/04/2018
- Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems, Hatem Ltaief, 26/04/2018
- Re: [Starpu-devel] Performance profiling of tile low rank cholesky (HiCMA) with StarPU on distributed memory systems, Samuel Thibault, 26/04/2018
Archives gérées par MHonArc 2.6.19+.