Accéder au contenu.
Menu Sympa

starpu-devel - Re: [Starpu-devel] Control data movement to/from device

Objet : Developers list for StarPU

Archives de la liste

Re: [Starpu-devel] Control data movement to/from device


Chronologique Discussions 
  • From: Amani Alonazi <amani.alonazi@kaust.edu.sa>
  • To: Samuel Thibault <samuel.thibault@inria.fr>, Amani Alonazi <amani.alonazi@kaust.edu.sa>, starpu-devel@lists.gforge.inria.fr
  • Cc: Hatem Ltaief <Hatem.Ltaief@kaust.edu.sa>
  • Subject: Re: [Starpu-devel] Control data movement to/from device
  • Date: Mon, 1 Apr 2019 11:10:16 +0300
  • Authentication-results: mail3-smtp-sop.national.inria.fr; spf=None smtp.pra=amani.alonazi@kaust.edu.sa; spf=Pass smtp.mailfrom=amani.alonazi@kaust.edu.sa; spf=None smtp.helo=postmaster@mail-ed1-f45.google.com
  • Ironport-phdr: 9a23:QAsc/RH1bQx/8Z7rIDh3gJ1GYnF86YWxBRYc798ds5kLTJ7yp8qwAkXT6L1XgUPTWs2DsrQY0rKQ4vurADZfqb+681k6OKRWUBEEjchE1ycBO+WiTXPBEfjxciYhF95DXlI2t1uyMExSBdqsLwaK+i764jEdAAjwOhRoLerpBIHSk9631+ev8JHPfglEnjWwba5uIBmsqQjcuMYajZZ8Jqsz1xDEvmZGd+NKyG1yOFmdhQz85sC+/J5i9yRfpfcs/NNeXKv5Yqo1U6VWACwpPG4p6sLrswLDTRaU6XsHTmoWiBtIDBPb4xz8Q5z8rzH1tut52CmdIM32UbU5Uims4qt3VBPljjoMOiUn+2/LlMN/kKNboAqgpxNhxY7UfJqVP+d6cq/EYN8WWXZNUsNXWidcAI2zcpEPAvIOMuZWrYbzp1UAoxijCweyGOzi0SVHimPs0KAgz+gtDQPL0Qo9FNwOqnTUq9D1Ob8OXOCw1qbIyzTDZO5K1Df574jIdAouoPCNXbltdsfe00wvGBnDjlWRs4DqJTeV1uMLs2eB7utgVPmii209pAFsuTiv2t0ghZfUiYII0FzE7j92zZ8zKNalS0B7ecapHIVMuyyeLYd7QcMvT3t2tComybAKo5G2cSgMxZ863RDQceaHfJKN4h/7VOaePzN4hHV9dbK6nRmy8EygxvTiWcapzVpGtyRFn9bMu3wX2BzT7c+HSvR5/ki/wzqAywfT6uRcLUA1k6rUNYIhz6YumpYPtUnPBCz7lUXsgKOIakkp+fKk5uvnb7n+o5+TLY50igXwMqQ0ncy/BPw1PRILX2eB/+S81afv8lf9QLVNiP05iKjYsJHBKMQYvKG5HhRV0po55xmhEjimzc4UnWIdI15dYhKIk5DpO03SIPD/Ffq/mEisny1xx/DeI73tG4jCIWbdkLj/ebZw8EpcyAsozdBD/JJYEL4BIPz0Wk/ru9zXEAU1Mw2yw+b9CdVyzJkSWWyVAvzRDKSHilaN++8ra9WMZYUcpTLhY6w+7vvzgHt/hV8cd6C02Yc/aXaiH/0gLV/PJTLFh94HEC8jug04Rf7rwAmLVDdVZjC7W6U67yM6IIGvEJzfAI2hnfqa1XH/VoZKb3peFxWAHGnlc62AWuwQc2SdLMh7nTFCVL67SoZn2wv9mhX9zu9OK+PS+2UxsZXl3cp0r7nakBg09Hp9C8Ob2nOMZ2J9g3gUATI6weZkqBoumR+4zaFkjqkARpRo7PRTX1J/bMaElr0oO5XJQgvEO+yxZhOjS9SiDys2S4ttkdwHfl1hXdiuk1bY1njzWuNHp/mwHJUxt5nk8T3pPc8klyTF3bQ6kx8rTtYJLmT03vcipTiWPJbAlgCir4jvdakY23SQpmKKzG7LsU0BFQAsDOPKWncQYkaQptP8tBvP
  • List-archive: <http://lists.gforge.inria.fr/pipermail/starpu-devel/>
  • List-id: "Developers list. For discussion of new features, code changes, etc." <starpu-devel.lists.gforge.inria.fr>

My main concern is that the time to solution takes longer than expected and the stats shows too much data movements than required (only maximum in the worst case 800GB from host and device and vise versa):
NUMA 0 -> CUDA 0        50491.3906 GB   25649.6622 MB/s (transfers : 24001 - avg 2154.2096 MB)
CUDA 0 -> NUMA 0        40552.6875 GB   20600.7938 MB/s (transfers : 15997 - avg 2595.8587 MB)

On Sun, Mar 31, 2019 at 5:29 PM Samuel Thibault <samuel.thibault@inria.fr> wrote:
Hello,

Amani Alonazi, le dim. 31 mars 2019 14:04:38 +0300, a ecrit:
> I have a matrix A with concurrent computation per tile each is a starpu-task.
> Ideally, I don't want the whole matrix to be alive in the device memory because
> sizeof(A) > sizeof(devicemem). How can I control how many tiles/tasks should be
> alive in the device memory?
>
> I want to avoid getting this message: [starpu][_starpu_memory_reclaim_generic]
> Not enough memory left on node CUDA 0. Your application data set seems too huge
> to fit on the device, StarPU will cope by trying to purge 5228 MiB out. This
> message will not be printed again for further purges.

The message exactly tells you that StarPU is coping with the limited
amount of memory of the GPU. There is no need to do anything more for
StarPU to handle it.

Samuel


--
Amani


This message and its contents, including attachments are intended solely for the original recipient. If you are not the intended recipient or have received this message in error, please notify me immediately and delete this message from your computer system. Any unauthorized use or distribution is prohibited. Please consider the environment before printing this email.


Archives gérées par MHonArc 2.6.19+.

Haut de le page