Objet : Developers list for StarPU
Archives de la liste
- From: Amani Alonazi <amani.alonazi@kaust.edu.sa>
- To: Samuel Thibault <samuel.thibault@inria.fr>, Amani Alonazi <amani.alonazi@kaust.edu.sa>, starpu-devel@lists.gforge.inria.fr
- Cc: Hatem Ltaief <Hatem.Ltaief@kaust.edu.sa>
- Subject: Re: [Starpu-devel] Control data movement to/from device
- Date: Mon, 1 Apr 2019 11:10:16 +0300
- Authentication-results: mail3-smtp-sop.national.inria.fr; spf=None smtp.pra=amani.alonazi@kaust.edu.sa; spf=Pass smtp.mailfrom=amani.alonazi@kaust.edu.sa; spf=None smtp.helo=postmaster@mail-ed1-f45.google.com
- Ironport-phdr: 9a23:QAsc/RH1bQx/8Z7rIDh3gJ1GYnF86YWxBRYc798ds5kLTJ7yp8qwAkXT6L1XgUPTWs2DsrQY0rKQ4vurADZfqb+681k6OKRWUBEEjchE1ycBO+WiTXPBEfjxciYhF95DXlI2t1uyMExSBdqsLwaK+i764jEdAAjwOhRoLerpBIHSk9631+ev8JHPfglEnjWwba5uIBmsqQjcuMYajZZ8Jqsz1xDEvmZGd+NKyG1yOFmdhQz85sC+/J5i9yRfpfcs/NNeXKv5Yqo1U6VWACwpPG4p6sLrswLDTRaU6XsHTmoWiBtIDBPb4xz8Q5z8rzH1tut52CmdIM32UbU5Uims4qt3VBPljjoMOiUn+2/LlMN/kKNboAqgpxNhxY7UfJqVP+d6cq/EYN8WWXZNUsNXWidcAI2zcpEPAvIOMuZWrYbzp1UAoxijCweyGOzi0SVHimPs0KAgz+gtDQPL0Qo9FNwOqnTUq9D1Ob8OXOCw1qbIyzTDZO5K1Df574jIdAouoPCNXbltdsfe00wvGBnDjlWRs4DqJTeV1uMLs2eB7utgVPmii209pAFsuTiv2t0ghZfUiYII0FzE7j92zZ8zKNalS0B7ecapHIVMuyyeLYd7QcMvT3t2tComybAKo5G2cSgMxZ863RDQceaHfJKN4h/7VOaePzN4hHV9dbK6nRmy8EygxvTiWcapzVpGtyRFn9bMu3wX2BzT7c+HSvR5/ki/wzqAywfT6uRcLUA1k6rUNYIhz6YumpYPtUnPBCz7lUXsgKOIakkp+fKk5uvnb7n+o5+TLY50igXwMqQ0ncy/BPw1PRILX2eB/+S81afv8lf9QLVNiP05iKjYsJHBKMQYvKG5HhRV0po55xmhEjimzc4UnWIdI15dYhKIk5DpO03SIPD/Ffq/mEisny1xx/DeI73tG4jCIWbdkLj/ebZw8EpcyAsozdBD/JJYEL4BIPz0Wk/ru9zXEAU1Mw2yw+b9CdVyzJkSWWyVAvzRDKSHilaN++8ra9WMZYUcpTLhY6w+7vvzgHt/hV8cd6C02Yc/aXaiH/0gLV/PJTLFh94HEC8jug04Rf7rwAmLVDdVZjC7W6U67yM6IIGvEJzfAI2hnfqa1XH/VoZKb3peFxWAHGnlc62AWuwQc2SdLMh7nTFCVL67SoZn2wv9mhX9zu9OK+PS+2UxsZXl3cp0r7nakBg09Hp9C8Ob2nOMZ2J9g3gUATI6weZkqBoumR+4zaFkjqkARpRo7PRTX1J/bMaElr0oO5XJQgvEO+yxZhOjS9SiDys2S4ttkdwHfl1hXdiuk1bY1njzWuNHp/mwHJUxt5nk8T3pPc8klyTF3bQ6kx8rTtYJLmT03vcipTiWPJbAlgCir4jvdakY23SQpmKKzG7LsU0BFQAsDOPKWncQYkaQptP8tBvP
- List-archive: <http://lists.gforge.inria.fr/pipermail/starpu-devel/>
- List-id: "Developers list. For discussion of new features, code changes, etc." <starpu-devel.lists.gforge.inria.fr>
My main concern is that the time to solution takes longer than expected and the stats shows too much data movements than required (only maximum in the worst case 800GB from host and device and vise versa):
NUMA 0 -> CUDA 0 50491.3906 GB 25649.6622 MB/s (transfers : 24001 - avg 2154.2096 MB)
CUDA 0 -> NUMA 0 40552.6875 GB 20600.7938 MB/s (transfers : 15997 - avg 2595.8587 MB)
CUDA 0 -> NUMA 0 40552.6875 GB 20600.7938 MB/s (transfers : 15997 - avg 2595.8587 MB)
On Sun, Mar 31, 2019 at 5:29 PM Samuel Thibault <samuel.thibault@inria.fr> wrote:
Hello,
Amani Alonazi, le dim. 31 mars 2019 14:04:38 +0300, a ecrit:
> I have a matrix A with concurrent computation per tile each is a starpu-task.
> Ideally, I don't want the whole matrix to be alive in the device memory because
> sizeof(A) > sizeof(devicemem). How can I control how many tiles/tasks should be
> alive in the device memory?
>
> I want to avoid getting this message: [starpu][_starpu_memory_reclaim_generic]
> Not enough memory left on node CUDA 0. Your application data set seems too huge
> to fit on the device, StarPU will cope by trying to purge 5228 MiB out. This
> message will not be printed again for further purges.
The message exactly tells you that StarPU is coping with the limited
amount of memory of the GPU. There is no need to do anything more for
StarPU to handle it.
Samuel
--
Amani
- Re: [Starpu-devel] Control data movement to/from device, Amani Alonazi, 01/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Samuel Thibault, 01/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Amani Alonazi, 01/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Samuel Thibault, 01/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Amani Alonazi, 16/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Samuel Thibault, 16/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Amani Alonazi, 17/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Amani Alonazi, 17/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Samuel Thibault, 17/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Amani Alonazi, 17/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Amani Alonazi, 17/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Samuel Thibault, 18/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Samuel Thibault, 16/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Amani Alonazi, 16/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Samuel Thibault, 01/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Amani Alonazi, 01/04/2019
- Re: [Starpu-devel] Control data movement to/from device, Samuel Thibault, 01/04/2019
Archives gérées par MHonArc 2.6.19+.