starpu-devel - Re: [Starpu-devel] Starpu stats about disk, OOC, and swapping

Objet : Developers list for StarPU

Archives de la liste

Re: [Starpu-devel] Starpu stats about disk, OOC, and swapping

From: Hatem Ltaief <hatem.ltaief@kaust.edu.sa>
To: Samuel Thibault <samuel.thibault@inria.fr>
Cc: Amani Alonazi <amani.alonazi@kaust.edu.sa>, "starpu-devel@lists.gforge.inria.fr" <starpu-devel@lists.gforge.inria.fr>
Subject: Re: [Starpu-devel] Starpu stats about disk, OOC, and swapping
Date: Thu, 17 Jan 2019 11:37:01 +0000
Accept-language: en-GB, en-US
Authentication-results: mail2-smtp-roc.national.inria.fr; spf=None smtp.pra=hatem.ltaief@kaust.edu.sa; spf=Pass smtp.mailfrom=prvs=4920dd8cd2=hatem.ltaief@kaust.edu.sa; spf=None smtp.helo=postmaster@mx08-0025e101.pphosted.com
Ironport-phdr: 9a23:E8WmGhEA+yyhT7VrMY/mWp1GYnF86YWxBRYc798ds5kLTJ7yrsiwAkXT6L1XgUPTWs2DsrQY07qQ6/iocFdDyK7JiGoFfp1IWk1NouQttCtkPvS4D1bmJuXhdS0wEZcKflZk+3amLRodQ56mNBXdrXKo8DEdBAj0OxZrKeTpAI7SiNm82/yv95HJbAhEmDmwbaluIBmqsA7cqtQYjYx+J6gr1xDHuGFIe+NYxWNpIVKcgRPx7dqu8ZBg7ipdpesv+9ZPXqvmcas4S6dYDCk9PGAu+MLrrxjDQhCR6XYaT24bjwBHAwnB7BH9Q5fxri73vfdz1SWGIcH7S60/VC+85Kl3VhDnlCYHNyY48G7JjMxwkLlbqw+lqxBm3oLYfJ2ZOP94c6jAf90VWHBBU95RWSJfH428c4UBAekPPelaqIf9pkcBohSlCAa2GO/vzyVFhn/q0aEk1ekqDAHI3BYnH9ILqHnars/6NLsMXuCw0aLGyynDYOlX2Tjj5ojDbxcsofGWUrJsb8XRzFMjFwfZjlqKqIzqIT2V2/8Os2eB8upgTv6vh3Q5pA5svzij3NwshZPQi48T11vK9j15zZ4xKNGlUkJ3f8KoHZlKuy2EKod6XNkuT3xqtSs70rEKpIK3cDIUxJknyBPTceGLf5SU7h75VOudOTl4i2xmdb6jghu/9Fasx+LiWcWq1VtFtShIn93Du30I1BHc99aLR/t480i92DuAyQbe4fxeL08uj6rUMZshz6YwlpUNtUTDGTf7mED5jaOKdUgo4/Sk5/j5brjmuJCQKpN4hhzkPqQ2gsy/AeM4MhMSX2eF5OuwzqHs/Ur8QLlSj/02lLfWsIzCKMkfu6K1GRFZ3poh5hqlETuqzcoUkWMaIF9HeR+Ll43pNEvPIPD8A/e/mVOskDJzyvDeJL3hHI7NI2DMnbrlY7px91NTxxcwwN9D+p1YFKkMIPLpVU/tqtPYCwU1Mwiow+n9CdVyyI0eVHmMAqCDLaPSqkOI6vgxLOaReY8Zoi39JOI96/70kXA5gUMdfbWu3ZYPc3C4Au5pI1+BYXrxm9sODHkFvhQgQ+zuk1CCVT9TZ22uX6In/D07B4ymDYDZRoCinrONxia7HptMZmBHEF+AC3nod5+cUfcWdC2SOtNhkiADVbW5V48h1RCuuxTgxLp6KurU5jYVtJPi1Nhw/OLTjws9+SZ1D8SbyWGNTnt7knkGRz8sj+hDphlGw1Ke3Kwwv/xZH9VO4+8BBhwzMIPRy6pmC9H4Ux/FYv+ITkynS5OoG2diYMg2xooualpwHp2GkhnC0iTiV78ci7GOQpgo+6PR0VDyLttm1zDL2LRnlFBwEZgHDnGvmqMqr1ubPIXOiUjM0v/yLf1Njh6Iz3+KyC+1hG8dVQdxVavfWnVGOhnVpMni+gXPQ6LoEr11a1Idm/7HEbNDb5jStXsDXO3qYYiMYGusgHv2CBqVgKiFPtKzJjctmR7FAU1BqDg9uHaLMQ9kVnWkszqOSWQ2Tw/iOhu1t/FmqHSgUkI4iQqNah852g==
List-archive: <http://lists.gforge.inria.fr/pipermail/starpu-devel/>
List-id: "Developers list. For discussion of new features, code changes, etc." <starpu-devel.lists.gforge.inria.fr>

Hi Samuel,

Please find attached three traces we would like to further analyze.

Would you be available for a short Skype call to over them at your early convenience?

Thanks,

Hatem

https://contattafiles.s3.us-west-1.amazonaws.com/tnt17276/wLTlRwfaK2Q80Hq/Trace_ooc10.png

https://contattafiles.s3.us-west-1.amazonaws.com/tnt17276/uJa6IYa_FZjvnvS/Trace_ooc100.png

On Jan 16, 2019, at 11:59 AM, Samuel Thibault <samuel.thibault@inria.fr> wrote:

Samuel Thibault, le mer. 16 janv. 2019 09:23:19 +0100, a ecrit:

Hatem Ltaief, le mer. 16 janv. 2019 04:53:18 +0000, a ecrit:

Does starpu allocate separate threads to perform the OOC data movement? Does the IO operation turn out to be done in parallel? How does it differ from standard fwrite and fread system calls?

Yes, it always uses asynchronous data transfers, which allows to overlap
everything.

(and it pushes data to disk ahead of missing out memory, and prefetches
it from the disk ahead of needing it for tasks).

Samuel

Re: [Starpu-devel] Starpu stats about disk, OOC, and swapping, (suite)

Archives gérées par MHonArc 2.6.19+.

Archives de la liste

Re: [Starpu-devel] Starpu stats about disk, OOC, and swapping