Re: [Starpu-devel] Moving Workers from One Context To Another in Real Time

[Andra Hugo <andra.hugo@inria.fr>]

Hi Gabriel,

You should use the hypervisor in that case and use the idle strategy.

In sc_hypervisor/examples you have a few examples of how to do that. Let me know if you need any help with that.

Best,

Andra

---

De: "Gabriel Gazolla" <gabrielgazolla@gmail.com>
À: "Andra Hugo" <andra.hugo@inria.fr>
Cc: starpu-devel@lists.gforge.inria.fr
Envoyé: Mardi 28 Mars 2017 14:50:12
Objet: Re: [Starpu-devel] Moving Workers from One Context To Another in Real Time

Hello Andra,

Thanks for your fast answer. Now i know that this function you indicated do this "adds dynamically the workers in workerids_ctx:, thank you very much!




I hope you can help me in another question:

1) How Can I test from time to time that Context 2 Queue Line of Tasks is Empty so I can move the workers back to Context 1 dinamically ? Notice that I already submitted all the tasks to both contexts and after that there`s the barrier starpu_task_wait_for_all(), is it anywhere between the submission and this barrier?

Best,

Joao

On Tue, Mar 28, 2017 at 4:39 AM, Andra Hugo <andra.hugo@inria.fr> wrote:

Hi Gabriel,

You can call starpu_sched_ctx_add_workers and starpu_sched_ctx_remove_workers. If you call only starpu_sched_ctx_add_workers without removing the workers from the other context, the workers will be shared between the two contexts and do round robin when poping tasks.

Does this answer your question?

Best,

Andra

---

De: "Gabriel Gazolla" <gabrielgazolla@gmail.com>
À: starpu-devel@lists.gforge.inria.fr
Envoyé: Mardi 28 Mars 2017 02:12:03
Objet: [Starpu-devel] Moving Workers from One Context To Another in Real        Time

Hello StarPU Team,

I have an interesting question, I hope you can help me...

Imagine this situation:

I have two contexts: Context 1 (CPU1, CPU2, CPU3) and Context 2 (GPU1)

With starPU paused i submit 900 tasks to Context 1 and 100 tasks to Context 2.

After I submit all of them, I resume, so all the tasks can start to execute.

i put the function starpu_task_wait_for_all(); to wait for all the tasks to finish.

Now comes the tricky part:

I already know that Context 2 is going to finish light years faster than Context 1, I would like to move all workers from Context 2 to the Context 1, so the workers on Context 2 can help Context 1 finish faster. Is it possible to do it ? or do I need to wait for the barrier starpu_task_wait_for_all(); ?

===

I tried to do this with starpu_sched_ctx_set_inheritor, starpu_sched_ctx_finished_submit() and starpu_sched_ctx_delete().....but I think it doesnt work on the described situation, since I need to wait for the barrier starpu_task_wait_for_all() to one context inherit the workers of another context, am I right? or is there a way how to do it like on the described situation in real time?

Thanks for any help or commentaries!

Best,

Joao

_______________________________________________
Starpu-devel mailing list
Starpu-devel@lists.gforge.inria.fr
https://lists.gforge.inria.fr/mailman/listinfo/starpu-devel

--

Gabriel Gazolla
Doutorando em Computação - IC/UFF