Re: [starpu-devel] Customization/Optimization for Scheduling Methods

[Samuel Thibault <samuel.thibault@inria.fr>]

Hello,

Konstantin Sozykin, le ven. 14 juil. 2023 14:52:26 +0000, a ecrit:
> we discovered that the default schedulers can't handle our custom
> operations.

What custom operation are not handled?

> Consequently, we are considering developing our own optimization- or
> even a learning-based scheduler. How reasonable is this, given the
> current development of StarPU?

StarPU was actually made for people to create their own schedulers, so
that is entirely reasonable :)

> Firstly and most importantly, how can we extract the full DAG? Are the *.rec
> and *.dot files sufficient for this purpose?

They can be used, yes, but that's offline.

> Can we access the full DAG in online mode?

You can use the graph module, see the graph_test policy example.

https://files.inria.fr/starpu/doc/html_web_extensions/HowToDefineANewSchedulingPolicy.html#GraphScheduling

> We have located functions for exporting linear programs (*.lp and *.mps 
> files)
> to determine theoretical bounds for execution time. However, as far as we
> understand, these are only for measuring performance and not for optimizing
> scheduling. Is our understanding correct?

Indeed, they only provide performance bounds.

Samuel