Re: [starpu-devel] How to visualize StarPU data?

[Vinícius Garcia Pinto <vgpinto@inf.ufrgs.br>]

Hello,

    I was not able
        to open the tutorial created by Emmanuel; however, I would like
        to tell you that we made some changes in starvz:
     - starvz is
        now on the CRAN repository (https://cran.r-project.org/web/packages/starvz/), one can install it with R>
          install.packages("starvz") 
     - it should
        be quite straightforward to generate a default view from the fxt
        files. I provide some lines below:

# Execute your app
STARPU_NCPU=10 ./starpu-starpu-1.3.3-release/examples/stencil/stencil
# Get the path of starvz tools (to convert from fxt to paje and then to the CSVs expected by starvz)
export STARVZ_TOOLS=$(Rscript -e 'cat(system.file("tools/", package = "starvz"), sep="\n")')
# Run starvz (assuming you have starpu_fxt_tool, pj_dump, and rec2csv in $PATH)
$STARVZ_TOOLS/starvz /foo/path-to-fxt-files
# Done! you should find a starvz.png file at /foo/path-to-fxt-files

If you want to have more control over the starvz panels, enrichments, disable plots, etc, you can jump to an R session and play with the config and plot functions. We have a working paper where we discuss each function's usage (https://hal.inria.fr/hal-02960848/document), we are still working on publishing it, but the main steps are already there...

Regards,
Vinicius

On 17/02/2021 05:21, Philippe SWARTVAGHER wrote:

Hello,

PhD student here, working on StarPU, and having sometimes to deal with trace visualization. :)

I think you didn't tell us the most important thing: what/why do you want to visualize ?

Regarding StarVZ, indeed it can provide lot of information. I think it isn't very difficult to use, while you don't need to add information, create new graphics, modify plots built with StarPU. By default, it is a set a scripts to apply on StarPU's traces.

Emmanuel Agullo (Hiepacs team) created a tutorial about how to use StarVZ: https://gitlab.inria.fr/agullo-teach/tutorials/tutorial-trace-starvz (I didn't read it)

Regards,

-- 
Philippe SWARTVAGHER

Doctorant
Équipe TADaaM, Inria Bordeaux Sud-Ouest

Le 17/02/2021 à 08:21, Sangeeth Simon a écrit :

Dear Whichever kind soul finds this,

I am working with team CAGIRE where we are trying to employ StarPU on Finite Volume type CFD code for nonlinear hyperbolic conservation laws. We have had some initial success with our work. On proceeding further, we encountered the following difficulties:

1. The Paje.trace file generated by StarPU fxt is not wholly supported by Vite. By 'wholly supported' I mean that certain features like color-based sorting of tasks/states is not possible. As identified by one of the developers of Vite, '... this is a know issue with StarPU trace. They have
multiple event with the same identifier, and thus it generates problem inside vite. Vite may not be flexible enough to support that, and StarPU does not
respect strictly the paje format, so right now I have no solutions.'

Now, has there been any progress on getting this feature to work? If not, what are the other alternatives for generating a Gantt chart from StarPU data?

2. On the above point, I read a paper recently that introduced the workflow called StarVZ. How reliable is this tool on StarPU traces and how easy is it for a non-expert like me (I come from CFD background and not a Computer Science background) to learn and use? Im willing to put in the effort of learning it provided it is indeed a powerful tool as claimed in the paper.

3. I have also heard about Paraver as a tool kit to visualize time data. Does StarPU fxt output data that can be read by Paraver?

4. Are there any other graphical tools to visualize and analyze the scheduler behaviour (at the task and memory management level) that works for StarPU?

Any help would be appreciated.

Dr. Sangeeth Simon
Post-Doctoral Researcher,
Team CAGIRE, INRIA,
Pau, Nouvelle-Aquitaine, France