[Starpu-devel] Different nodes are owning W data

[Kadir Akbudak <kadir.akbudak@kaust.edu.sa>]

Dear StarPU Developers,

I am getting the following warning:

[3][starpu_mpi][_starpu_mpi_task_decode_v:412] Different nodes are
owning W data. The node to execute the codelet is going to be selected
with the current selection node policy. See
starpu_mpi_node_selection_set_current_policy() to change the policy,
or use STARPU_EXECUTE_ON_NODE or STARPU_EXECUTE_ON_DATA to specify the
node

I am using StarPU 1.2.1.

My codelet definition is as follow: (My codelet is a modified version
of 
https://gitlab.inria.fr/solverstack/chameleon/blob/master/runtime/starpu/codelets/codelet_zplrnt.c)

#include "runtime/starpu/include/runtime_codelets.h" // from Chameleon
repository
ZCODELETS_HEADER(mycodelet)
void mycodelet( const MORSE_option_t *options,
                        int m, int n,
                        const MORSE_desc_t *A,
                        const MORSE_desc_t *B,
                        const MORSE_desc_t *C, int Cm, int Cn,
                        const MORSE_desc_t *D,
                        int Am, int An, int lda,
                        int bigM, int m0, int n0, unsigned long long int seed,
                        const MORSE_desc_t *E)
{
    struct starpu_codelet *codelet = &cl_mycodelet;
    void (*callback)(void*) = NULL;

    MORSE_BEGIN_ACCESS_DECLARATION;
    MORSE_ACCESS_W(A, Am, An);
    MORSE_ACCESS_W(B, Am, An);
    MORSE_ACCESS_W(C, Cm, Cn);
    MORSE_ACCESS_W(D, Am, An);
    MORSE_ACCESS_W(E, Am, An);
    MORSE_END_ACCESS_DECLARATION;
    starpu_insert_task(
            starpu_mpi_codelet(codelet),
            STARPU_VALUE,    &m,                      sizeof(int),
            STARPU_VALUE,    &n,                      sizeof(int),
            STARPU_W,         RTBLKADDR(A, double, Am, An),
            STARPU_W,         RTBLKADDR(B, double, Am, An),
            STARPU_W,         RTBLKADDR(C, double, Cm, Cn),
            STARPU_W,         RTBLKADDR(D, double, Am, An),
            STARPU_W,         RTBLKADDR(E, double, Am, An),
            STARPU_VALUE,  &lda,                      sizeof(int),
            STARPU_VALUE, &bigM,                      sizeof(int),
            STARPU_VALUE,   &m0,                      sizeof(int),
            STARPU_VALUE,   &n0,                      sizeof(int),
            STARPU_VALUE, &seed,   sizeof(unsigned long long int),
            STARPU_PRIORITY,    options->priority,
            STARPU_CALLBACK,    callback,
#if defined(CHAMELEON_CODELETS_HAVE_NAME)
            STARPU_NAME, "mycodelet",
#endif
            0);
}
CODELETS_CPU(mycodelet, 5, cl_mycodelet_cpu_func)

C is an MxMB matrix, whereas others are MxN matrices. So I need Cm and
Cn indices to access matrix C, whereas I use Am and An indices to
access other matrices. In the initialization of all matrices, I used
PxQ processor mesh. Also I tried PQx1 process mesh for C, but it did
not get rid of the warning.

I appreciate your help on this issue.

Thanks a lot.

Best regards,
Kadir Akbudak
Extreme Computing Research Center

-- 

------------------------------
This message and its contents, including attachments are intended solely 
for the original recipient. If you are not the intended recipient or have 
received this message in error, please notify me immediately and delete 
this message from your computer system. Any unauthorized use or 
distribution is prohibited. Please consider the environment before printing 
this email.