Objet : Developers list for StarPU
Archives de la liste
[starpu-devel] [StarPU-MPI: no dedicated thread for communication; function to set MPI_THREAD_MULTIPLE]
Chronologique Discussions
- From: Maxim Abalenkov <maxim.abalenkov@gmail.com>
- To: starpu-devel@inria.fr
- Subject: [starpu-devel] [StarPU-MPI: no dedicated thread for communication; function to set MPI_THREAD_MULTIPLE]
- Date: Wed, 11 Sep 2024 12:28:31 +0100
- Authentication-results: mail2-smtp-roc.national.inria.fr; spf=None smtp.pra=maxim.abalenkov@gmail.com; spf=Pass smtp.mailfrom=maxim.abalenkov@gmail.com; spf=None smtp.helo=postmaster@mail-wm1-f47.google.com
- Ironport-data: A9a23:w7MrkqvlwXK/C6gl/2AYP8v2UufnVJRfMUV32f8akzHdYApBsoF/q tZmKTzQbKmKajemKNx/atni8U4C65+HmtJlS1Nk+SBnFn4RgMeUXt7xwmXYb3rDdJWbJK5Ex 5xDMYeYdJhcolv0/ErF3m3J9CEkvU2wbuOgTrSCYEidfCc8IA85kxVvhuUltYBhhNm9Emult Mj7yyHlEAbNNwVcbCRNs8pvlDs15K6u4GJB5wRnDRx2lAa2e0c9XMp3yZ6ZdCOQrrl8RoaSW +vFxbelyWLVlz9F5gSNz94X2mVTKlLjFVDmZkh+A8BOsTAezsAG6ZvXAdJHAathZ5plqPgqo DlFncTYpQ7EpcQgksxFO/VTO3kW0aGrZNYriJVw2CCe5xSuTpfi/xlhJF8aZa8A9rZPOExt9 PUqCSwwV0iEnMvjldpXSsE07igiBMziPYdapXQ5iD+FUrApRpfMR6iM7thdtNsyrpoWTLCOO oxAM2opMEuojx5nYj/7DLo7lfepgz/2eTRcpVSWorQf7G3azQg327/oWDbQUoXaH5gFwxjC+ woq+UymBDM1GtKx+wah1X2Dlr7joCnWcq4rQejQGvlCxQf7KnYoIAYKXEGjvLy1h1CzX/pEO kkM82wvq7Iz/QqlVLHAswaQpXeFulsDXoMVHbFlrg6KzaXQ7kCSAW1soiN9VeHKffQeHVQCv mJlVfuwbdDCmOT9pa61nltVkd+zBcTRBWoLZCtBUg5cpte//8c8iRXAStslG6mw5jEw9fcc3 BjSxBXSRZ1K5SLI60l/1V/CijOo4JPOS2bZIy3JC3m94FoRiJGNPuSVBJuy0RqEBImcR1iF+ nMDnqByKQzI4Y6lzESwfQnGIF1lCztp/tERbZ6D0qTNLwiQxkM=
- Ironport-hdrordr: A9a23:6dNc9aDbbbe8fMzlHemX55DYdb4zR+YMi2TDtnoBKyC9F/bzqy nApoV86faZskdzZJhfo6HmBEDwewK4yXcd2+B4VteftWHd2VdAR7sSibcKrQeQYhEWNdQw6U 6jScVD4RHLYmSS9fyKmDVQ2uxP/OW6
- Ironport-phdr: A9a23:aFLSDBK8vadykC+TSdmcuAVvWUAX0o4c3iYr45Yqw4hDbr6kt8y7e hCEvbM00waCBtSTwskHotSVmpijY1BI2YyGvnEGfc4EfD4+ouJSoTYdBtWYA1bwNv/gYn9yN s1DUFh44yPzahANS47xaFLIv3K98yMZFAnhOgppPOT1HZPZg9iq2+yo9JDebRlEiCCgbb5wM Rm6ogvcu80LioZ+N6g9zQfErXRPd+lK321kIk6dkQjh7cmq5p5j9CpQu/Ml98FeVKjxYro1Q 79FAjk4Km45/MLkuwXNQguJ/XscT34ZkgFUDAjf7RH1RYn+vy3nvedgwiaaPMn2TbcpWTS+6 qpgVRHlhDsbOzM/7WrajNF7gqBGrxK7vxFxw5Lbb46IOvR9cK3TY9QUSHFbUcpNUixMGIO8Y 5cNAucHIO1Wr5P9p1wLrRamAgejHuzuyj5NhnTrwaA1yP4uEQXY0wwmHNIOt2rUp8jyOacXS ++0w6jIzTDZY/xMwjjy8ozIfQ4nofGPWrJwb9HcyUYqFwzfj1WQrZbpMC+S1uQIqmWW6fdrW u2zhWA9sQ5xviSvydk2ionPno8Yzk3I+yt2zog7KtO1Skx2bcK4HJZOqS2XOYV4Tt8tTW12p Ss31qAKtIO5cSUOx5kq2QPTZuGJfoSV4hzvSfucLDFlj3xrf7K/ggy98UmmyuDkTMa7y0xFr i5bndnKtXAN0ALT5tKaSvt++EqqxDWB1xjL5+1aPUw5kbDXJp0hz7Iqi5Yfr0fOEjX5lUj0l KObdUYp9vKs5unleLnquIOQOoxuhg3jM6kih8qyCvkmPwgKQmib4vi826P5/UPkQbVLj+M5n 7HFvJ3cOM8VvLS2AxVP3YYm8xu/Dymp0NAfnXQfKVJKYhOHj4zwN1DAJfD0EO6zg1qjnTpp3 fzGMbrhApLCLnjHjrjtZ6py60lZyAYrzNBf4YxbCq0ZLf7tRkP8sMbUAxw5PgCu3urrFtZw2 pkRVG+NGqOZNbndsV6M5uIhOemMY4oVtS74K/c/6P/ujHo5lUUHcqayx5QXbG63HvJlI0Wef 3rhmdgBEWIQsQo/SOzmkkGNUTlWZ3qqWaIz/Sk0CJi6AofbWoCtnLuB0T+mEpFOfGBJFkiME Wv0d4WDQ/oMcz6SLdV7kjwcSLitUpIu2g+wtADkz7pqNfHU+y0dtZL7ztd5/ezTlRco9Tx1F cuRyW+NT3sn1l8PEiQq1bpnvAlxx0mO1YB5heZZHJpd/aBnSAA/YLvV3+1/Q/n4UwbMeNSOV h7yR9y2ADR3R9g4x9IIYEFjM9qnhxHHmSGtBulGxPSwGJUo//eEjDDKLMFnxiOevEFAp1wvQ 88VcHajmrY67Q/YQYjAj0Seka+uM6Uaxi/EsmmZniKVpE8Ndgl2XO3eWGwHIFPMpIH871PDS vmnA70jPw1CztCqJa5Da9mvhlJDF7/4INqLW2uqgC+rAAqQgLaFbY7kYWIYiSDUGEkB1QkZ9 HKLMws5GA+upmvfCHplEle8K1j0/7xYr3W2BlQx0xnMb0Bl0O+t/QUJgPWHV/4J9rcNuSNkt DAtWVjhgJTZDN2Powcnd6JZCT8kyHFA02+R9wl0P5j6artnmkZbaQN8+UXnyxRwDIxE18kst nIjigRoe+qe1xtaejWU0IqVWPWfI3Tu/B2pd6/d203PmNeQ9KAV7f0kqlLl9Ai3H0sm+n9j3 pFbyXyZrpnNCQMTV9r2XCNVv1B/rqHbZ2807YrQ2HtvNrecvTrL2tZvD+wgi16hc9pZLKKYB VrqCcRJYqrmYOcumlWvclcFJLUIrP9yb57gLqHWnvL0b4MC1Hq8gG9K4Z5wyBeJ/it4EKvT2 oodhuuf1U2BXiv9i1Gotob2n5pFbHccBDnaq2CsCYhPa6l1ZYtOB32pJpj9w9xuhpurUnRR8 FOlBFQY8MCscBuWKVf62EcDsCZf6Wzigia+wzFuxnssp7qe2WrHye3meRwEPXBjS2xrjFOqK o+xxYN/PgDgf00ikx2r4lz/zq5QqfFkLmXddkxPejD/M2BoVqbYWqOqW8dU89totCxWVL75e lWGUvvnpBBc1Sr/HmxYzTR9djewu5y/kQYowG6aKX9yqjLed6QSjV/a7czdQLhY1DMCSS97j if/CV21Pt3v9tKR35vOqeGxUWu9W4YbK3G6i9Pd8nLhtSs2XlW2hJXR0pX/HBI/0DPn2tUiT ijOoBvmI8Hq26m8LeN7bxxtDV745dB9H9I2mY8xiZcMnHkC08/NrDxXzCGqa4Udhf2tCRhFD SQGyNPU/gX/jUhqL3bTgpn8Sm3Y2MxqId+zfmIR3Cs5qcFMEqadqrJezk4X6hK1qxzcZf9lk 3IT0/wrvTQfivEIvUwkxCyZD7YRGldwMinllhDO5Ne75vYyBi7nYf2r2UxykMr0RrSLsgBZH n/zc5MvGyx38O1wNVvN1Dv47YSuK7yyJZoD8xaTlRnHle1cLpk8w+ELiSRQMmX4pXQ5yuQ/g E8mzdSgsYOAMWko4LOhD0sSKGjuf81KsGKI7+4WjoOM0ouoBJkkBjgbQM6iU6ezCDxL/fX/a 1TVTXtl+y/dQ+aAW1fYshsurmqTQc73cSvMfz9Ak40kHF7EdSk9yEgVRGlowMB/T1jwgpSnK AAjvngQ/gKq9EUKkL45cUmnFD+Y/l/gay9oGsfFakMKqFgTvQGNdpXOi4A7VyBAos/+8ErUc DHdP0IQSjhXEk2cWwK6ZunovIaftbjeXq3kdrPPeenc8LMFEa7ZmdT3lNMhpmjpVI3HP2E+X adjiwwTADYgQZSfw3JWFGQWj36fNZfF4krsvHQm9Ibnt626EAP3udnVUuUUa44+vUvsx//Eb r/15m4xPz9c0tlkKWbg7r8Z0RZSjihvc2PoCrEcrWvXS6mWnKZLDhkdYic1Nc1S7qt60BMfc cjcwsj40LJ1lJtXQx9MSEDhl8e1ZMcLP3D1NVXJA1yOPaiHIjuDyt/+YKe1Q7ldxOtOsBj4t TGeGk7ldjON8luhHwioKv1JhTqHMQZ2vYi8dlNyDDGmQo65LBK8N9BzgHs9xrh1znLGOGgAM CRtJkNAqrrDiEEQyv57GmFH8j9kNbzew3ffv7Sec8xG96c0UUEW36pA7X83yqVY9nRBTf1xw m7Jq8J25kuhma+JwyZmVxxHrnBKgpiKtANsI/a8lNEIVHDa8RYK9WjVBQ4Noo4vD9T/uqUWw 9LGkK/1KzBc293R9MoYQcPTLYjUVRhpeQqsAzPSAAYfGHSzMnrDgkVGjPyI3nicr5x/tZ213 ZRSFflUU1s6Ev5cAUNgVo9nQt8/TnYvlriVi9QN7Hy1oUzKRclUiZvAU+qbHfTlLDvxZVZsa B4BwLe+JoMWZNSTM6lKZVxznYCMEE3VD4glSsxJawY1pABS9SE7QDFsnU3ibQyp7TkYEvvmx nYL
- Ironport-sdr: 66e17ef6_A1qAgpf+Mbq7FnlGYRqknrNj+++ShoXiQ/uM879ZVE2Rp4l dNqvWkQS3HyUDgGphPGLnwbKSAqNlDPT+uTXfuQ==
Dear all,
How are you? I hope all is well with you. I have two relatively simple questions on StarPU-MPI:
1) I would like StarPU-MPI to use all available threads for computation (i.e. avoid to have a dedicated thread for MPI communication). To achieve that I create a StarPU configuration structure and set the variable ‘reserve_ncpu = 0’.
// ensure StarPU does not reserse CPUs solely for MPI communication
struct starpu_conf conf = {.reserve_ncpus = 0};
int status = starpu_conf_init(&conf);
STARPU_CHECK_RETURN_VALUE(status, "starpu_conf_init");
// initialise StarPU MPI
status = starpu_mpi_init_conf(&argc, &argv, 1, MPI_COMM_WORLD, &conf);
STARPU_CHECK_RETURN_VALUE(status, "starpu_mpi_init_conf");
starpu_mpi_comm_rank(MPI_COMM_WORLD, &rank);
starpu_mpi_comm_size(MPI_COMM_WORLD, &np);
However, when I print out timing results for each CPU worker I see only seven workers:
Worker CPU 0…
…
Worker CPU 6…
Am I creating the StarPU configuration incorrectly or is this (the hardware) reality of the Apple M2 CPU?
2) Many StarPU-MPI examples use MPI_THREAD_MULTIPLE to allow multiple simultaneous calls to MPI library. In the examples, the value is set by calling ‘MPI_Init_thread()’. As I understand it is defined in various ‘helper.h’ files in the ‘tests’ directory. Is there a convenient StarPU API function to set ‘MPI_THREAD_MULTIPLE'? I tried including these helper header files. But I immediately face the errors of being unable to find “common/config.h”.
Thank you for your help and have a great day ahead!
—
Best wishes,
Maxim
Maxim Abalenkov \\ maxim.abalenkov@gmail.com
+44 7 486 486 505 \\ www.maxim.abalenkov.uk
+44 7 486 486 505 \\ www.maxim.abalenkov.uk
- [starpu-devel] [StarPU-MPI: no dedicated thread for communication; function to set MPI_THREAD_MULTIPLE], Maxim Abalenkov, 11/09/2024
- Re: [starpu-devel] [StarPU-MPI: no dedicated thread for communication; function to set MPI_THREAD_MULTIPLE], Philippe SWARTVAGHER, 11/09/2024
- Re: [starpu-devel] [StarPU-MPI: no dedicated thread for communication; function to set MPI_THREAD_MULTIPLE], Maxim Abalenkov, 12/09/2024
- Re: [starpu-devel] [StarPU-MPI: no dedicated thread for communication; function to set MPI_THREAD_MULTIPLE], Philippe SWARTVAGHER, 12/09/2024
- Re: [starpu-devel] [StarPU-MPI: no dedicated thread for communication; function to set MPI_THREAD_MULTIPLE], Maxim Abalenkov, 12/09/2024
- Re: [starpu-devel] [StarPU-MPI: no dedicated thread for communication; function to set MPI_THREAD_MULTIPLE], Philippe SWARTVAGHER, 11/09/2024
Archives gérées par MHonArc 2.6.19+.