Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

coll/han: Add alltoall algorithm #12387

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

coll/han: Add alltoall algorithm #12387

wants to merge 3 commits into from

Commits on Apr 6, 2024

  1. coll/han: reduce coll:han:get_algorithm prints 

    Increase coll:han:get_algorithm verbosity level from 1 to 30, to avoid
flooding terminal at any verbosity level.  Thirty seems to be used for
most of the other han dynamic selection prints.

Signed-off-by: Luke Robison <lrbison@amazon.com>
    @lrbison
    lrbison committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    8781eca View commit details
    Browse the repository at this point in the history

  2. coll/han: require smsc endpoint 

    This will allow HAN collectives to check for and use SMSC methods to
direct-map peer memory during on-node communication.

Signed-off-by: Luke Robison <lrbison@amazon.com>
    @lrbison
    lrbison committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    d6891dd View commit details
    Browse the repository at this point in the history

  3. coll/han: Add SMSC-based alltoall to HAN 

    Add Alltoall algorithm to coll/han.  Each rank on one host is assigned
a single partner on a remote host and vice versa.  Then the rank
collects all the data its partner will need to receive from it's host,
and sends it in one large send, and likewise receives it's data in one
large recv, then cycles to the next host.

This algorithm is only selected when SMSC component has ability to
direct-map peer memory, which only exists for XPMEM module.

Signed-off-by: Luke Robison <lrbison@amazon.com>
    @lrbison
    lrbison committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    06fa035 View commit details
    Browse the repository at this point in the history