#2240: Add Rabenseifner and Recursive doubling allreduce algorithms for ObjGroup
#2272
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
JacobDomagala
force-pushed
the
2240-use-a-proper-all-reduce-algorithm-for-proxyallreduce
branch
2 times, most recently
from
17cfcbd
to
16da9e7
Compare
|
Results of running allreduce on std::vector<int32_t> with 65536 elements |
|
Results of running allreduce on std::vector<int32_t> with 2 elems |
JacobDomagala
force-pushed
the
2240-use-a-proper-all-reduce-algorithm-for-proxyallreduce
branch
2 times, most recently
from
53da893
to
e3fa49b
Compare
|
Still missing:
|
ppebay
changed the title
Rabenseifner and Recursive doubling allreduce algorithms for ObjGroupRabenseifner and Recursive doubling allreduce algorithms for ObjGroup
JacobDomagala
force-pushed
the
2240-use-a-proper-all-reduce-algorithm-for-proxyallreduce
branch
2 times, most recently
from
80d6712
to
f01bad5
Compare
|
Regarding the issue with the If users want to use their custom wrapper, then they should provide #include <vector>
#ifdef VT_KOKKOS_ENABLED
#include <Kokkos_Core.hpp>
#endif
template <typename Container>
class DataHandler {
public:
using Scalar = float;
static size_t size(const Container& data);
static Scalar& at(Container& data, size_t idx);
static void set(Container& data, size_t idx, const Scalar& value);
static Container split(Container& data, size_t start, size_t end);
};
template <typename T>
class DataHandler<std::vector<T>> {
public:
using Scalar = T;
static size_t size(const std::vector<T>& data) { return data.size(); }
static T at(const std::vector<T>& data, size_t idx) { return data[idx]; }
static T& at(std::vector<T>& data, size_t idx) { return data[idx]; }
static void set(std::vector<T>& data, size_t idx, const T& value) {
data[idx] = value;
}
static std::vector<T> split(std::vector<T>& data, size_t start, size_t end) {
return std::vector<T>{data.begin() + start, data.begin() + end};
}
};
#ifdef VT_KOKKOS_ENABLED
template <typename T, typename... Props>
class DataHandler<Kokkos::View<T*, Props...>> {
public:
static size_t size(const Kokkos::View<T*, Props...>& data) {
return data.extent(0);
}
static T at(const Kokkos::View<T*, Props...>& data, size_t idx) {
return data(idx);
}
static T& at(Kokkos::View<T*, Props...>& data, size_t idx) {
return data(idx);
}
static void
set(Kokkos::View<T*, Props...>& data, size_t idx, const T& value) {
data(idx) = value;
}
};
#endif // VT_KOKKOS_ENABLED |
|
Let's go with the |
…I for various data types
JacobDomagala
force-pushed
the
2240-use-a-proper-all-reduce-algorithm-for-proxyallreduce
branch
from
f7e0f45
to
ec6751d
Compare
…nd fix compile issues realted to using Kokkos::View for allreduce
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes #2240