Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Building on Redhat 8.9 #10643

Open
fmulero opened this issue Mar 18, 2024 · 1 comment
Open

Building on Redhat 8.9 #10643

fmulero opened this issue Mar 18, 2024 · 1 comment

Comments

@fmulero
Copy link

fmulero commented Mar 18, 2024

I'm trying to build OpenXLA on Redhat 8.9 from source.

So far I cloned the repository on ~/xla with git clone https://github.com/openxla/xla.git and ran:

$ bazel build   --verbose_failures --jobs 2 //xla/...
INFO: Reading 'startup' options from /xla/.bazelrc: --windows_enable_symlinks
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=192
INFO: Reading rc options for 'build' from /xla/.bazelrc:
  Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /xla/.bazelrc:
  'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --features=-force_no_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility
INFO: Found applicable config definition build:short_logs in file /xla/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /xla/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:linux in file /xla/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --experimental_guard_against_concurrent_changes
INFO: Found applicable config definition build:dynamic_kernels in file /xla/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
INFO: Analyzed 3127 targets (0 packages loaded, 0 targets configured).
INFO: Found 3127 targets...
ERROR: /xla/xla/hlo/evaluator/BUILD:20:11: Compiling xla/hlo/evaluator/hlo_evaluator.cc failed: (Exit 1): gcc failed: error executing command (from target //xla/hlo/evaluator:hlo_evaluator) 
  (cd /root/.cache/bazel/_bazel_root/e4ab50d61a21943a819d1e092972a817/execroot/xla && \
  exec env - \
    PATH=/usr/share/Modules/bin:/opt/bitnami/python/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin \
    PWD=/proc/self/cwd \
    TF2_BEHAVIOR=1 \
  /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG -ffunction-sections -fdata-sections '-std=c++0x' -MD -MF bazel-out/k8-opt/bin/xla/hlo/evaluator/_objs/hlo_evaluator/hlo_evaluator.pic.d '-frandom-seed=bazel-out/k8-opt/bin/xla/hlo/evaluator/_objs/hlo_evaluator/hlo_evaluator.pic.o' -fPIC '-DEIGEN_MAX_ALIGN_BYTES=64' -DEIGEN_ALLOW_UNALIGNED_SCALARS '-DEIGEN_USE_AVX512_GEMM_KERNELS=0' -DHAVE_SYS_UIO_H -DTF_USE_SNAPPY '-DBAZEL_CURRENT_REPOSITORY=""' -iquote . -iquote bazel-out/k8-opt/bin -iquote external/com_google_absl -iquote bazel-out/k8-opt/bin/external/com_google_absl -iquote external/eigen_archive -iquote bazel-out/k8-opt/bin/external/eigen_archive -iquote external/ml_dtypes -iquote bazel-out/k8-opt/bin/external/ml_dtypes -iquote external/tsl -iquote bazel-out/k8-opt/bin/external/tsl -iquote external/nsync -iquote bazel-out/k8-opt/bin/external/nsync -iquote external/double_conversion -iquote bazel-out/k8-opt/bin/external/double_conversion -iquote external/com_google_protobuf -iquote bazel-out/k8-opt/bin/external/com_google_protobuf -iquote external/snappy -iquote bazel-out/k8-opt/bin/external/snappy -iquote external/com_googlesource_code_re2 -iquote bazel-out/k8-opt/bin/external/com_googlesource_code_re2 -iquote external/farmhash_archive -iquote bazel-out/k8-opt/bin/external/farmhash_archive -iquote external/zlib -iquote bazel-out/k8-opt/bin/external/zlib -Ibazel-out/k8-opt/bin/external/ml_dtypes/_virtual_includes/int4 -Ibazel-out/k8-opt/bin/external/ml_dtypes/_virtual_includes/float8 -isystem external/eigen_archive -isystem bazel-out/k8-opt/bin/external/eigen_archive -isystem external/eigen_archive/mkl_include -isystem bazel-out/k8-opt/bin/external/eigen_archive/mkl_include -isystem external/ml_dtypes -isystem bazel-out/k8-opt/bin/external/ml_dtypes -isystem external/ml_dtypes/ml_dtypes -isystem bazel-out/k8-opt/bin/external/ml_dtypes/ml_dtypes -isystem external/nsync/public -isystem bazel-out/k8-opt/bin/external/nsync/public -isystem external/com_google_protobuf/src -isystem bazel-out/k8-opt/bin/external/com_google_protobuf/src -isystem external/farmhash_archive/src -isystem bazel-out/k8-opt/bin/external/farmhash_archive/src -isystem external/zlib -isystem bazel-out/k8-opt/bin/external/zlib -Wno-all -Wno-extra -Wno-deprecated -Wno-deprecated-declarations -Wno-ignored-attributes -Wno-array-bounds -Wunused-result '-Werror=unused-result' -Wswitch '-Werror=switch' '-Wno-error=unused-but-set-variable' -DAUTOLOAD_DYNAMIC_KERNELS '-std=c++17' -fno-canonical-system-headers -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -c xla/hlo/evaluator/hlo_evaluator.cc -o bazel-out/k8-opt/bin/xla/hlo/evaluator/_objs/hlo_evaluator/hlo_evaluator.pic.o)
# Configuration: ae6455079d93af1db7275eaba80d18c7d2c6c7cb0baa0cfc0665de4dffe0b286
# Execution platform: @local_execution_config_platform//:platform
In file included from ./xla/hlo/ir/hlo_computation.h:31,
                 from ./xla/hlo/ir/dfs_hlo_visitor_with_default.h:25,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:29,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
external/com_google_absl/absl/log/log.h:199: warning: "LOG" redefined
 #define LOG(severity) ABSL_LOG_INTERNAL_LOG_IMPL(_##severity)
 
In file included from external/tsl/tsl/platform/logging.h:26,
                 from external/tsl/tsl/platform/errors.h:30,
                 from external/tsl/tsl/platform/statusor.h:73,
                 from ./xla/statusor.h:19,
                 from ./xla/status_macros.h:27,
                 from ./xla/util.h:50,
                 from ./xla/array2d.h:32,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:28,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
external/tsl/tsl/platform/default/logging.h:165: note: this is the location of the previous definition
 #define LOG(severity) _TF_LOG_##severity
 
In file included from ./xla/hlo/ir/hlo_computation.h:31,
                 from ./xla/hlo/ir/dfs_hlo_visitor_with_default.h:25,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:29,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
external/com_google_absl/absl/log/log.h:237: warning: "LOG_EVERY_N" redefined
 #define LOG_EVERY_N(severity, n) \
 
In file included from external/tsl/tsl/platform/logging.h:26,
                 from external/tsl/tsl/platform/errors.h:30,
                 from external/tsl/tsl/platform/statusor.h:73,
                 from ./xla/statusor.h:19,
                 from ./xla/status_macros.h:27,
                 from ./xla/util.h:50,
                 from ./xla/array2d.h:32,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:28,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
external/tsl/tsl/platform/default/logging.h:278: note: this is the location of the previous definition
 #define LOG_EVERY_N(severity, n)                       \
 
In file included from ./xla/hlo/ir/hlo_computation.h:31,
                 from ./xla/hlo/ir/dfs_hlo_visitor_with_default.h:25,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:29,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
external/com_google_absl/absl/log/log.h:245: warning: "LOG_FIRST_N" redefined
 #define LOG_FIRST_N(severity, n) \
 
In file included from external/tsl/tsl/platform/logging.h:26,
                 from external/tsl/tsl/platform/errors.h:30,
                 from external/tsl/tsl/platform/statusor.h:73,
                 from ./xla/statusor.h:19,
                 from ./xla/status_macros.h:27,
                 from ./xla/util.h:50,
                 from ./xla/array2d.h:32,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:28,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
external/tsl/tsl/platform/default/logging.h:284: note: this is the location of the previous definition
 #define LOG_FIRST_N(severity, n)                       \
 
In file included from ./xla/hlo/ir/hlo_computation.h:31,
                 from ./xla/hlo/ir/dfs_hlo_visitor_with_default.h:25,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:29,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
external/com_google_absl/absl/log/log.h:253: warning: "LOG_EVERY_POW_2" redefined
 #define LOG_EVERY_POW_2(severity) \
 
In file included from external/tsl/tsl/platform/logging.h:26,
                 from external/tsl/tsl/platform/errors.h:30,
                 from external/tsl/tsl/platform/statusor.h:73,
                 from ./xla/statusor.h:19,
                 from ./xla/status_macros.h:27,
                 from ./xla/util.h:50,
                 from ./xla/array2d.h:32,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:28,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
external/tsl/tsl/platform/default/logging.h:290: note: this is the location of the previous definition
 #define LOG_EVERY_POW_2(severity)                         \
 
In file included from ./xla/hlo/ir/hlo_computation.h:31,
                 from ./xla/hlo/ir/dfs_hlo_visitor_with_default.h:25,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:29,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
external/com_google_absl/absl/log/log.h:265: warning: "LOG_EVERY_N_SEC" redefined
 #define LOG_EVERY_N_SEC(severity, n_seconds) \
 
In file included from external/tsl/tsl/platform/logging.h:26,
                 from external/tsl/tsl/platform/errors.h:30,
                 from external/tsl/tsl/platform/statusor.h:73,
                 from ./xla/statusor.h:19,
                 from ./xla/status_macros.h:27,
                 from ./xla/util.h:50,
                 from ./xla/array2d.h:32,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:28,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
external/tsl/tsl/platform/default/logging.h:300: note: this is the location of the previous definition
 #define LOG_EVERY_N_SEC(severity, n_seconds)                      \
 
In file included from ./xla/shape.h:28,
                 from ./xla/index_util.h:24,
                 from ./xla/literal.h:41,
                 from ./xla/hlo/ir/dfs_hlo_visitor.h:26,
                 from ./xla/hlo/ir/dfs_hlo_visitor_with_default.h:24,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:29,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
./xla/layout.h:377:35: warning: 'xla::Layout::DimInfo::dim_level_type' is too small to hold all values of 'enum xla::DimLevelType'
     DimLevelType dim_level_type : 6;
                                   ^
./xla/layout.h:389:41: warning: 'xla::Layout::index_primitive_type_' is too small to hold all values of 'enum xla::PrimitiveType'
   PrimitiveType index_primitive_type_ : 8;
                                         ^
./xla/layout.h:390:43: warning: 'xla::Layout::pointer_primitive_type_' is too small to hold all values of 'enum xla::PrimitiveType'
   PrimitiveType pointer_primitive_type_ : 8;
                                           ^
xla/hlo/evaluator/hlo_evaluator.cc: In instantiation of 'xla::{anonymous}::StochasticConvertOp(const xla::Literal&, const xla::Literal&, const xla::Shape&)::<lambda(auto:32)> [with auto:32 = std::integral_constant<xla::PrimitiveType, (xla::PrimitiveType)20>]':
./xla/primitive_util.h:400:34:   required from 'constexpr R xla::primitive_util::FloatingPointTypeSwitch(F&&, xla::PrimitiveType) [with R = absl::lts_20230802::StatusOr<xla::Literal>; F = xla::{anonymous}::StochasticConvertOp(const xla::Literal&, const xla::Literal&, const xla::Shape&)::<lambda(auto:32)>]'
./xla/primitive_util.h:448:40:   required from 'constexpr R xla::primitive_util::ArrayTypeSwitch(F&&, xla::PrimitiveType) [with R = absl::lts_20230802::StatusOr<xla::Literal>; F = xla::{anonymous}::StochasticConvertOp(const xla::Literal&, const xla::Literal&, const xla::Shape&)::<lambda(auto:32)>]'
./xla/primitive_util.h:466:30:   required from 'constexpr R xla::primitive_util::PrimitiveTypeSwitch(F&&, xla::PrimitiveType) [with R = absl::lts_20230802::StatusOr<xla::Literal>; F = xla::{anonymous}::StochasticConvertOp(const xla::Literal&, const xla::Literal&, const xla::Shape&)::<lambda(auto:32)>]'
xla/hlo/evaluator/hlo_evaluator.cc:3727:45:   required from here
xla/hlo/evaluator/hlo_evaluator.cc:3718:70: error: no matching function for call to 'StochasticConvertOp<primitive_type_constant, xla::primitive_util::UnsignedIntegralTypeForBitWidth(((int64_t)xla::primitive_util::BitWidth(primitive_type_constant.std::integral_constant<xla::PrimitiveType, (xla::PrimitiveType)20>::operator std::integral_constant<xla::PrimitiveType, (xla::PrimitiveType)20>::value_type())))>(const xla::Literal&, const xla::Literal&, const xla::Shape&)'
           return StochasticConvertOp<
                  ~~~~~~~~~~~~~~~~~~~~                                 
               primitive_type_constant,
               ~~~~~~~~~~~~~~~~~~~~~~~~                                
               primitive_util::UnsignedIntegralTypeForBitWidth(
               ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~        
                   primitive_util::BitWidth(primitive_type_constant))>(
                   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
               operand_literal, random_literal, result_shape);
               ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~          
xla/hlo/evaluator/hlo_evaluator.cc:3611:19: note: candidate: 'template<class Fp, class Uint, class ResultT> absl::lts_20230802::StatusOr<xla::Literal> xla::{anonymous}::StochasticConvertOp(const xla::Literal&, const xla::Literal&, const xla::Shape&)'
 StatusOr<Literal> StochasticConvertOp(const Literal& operand_literal,
                   ^~~~~~~~~~~~~~~~~~~
xla/hlo/evaluator/hlo_evaluator.cc:3611:19: note:   template argument deduction/substitution failed:
xla/hlo/evaluator/hlo_evaluator.cc:3675:19: note: candidate: 'template<xla::PrimitiveType operand_type, xla::PrimitiveType random_type, xla::PrimitiveType result_type> absl::lts_20230802::StatusOr<xla::Literal> xla::{anonymous}::StochasticConvertOp(const xla::Literal&, const xla::Literal&, const xla::Shape&)'
 StatusOr<Literal> StochasticConvertOp(const Literal& operand_literal,
                   ^~~~~~~~~~~~~~~~~~~
xla/hlo/evaluator/hlo_evaluator.cc:3675:19: note:   template argument deduction/substitution failed:
In file included from ./xla/shape.h:29,
                 from ./xla/index_util.h:24,
                 from ./xla/literal.h:41,
                 from ./xla/hlo/ir/dfs_hlo_visitor.h:26,
                 from ./xla/hlo/ir/dfs_hlo_visitor_with_default.h:24,
                 from ./xla/hlo/evaluator/hlo_evaluator.h:29,
                 from xla/hlo/evaluator/hlo_evaluator.cc:15:
xla/hlo/evaluator/hlo_evaluator.cc:3718:43:   in 'constexpr' expansion of 'xla::primitive_util::BitWidth(primitive_type_constant.std::integral_constant<xla::PrimitiveType, (xla::PrimitiveType)20>::operator std::integral_constant<xla::PrimitiveType, (xla::PrimitiveType)20>::value_type())'
./xla/primitive_util.h:536:54: error: 'constexpr int xla::primitive_util::internal::WidthForType(xla::PrimitiveType) [with const std::array<int, 26>& kWidths = xla::primitive_util::internal::kBitWidths]' called in a constant expression
   return internal::WidthForType<internal::kBitWidths>(type);
          ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~
./xla/primitive_util.h:526:22: note: 'constexpr int xla::primitive_util::internal::WidthForType(xla::PrimitiveType) [with const std::array<int, 26>& kWidths = xla::primitive_util::internal::kBitWidths]' is not usable as a 'constexpr' function because:
 inline constexpr int WidthForType(PrimitiveType type) {
                      ^~~~~~~~~~~~
./xla/primitive_util.h:530:45: error: call to non-'constexpr' function 'std::basic_ostream<_CharT, _Traits>& std::basic_ostream<_CharT, _Traits>::operator<<(int) [with _CharT = char; _Traits = std::char_traits<char>]'
   LOG(FATAL) << "Unhandled primitive type " << type;
xla/hlo/evaluator/hlo_evaluator.cc:3717:62: note: in template argument for type 'xla::PrimitiveType'
               primitive_util::UnsignedIntegralTypeForBitWidth(
               ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
                   primitive_util::BitWidth(primitive_type_constant))>(
                   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
xla/hlo/evaluator/hlo_evaluator.cc:3687:19: note: candidate: 'template<xla::PrimitiveType operand_type, xla::PrimitiveType random_type> absl::lts_20230802::StatusOr<xla::Literal> xla::{anonymous}::StochasticConvertOp(const xla::Literal&, const xla::Literal&, const xla::Shape&)'
 StatusOr<Literal> StochasticConvertOp(const Literal& operand_literal,
...
INFO: Elapsed time: 504.624s, Critical Path: 27.29s
INFO: 285 processes: 3 internal, 282 local.
FAILED: Build did NOT complete successfully

Information about the environment:

$ python --version
Python 3.11.8
$ clang --version
clang version 16.0.6 (Red Hat 16.0.6-2.module+el8.9.0+19521+190d7aba)
Target: x86_64-redhat-linux-gnu
Thread model: posix
InstalledDir: /usr/bi
$ gcc --version
gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-20)
Copyright (C) 2018 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
@fmulero
Copy link
Author

fmulero commented Mar 18, 2024

I tried to build the project from commit a487d8b and it worked without issues

@fmulero fmulero mentioned this issue Mar 18, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@fmulero