clang error when compile sycl codes

[csccva]

Hello,

I am still trying to figure out the best way to compile AdaptiveCpp. My last attempt I was able comppile it from source, but when I try to compile sycl codes I get this error:

$ /projappl/project_2008874/AdaptiveCpp_TR/bin/acpp -O3 --acpp-targets="omp;cuda:sm_80" code00to05/enumerate_devices.cpp 
/usr/bin/ld: /scratch/project_2008874/spack2/opt/spack/linux-rhel8-zen2/gcc-11.2.0/llvm-15.0.7-terlbaqsongcywhiyf73hqbeop73njbm/lib/libomp.so: unable to initialize decompress status for section .debug_aranges
/usr/bin/ld: /scratch/project_2008874/spack2/opt/spack/linux-rhel8-zen2/gcc-11.2.0/llvm-15.0.7-terlbaqsongcywhiyf73hqbeop73njbm/lib/libomp.so: unable to initialize decompress status for section .debug_aranges
/scratch/project_2008874/spack2/opt/spack/linux-rhel8-zen2/gcc-11.2.0/llvm-15.0.7-terlbaqsongcywhiyf73hqbeop73njbm/lib/libomp.so: file not recognized: File format not recognized
clang-15: error: linker command failed with exit code 1 (use -v to see invocation)

I configured AdaptiveCpp with

cmake -DCMAKE_INSTALL_PREFIX=/projappl/project_2008874/AdaptiveCpp_TR -DBOOST_ROOT=/scratch/project_2008874/spack2/opt/spack/linux-rhel8-zen2/gcc-11.2.0/boost-1.69.0-7kltrtaxxez7rsl65kuqka25q5poq6vk  -DROCM_PATH=$CUDA_HOME -DWITH_CPU_BACKEND=ON -DWITH_CUDA_BACKEND=ON  -DWITH_ROCM_BACKEND=OFF -DDEFAULT_TARGETS="cuda:sm_80" -DWITH_ACCELERATED_CPU=ON -DWITH_SSCP_COMPILER=OFF  -DWITH_OPENCL_BACKEND=OFF -DWITH_LEVEL_ZERO_BACKEND=OFF -DLLVM_DIR=/scratch/project_2008874/spack2/opt/spack/linux-rhel8-zen2/gcc-11.2.0/llvm-15.0.7-terlbaqsongcywhiyf73hqbeop73njbm/lib/cmake/llvm  ..

Where the boost library and llvm were built via spack. The gcc is version 11.2.0:

$ gcc --version
gcc (Spack GCC) 11.2.0
Copyright (C) 2021 Free Software Foundation, Inc.

The acpp-info tool works without any issues.

[normallytangent]

Hi, could you please do a $ ldd ~/projappl/project_2008874/AdaptiveCpp_TR/lib/hipSYCL/librt-backend-omp.so?
It could be that the application is linked against LLVM libomp, but the AdaptiveCpp runtime is using libgomp since you built it with gcc. Do you also face this issue when building AdaptiveCpp with clang?

[csccva]

I got this:

$ ldd /projappl/project_2008874/AdaptiveCpp_TR/lib/hipSYCL/librt-backend-omp.so
        linux-vdso.so.1 (0x00007ffee15d7000)
        libacpp-rt.so => /projappl/project_2008874/AdaptiveCpp_TR/lib/libacpp-rt.so (0x00007fe4897a7000)
        libgomp.so.1 => /appl/spack/v017/install-tree/gcc-8.5.0/gcc-11.2.0-zshp2k/lib64/libgomp.so.1 (0x00007fe489762000)
        libpthread.so.0 => /lib64/libpthread.so.0 (0x00007fe4893e8000)
        libstdc++.so.6 => /appl/spack/v017/install-tree/gcc-8.5.0/gcc-11.2.0-zshp2k/lib64/libstdc++.so.6 (0x00007fe4891d0000)
        libm.so.6 => /lib64/libm.so.6 (0x00007fe488e4e000)
        libgcc_s.so.1 => /appl/spack/v017/install-tree/gcc-8.5.0/gcc-11.2.0-zshp2k/lib64/libgcc_s.so.1 (0x00007fe48973a000)
        libc.so.6 => /lib64/libc.so.6 (0x00007fe488a88000)
        /lib64/ld-linux-x86-64.so.2 (0x00007fe489608000)
        libacpp-common.so => /projappl/project_2008874/AdaptiveCpp_TR/lib/libacpp-common.so (0x00007fe489732000)
        libdl.so.2 => /lib64/libdl.so.2 (0x00007fe488884000)

[csccva]

I guess it did not link against libomp, but how can I control it ?

[normallytangent]

This should do it: $ export LD_PRELOAD=/path/to/libomp.so

[csccva]

I did that and I still get the same error. Do you mean that I recompile AdaptiveCpp from source with the LD_PRELOAD variable set?

[csccva]

I also recompile it from source with the smae arguments, but with LD_PRELOAD set and got the same error. I tried several ways to compile and all ended up with the same error :(
trangely on another machine

[illuhad]

/scratch/project_2008874/spack2/opt/spack/linux-rhel8-zen2/gcc-11.2.0/llvm-15.0.7-terlbaqsongcywhiyf73hqbeop73njbm/lib/libomp.so: file not recognized: File format not recognized

This sounds like that library is corrupt. Can you verify whether LLVM OpenMP works?

[csccva]

I tried a simple code:

$ spack2/opt/spack/linux-rhel8-zen2/gcc-11.2.0/llvm-15.0.7-terlbaqsongcywhiyf73hqbeop73njbm/bin/clang fff.c  -fopenmp 
/usr/bin/ld: /scratch/project_2008874/spack2/opt/spack/linux-rhel8-zen2/gcc-11.2.0/llvm-15.0.7-terlbaqsongcywhiyf73hqbeop73njbm/lib/libomp.so: unable to initialize decompress status for section .debug_aranges
/usr/bin/ld: /scratch/project_2008874/spack2/opt/spack/linux-rhel8-zen2/gcc-11.2.0/llvm-15.0.7-terlbaqsongcywhiyf73hqbeop73njbm/lib/libomp.so: unable to initialize decompress status for section .debug_aranges
/scratch/project_2008874/spack2/opt/spack/linux-rhel8-zen2/gcc-11.2.0/llvm-15.0.7-terlbaqsongcywhiyf73hqbeop73njbm/lib/libomp.so: file not recognized: File format not recognized
clang-15: error: linker command failed with exit code 1 (use -v to see invocation)

[csccva]

Could the error be realted to this https://wiki.gentoo.org/wiki/Project:Toolchain/Binutils_2.32_upgrade_notes/elfutils_0.175:_unable_to_initialize_decompress_status_for_section_.debug_info ?

[illuhad]

I don't know, but your error looks suspiciously similar. Perhaps try what they recommend there?

[csccva]

Unfortunately I do not have root access.
I tried setting the LD variable, but did not work. Is there any way to overwrite the defualt system ld?

[csccva]

Weirdly this compilation flag -fuse-ld=lld seems to solve the problem.