[BUG] Building from source fails when linking

[betatim]

Describe the bug
I just tried to build cuml from source.

Steps/Code to reproduce bug

Followed the recommended process section from https://github.com/rapidsai/cuml/blob/branch-24.06/BUILD.md#installing-from-source

• mamba env create -n cuml-dev-24.06 -f conda/environments/all_cuda-122_arch-x86_64.yaml because nvidia-smi on the system says the CUDA version is 12.2, this is different from the guide which uses 11.8
• ./build.sh in the top level directory

This runs for a while but then errors when linking the libcuml++.so. More build log https://gist.github.com/betatim/622087529cbe98a4f2aca8d4f521690a - before this comes lots of output regarding the use of deprecated raft headers, I can't go further back in my terminal's history to find output fom before that.

Environment details (please complete the following information):

• Environment location: Bare-metal
• Linux Distro/Architecture: Ubuntu 22.04.2 LTS
• GPU Model/Driver: Tesla T4 Driver Version: 535.129.03
• CUDA: 12.2
• Method of cuDF & cuML install from source:
  • cmake version 3.29.1
  • gcc (conda-forge gcc 11.4.0-5) 11.4.0
  • cuml commit d14d7e93e702dc28bb239043ae822eff586e7b64

[betatim]

I just noticed that it seems to be using things from a previous conda env (cuml-dev-23.12-dgx15), not the one I have activated at the moment. I've used this checkout of cuml before and today updated to the latest commit.

To solve the issue of referring to old conda env I tried to run ./build.sh clean. This runs for a bit and then errors with python: can't open file '/home/my-user-name/git/cuml/python/setup.py': [Errno 2] No such file or directory

[betatim]

After the clean up cuml installed without a problem. So the remaining issue is that something in the build system doesn't invalidate properly and that build.sh clean raises an error