feat: Support Python 3.12 #28

qnixsynapse · 2024-04-03T06:55:29Z

This is the error I am getting:

jax_plugins/intel_extension_for_openxla/pjrt_plugin_xpu.so: undefined symbol: _ZNK4sycl3_V16detail16AccessorBaseHost25isMemoryObjectUsedByGraphEv

The text was updated successfully, but these errors were encountered:

fredlarochelle · 2024-04-05T19:56:12Z

Yeah, it's not in an usable state yet, especially on Arc...

rahulunair · 2024-05-08T20:17:52Z

Any update on this?, I tried using 2024.0 and 2024.1 version of oneapi and with latest version of jax as well as the version prescribed in the readme. Both didnt work.

using 2024.0 version of oneapi and jax 0.4.25, here is the error I am getting on a Intel GPU Max system:

>>> import jax
>>> jax.local_devices()
INFO: Intel Extension for OpenXLA version: 0.3.0, commit: 9a484818
Jax plugin configuration error: Exception when calling jax_plugins.intel_extension_for_openxla.initialize()
Traceback (most recent call last):
  File "/home/sdp/.conda/envs/jax/lib/python3.11/site-packages/jax/_src/xla_bridge.py", line 482, in discover_pjrt_plugins
    plugin_module.initialize()
  File "/home/sdp/.conda/envs/jax/lib/python3.11/site-packages/jax_plugins/intel_extension_for_openxla/__init__.py", line 39, in initialize
    c_api = xb.register_plugin("xpu",
            ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sdp/.conda/envs/jax/lib/python3.11/site-packages/jax/_src/xla_bridge.py", line 544, in register_plugin
    c_api = xla_client.load_pjrt_plugin_dynamically(plugin_name, library_path)  # type: ignore
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sdp/.conda/envs/jax/lib/python3.11/site-packages/jaxlib/xla_client.py", line 155, in load_pjrt_plugin_dynamically
    return _xla.load_pjrt_plugin(plugin_name, library_path, c_api=None)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
jaxlib.xla_extension.XlaRuntimeError: INTERNAL: Failed to open /home/sdp/.conda/envs/jax/lib/python3.11/site-packages/jax_plugins/intel_extension_for_openxla/pjrt_plugin_xpu.so: /home/sdp/.conda/envs/jax/lib/python3.11/site-packages/jax_plugins/intel_extension_for_openxla/pjrt_plugin_xpu.so: undefined symbol: _ZNK4sycl3_V16detail16AccessorBaseHost25isMemoryObjectUsedByGraphEv
[CpuDevice(id=0)]
>>>

Using latest jax, 2024.1 oneapi and latest openxla I am getting a core dump.

Zantares · 2024-05-15T02:59:23Z

Any update on this?, I tried using 2024.0 and 2024.1 version of oneapi and with latest version of jax as well as the version prescribed in the readme. Both didnt work.

using 2024.0 version of oneapi and jax 0.4.25, here is the error I am getting on a Intel GPU Max system:

2024.0 is not supported if you are using the Extension from pip. It's built by 2024.1 and will show undefined symbol error if works with 2024.0. Please rebuild Extension in your environment if you don't want to switch to 2024.1.
You mentioned that JAX v0.4.25 is used, so maybe you are suffering similar issue as installation issue #18. Each Extension version can only work with specific JAX version, such as 0.2.0 vs. 0.4.20. 0.3.0 vs. 0.4.24... Currently you can find the match info in the release notes: https://github.com/intel/intel-extension-for-openxla/releases .

qnixsynapse · 2024-05-16T04:02:58Z

I am currently using 2024.1 and it stopped detecting my GPU.

The output of jax.local_devices() shows [CpuDevice(id=0)]

Zantares · 2024-05-16T05:30:50Z

I am currently using 2024.1 and it stopped detecting my GPU.

The output of jax.local_devices() shows [CpuDevice(id=0)]

Do you meet the undefined symbol error even with 2024.1? If so, can you help to

list the JAX version by pip list |egrep jax?
list the Driver version by dpkg -l |egrep level-zero-gpu?

qnixsynapse · 2024-05-16T14:38:07Z

The undefined symbol is fixed when upgraded to 2024.1. However, it stopped detecting the pjrt plugin/GPU.

$ pip list |egrep jax
egrep: warning: egrep is obsolescent; using grep -E
jax                         0.4.25
jaxlib                      0.4.25

$ sudo pacman -Qs level-zero
local/intel-compute-runtime 24.13.29138.7-1
    Intel(R) Graphics Compute Runtime for oneAPI Level Zero and OpenCL(TM) Driver
local/level-zero-loader 1.16.15-1
    API for accessing low level interfaces in oneAPI platform devices (loader)

Zantares · 2024-05-17T07:55:38Z

@qnixsynapse JAX v0.4.25 doesn't match released Extension v0.3.0, so please try to use any of the following 2 solutions first:

Downgrade JAX version to v0.4.24
Rebuild the newest Extension main branch by yourself, it has upgraded to support JAX v0.4.25

More version-matching info can be found in the release notes: https://github.com/intel/intel-extension-for-openxla/releases. We will add a table in the home page to tell the matching info later.

qnixsynapse · 2024-05-17T11:58:17Z

@Zantares Same issue with v0.4.24:

Edit: It seems a python version mismatch, reason why pip is pulling a pre release old pywheel of openxla plugin. Arch Linux has python version: 3.12.3, the new wheels are built with 3.11.

Zantares · 2024-05-20T04:40:44Z

@Zantares Same issue with v0.4.24:

Edit: It seems a python version mismatch, reason why pip is pulling a pre release old pywheel of openxla plugin. Arch Linux has python version: 3.12.3, the new wheels are built with 3.11.

Thanks for the trial and the new info. We will check the error with Python 3.12 on Arc.

BTW, isn't Extension v0.3.0 installed but an old version if it's mismatched?

qnixsynapse · 2024-05-20T04:47:00Z

Seems like it. Pip is refusing to install the 0.3.0 because it is trying to search for a wheel built for Python 3.12

I guess the last one is the one getting installed.

Also, this:

Zantares · 2024-05-20T05:10:19Z

That's it. We will discuss it internally first to see if we can release more Python packages (means more test processes). Right now you can try to build it by yourself if Python 3.12 is hard requested.

qnixsynapse · 2024-05-23T05:10:44Z

I tried to build it today, hit with an error. Tbh, I am not familiar with bazel.

$ bazel build //xla/tools/pip_package:build_pip_package
Starting local Bazel server and connecting to it...
INFO: Reading rc options for 'build' from /home/qnixsynapse/.cache/work/intel-extension-for-openxla/.bazelrc:
  'build' options: --nocheck_visibility --announce_rc --config=gpu --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone --strategy=Genrule=standalone -c opt --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --distinct_host_configuration=false
ERROR: --distinct_host_configuration=false :: Unrecognized option: --distinct_host_configuration=false

Removing(commenting that option) gives this error:

$ bazel build //xla/tools/pip_package:build_pip_package
Starting local Bazel server and connecting to it...
INFO: Reading rc options for 'build' from /home/qnixsynapse/.cache/work/intel-extension-for-openxla/.bazelrc:
  'build' options: --nocheck_visibility --announce_rc --config=gpu --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone --strategy=Genrule=standalone -c opt --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --distinct_host_configuration=false
ERROR: --distinct_host_configuration=false :: Unrecognized option: --distinct_host_configuration=false
(mldev) $ nano .bazelrc 
(mldev) $ bazel build //xla/tools/pip_package:build_pip_package
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=145
INFO: Reading rc options for 'build' from /home/qnixsynapse/.cache/work/intel-extension-for-openxla/.bazelrc:
  Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /home/qnixsynapse/.cache/work/intel-extension-for-openxla/.bazelrc:
  'build' options: --nocheck_visibility --announce_rc --config=gpu --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone --strategy=Genrule=standalone -c opt --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include
INFO: Reading rc options for 'build' from /home/qnixsynapse/.cache/work/intel-extension-for-openxla/.xla_extension_configure.bazelrc:
  'build' options: --action_env PYTHON_BIN_PATH=/home/qnixsynapse/.pyenvs/mldev/bin/python --action_env PYTHON_LIB_PATH=/home/qnixsynapse/.pyenvs/mldev/lib/python3.12/site-packages --python_path=/home/qnixsynapse/.pyenvs/mldev/bin/python --action_env TF_CXX11_ABI_FLAG=1 --action_env TF_NEED_SYCL=1 --action_env SYCL_TOOLKIT_PATH=/opt/intel/oneapi/compiler/latest --action_env LD_LIBRARY_PATH=/opt/intel/oneapi/compiler/latest/lib:/opt/intel/oneapi/compiler/latest/compiler/lib/intel64_lin --action_env LIBRARY_PATH=/opt/intel/oneapi/compiler/latest/lib:/opt/intel/oneapi/compiler/latest/compiler/lib/intel64_lin
INFO: Found applicable config definition build:gpu in file /home/qnixsynapse/.cache/work/intel-extension-for-openxla/.bazelrc: --crosstool_top=@local_config_sycl//crosstool:toolchain --define=using_sycl=true --repo_env TF_NEED_SYCL=1 --define=tensorflow_mkldnn_contraction_kernel=0 --cxxopt=-std=c++17 --host_cxxopt=-std=c++17
WARNING: --enable_bzlmod is set, but no MODULE.bazel file was found at the workspace root. Bazel will create an empty MODULE.bazel file. Please consider migrating your external dependencies from WORKSPACE to MODULE.bazel. For more details, please refer to https://github.com/bazelbuild/bazel/issues/18958.
DEBUG: /home/qnixsynapse/.cache/bazel/_bazel_qnixsynapse/30b9de68561309b1e1c2b2989f0a0749/external/xla/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'llvm-raw' because it already exists.
DEBUG: /home/qnixsynapse/.cache/bazel/_bazel_qnixsynapse/30b9de68561309b1e1c2b2989f0a0749/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'nvtx_archive' because it already exists.
ERROR: Traceback (most recent call last):
	File "/home/qnixsynapse/.cache/bazel/_bazel_qnixsynapse/30b9de68561309b1e1c2b2989f0a0749/external/build_bazel_rules_apple/apple/internal/rule_support.bzl", line 221, column 36, in <toplevel>
		deps_cfg = apple_common.multi_arch_split,
Error: 'apple_common' value has no field or method 'multi_arch_split'
ERROR: error loading package '@@com_github_grpc_grpc//': at /home/qnixsynapse/.cache/bazel/_bazel_qnixsynapse/30b9de68561309b1e1c2b2989f0a0749/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl:28:6: at /home/qnixsynapse/.cache/bazel/_bazel_qnixsynapse/30b9de68561309b1e1c2b2989f0a0749/external/build_bazel_rules_apple/apple/ios.bzl:33:5: at /home/qnixsynapse/.cache/bazel/_bazel_qnixsynapse/30b9de68561309b1e1c2b2989f0a0749/external/build_bazel_rules_apple/apple/internal/ios_rules.bzl:71:5: initialization of module 'apple/internal/rule_support.bzl' failed
ERROR: /home/qnixsynapse/.cache/bazel/_bazel_qnixsynapse/30b9de68561309b1e1c2b2989f0a0749/external/tsl/tsl/BUILD:460:11: error loading package '@@com_github_grpc_grpc//': at /home/qnixsynapse/.cache/bazel/_bazel_qnixsynapse/30b9de68561309b1e1c2b2989f0a0749/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl:28:6: at /home/qnixsynapse/.cache/bazel/_bazel_qnixsynapse/30b9de68561309b1e1c2b2989f0a0749/external/build_bazel_rules_apple/apple/ios.bzl:33:5: at /home/qnixsynapse/.cache/bazel/_bazel_qnixsynapse/30b9de68561309b1e1c2b2989f0a0749/external/build_bazel_rules_apple/apple/internal/ios_rules.bzl:71:5: initialization of module 'apple/internal/rule_support.bzl' failed and referenced by '@@tsl//tsl:grpc++'
ERROR: Analysis of target '//xla/tools/pip_package:build_pip_package' failed; build aborted: Analysis failed
INFO: Elapsed time: 92.196s, Critical Path: 0.02s
INFO: 1 process: 1 internal.
ERROR: Build did NOT complete successfully
FAILED: 
    Fetching repository @@bazel_tools~cc_configure_extension~local_config_cc; starting
    Fetching repository @@double_conversion; starting
    Fetching repository @@eigen_archive; starting
    Fetching repository @@com_googlesource_code_re2; starting
    Fetching repository @@snappy; starting
    Fetching repository @@nsync; starting
    Fetching https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/double-conversion/archive/v3.2.0.tar.gz; 252.1 KiB (3.7%)
    Fetching https://storage.googleapis.com/.../eigen-aa6964bf3a34fd607837dd8123bc42465185c4f8.tar.gz; 79.9 KiB (2.9%) ... (12 fetches)

Zantares · 2024-05-23T10:42:15Z

Hi @qnixsynapse thanks for your trial, but I have never saw this error before... Have you missed any steps in the instruction https://github.com/intel/intel-extension-for-openxla?tab=readme-ov-file#install-from-source-build like configure? If not, can you list your environment info including HW, OS and related SW? I can bridge a support engineer to you if you don't know what info is needed here.

qnixsynapse · 2024-05-23T11:05:22Z

Yes. I was following that while trying to build. And I ran ./configure before.

I tried to build two times but I am getting the exact same error..

As I mentioned before, I am not familiar with bazel. My OS is an up to date Arch Linux on an Intel 12th gen (CPU + ARC A750) PC. The Intel oneapi basekit is latest and is installed in /opt.

Just curious, what is the version of bazel that is used to build this package?

Zantares · 2024-05-24T03:35:47Z

I'm using Bazel 6.1.0. The configure script will check Bazel version: https://github.com/intel/intel-extension-for-openxla/blob/main/configure.py#L801, but I'm not sure what will happen if use a very new Bazel...

qnixsynapse · 2024-05-24T04:27:06Z

Got it. The version of bazel on my system is 7.1.1. This might be creating the problem.

feng-intel · 2024-05-27T03:27:41Z

@qnixsynapse
Thanks for your reply. Do you still have build problem?

qnixsynapse · 2024-05-27T07:27:16Z

@feng-intel Yes, with the latest release tag.

Zantares added the question Further information is requested label May 15, 2024

qnixsynapse changed the title ~~intel-extension-for-openxla-0.3.0 seems broken on Intel Arc A750.~~ feat: Support Python 3.12 May 20, 2024

Zantares added enhancement New feature or request and removed question Further information is requested labels May 20, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: Support Python 3.12 #28

feat: Support Python 3.12 #28

qnixsynapse commented Apr 3, 2024

fredlarochelle commented Apr 5, 2024

rahulunair commented May 8, 2024

Zantares commented May 15, 2024 •

edited

qnixsynapse commented May 16, 2024

Zantares commented May 16, 2024

qnixsynapse commented May 16, 2024

Zantares commented May 17, 2024 •

edited

qnixsynapse commented May 17, 2024 •

edited

Zantares commented May 20, 2024

qnixsynapse commented May 20, 2024

Zantares commented May 20, 2024

qnixsynapse commented May 23, 2024

Zantares commented May 23, 2024

qnixsynapse commented May 23, 2024 •

edited

Zantares commented May 24, 2024

qnixsynapse commented May 24, 2024

feng-intel commented May 27, 2024

qnixsynapse commented May 27, 2024

feat: Support Python 3.12 #28

feat: Support Python 3.12 #28

Comments

qnixsynapse commented Apr 3, 2024

fredlarochelle commented Apr 5, 2024

rahulunair commented May 8, 2024

Zantares commented May 15, 2024 • edited

qnixsynapse commented May 16, 2024

Zantares commented May 16, 2024

qnixsynapse commented May 16, 2024

Zantares commented May 17, 2024 • edited

qnixsynapse commented May 17, 2024 • edited

Zantares commented May 20, 2024

qnixsynapse commented May 20, 2024

Zantares commented May 20, 2024

qnixsynapse commented May 23, 2024

Zantares commented May 23, 2024

qnixsynapse commented May 23, 2024 • edited

Zantares commented May 24, 2024

qnixsynapse commented May 24, 2024

feng-intel commented May 27, 2024

qnixsynapse commented May 27, 2024

Zantares commented May 15, 2024 •

edited

Zantares commented May 17, 2024 •

edited

qnixsynapse commented May 17, 2024 •

edited

qnixsynapse commented May 23, 2024 •

edited