Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ibverb-support fails under OFED 5.5 #196

Open
jaycedowell opened this issue Jan 18, 2023 · 2 comments
Open

ibverb-support fails under OFED 5.5 #196

jaycedowell opened this issue Jan 18, 2023 · 2 comments
Labels
bug

Comments

@jaycedowell
Copy link
Collaborator

After upgrading a machine to Ubuntu 20/OFED 5.5 I'm running into problems with the ibverb-support branch, mainly segfaults.
@jaycedowell
Copy link
Collaborator Author

This could just be user error on my part.

@jaycedowell
Copy link
Collaborator Author

I think everything is working now. My problems were:

  • outdated version of Bifrost Verbs support -> what's in ibverb-support does work
  • problems with the OFED installation -> there were some old /etc/modprobe.d config. files that caused mlx5_core to be loaded with the wrong options
  • changes to the permissions model of OFED -> the Verbs support that we use now requires the CAP_NET_RAW capability to work.

For this last point I ended up going to the spead2 documentation for help:

We should try to convey this information to users of Bifrost as well.

@jaycedowell jaycedowell mentioned this issue Feb 14, 2023
Open
jaycedowell added a commit that referenced this issue Sep 5, 2023
@jaycedowell
Add a helpful message for #196.
c966503
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jaycedowell