Less copying, more batch optimisation #820
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
thread_initialize
callback intothread_initialize
andprepare_packet
, allowing the latter to be called on each buffer in a batch.ip
field frombatch->packets[]
, as it was only used on an error path of BSD's send code, and the IP can also be read from the packet data. While removing theip
field, align the packet data in batch such that the IP headers start at a 32-bit boundary, speeding up 32-bit header field access.These combined get me ~ 2.9 % send rate improvement, two thirds of which coming from the first change. Again, I realize some or all of this may be arguable.
The change in probe module interface could also be a step towards potential future work of letting probe modules write directly into mapped NIC memory in netmap mode (tho I suspect that might be more intrusive than it's worth).
This is a revised version of #818, now without breaking
--dryrun
. Tested on macOS Sonoma, FreeBSD 14 and Ubuntu 23.10; smoke tested various probe modules;test-shard.sh
andtest_big_group.sh
succeed.