What's Changed
- Fix local shuffling failure by @soldni in #140
- Fix issue in getting started tutorial using wikipedia data by @RohitRathore1 in #117
- Add an option to improve tokenization shuffling by @soldni in #141
- Optionally add total/sum to output of analyzer by @soldni in #144
- Add extra tests for multi-byte unicode spans in deduper. by @soldni in #145
- Bump s3 client lib and parameterize region in s3 tests + devcontainer by @undfined in #147
New Contributors
- @RohitRathore1 made their first contribution in #117
- @undfined made their first contribution in #147
Full Changelog: v1.0.2...v1.0.3
Contributors
undfined, soldni, and RohitRathore1