Skip to content

Releases: nlpodyssey/gotokenizers

v0.2.0

12 Dec 23:29
Compare
Choose a tag to compare

Added

  • Initial Encoding implementation, including its creation from PreTokenizedString

First tagged release

11 Dec 10:37
Compare
Choose a tag to compare
v0.1.0

Fix some golint problems