You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
wanted to try it out, but i'm not able to run your demo program (I have put it in sm.rb file):
ruby sm.rb
/System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require': cannot load such file -- bundler/setup (LoadError)
from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require'
from /Library/Ruby/Gems/2.3.0/gems/porter2stemmer-1.0.1/lib/porter2stemmer.rb:2:in `<top (required)>'
from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require'
from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require'
from /Library/Ruby/Gems/2.3.0/gems/smalltext-0.1.0/lib/smalltext.rb:1:in `<top (required)>'
from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:127:in `require'
from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:127:in `rescue in require'
from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:39:in `require'
from sm.rb:1:in `<main>'
hey, and while I am at it, can you please consider support for using other tokenizers as well? I myself prefer the pragmatic_tokenizer as it supports many languages, has stopwords, cleanup methods, etc.. thank you.
The text was updated successfully, but these errors were encountered:
Bundler is generally part of a standard Ruby setup.
While building this library I had evaluated many tokenizers, including pragmatic_tokenizer. What I remember is it could not split some types of sentences the way I was looking for but the tokenizer gem, which I have included, did.
The preprocessor for Smalltext can accept your list of stopwords, I simply have not exposed that config yet. As far as other languages are concerned I can surely include an option to have the preprocessor consider that. Give me some time.
hi,
wanted to try it out, but i'm not able to run your demo program (I have put it in sm.rb file):
gem install smalltext
completed successfully.any ideas what is wrong?
hey, and while I am at it, can you please consider support for using other tokenizers as well? I myself prefer the
pragmatic_tokenizer
as it supports many languages, has stopwords, cleanup methods, etc.. thank you.The text was updated successfully, but these errors were encountered: