Skip to content

Issues: atilika/kuromoji

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

25 Open 13 Closed
25 Open 13 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Kuromoji_tokenizer: sort clause does not seem to work for some specific character combinations
#141 opened Mar 26, 2024 by ajaypvymo
Kanji penalty and other penalty
#140 opened Dec 25, 2023 by elialm7
Handling of userDictionary comments
#139 opened Jun 13, 2023 by tottokug
日本人 is not divided into two sections even in extended mode
#138 opened Aug 26, 2021 by hohno-panopto
ソーシャルメディア is not tokenized into two words
#137 opened Aug 26, 2021 by hohno-panopto
Question: Is there any way to update neologd dictionary?
#135 opened May 26, 2021 by tstsukahara
How to enable discardPunctuation in Kuromoji Java
#134 opened May 20, 2021 by yanghanxy
how to increase heap size other than MAVEN_OPS
#133 opened Sep 15, 2020 by kazukousen
Next release?
#131 opened May 14, 2020 by mpriala-code
2
Optimization opportunity in the fst usage.
#130 opened Sep 1, 2019 by fulmicoton
2
Kuromoji POS Train
#129 opened Feb 11, 2019 by abhinandansrivastava
Normalized surface in user dictionary.
#126 opened May 28, 2018 by mrikitoku
5
tokenize 一人（ひとり,hitori）will be seperate as 一(いち,ichi) 人（ひと,hito）
#125 opened Feb 28, 2018 by andy840119
1
Unidic design flaw
#118 opened Aug 28, 2017 by wareya
4
Possible Issue with tokenization when English+Japanese are adjacent in text
#116 opened Jun 26, 2017 by bbguitar77
Longer string in Katakana has low priority
#115 opened Mar 8, 2017 by oharato
The tokenizing performance of mixed language
#113 opened Dec 16, 2016 by kwkwvenusgod
http://www.atilika.org showcases the outdated maven artifact repository information
#111 opened Oct 10, 2016 by titsuki
java.lang.RuntimeException: Could not load dictionaries. Caused by: java.io.IOException: Classpath resource not found: fst.bin
#110 opened Sep 27, 2016 by proninalex
Segmentation wrong with token contains square brackets?
#108 opened Jul 31, 2016 by reckart
3
Is there any example for Lemmatization?
#107 opened Jul 26, 2016 by RangerWolf
Tokenizing text in Hiragana character set
#105 opened Jun 8, 2016 by mhko
5
Unidic Tokenization on Romaji Words
#103 opened Apr 27, 2016 by tobias-khs
Question: how to obtain multiple parsings?
#99 opened Mar 29, 2016 by fasiha
5
Tokenizer is not serializable for Apache Spark
#85 opened Nov 2, 2015 by lamrongol
7
ProTip! Exclude everything labeled bug with -label:bug.