New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Strange results for Chinese with Japanese #38
Comments
Hi @71sprite, thanks for your request. I'm aware of the difficulties to recognize Chinese and Japanese correctly. These are actually the most difficult languages. I will try to improve the algorithm but as I'm not a speaker of these languages, it's not easy. If you know how to speak these languages and have ideas for heuristics to implement, I will be glad to read about them. |
I have also read some documents List_of_Unicode_characters , it is indeed impossible to accurately distinguish among Chinese, Japanese and Korean. Perhaps we can judge according to the Unicode range.
|
As a speaker of Chinese and Japanese, I vote for @71sprite |
To reproduce:
Expected:
Get
Chinese
for this case.It's because here return
Japanese
if any japaneseCharacterSet char exists, I'm unsure if this is intended.Thanks for awesome work!
The text was updated successfully, but these errors were encountered: