New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

实现微信最新优化的几个功能 #99

Open

1 of 7 tasks

wangfenjin opened this issue Aug 20, 2022 · 0 comments

Owner

wangfenjin commented Aug 20, 2022 •

edited

原文： https://mp.weixin.qq.com/s/Ph0jykLr5CMF-xFgoJw5UQ

可以实现的点：

支持在分词时将繁体字转换成简体字
支持Unicode归一化
支持过滤符号，需要可配置
支持用Porter Stemming算法对英文单词取词干，需要可配置
支持将字母全部转成小写，应该已经做了，需要检查确认
索引内容支持多级分隔符
FTS merge 机制优化 - 可能实现不了

全文搜索应用逻辑优化章节不用处理

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment