#

chinese-word-segmentation

Here are 95 public repositories matching this topic...

Embedding / Chinese-Word-Vectors

100+ Chinese Word Vectors 上百种预训练中文词向量

word-embeddings embeddings chinese embedding chinese-word-segmentation vectors-trained

Updated Oct 30, 2023
Python

lancopku / pkuseg-python

pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation

chinese-word-segmentation

Updated Nov 5, 2022
Python

baidu / lac

百度NLP：分词，词性标注，命名实体识别，词重要性

python java named-entity-recognition lexical-analysis chinese-nlp word-segmentation part-of-speech-tagger chinese-word-segmentation

Updated May 25, 2021
C++

ownthink / Jiagu

Jiagu深度学习自然语言处理工具知识图谱关系抽取中文分词词性标注命名实体识别情感分析新词发现关键词文本摘要文本聚类

nlp pos ner cws chinese-word-segmentation

Updated May 7, 2022
Python

hankcs / pyhanlp

中文分词

natural-language-processing hanlp named-entity-recognition dependency-parser part-of-speech-tagger chinese-word-segmentation

Updated Apr 19, 2024
Python

wolfgarbe / SymSpell

SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm

spellcheck fuzzy-search fuzzy-matching edit-distance levenshtein levenshtein-distance spelling spell-check chinese-text-segmentation word-segmentation approximate-string-matching spelling-correction damerau-levenshtein text-segmentation chinese-word-segmentation symspell

Updated Apr 2, 2024
C#

didi / ChineseNLP

Datasets, SOTA results of every fields of Chinese NLP

nlp machine-translation question-answering chinese-nlp entity-linking chinese-word-segmentation nlp-tasks

Updated Apr 7, 2022
HTML

lionsoul2014 / jcseg

Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywords extraction, key sentence extraction, summary extraction implemented based on TEXTRANK algorithm. Jcseg had a build-in http server and search modules for lucene,solr,elasticsearch,opensearch

java nlp natural-language-processing chinese-nlp chinese-text-segmentation nlp-keywords-extraction pos-tagging solr-plugin chinese-word-segmentation jcseg mmseg lucene-analyzer elasticsearch-analyzer keywords-extraction lucene-tokenizer jcseg-analyzer opensearch-analyzer opensearch-tokenizer elasticsearch-tokenizer

Updated Sep 18, 2023
Java

mammothb / symspellpy

Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm

python spellcheck fuzzy-search fuzzy-matching edit-distance levenshtein levenshtein-distance spelling spell-check chinese-text-segmentation word-segmentation approximate-string-matching spelling-correction damerau-levenshtein text-segmentation chinese-word-segmentation symspell

Updated Mar 21, 2024
Python

messense / jieba-rs

The Jieba Chinese Word Segmentation Implemented in Rust

nlp wasm jieba chinese-word-segmentation jieba-chinese

Updated Apr 22, 2024
Rust

lionsoul2014 / friso

High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.

c tokenizer full-text-search chinese-word-segmentation chinese-tokenizer php-tokenizer korean-tokenizer japanese-tokenizer cjk-tokenizer

Updated Oct 29, 2023
C

monpa

monpa-team / monpa

MONPA 罔拍是一個提供正體中文斷詞、詞性標註以及命名實體辨識的多任務模型

nlp named-entity-recognition pos ner word-segmentation albert bert pos-tagging chinese-word-segmentation

Updated Jul 18, 2022
Python

g2pC

Kyubyong / g2pC

g2pC: A Context-aware Grapheme-to-Phoneme Conversion module for Chinese

crf pinyin chinese-nlp crfsuite chinese-word-segmentation g2p

Updated Jul 10, 2019
Python

hemingkx / WordSeg

A PyTorch implementation of a BiLSTM \ BERT \ Roberta (+ BiLSTM + CRF) model for Chinese Word Segmentation (中文分词) .

pytorch bert chinese-word-segmentation bilstm-crf roberta bert-crf

Updated Jul 28, 2022
Python

supercoderhawk / DeepLearning_NLP

基于深度学习的自然语言处理库

natural-language-processing deep-learning tensorflow named-entity-recognition relation-extraction chinese-word-segmentation chinese-tokenizer

Updated Nov 3, 2018
Python

howl-anderson / MicroTokenizer

一个微型&算法全面的中文分词引擎 | A micro tokenizer for Chinese

tokenizer chinese-nlp nlp-machine-learning chinese-word-segmentation chinese-tokenizer dag-network

Updated Dec 26, 2022
Python

llhthinker / MachineLearningLab

Some experiments about Machine Learning

machine-learning classification gradient-descent frequent-itemset-mining regression-models chinese-word-segmentation

Updated Nov 16, 2020
Python

xtea / chinese_medical_words

手工整理医疗行业词汇、术语等语料。可用于语音识别、对话系统等各类nlp模型训练。

nlp medical chinese-nlp chinese-word-segmentation nlp-datasets nlp-data-to-text

Updated Apr 5, 2020

fudannlp16 / CWS_Dict

Source codes for paper "Neural Networks Incorporating Dictionaries for Chinese Word Segmentation", AAAI 2018

deep-learning tensorflow word-segmentation cws chinese-word-segmentation

Updated Feb 1, 2018
Python

jcyk / greedyCWS

Source code for an ACL2017 paper on Chinese word segmentation

acl dynet cws chinese-word-segmentation

Updated Jan 8, 2019
Python

Improve this page

Add a description, image, and links to the chinese-word-segmentation topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the chinese-word-segmentation topic, visit your repo's landing page and select "manage topics."