Comparable Wikipedia Coprus

Comparable Wikipedia Corpus (aligned documents)

Corpus extracts from 20-01-2017 Wikipedia dumps

This corpus is aligned by WikiDocsAligner

Lanugage pairs list (20-01-2017):

Arabic-Egyptian

In the future, other language pairs will be included

Corpus Information

	Arabic Wikipedia	Egyptian Wikipedia
documents	10,197	10,197
words	8,397,154	1,543,516
vocabulary	740,055	215,659

To cite this resource:

Motaz Saad and Basem Alijla (2017). WikiDocsAligner: an off-the-shelf Wikipedia Documents Alignment Tool. in The Second Palestinian International Conference on Information and Communication Technology (PICICT 2017).

Name		Name	Last commit message	Last commit date
Latest commit History 48 Commits
ar-arz/20012017		ar-arz/20012017
ar_arz_wiki_corpus		ar_arz_wiki_corpus
langid-1.1.6		langid-1.1.6
my_models		my_models
LICENSE.txt		LICENSE.txt
README.md		README.md
build_gram_model.py		build_gram_model.py
build_langid_model.sh		build_langid_model.sh
clean_text.py		clean_text.py
cmds.sh		cmds.sh
eval_metrics.py		eval_metrics.py
feature_extraction.py		feature_extraction.py
langid-1.1.6.tar.gz		langid-1.1.6.tar.gz
prepare_data.py		prepare_data.py
prepare_data_json.py		prepare_data_json.py
process_arabic.py		process_arabic.py
test.json		test.json
tm_sklearn.py		tm_sklearn.py
tm_sklearn_grid.py		tm_sklearn_grid.py
tm_sklearn_pipeline.py		tm_sklearn_pipeline.py
tmp.py		tmp.py

License

motazsaad/egy-arb-dialect-id

Folders and files

Latest commit

History

Repository files navigation

Comparable Wikipedia Coprus

Lanugage pairs list (20-01-2017):

Corpus Information

To cite this resource:

About

Topics

Resources

License

Stars

Watchers

Forks

Languages