Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add all the other wikipedia snapshots #63

Open
2 of 17 tasks
momack2 opened this issue Sep 10, 2019 · 1 comment
Open
2 of 17 tasks

Add all the other wikipedia snapshots #63

momack2 opened this issue Sep 10, 2019 · 1 comment
Labels
snapshots issues related to snapshot creation and updates

Comments

@momack2
Copy link
Contributor

momack2 commented Sep 10, 2019

Many countries have blocked Wikipedia over the years, and Wikipedia has also suffered from DDOS attacks causing service drops in various regions. We should broaden our current list of Wikipedia mirrors to include other languages. I propose doing the languages with the most users - as of now there are 13 languages with more than 1M users and 6 languages with more than 2.5M users.

Language Wiki Users Active Users Good Pages Total Pages On IPFS
English en 37103876 124823 5926367 48505470
Spanish es 5543043 15373 1543777 6782414
French fr 3544188 16349 2138049 10319452
German de 3271376 18550 2341066 6547819
Chinese zh 2803562 8437 1073112 5907531
Russian ru 2589568 10331 1567312 5987865
Portuguese pt 2297005 5696 1013328 4890332
Italian it 1867701 8066 1551915 6360102
Arabic ar 1709753 4342 949434 5651012
Japanese ja 1527805 14061 1167744 3460642
Indonesian id 1087372 2786 502154 2604650
Turkish tr 1042570 683 333283 1666749
Dutch nl 1018242 3866 1978041 4116417

For each:

@momack2 momack2 changed the title Add Chinese wikipedia snapshot Add all the other wikipedia snapshots Sep 10, 2019
@lidel lidel added snapshots issues related to snapshot creation and updates language language-specific issues and removed language language-specific issues labels Sep 27, 2019
@RubenKelevra
Copy link

I think we should put the Indic Wikipedia on that list, due to the recent push to block the access...

https://twitter.com/smittal_ips/status/1237030193937575938?s=19

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
snapshots issues related to snapshot creation and updates
Projects
None yet
Development

No branches or pull requests

3 participants