Skip to content

Performs a wikipedia search of 2 keywords or phrases and then identifies a link between them. Intended to assist in creating a knowledge tree.

Notifications You must be signed in to change notification settings

ks-manu/wikipedia-connection-discovery

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Wikipedia Connection Discovery

Code base forked from: https://github.com/Mgancita/wikipedia_connection_finder/

About

Web crawling application which finds the most efficient internal wikipedia webpage connection between two wikipedia webpages based on supplied keywords.

It is intended for use in knowledge graph generation and idea linkage. Students and researchers are encouraged to test and critique this use case.

Requirements

  • Python 3+

    • wikipedia
    • bs4
    • networkx
    • requests
    • urllib.parse
  • Python 2 may be used by replacing urllib.parse with urllib in both ./requirements.txt and ./modules/functions.py

Usage

Install dependencies:

pip install -r requirements.txt

Run:

python3 main.py

Test with any of the word pairs in the results-images folder.

To do

  • Asynchronous Discovery
  • Indexing
  • N words
  • Explore wikipedia module for opportunities to optimise

About

Performs a wikipedia search of 2 keywords or phrases and then identifies a link between them. Intended to assist in creating a knowledge tree.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages