Author: Jan Haslik
Asura Crow is a project aimed at replicating the functionality of a basic search engine similar to Google. It involves crawling, indexing, and searching functionalities implemented using C++, Go, and MongoDB. Various algorithms such as TF-IDF and BM25 are applied to enhance the search results. Additionally, a responsive web application is constructed using React.js to provide a user-friendly interface for searching.
- Description: Responsible for crawling web pages using Go and saving the extracted information into MongoDB for indexing.
- Description: Implemented in C++, the indexer accesses MongoDB to perform indexing of crawled data and stores it efficiently for quick retrieval during searches.
- Description: Accesses the MongoDB database and delivers relevant information to the query using various algorithms like TF-IDF and BM25.
- Description: Fetches data from the Searcher API and provides an interface for interacting with the different components of the search engine. Additionally, it serves the React frontend as a Single Page Application (SPA).