Skip to content

Performing various NLP tasks with the latest transformer libraries and engineering tools.

Notifications You must be signed in to change notification settings

vijpandaturtle/naturallang-transformers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 

Repository files navigation

Transformers for Natural Language Processing

Performing various NLP tasks with the latest transformer libraries and engineering tools. In this repo, the following tasks will be demonstrated (each task will have its own CLI) :

  1. Financial Sentiment Analysis from HTML news articles
python finsent.py --fpath 'data.txt' --model_name 'ProsusAI/finbert' --chunksize 512
  1. Named Entity Recognition
  2. Open Domain Question Answering with Transformers (Elasticsearch & Haystack)
  3. Masked Language Modelling
  4. Interpretability techniques on NLP Sentiment Analysis

Dependencies

  1. Huggingface Transformers
  2. PyTorch
  3. Trafilatura
  4. Haystack
  5. Elasticsearch
  6. FAISS

About

Performing various NLP tasks with the latest transformer libraries and engineering tools.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages