Skip to content

howawong/luigi_pipeline_demo

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits

data/jieba

data/jieba

 
 

README.md

README.md

 
 

apple_links.py

apple_links.py

 
 

config.py

config.py

 
 

content.py

content.py

 
 

keyword_scores.py

keyword_scores.py

 
 

keywords.py

keywords.py

 
 

likes.py

likes.py

 
 

requirements.txt

requirements.txt

 
 

sample_pipeline.py

sample_pipeline.py

 
 

Repository files navigation

luigi_pipeline_demo

Starting luigid / Central Scheduler

URL: http://localhost:8082/

luigid --background

How to run

python sample_pipeline.py Workflow

Dependency

flow

Tasks

RetrieveNewsLinksTask

RetrieveNewsContentTask

RetrieveNewsKeywordsTask

RetrieveNewsLikeCountsTask

RetrieveNewsKeywordsScoresTask

Result

result

About

Luigi Pipeline Demo for https://www.facebook.com/events/144094749445572/

Topics

python demo facebook news luigi jieba

Resources

Readme
Activity

Stars

0 stars

Watchers

2 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages