Skip to content

A simple Python wrapper to download tweets data from the Twitter Analytics platform. Particularly interesting for the impressions metrics that are unavailable on current Twitter API. Also works for the videos data.

Notifications You must be signed in to change notification settings

philippe2803/twitter-analytics-wrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

41 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Twitter analytics downloader

This script downloads the tweets report from the analytics section of a twitter account (including impressions). You can specify dates for period longer than the last 28 days default period from the Twitter analytics interface.

The twitter analytics platform used to have a limit of 91 days. In the latest iteration Twitter allows for periods of a month worth of data to be doenloaded. For periods longer thatn 28-31 days the script splits the downloading of reports in multiple requests.

This was created so we can get impressions data for every tweets as there is no API endpoints specifically for those metrics (as of today).

Installation

Selenium uses a few binaries (Chromedriver, xvfb) that needs to be installed beforehand with the following command:

$ sudo apt-get install chromium-chromedriver xvfb

Then you can install the library with pip

$ pip install twitter-analytics

A simple download for the last 28 days (default period) is done as follow:

from twitter_analytics import ReportDownloader


reports = ReportDownloader(
    username='<twitter username>',
    password='<twitter password>',
)

report_filepath = reports.run()

For specific date range and/or period over 90 days, you can launch the report download as follow:

from twitter_analytics import ReportDownloader
import csv


reports = ReportDownloader(
    username='<twitter username>',
    password='<twitter password>',
    from_date='03/28/2014',         # must be in string format 'mm/dd/yyyy' and nothing before October 2013 (twitter restriction).
    to_date='12/31/2016'
)

reports_filepath = reports.run()            # list of filepaths of downloaded csv reports

# Then you can parse the csv simply as follow
tweets = list()
for report in reports_filepath:
    with open(report, 'r') as csvfile:
        r = csv.DictReader(csvfile)
        rows = [row for row in r]
        tweets += rows

If you encounter issues, submit it on this repo. I also accept pull requests.

Mac OS install prerequisites

  • xvfb: Install XQuartz. Download the installer from here.

  • Chromedriver: The easiest way to obtain this is via Homebrew:

    $ /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
    
    $ brew tap homebrew/cask
    $ brew cask install chromedriver
    

Please note that chromedriver was migrated from homebrew/core to homebrew/cask.

If you are installing from this repository:

  1. Clone/Download (and unzip) this repo in a known location in your computer

  2. Open a terminal and navigate to the location chosen for step 1

  3. In the terminal type the following

    python setup.py install --force
    

About

A simple Python wrapper to download tweets data from the Twitter Analytics platform. Particularly interesting for the impressions metrics that are unavailable on current Twitter API. Also works for the videos data.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages