main.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "[banner]: b1.png\n",
    "![banner]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Welcome to Destiny Subreddit Analyzer\n",
    "\n",
    "## How it works\n",
    "Currently the subreddits this analyzer works with are:\n",
    "- r/destinythegame\n",
    "- r/destiny2\n",
    "- r/lowsodiumdestiny\n",
    "- r/raidsecrets\n",
    "- r/crucibleplaybook\n",
    "\n",
    "Below you will find switches which let you turn on different types of informational charts on or off. As many of these charts can be extremely data intensive depending on the parameters you choose, I felt it was better to allow users to choose which charts they wanted to load instead of loading them all at once. Some of these charts will allow you to adjust their input parameters using widgets; these widgets will display after you select to turn a chart \"On\".\n",
    "\n",
    "For charts which allow you to change the input parameters, please be patient with it as the charts have to load again with the new parameters. It'll keep displaying the old chart until the new one is finished loading, at which point it will switch the chart to the new one. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "#imports\n",
    "import json\n",
    "import requests\n",
    "import pandas as pd\n",
    "from textblob import TextBlob\n",
    "from textblob.sentiments import NaiveBayesAnalyzer\n",
    "import numpy as np\n",
    "import plotly.express as px\n",
    "import ipywidgets as widgets\n",
    "import time\n",
    "from tqdm.notebook import tqdm as progbar"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "#functions\n",
    "\n",
    "def jprint(obj):\n",
    "    # create a formatted string of the Python JSON object\n",
    "    text = json.dumps(obj, sort_keys=True, indent=4)\n",
    "    print(text)\n",
    "    \n",
    "def format_comment(text):\n",
    "    l = text.split()\n",
    "    n = len(l)\n",
    "    i=1\n",
    "    result = l[0]\n",
    "    while i < n:\n",
    "        result = result + ' ' + l[i]\n",
    "        if (n % 20) == 0:\n",
    "            result = result + '\\n'\n",
    "        i += 1\n",
    "    return result\n",
    "\n",
    "def get_top_5_submissions():\n",
    "    #returns a list of dictionaries each reresenting 1 of the top 5 submissions from dtg from last day\n",
    "    submission_url = \"https://api.pushshift.io/reddit/search/submission/\"\n",
    "    paramdict = {'after': \"1d\", \"sort_type\":\"num_comments\",\"subreddit\":\"destinythegame\",\"size\":5, \"sort\":\"desc\"}\n",
    "    response = requests.get(url=submission_url, params= paramdict).json()\n",
    "    response_data = response[\"data\"]\n",
    "    results = []\n",
    "    for x in response_data:\n",
    "        temp = {}\n",
    "        temp[\"title\"]=x[\"title\"]\n",
    "        temp[\"author\"]=x[\"author\"]\n",
    "        temp[\"url\"] = x[\"url\"]\n",
    "        temp[\"num_comments\"]=x[\"num_comments\"]\n",
    "        temp[\"id\"]=x[\"id\"]\n",
    "        comment_json = requests.get('https://api.pushshift.io/reddit/submission/comment_ids/{}'.format(x[\"id\"])).json()\n",
    "        comment_array = comment_json['data']\n",
    "        temp['comment_ids']=comment_array\n",
    "        results.append(temp)\n",
    "    return results\n",
    "\n",
    "def get_submissions(**kwrgs):\n",
    "    #returns a list of dictionaries each reresenting 1 of the top 5 submissions from dtg from last day\n",
    "    submission_url = \"https://api.pushshift.io/reddit/search/submission/\"\n",
    "    response = requests.get(url=submission_url, params=kwargs).json()\n",
    "    response_data = response[\"data\"]\n",
    "    return response_data\n",
    "\n",
    "def get_comments(**kwrgs):\n",
    "    #returns a list of dictionaries each reresenting 1 of the top 5 submissions from dtg from last day\n",
    "    submission_url = \"https://api.pushshift.io/reddit/search/comment/\"\n",
    "    response = requests.get(url=submission_url, params=kwargs).json()\n",
    "    response_data = response[\"data\"]\n",
    "    return response_data\n",
    "\n",
    "\n",
    "def get_comments_from_ids(comment_id_array):\n",
    "    #returns a list of comments in string form seperated by \",\" for a set of comment ids\n",
    "    comment_url = \"https://api.pushshift.io/reddit/search/comment/\"\n",
    "    params_dict = {\"ids\": \", \".join(str(x) for x in comment_id_array), \"fields\":\"body\"}\n",
    "    result = requests.get(url=comment_url, params=params_dict).json()\n",
    "    data = result['data']\n",
    "    final_result  = []\n",
    "    for x in data:\n",
    "        final_result.append(x[\"body\"])\n",
    "    return final_result\n",
    "\n",
    "def analyze_comment(comment):\n",
    "    #returns a list containing a comment, its polarity, and subjectvity\n",
    "    blob = TextBlob(comment)\n",
    "    polarity, subjectivity = blob.sentiment\n",
    "    return polarity, subjectivity\n",
    "\n",
    "def daily_submissions():\n",
    "    #returns a list of dictionaries each reresenting 1 of the top 5 submissions from dtg from last day\n",
    "    submission_url = \"https://api.pushshift.io/reddit/search/submission/\"\n",
    "    paramdict = {'after': \"1d\",\"subreddit\":\"destinythegame\"}\n",
    "    response = requests.get(url=submission_url, params= paramdict).json()\n",
    "    response_data = response[\"data\"]\n",
    "    results = []\n",
    "    for x in response_data:\n",
    "        temp = {}\n",
    "        temp[\"title\"]=x[\"title\"].strip()\n",
    "        temp[\"author\"]=x[\"author\"].strip()\n",
    "        temp[\"url\"] = x[\"url\"].strip()\n",
    "        temp[\"num_comments\"]=x[\"num_comments\"]\n",
    "        temp[\"id\"]=x[\"id\"].strip()\n",
    "        temp['text'] = x['selftext'].strip()\n",
    "        results.append(temp)\n",
    "    return results\n",
    "\n",
    "def text_splitter(text):\n",
    "    l = text.split()\n",
    "    n = len(l)\n",
    "    i = 0\n",
    "    x = 1\n",
    "    results = {'results1':'', 'results2':'', 'results3':'', 'results4':''}\n",
    "    while i < n:\n",
    "        if (n- i) >= 20:\n",
    "            r = 'results'+str(x)\n",
    "            results[r]=' '.join(l[i:i+20])\n",
    "            i = i+20\n",
    "            x += 1\n",
    "        else:\n",
    "            r = 'results'+str(x)\n",
    "            results[r]= ' '.join(l[i:i+(n-i)])\n",
    "            break\n",
    "    return results['results1'], results['results2'], results['results3'], results['results4']\n",
    "         \n",
    "\n",
    "def get_submissions_df(subreddit, **kwargs):\n",
    "    #returns a list of dictionaries each reresenting 1 of the top 5 submissions from dtg from last day\n",
    "    submission_url = \"https://api.pushshift.io/reddit/search/submission/\"\n",
    "    kwargs['subreddit']=subreddit\n",
    "    response = requests.get(url=submission_url, params=kwargs)\n",
    "    try:\n",
    "        response = response.json()\n",
    "    except:\n",
    "        return None\n",
    "    response_data = response[\"data\"]\n",
    "    results = []\n",
    "    if len(response_data) < 1:\n",
    "        return None\n",
    "    for x in response_data:\n",
    "        try:\n",
    "            if isinstance(x['selftext'], str):\n",
    "                temp = {}\n",
    "                temp[\"title\"]=x[\"title\"].strip()\n",
    "                temp[\"author\"]=x[\"author\"].strip()\n",
    "                temp[\"url\"] = x[\"url\"].strip()\n",
    "                temp[\"num_comments\"]=x[\"num_comments\"]\n",
    "                temp[\"id\"]=x[\"id\"].strip()\n",
    "                temp['text'] = x['selftext'].strip()\n",
    "                temp['post_length'] = len(x['selftext'].split())\n",
    "                temp['date'] = pd.to_datetime(x['created_utc'], unit='s')\n",
    "                results.append(temp)\n",
    "        except:\n",
    "            pass\n",
    "    df = pd.DataFrame.from_dict(results)\n",
    "    df = df[df.text != '[removed]']\n",
    "    df = df[df.post_length > 10]\n",
    "    df['polarity'], df['subjectivity'] = zip(*df['text'].map(analyze_comment))\n",
    "    df['sentiment'] = df.apply(lambda x: 'positive' if x['polarity'] > 0 else 'negative', axis=1)\n",
    "    df['subreddit'] = subreddit\n",
    "    return df\n",
    "\n",
    "# def get_submissions_df(subreddit, **kwargs):\n",
    "#     #returns a list of dictionaries each reresenting 1 of the top 5 submissions from dtg from last day\n",
    "#     submission_url = \"https://api.pushshift.io/reddit/search/submission/\"\n",
    "#     kwargs['subreddit']=subreddit\n",
    "#     response = requests.get(url=submission_url, params=kwargs).json()\n",
    "\n",
    "#     response_data = response[\"data\"]\n",
    "#     results = []\n",
    "#     if len(response_data) < 1:\n",
    "#         return None\n",
    "#     for x in response_data:\n",
    "#         try:\n",
    "#             if isinstance(x['selftext'], str):\n",
    "#                 temp = {}\n",
    "#                 temp[\"title\"]=x[\"title\"].strip()\n",
    "#                 temp[\"author\"]=x[\"author\"].strip()\n",
    "#                 temp[\"url\"] = x[\"url\"].strip()\n",
    "#                 temp[\"num_comments\"]=x[\"num_comments\"]\n",
    "#                 temp[\"id\"]=x[\"id\"].strip()\n",
    "#                 temp['text'] = x['selftext'].strip()\n",
    "#                 temp['post_length'] = len(x['selftext'].split())\n",
    "#                 temp['date'] = pd.to_datetime(x['created_utc'], unit='s')\n",
    "#                 results.append(temp)\n",
    "#         except:\n",
    "#             pass\n",
    "#     df = pd.DataFrame.from_dict(results)\n",
    "#     df = df[df.text != '[removed]']\n",
    "#     df = df[df.post_length > 10]\n",
    "#     df['polarity'], df['subjectivity'] = zip(*df['text'].map(analyze_comment))\n",
    "#     df['sentiment'] = df.apply(lambda x: 'positive' if x['polarity'] > 0 else 'negative', axis=1)\n",
    "#     df['subreddit'] = subreddit\n",
    "#     return df\n",
    "\n",
    "# def get_submissions_df(subreddit, **kwargs):\n",
    "#     #returns a list of dictionaries each reresenting 1 of the top 5 submissions from dtg from last day\n",
    "#     submission_url = \"https://api.pushshift.io/reddit/search/submission/\"\n",
    "#     kwargs['subreddit']=subreddit\n",
    "#     response = requests.get(url=submission_url, params=kwargs)\n",
    "#     try:\n",
    "#         response = response.json()\n",
    "#     except:\n",
    "#         return None\n",
    "#     response_data = response[\"data\"]\n",
    "#     results = []\n",
    "#     if len(response_data) < 1:\n",
    "#         return None\n",
    "#     for x in response_data:\n",
    "#         try:\n",
    "#             if isinstance(x['selftext'], str):\n",
    "#                 temp = {}\n",
    "#                 temp[\"title\"]=x[\"title\"].strip()\n",
    "#                 temp[\"author\"]=x[\"author\"].strip()\n",
    "#                 temp[\"url\"] = x[\"url\"].strip()\n",
    "#                 temp[\"num_comments\"]=x[\"num_comments\"]\n",
    "#                 temp[\"id\"]=x[\"id\"].strip()\n",
    "#                 temp['text'] = x['selftext'].strip()\n",
    "#                 temp['post_length'] = len(x['selftext'].split())\n",
    "#                 temp['date'] = pd.to_datetime(x['created_utc'], unit='s')\n",
    "#                 results.append(temp)\n",
    "#         except:\n",
    "#             pass\n",
    "#     df = pd.DataFrame.from_dict(results)\n",
    "#     df = df[df.text != '[removed]']\n",
    "#     df = df[df.post_length > 10]\n",
    "#     df['polarity'], df['subjectivity'] = zip(*df['text'].map(analyze_comment))\n",
    "#     df['sentiment'] = df.apply(lambda x: 'positive' if x['polarity'] > 0 else 'negative', axis=1)\n",
    "#     df['subreddit'] = subreddit\n",
    "#     return df\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## A few example charts\n",
    "Hit on to see a few example charts"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "f21c2f092ac240d0988a47ca938c03fd",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "interactive(children=(ToggleButtons(button_style='success', description='Load Chart?', options=(('Off', False)…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "302c185360354dd29ea02f1516454887",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Output(layout=Layout(border='4px solid purple'))"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "def examples():\n",
    "    bar = progbar(range(0,5), desc='progress')\n",
    "    df = get_submissions_df(\"destinythegame\", after = \"1d\", size = 500)\n",
    "    df2 = get_submissions_df(\"destiny2\", after = \"1d\", size = 500)\n",
    "    #dfraid = get_submissions_df(\"raidsecrets\", after = \"1d\", size = 500)\n",
    "    #dfcrucible = get_submissions_df(\"crucibleplaybook\", after = \"1d\", size = 500)\n",
    "\n",
    "    df3 = df.append(df2)\n",
    "    bar.update(1)\n",
    "    fig1 = px.scatter(df, \n",
    "                      x='date',\n",
    "                      y='polarity',\n",
    "                     hover_data=[\"author\", \"id\"],\n",
    "                    marginal_x='histogram',\n",
    "                   color_discrete_sequence=[\"violet\", \"lightslategrey\"], # colors to use\n",
    "                   color=\"sentiment\", # what should the color depend on?\n",
    "                   size=\"num_comments\", # the more votes, the bigger the circle\n",
    "                   #size_max=10, # not too big\n",
    "                   labels={\"polarity\": \"Post Polarity\", \"date\": \"Date Posted\"}, # axis names\n",
    "                   title=f\"Sentiment analysis of r/destinythegame posts from previous 24 hours\", # title of figure\n",
    "     )\n",
    "\n",
    "    fig2 = px.scatter(df2, \n",
    "                      x='date',\n",
    "                      y='polarity',\n",
    "                     hover_data=[\"author\", \"id\"],\n",
    "                    marginal_x='histogram',\n",
    "                   color_discrete_sequence=[\"violet\", \"lightslategrey\"], # colors to use\n",
    "                   color=\"sentiment\", # what should the color depend on?\n",
    "                   size=\"num_comments\", # the more votes, the bigger the circle\n",
    "                   #size_max=10, # not too big\n",
    "                   labels={\"polarity\": \"Post Polarity\", \"date\": \"Date Posted\"}, # axis names\n",
    "                   title=f\"Sentiment analysis of r/destiny2 posts from previous 24 hours\", # title of figure\n",
    "     )\n",
    "\n",
    "\n",
    "\n",
    "\n",
    "    fig3 = px.scatter(df3, \n",
    "                      x='date',\n",
    "                      y='polarity',\n",
    "                     hover_data=['subreddit', \"id\"],\n",
    "                    marginal_x='histogram',\n",
    "                   color_discrete_sequence=[\"blue\", \"green\"], # colors to use\n",
    "                   color=\"subreddit\", # what should the color depend on?\n",
    "                   #size=\"num_comments\", # the more votes, the bigger the circle\n",
    "                   #size_max=10, # not too big\n",
    "                   labels={\"polarity\": \"Post Polarity\", \"date\": \"Date Posted\"},\n",
    "                      category_orders = {'subreddit': ['DestinyTheGame', 'Destiny2']},\n",
    "                      facet_col = 'subreddit',\n",
    "                   title=f\"r/destinythegame vs r/destiny2 posts from previous 24 hours\", # title of figure\n",
    "     )\n",
    "\n",
    "    bar.update(1)\n",
    "    # bargraph showing percentage of posts postive and negative, objective and subjective, for dtg and destiny2\n",
    "    labels = ['+polarity %', '-polarity %', 'subjective %', 'objective %']\n",
    "    dtg0 = [len(df[df.polarity >= 0]) / len(df), len(df[df.polarity < 0])/len(df), len(df[df.subjectivity >= .5])/len(df),\n",
    "          len(df[df.subjectivity < .5])/len(df)]\n",
    "    d20 = [len(df2[df2.polarity >= 0]) / len(df2), len(df2[df2.polarity < 0])/len(df2), len(df2[df2.subjectivity >= .5])/len(df2),\n",
    "          len(df2[df2.subjectivity < .5])/len(df2)]\n",
    "    dtg = dict(zip(labels, dtg0))\n",
    "    d2 = dict(zip(labels,d20))\n",
    "\n",
    "    labels2 = ['subreddit', 'rating', 'polarity/subjectvity', 'percent']\n",
    "    df4list = [dict(zip(labels2,['destinythegame', 'positive polarity', 'polarity', dtg0[0]])),\n",
    "               dict(zip(labels2,['destinythegame', 'negative polarity', 'polarity', dtg0[1]])),\n",
    "               dict(zip(labels2,['destinythegame', 'subjective', 'subjectivity', dtg0[2]])),\n",
    "               dict(zip(labels2,['destinythegame', 'objective', 'subjectivity', dtg0[3]])),\n",
    "               dict(zip(labels2,['destiny2', 'positive polarity', 'polarity', d20[0]])),\n",
    "               dict(zip(labels2,['destiny2', 'negative polarity', 'polarity', d20[1]])),\n",
    "               dict(zip(labels2,['destiny2', 'subjective', 'subjectivity', d20[2]])),\n",
    "               dict(zip(labels2,['destiny2', 'objective', 'subjectivity', d20[3]]))\n",
    "            ]\n",
    "\n",
    "    bar.update(1)\n",
    "    df4 = pd.DataFrame(df4list)\n",
    "    fig4 = px.bar(df4, x='polarity/subjectvity',\n",
    "                  y ='percent',\n",
    "                  color='rating',\n",
    "                  barmode='group',\n",
    "                  category_orders = {'subreddit': ['DestinyTheGame', 'Destiny2']},\n",
    "                  labels={'percent':'percent of total posts', 'polarity/subjectvity': 'sentiment analysis'},\n",
    "                  facet_col = 'subreddit',\n",
    "                 title='Comparison of post sentiment and subjectivity over last 24 hours for r/destinythegame vs r/destiny2')\n",
    "    bar.update(2)\n",
    "    fig1.show()\n",
    "    fig2.show()\n",
    "    fig3.show()\n",
    "    fig4.show()\n",
    "    \n",
    "def display_out_ex(x=False):\n",
    "    if x:\n",
    "        with outex:\n",
    "            display(examples())\n",
    "    else:\n",
    "        outex.clear_output()\n",
    "\n",
    "outex = widgets.Output(layout={'border': '4px solid purple'})\n",
    "\n",
    "woutex = widgets.ToggleButtons( options=[('Off', False),('On',True)],\n",
    "                          description='Load Chart?',\n",
    "                          disabled=False,\n",
    "                          button_style='success')\n",
    "widgets.interact(display_out_ex, x=woutex)\n",
    "display(outex)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Post frequency per subreddit\n",
    "Hit \"on\" then select which subreddits you would like to see the data for, the frequency is the timeframes you want to see the data aggregated into, and the days are just the amount of days you want to see data for.\n",
    "Be warned that if there is a point of data where the y value (# of posts) for a specific data point is much higher than  most of the other data points, you will barely be able to see the other data points plotted on the graph. This happens a lot when comparing r/destinythegame with other boards and is more likely to happen when you select longer time periods."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "5ce768fda6624310a57798e9821c5692",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "interactive(children=(ToggleButtons(button_style='success', description='Load Chart?', options=(('Off', False)…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "5d16c77d83934f78b822fa1e82ca77e9",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Output(layout=Layout(border='4px solid purple'))"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "#####OUTPUT 3###########\n",
    "#functions----------------\n",
    "def get_posts_aggs(subreddit, aggs, freq, days):\n",
    "    params_dict = {'after':str(days)+'d','subreddit':subreddit,\n",
    "                   'size':'0','fields':'aggs','aggs':aggs}\n",
    "    params_dict['frequency']=freq\n",
    "    submission_url = \"https://api.pushshift.io/reddit/search/submission/\"\n",
    "    response = requests.get(url=submission_url, params=params_dict).json()\n",
    "    response_data = response[\"aggs\"][aggs]\n",
    "    df = pd.DataFrame.from_dict(response_data)\n",
    "    return df\n",
    "\n",
    "def plot_posts_per_day(dtg, d2, lsd, rs, cp, freq, days):\n",
    "    \n",
    "    def fun(x):\n",
    "        thedate, thetime = str(x).split()\n",
    "        year, month, day = thedate.split('-')\n",
    "        hour, minute, second = thetime.split(':')\n",
    "        if freq is 'days':\n",
    "            return f'{year}-{month}-{day}'\n",
    "        elif freq is 'hour':\n",
    "            return f'{year}-{month}-{day} {hour}'\n",
    "        elif freq is 'minute':\n",
    "            return  f'{year}-{month}-{day} {hour}:{minute}'\n",
    "        else :\n",
    "            return  f'{year}-{month}-{day} {hour}:{minute}:{second}'\n",
    "    \n",
    "    bar = progbar(range(0,110), desc='progress')\n",
    "    \n",
    "    l = []\n",
    "    \n",
    "    if dtg:\n",
    "        l.append('destinythegame')\n",
    "    if d2:\n",
    "        l.append('destiny2')\n",
    "    if lsd:\n",
    "        l.append('lowsodiumdestiny')\n",
    "    if rs:\n",
    "        l.append('raidsecrets')\n",
    "    if cp:\n",
    "        l.append('crucibleplaybook')\n",
    "    \n",
    "    fig = ''\n",
    "    df = 1\n",
    "\n",
    "    if len(l) < 1:\n",
    "        return print('At least 1 subreddit must be selected')\n",
    "    barinc = (100/len(l))/2\n",
    "    for s in l:\n",
    "        bar.update(barinc)\n",
    "        if df is 1:\n",
    "            df = get_posts_aggs(s,'created_utc', freq, days)\n",
    "            bar.update(barinc)\n",
    "            df['date'] = pd.to_datetime(df['key'], unit='s')\n",
    "            df['date'] = df['date'].apply(fun)\n",
    "            df['subreddit'] = s\n",
    "            \n",
    "        else:\n",
    "            temp = get_posts_aggs(s,'created_utc', freq, days)\n",
    "            bar.update(barinc)\n",
    "            temp['date'] = pd.to_datetime(temp['key'], unit='s')\n",
    "            temp['date'] = temp['date'].apply(fun)\n",
    "            temp['subreddit'] = s\n",
    "            df = df.append(temp)\n",
    "\n",
    "    fig = px.bar(df, x='date',\n",
    "                 y ='doc_count',\n",
    "                 barmode='group',\n",
    "                 labels={'doc_count':'number of posts'},\n",
    "                 color='subreddit',\n",
    "                 title=f'Subreddit posts per {freq} for last {days} days')\n",
    "    bar.update(10)\n",
    "    \n",
    "    return fig.show()\n",
    "\n",
    "\n",
    "def display_out3(x=False):\n",
    "    if x:\n",
    "        with out3:\n",
    "            o = widgets.interactive(plot_posts_per_day,\n",
    "                                    dtg=check_dtg,\n",
    "                                    d2 = check_d2,\n",
    "                                    lsd = check_lsd,\n",
    "                                    rs = check_rs,\n",
    "                                    cp = check_cp,\n",
    "                                    days=toggle_days3,\n",
    "                                    freq=toggle_freq3)\n",
    "            display(o)\n",
    "    else:\n",
    "        out3.clear_output()\n",
    "        \n",
    "\n",
    "#widgets------------------------\n",
    "out3 = widgets.Output(layout={'border': '4px solid purple'})\n",
    "\n",
    "wout3 = widgets.ToggleButtons( options=[('Off', False),('On',True)],\n",
    "                          description='Load Chart?',\n",
    "                          disabled=False,\n",
    "                          button_style='success')\n",
    "\n",
    "toggle_subs3 = widgets.Dropdown( options=[('DestinyTheGame', 'destinythegame'),\n",
    "                                               ('Destiny2', 'destiny2'),\n",
    "                                               ('LowSodiumDestiny', 'lowsodiumdestiny'),\n",
    "                                              ('RaidSecrets', 'raidsecrets'),\n",
    "                                              ('CruciblePlaybook', 'crucibleplaybook'), ('All 5 subreddits', 'all')],\n",
    "                                value='destinythegame',\n",
    "                          description='Subreddit',\n",
    "                          disabled=False)\n",
    "\n",
    "toggle_days3 = widgets.Dropdown( options=['1', '7', '30', '182', '365'], \n",
    "                          description='Days',\n",
    "                            value = '1',\n",
    "                          disabled=False)\n",
    "\n",
    "toggle_freq3 = widgets.Dropdown( options=[('Day', 'day'),\n",
    "                                               ('Hour', 'hour')],\n",
    "                          description='Frequency',\n",
    "                            value = 'day',\n",
    "                          disabled=False)\n",
    "\n",
    "toggle_aggs3 = widgets.Dropdown( options=[\"author\", \"link_id\", \"created_utc\", \"subreddit\"],\n",
    "                          description='aggs type',\n",
    "                            value = 'author',\n",
    "                          disabled=False)\n",
    "#sub selection checkboxes\n",
    "\n",
    "check_dtg = widgets.Checkbox(\n",
    "    value=True,\n",
    "    description='r/destinythegame',\n",
    "    disabled=False)\n",
    "\n",
    "check_d2 = widgets.Checkbox(\n",
    "    value=False,\n",
    "    description='r/destiny2',\n",
    "    disabled=False)\n",
    "\n",
    "check_lsd = widgets.Checkbox(\n",
    "    value=False,\n",
    "    description='r/lowsodiumdestiny',\n",
    "    disabled=False)\n",
    "\n",
    "check_rs = widgets.Checkbox(\n",
    "    value=False,\n",
    "    description='r/raidsecrets',\n",
    "    disabled=False)\n",
    "\n",
    "check_cp = widgets.Checkbox(\n",
    "    value=False,\n",
    "    description='r/crucibleplaybook',\n",
    "    disabled=False)\n",
    "\n",
    "\n",
    "boxv3 = widgets.VBox([check_dtg, check_d2, check_lsd, check_rs, check_cp])\n",
    "\n",
    "#display-------------------------\n",
    "\n",
    "widgets.interact(display_out3, x=wout3)\n",
    "display(out3)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Sentiment Analysis of Posts for Last 30 Days of Selected Subreddit\n",
    "**WARNING: THIS CHART TAKES A LONG TIME TO LOAD FOR CERTAIN SUBREDDITS**\n",
    "\n",
    "This shows all the posts from the last 30 days of a selected subreddit, and plots the\n",
    "posts by their polarity (if the speaker express a positive or negative opinion). The size of the dots represents the number of comments on each post.\n",
    "This way you can see how well postive and negative posts do at attracting commentors.\n",
    "\n",
    "The bar chart looking thing on top is a histogram. It shows total number of positive posts versus total\n",
    "number of negative posts for the section of time represented by the area directly under each bar.\n",
    "\n",
    "Here is how polarity and subjectivity are calculated : https://planspace.org/20150607-textblob_sentiment/"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "0c9e3ea3c3de48bebde630e338a5679a",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "interactive(children=(ToggleButtons(button_style='success', description='Load Chart?', options=(('Off', False)…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "9b4b0589f9f64cf899f5f6efd0b64686",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Output(layout=Layout(border='4px solid black'))"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "#####OUTPUT 1#####\n",
    "#functions---------------------\n",
    "def sub_data(subreddit, days=30):\n",
    "    bar = progbar(range(0,31), desc='progress')\n",
    "    i = 2\n",
    "    j = 1\n",
    "    df = get_submissions_df(subreddit, after = '1d', size = 500)\n",
    "    bar.update(1)\n",
    "    while i <= days:\n",
    "        temp = get_submissions_df(subreddit, after = ''+str(i)+'d',before=''+str(j)+'d', size = 500)\n",
    "        if temp is None:\n",
    "            continue\n",
    "        df = df.append(temp)\n",
    "        i += 1\n",
    "        j += 1\n",
    "        bar.update(1)\n",
    "    fig = px.scatter(df, \n",
    "                  x='date',\n",
    "                  y='polarity',\n",
    "                 hover_data=[\"author\", \"id\"],\n",
    "                marginal_x='histogram',\n",
    "               color_discrete_sequence=[\"violet\", \"lightslategrey\"], # colors to use\n",
    "               color=\"sentiment\", # what should the color depend on?\n",
    "               size=\"num_comments\", # the more votes, the bigger the circle\n",
    "               #size_max=10, # not too big\n",
    "               labels={\"polarity\": \"Post Polarity\", \"date\": \"Date Posted\"}, # axis names\n",
    "               title=f\"Sentiment analysis of r/\"+subreddit+\" \"+\"last \" + str(days) + \" days\", # title of figure\n",
    "                 )\n",
    "    bar.update(1)\n",
    "    return fig.show()\n",
    "\n",
    "\n",
    "\n",
    "def display_out1(x=False):\n",
    "    if x:\n",
    "        with out1:\n",
    "            o = widgets.interactive(sub_data, subreddit=subreddit_select_widget, days=widgets.fixed(30))\n",
    "            display(o)\n",
    "    else:\n",
    "        out1.clear_output()\n",
    "        \n",
    "#widgets------------------------\n",
    "subreddit_select_widget = widgets.RadioButtons(\n",
    "    options=['destinythegame', 'destiny2', 'lowsodiumdestiny', 'raidsecrets', 'crucibleplaybook'],\n",
    "    value = 'lowsodiumdestiny',\n",
    "    description='subreddit',\n",
    "    disabled=False)\n",
    "\n",
    "out1 = widgets.Output(layout={'border': '4px solid black'})\n",
    "\n",
    "wout1 = widgets.ToggleButtons( options=[('Off', False),('On',True)],\n",
    "                          description='Load Chart?',\n",
    "                          disabled=False,\n",
    "                          button_style='success')\n",
    "\n",
    "\n",
    "#display-------------------------\n",
    "widgets.interact(display_out1, x=wout1)\n",
    "display(out1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Compare sentiment/subjectivity last 500 post from selected subreddits\n",
    "Hit \"On\" to load the widget and select a different subreddit from either one of the\n",
    "selection boxs to cause the chart to display.\n",
    "\n",
    "Here is how polarity and subjectivity are calculated : https://planspace.org/20150607-textblob_sentiment/\n",
    "\n",
    "Polarity is if the speaker express a positive or negative opinion.\n",
    "- negative (-1 to 0)\n",
    "- positive (0 to 1)\n",
    "\n",
    "Subjectivity can be objective (-1 to 0) or subjective (0 to 1)\n",
    "- objective (0 to .5) expressing or dealing with facts or conditions as perceived without distortion by personal feelings, prejudices, or interpretations\n",
    "- subjective (.5 to 1) based on or influenced by personal feelings, tastes, or opinions.\n",
    "\n",
    "This is based on using textblob on the content of a post as a whole. So its not going to be anything like perfect at capturing whats really going on in the most. Its just going to show how the post was written without getting any of the nuances of language such as irony. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "1285ab3f2d6140cd8176482d4e139a50",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "interactive(children=(ToggleButtons(button_style='success', description='Load Chart?', options=(('Off', False)…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "94795759bc0441ff9e1a94d39f63d843",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Output(layout=Layout(border='4px solid blue'))"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "#####Output 2#####\n",
    "\n",
    "#functions---------------------\n",
    "    \n",
    "def compare_subreddit_last_500_sidebyside(one,two):\n",
    "    bar = progbar(range(0,5), desc='progress')\n",
    "    count = 10\n",
    "    dflist = []\n",
    "    subs = [one,two]\n",
    "    #get posts for subs\n",
    "    for sub in subs:\n",
    "        i = 1\n",
    "        j = 0\n",
    "        x = 0\n",
    "        df = get_submissions_df(sub, after = '1d', size = 500)\n",
    "        while df is None:\n",
    "            i+=1\n",
    "            j+=1\n",
    "            df = get_submissions_df(sub, after = str(i)+'d', before=str(j)+'d', size = 500)\n",
    "            print('df was none ' + str(sub) +' ' + 'i= '+ str(i) + ' j = '+str(j))\n",
    "        x = len(df)\n",
    "        \n",
    "        if x > count:\n",
    "            df = df[:500]\n",
    "        else:\n",
    "            while x < count and i < count:\n",
    "                if i == count-1:\n",
    "                    print(\"i got to count\")\n",
    "                    return None\n",
    "                i+=1\n",
    "                j+=1\n",
    "                temp = get_submissions_df(sub, after = str(i)+'d', before=str(j)+'d', size = 500)\n",
    "                while temp is None:\n",
    "                    i+=1\n",
    "                    j+=1\n",
    "                    temp = get_submissions_df(sub, after = str(i)+'d', before=str(j)+'d', size = 500)\n",
    "                size = len(temp)\n",
    "                if (x + size) < count:\n",
    "                    df.append(temp)\n",
    "                    x += size\n",
    "                else:\n",
    "                    rest = count - x\n",
    "                    df.append(temp[:rest])\n",
    "                    x = 1000\n",
    "        #get polarity for sub:\n",
    "        bar.update(1)\n",
    "        measures = [len(df[df.polarity >= 0]) / len(df), len(df[df.polarity < 0])/len(df),\n",
    "                    len(df[df.subjectivity >= .5])/len(df),\n",
    "                    len(df[df.subjectivity < .5])/len(df)]\n",
    "        labels = ['subreddit', 'rating', 'polarity/subjectvity', 'percent']\n",
    "        templist = [dict(zip(labels,[sub, 'positive polarity', 'polarity', measures[0]])),\n",
    "               dict(zip(labels,[sub, 'negative polarity', 'polarity', measures[1]])),\n",
    "               dict(zip(labels,[sub, 'subjective', 'subjectivity', measures[2]])),\n",
    "               dict(zip(labels,[sub, 'objective', 'subjectivity', measures[3]]))]\n",
    "        for thing in templist:\n",
    "            dflist.append(thing)\n",
    "        bar.update(1)\n",
    "    #convert dataframe\n",
    "    df = pd.DataFrame(dflist)\n",
    "    fig = px.bar(df, x='polarity/subjectvity',\n",
    "              y ='percent',\n",
    "              color='rating',\n",
    "              barmode='group',\n",
    "              category_orders = {'subreddit': ['destinythegame','destiny2', 'lowsodiumdestiny',\n",
    "                                               'raidsecrets', 'crucibleplaybook']},\n",
    "              labels = {'percent':'percent of total posts', 'polarity/subjectvity': 'sentiment analysis'},\n",
    "              facet_col = 'subreddit',\n",
    "             title='Comparison of post sentiment and subjectivity over last 500 posts for various destiny subreddits')\n",
    "    bar.update(1)\n",
    "    fig.show()\n",
    "    \n",
    "\n",
    "def display_out2(x=False):\n",
    "    if x:\n",
    "        with out2:\n",
    "            o = widgets.interactive(compare_subreddit_last_500_sidebyside,\n",
    "                                           one=toggle_subs1, two=toggle_subs2)\n",
    "            display(o)\n",
    "    else:\n",
    "        out2.clear_output()\n",
    "\n",
    "#widgets---------------------------------------------------\n",
    "out2 = widgets.Output(layout={'border': '4px solid blue'})\n",
    "\n",
    "\n",
    "toggle_subs1 = widgets.Dropdown( options=[('DestinyTheGame', 'destinythegame'),\n",
    "                                               ('Destiny2', 'destiny2'),\n",
    "                                               ('LowSodiumDestiny', 'lowsodiumdestiny'),\n",
    "                                              ('RaidSecrets', 'raidsecrets'),\n",
    "                                              ('CruciblePlaybook', 'crucibleplaybook')],\n",
    "                                value='destinythegame',\n",
    "                          description='Subreddit 1',\n",
    "                          disabled=False)\n",
    "\n",
    "toggle_subs2 = widgets.Dropdown( options=[('DestinyTheGame', 'destinythegame'),\n",
    "                                               ('Destiny2', 'destiny2'),\n",
    "                                               ('LowSodiumDestiny', 'lowsodiumdestiny'),\n",
    "                                              ('RaidSecrets', 'raidsecrets'),\n",
    "                                              ('CruciblePlaybook', 'crucibleplaybook')],\n",
    "                          description='Subreddit 2',\n",
    "                            value = 'destiny2',\n",
    "                          disabled=False)\n",
    "\n",
    "\n",
    "\n",
    "wout2 = widgets.ToggleButtons( options=[('Off', False),('On',True)],\n",
    "                          description='Load Chart?',\n",
    "                          disabled=False,\n",
    "                          button_style='success')\n",
    "\n",
    "\n",
    "\n",
    "#output-------------------------------------\n",
    "widgets.interact(display_out2, x=wout2)\n",
    "\n",
    "display(out2)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Author Sentiment over last 500 posts\n",
    "This tool returns a plot of the last 500 posts by a user on the selected subreddit. The size of the plot points are related to the score of the comment (the size of the points increase as score grows above 0, scores less than 0 are normalized to 0). \n",
    "\n",
    "Here is how polarity and subjectivity are calculated : https://planspace.org/20150607-textblob_sentiment/\n",
    "\n",
    "The polarity of a post ranges from -1 to 1. Scores of -1 <= x < 0 are *negative polarity*. Scores of 0 <= x <= 1 are *positive polarity*. \n",
    "\n",
    "The subjectivity of a post ranges from 0 to 1. Scores of 0 <= x < 0.5 are *objective*. Scores of 0.5 <= x <= 1 are *subjective*.\n",
    "\n",
    "\n",
    "**Instructions:**\n",
    "- Select subreddit from dropdown\n",
    "- Type the name of the user you want to get info on\n",
    "- Hit the search button\n",
    "\n",
    "Note: attempting to change the name of the author after a chart has been produced will erase the chart and you will have to re-enter the name and hit the search button again for to bring the chart back up"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "850d264f39aa4caca2ae4b7ca2961c5b",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "interactive(children=(ToggleButtons(button_style='success', description='Load Chart?', options=(('Off', False)…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "45d13ac445bc4f7693a1a9946c623bf6",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Output(layout=Layout(border='4px solid red'))"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "#####OUTPUT 4#####\n",
    "#functions---------------------\n",
    "\n",
    "def get_author_df(subreddit, **kwargs):\n",
    "    #returns a list of dictionaries each reresenting 1 of the top 5 submissions from dtg from last day\n",
    "    submission_url = \"https://api.pushshift.io/reddit/search/comment/\"\n",
    "    kwargs['subreddit']=subreddit\n",
    "    response = requests.get(url=submission_url, params=kwargs)\n",
    "    try:\n",
    "        response = response.json()\n",
    "    except:\n",
    "        return None\n",
    "    response_data = response[\"data\"]\n",
    "    results = []\n",
    "    if len(response_data) < 1:\n",
    "        return None\n",
    "    for x in response_data:\n",
    "        try:\n",
    "            if isinstance(x['body'], str):\n",
    "                temp = {}\n",
    "                temp[\"author\"]=x[\"author\"].strip()\n",
    "                temp[\"body\"]=x[\"body\"].strip()\n",
    "                temp[\"score\"]=x[\"score\"]\n",
    "                temp['date'] = pd.to_datetime(x['created_utc'], unit='s')\n",
    "                results.append(temp)\n",
    "        except:\n",
    "            pass\n",
    "    df = pd.DataFrame.from_dict(results)\n",
    "    df = df[df.body != '[removed]']\n",
    "    df['marker_score'] = df['score'].apply(lambda x: 0 if x < 0 else x)\n",
    "    df['polarity_percent'], df['subjectivity_percent'] = zip(*df['body'].map(analyze_comment))\n",
    "    df['polarity'] = df.apply(lambda x: 'negative' if x['polarity_percent'] < 0 else 'positive', axis=1)\n",
    "    df['subjectivity'] = df.apply(lambda x: 'objective' if x['subjectivity_percent'] < .5 else 'subjective', axis=1)\n",
    "    df['subreddit'] = subreddit\n",
    "    return df\n",
    "\n",
    "\n",
    "def author_data(subreddit, author, search):\n",
    "    if search:\n",
    "        bar = progbar(range(0,3), desc='progress')\n",
    "        bar.update(1)\n",
    "        df = get_author_df(subreddit, author=author, size=500)\n",
    "        bar.update(1)\n",
    "        if df is None:\n",
    "            bar.update(1)\n",
    "            search4.value = False\n",
    "            return print('No data found for this username')\n",
    "        means = df.mean(axis=0)\n",
    "        pol_avg = \"negative\" if means['polarity_percent'] < 0 else 'positive'\n",
    "        sub_avg = 'objective' if means['subjectivity_percent'] < .5 else 'subjective'\n",
    "        pol_per = means['polarity_percent']\n",
    "        sub_per = means['subjectivity_percent']\n",
    "        print('Stats for this user')\n",
    "        print(f'Average polarity score of {pol_per: .2f} \\nAverage subjectivity score of {sub_per: .2f}')\n",
    "        print(f'On average, this users posts are {pol_avg} and {sub_avg}')\n",
    "        df = df.sort_values(by=['polarity_percent'])\n",
    "        fig = px.scatter(df, \n",
    "                      x='date',\n",
    "                      y='polarity_percent',\n",
    "                     hover_data=['polarity_percent', 'score'],\n",
    "                    marginal_x='histogram',\n",
    "                   color_discrete_sequence=[\"mediumvioletred\", \"cornflowerblue\"],\n",
    "                   color=\"polarity\", \n",
    "                   size=\"marker_score\",\n",
    "                   labels={\"polarity_percent\": \"Post Polarity\", \"date\": \"Date Posted\"},\n",
    "                   title=f\"Polarity score of last 500 posts by {author}\"\n",
    "                     )\n",
    "        df = df.sort_values(by=['subjectivity_percent'])\n",
    "        fig2 = px.scatter(df, \n",
    "                      x='date',\n",
    "                      y='subjectivity_percent',\n",
    "                     hover_data=['subjectivity_percent', 'score'],\n",
    "                    marginal_x='histogram',\n",
    "                   color_discrete_sequence=[\"seagreen\", \"darkorchid\"],\n",
    "                   color=\"subjectivity\", \n",
    "                   size=\"marker_score\",\n",
    "                   labels={\"subjectivity_percent\": \"Post Subjectivity\", \"date\": \"Date Posted\"},\n",
    "                   title=f\"Subjectivity score of last 500 posts by {author}\"\n",
    "                     )\n",
    "        bar.update(1)\n",
    "        fig.show()\n",
    "        fig2.show()\n",
    "        search4.value = False\n",
    "        return\n",
    "\n",
    "\n",
    "\n",
    "\n",
    "def display_out4(x=False):\n",
    "    if x:\n",
    "        with out4:\n",
    "            o = widgets.interactive(author_data, subreddit=toggle_subs4, author=author_text4,\n",
    "                                   search=search4)\n",
    "            display(o)\n",
    "    else:\n",
    "        out4.clear_output()\n",
    "        \n",
    "#widgets------------------------\n",
    "\n",
    "out4 = widgets.Output(layout={'border': '4px solid red'})\n",
    "\n",
    "toggle_subs4 = widgets.Dropdown( options=[('DestinyTheGame', 'destinythegame'),\n",
    "                                               ('Destiny2', 'destiny2'),\n",
    "                                               ('LowSodiumDestiny', 'lowsodiumdestiny'),\n",
    "                                              ('RaidSecrets', 'raidsecrets'),\n",
    "                                              ('CruciblePlaybook', 'crucibleplaybook')],\n",
    "                                value='destinythegame',\n",
    "                          description='Subreddit',\n",
    "                          disabled=False)\n",
    "\n",
    "\n",
    "wout4 = widgets.ToggleButtons( options=[('Off', False),('On',True)],\n",
    "                          description='Load Chart?',\n",
    "                          disabled=False,\n",
    "                          button_style='success')\n",
    "\n",
    "author_text4 = widgets.Text(placeholder='Enter author name here', description='Author',\n",
    "                           disabled=False)\n",
    "\n",
    "search4 = widgets.ToggleButton(\n",
    "    description='Start search',\n",
    "    disabled=False,\n",
    "    button_style='', # 'success', 'info', 'warning', 'danger' or ''\n",
    "    tooltip='Click to begin search',\n",
    "    icon='check'\n",
    ")\n",
    "\n",
    "\n",
    "\n",
    "\n",
    "#display-------------------------\n",
    "widgets.interact(display_out4, x=wout4)\n",
    "display(out4)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# About\n",
    "\n",
    "## Why?\n",
    "Well I noticed we have all kinds of nice tools to analyze in-game stats, but I didn't know of any tools to analyze\n",
    "the destiny community itself outside of the game. So I figured I'd play around with what I know and build up a set of\n",
    "tools that can be used to examine different aspects of the community starting with the destiny subreddits. \n",
    "\n",
    "This is currently just a quick demo to get it up and running,  but I hope to soon (before the end of January) have features that allow for customized search and data analysis of different aspects of the subreddit. This will be my first time creating something like this so any feedback or feature requests would be appreciated.\n",
    "\n",
    "## Things I'd like to add soon\n",
    "\n",
    "- Charts showing # pvp-focused posts vs # pve focused posts over time\n",
    "- User search to see stats about a users various posting habits, overall attitute (pos or negative), favorite curse words, favorite day to post, posts / comments per subreddit,  and whatever else people can think of that they might want\n",
    "- Post features most likely to get a bungie response (pvp or pve focused, specific words, time of post, etc)\n",
    "- Whatever else I can think up or is suggested to me\n",
    "\n",
    "## How it works\n",
    "\n",
    "This is all done using python and jupyter notebooks with Viola to create a dashboard from the notebook and\n",
    "Binder to deploy it to the web using github.\n",
    "\n",
    "### Libraries and Packages\n",
    "\n",
    "- **numpy** - matrix creation\n",
    "- **pandas** - data manipulation and cleaning\n",
    "- **requests** - accessing apis\n",
    "- **plotly** - creation of interactive plots\n",
    "- **textblob** - sentiment analysis of posts and comments\n",
    "- **voila** - creation of standalone web apps from jupyter notebooks [link](https://github.com/voila-dashboards/voila)\n",
    "- **ipywidgets** - widget creation\n",
    "\n",
    "### APIs\n",
    "**pushshift** - accesing reddit data [link](https://github.com/pushshift/api)\n",
    "\n",
    "### Servives\n",
    "**binder** - turn github repo into interactive notebook environment [link](https://mybinder.org/)\n",
    "\n",
    "\n",
    "## Contact Me\n",
    "\n",
    "Send complaints and suggestions to destiny_sub_analyzer@gmx.com"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}