Brewery_Dataset_Quickstart.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Brewery Dataset Quick Start\n",
    "\n",
    "Version 1.1\n",
    "\n",
    "The Brewery Dataset is an Academic Hub dataset hosted by the OSIsoft Cloud Service (OCS, https://www.osisoft.com/solutions/cloud/vision/), a cloud-native real-time data infrastructure used to perform enterprise-wide analytics using tools and languages of the user's choice.   \n",
    "\n",
    "<div class=\"alert alert-info\">\n",
    "<b>For documentation about the Brewery dataset itself, please go to <a href=\"https://data.academic.osisoft.com/nbviewer/github/academic-hub/datasets/blob/master/Brewery_Dataset_Doc.ipynb\">https://data.academic.osisoft.com/nbviewer/github/academic-hub/datasets/blob/master/Brewery_Dataset_Doc.ipynb</a></b>\n",
    "</div>\n",
    "\n",
    "\n",
    "**Raw operational data has specific characteristics making it difficult to deal with directly**, among them:\n",
    "\n",
    "* variable data collection frequencies\n",
    "* bad values (system error codes)\n",
    "* data gaps \n",
    "\n",
    "\n",
    "**But data science projects using operational data needs to be:**\n",
    "\n",
    "* **Time-aligned** to deal with the characteritics above in consistent way according to the data type (e.g. interpolation for float values, repeat last good value for categorical data, etc)\n",
    "* **Context aware** so that the data can be understandable, across as many real-world assets that you need it for\n",
    "* **Shaped and filtered** to ensure you have the data you need, in the form you need it\n",
    "\n",
    "**The OCS solutions for application-ready data are Data Views:**\n",
    "\n",
    "![](https://academichub.blob.core.windows.net/images/piworld-dse-dataview-p2.png)\n",
    "\n",
    "**Each Academic Hub datasets comes endowed with a set of asset-centric data views.** \n",
    "\n",
    "The goal of Academic Hub Python library is to provide a very generic and consistent way to access:\n",
    "\n",
    "* the list of existing datasets\n",
    "* for a given dataset:\n",
    "  * the list of its assets\n",
    "  * the OCS namespace where the dataset is hosted\n",
    "* for a given asset, the list of data views it belongs to\n",
    "\n",
    "<div class=\"alert alert-info\">\n",
    "<b>The rest of this notebook is a working example of the functionality listed above for the Brewery dataset</b>\n",
    "</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Install Academic Hub Python library "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Requirement already satisfied: ocs-academic-hub==0.99.13 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (0.99.13)\n",
      "Requirement already satisfied: pandas>=0.24.2 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from ocs-academic-hub==0.99.13) (1.1.4)\n",
      "Requirement already satisfied: backoff in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from ocs-academic-hub==0.99.13) (1.10.0)\n",
      "Requirement already satisfied: gql in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from ocs-academic-hub==0.99.13) (2.0.0)\n",
      "Requirement already satisfied: ocs-sample-library-hub>=0.1.19 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from ocs-academic-hub==0.99.13) (0.1.19)\n",
      "Requirement already satisfied: python-dateutil>=2.8.0 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from ocs-academic-hub==0.99.13) (2.8.1)\n",
      "Requirement already satisfied: typeguard>=2.4.1 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from ocs-academic-hub==0.99.13) (2.10.0)\n",
      "Requirement already satisfied: numpy in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from ocs-academic-hub==0.99.13) (1.19.4)\n",
      "Requirement already satisfied: requests>=2.26 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from ocs-academic-hub==0.99.13) (2.26.0)\n",
      "Requirement already satisfied: pytz>=2017.2 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from pandas>=0.24.2->ocs-academic-hub==0.99.13) (2020.4)\n",
      "Requirement already satisfied: promise<3,>=2.3 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from gql->ocs-academic-hub==0.99.13) (2.3)\n",
      "Requirement already satisfied: six>=1.10.0 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from gql->ocs-academic-hub==0.99.13) (1.15.0)\n",
      "Requirement already satisfied: graphql-core<3,>=2.3.2 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from gql->ocs-academic-hub==0.99.13) (2.3.2)\n",
      "Requirement already satisfied: certifi>=2017.4.17 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from requests>=2.26->ocs-academic-hub==0.99.13) (2020.11.8)\n",
      "Requirement already satisfied: idna<4,>=2.5; python_version >= \"3\" in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from requests>=2.26->ocs-academic-hub==0.99.13) (2.10)\n",
      "Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= \"3\" in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from requests>=2.26->ocs-academic-hub==0.99.13) (2.0.7)\n",
      "Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from requests>=2.26->ocs-academic-hub==0.99.13) (1.25.11)\n",
      "Requirement already satisfied: rx<2,>=1.6 in c:\\users\\cfoisy\\anaconda3\\envs\\datapump\\lib\\site-packages (from graphql-core<3,>=2.3.2->gql->ocs-academic-hub==0.99.13) (1.6.1)\n"
     ]
    }
   ],
   "source": [
    "!pip install ocs-academic-hub==0.99.13"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Use the `pip uninstall` only in case of library issues"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "# It's sometimes necessary to uninstall previous versions, uncomment and run the following line. Then restart kernel and reinstall with previous cell\n",
    "# !pip uninstall -y ocs-academic-hub ocs-sample-library-preview"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Import HubClient, necessary to connect and interact with OCS"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "from ocs_academic_hub import HubClient"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Running the following cell initiate the login sequence\n",
    "\n",
    "**Warning:** a new brower tab will open offering the choice of identifying with Microsoft or Google. You should always pick Google:\n",
    "<img src=\"https://academichub.blob.core.windows.net/images/ocs-login-page-google.png\" alt=\"Login screen\" width=\"600\"/>\n",
    "\n",
    "Return to this web page when done"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Step 1: Get OAuth endpoint configuration...\n",
      "Step 2: Set up server to process authorization response...\n",
      "Step 3: Authorize the user...\n",
      "Step 4: Set server to handle one request...\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "127.0.0.1 - - [16/Nov/2021 16:33:38] \"GET /callback.html?code=8638C742747DEEA36F50A4E2173F8D546E1F264114B0EEAF20D098D6154BB164&scope=openid%20ocsapi&session_state=gBG1C1-Zy0_ecMoP9-Lhmn_ziOH1HeBtnAnBNRPUN20.D806D440F0ECE36BA04E73CB70814EDA HTTP/1.1\" 200 -\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Step 5: Get a token using the authorization code...\n",
      "Step 6: Access token read ok\n",
      "Complete!\n",
      "@ Hub data file: hub_datasets.json\n"
     ]
    }
   ],
   "source": [
    "hub = HubClient()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Refresh datasets information\n",
    "\n",
    "Over time existing datasets are updated and new ones are added. The cell below makes sure you have the latest version of the production datasets. \n",
    "\n",
    "Note: after execution of this method, a file named `hub_datasets.json` will be created in the same directory as this notebook. The data in this file supersedes the one built-in with the `ocs_academic_hub` module. To get back to the built-in datasets information, move/rename/delete `hub_datasets.json`. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "@ Hub data file: hub_datasets.json\n",
      "@ Current dataset: Brewery\n"
     ]
    }
   ],
   "source": [
    "hub.refresh_datasets()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get list of published hub datasets\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['Brewery', 'Campus_Energy', 'Champlain_College', 'Pilot_Plant', 'Wind_Farms']"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "hub.datasets()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Display current active dataset\n",
    "\n",
    "The default dataset is Brewery. Only one dataset can be active. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'Brewery'"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "hub.current_dataset()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get list of assets with Data Views\n",
    "\n",
    "Returned into the form of a pandas dataframe, with column `Asset_Id` and `Description`. Each asset has a unique `Asset_Id` as its identity. The Brewery dataset has a mix of bright tanks (prefixed `BB`), fermenter vessels (prefixed `FV`) and miscellaneous pieces of equipment. \n",
    "\n",
    "The cell below with `print` and `.to_string()` allows to see the whole dataframe content. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "          Asset_Id            Description\n",
      "0        Acid Tank                    AT1\n",
      "1              BA1                       \n",
      "2              BA2                       \n",
      "3             BB02            Bright Tank\n",
      "4        BB02 Line                       \n",
      "5             BB03            Bright Tank\n",
      "6             BB04            Bright Tank\n",
      "7             BB05            Bright Tank\n",
      "8             BB06            Bright Tank\n",
      "9             BB07            Bright Tank\n",
      "10            BB08            Bright Tank\n",
      "11            BB09            Bright Tank\n",
      "12            BB11            Bright Tank\n",
      "13            BB12            Bright Tank\n",
      "14            BB13            Bright Tank\n",
      "15            BB14            Bright Tank\n",
      "16            BB15            Bright Tank\n",
      "17   Beer Transfer  Beer TransferTemplate\n",
      "18         C1_BBL1            Bright Tank\n",
      "19          C1_BL1     Cellar 1 Beer Line\n",
      "20          C1_PS1                    PS1\n",
      "21          C1_PS2                    PS2\n",
      "22          C1_YL1    Cellar 1 Yeast Line\n",
      "23         C2_BBL1            Bright Tank\n",
      "24          C2_FT1     Cellar 2 Foam Tank\n",
      "25          C2_PS1                 C2_PS1\n",
      "26          C2_PS2                 C2_PS2\n",
      "27          C3_BL1     Cellar 3 Beer Line\n",
      "28          C3_FT1     Cellar 3 Foam Trap\n",
      "29          C3_YL1    Cellar 3 Yeast Line\n",
      "30            CNT1             Centrifuge\n",
      "31            CNT2             Centrifuge\n",
      "32            CST1                       \n",
      "33    Caustic Tank                    CT1\n",
      "34  Clean In Place                   CIP1\n",
      "35            FV01       Fermenter Vessel\n",
      "36            FV02       Fermenter Vessel\n",
      "37            FV08       Fermenter Vessel\n",
      "38            FV09       Fermenter Vessel\n",
      "39    FV1/FV2 Line            Supply Line\n",
      "40            FV10       Fermenter Vessel\n",
      "41            FV11       Fermenter Vessel\n",
      "42            FV12       Fermenter Vessel\n",
      "43            FV13       Fermenter Vessel\n",
      "44            FV14       Fermenter Vessel\n",
      "45            FV15       Fermenter Vessel\n",
      "46            FV16       Fermenter Vessel\n",
      "47            FV17       Fermenter Vessel\n",
      "48            FV18       Fermenter Vessel\n",
      "49            FV19       Fermenter Vessel\n",
      "50            FV20       Fermenter Vessel\n",
      "51            FV21       Fermenter Vessel\n",
      "52            FV22       Fermenter Vessel\n",
      "53            FV23       Fermenter Vessel\n",
      "54            FV24       Fermenter Vessel\n",
      "55            FV25       Fermenter Vessel\n",
      "56            FV26       Fermenter Vessel\n",
      "57            FV27       Fermenter Vessel\n",
      "58            FV28       Fermenter Vessel\n",
      "59            FV31       Fermenter Vessel\n",
      "60            FV32       Fermenter Vessel\n",
      "61            FV33       Fermenter Vessel\n",
      "62            FV34       Fermenter Vessel\n",
      "63            FV35       Fermenter Vessel\n",
      "64            FV36       Fermenter Vessel\n",
      "65            FV37       Fermenter Vessel\n",
      "66            FV38       Fermenter Vessel\n",
      "67            FV39       Fermenter Vessel\n",
      "68            FV40       Fermenter Vessel\n",
      "69            FV41       Fermenter Vessel\n",
      "70            FV42       Fermenter Vessel\n",
      "71            FV43       Fermenter Vessel\n",
      "72            FV44       Fermenter Vessel\n",
      "73            FV45       Fermenter Vessel\n",
      "74            FV46       Fermenter Vessel\n",
      "75          Loop 1                       \n",
      "76          Loop 2                       \n",
      "77             PZ1                       \n"
     ]
    }
   ],
   "source": [
    "print(hub.assets().to_string())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## List of all Data Views\n",
    "\n",
    "Those are all single-asset default (with all data available for the asset) Data Views"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['brewery-acid.tank',\n",
       " 'brewery-ba1',\n",
       " 'brewery-ba2',\n",
       " 'brewery-bb02',\n",
       " 'brewery-bb02.line',\n",
       " 'brewery-bb03',\n",
       " 'brewery-bb04',\n",
       " 'brewery-bb05',\n",
       " 'brewery-bb06',\n",
       " 'brewery-bb07',\n",
       " 'brewery-bb08',\n",
       " 'brewery-bb09',\n",
       " 'brewery-bb11',\n",
       " 'brewery-bb12',\n",
       " 'brewery-bb13',\n",
       " 'brewery-bb14',\n",
       " 'brewery-bb15',\n",
       " 'brewery-beer.transfer',\n",
       " 'brewery-c1_bbl1',\n",
       " 'brewery-c1_bl1',\n",
       " 'brewery-c1_ps1',\n",
       " 'brewery-c1_ps2',\n",
       " 'brewery-c1_yl1',\n",
       " 'brewery-c2_bbl1',\n",
       " 'brewery-c2_ft1',\n",
       " 'brewery-c2_ps1',\n",
       " 'brewery-c2_ps2',\n",
       " 'brewery-c3_bl1',\n",
       " 'brewery-c3_ft1',\n",
       " 'brewery-c3_yl1',\n",
       " 'brewery-caustic.tank',\n",
       " 'brewery-clean.in.place',\n",
       " 'brewery-cnt1',\n",
       " 'brewery-cnt2',\n",
       " 'brewery-cst1',\n",
       " 'brewery-fv01',\n",
       " 'brewery-fv02',\n",
       " 'brewery-fv08',\n",
       " 'brewery-fv09',\n",
       " 'brewery-fv10',\n",
       " 'brewery-fv11',\n",
       " 'brewery-fv12',\n",
       " 'brewery-fv13',\n",
       " 'brewery-fv14',\n",
       " 'brewery-fv15',\n",
       " 'brewery-fv16',\n",
       " 'brewery-fv17',\n",
       " 'brewery-fv18',\n",
       " 'brewery-fv19',\n",
       " 'brewery-fv1__fv2.line',\n",
       " 'brewery-fv20',\n",
       " 'brewery-fv21',\n",
       " 'brewery-fv22',\n",
       " 'brewery-fv23',\n",
       " 'brewery-fv24',\n",
       " 'brewery-fv25',\n",
       " 'brewery-fv26',\n",
       " 'brewery-fv27',\n",
       " 'brewery-fv28',\n",
       " 'brewery-fv31',\n",
       " 'brewery-fv32',\n",
       " 'brewery-fv33',\n",
       " 'brewery-fv34',\n",
       " 'brewery-fv35',\n",
       " 'brewery-fv36',\n",
       " 'brewery-fv37',\n",
       " 'brewery-fv38',\n",
       " 'brewery-fv39',\n",
       " 'brewery-fv40',\n",
       " 'brewery-fv41',\n",
       " 'brewery-fv42',\n",
       " 'brewery-fv43',\n",
       " 'brewery-fv44',\n",
       " 'brewery-fv45',\n",
       " 'brewery-fv46',\n",
       " 'brewery-loop.1',\n",
       " 'brewery-loop.2',\n",
       " 'brewery-pz1']"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "hub.asset_dataviews()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## List of Data Views exclusive to Fermenter Vessel #32 (FV32)\n",
    "\n",
    "Empty filter (`filter=\"\"`) allows to see all dataviews for the asset instead of simply the default one"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['brewery-fv32',\n",
       " 'brewery-fv32-adf_prediction',\n",
       " 'brewery-fv32-cooling_prediction',\n",
       " 'brewery-fv32-pca']"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "dvs_fv32 = hub.asset_dataviews(asset=\"FV32\", filter=\"\")\n",
    "dvs_fv32"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## List Multi-Asset Data Views Containing FV32\n",
    "\n",
    "The column `Asset_Id` in data view results indicates which asset the row of data belongs to "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['brewery-fv31--36',\n",
       " 'brewery-fv31--36-adf_prediction',\n",
       " 'brewery-fv31--36-cooling_prediction',\n",
       " 'brewery-fv31--36-pca']"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "hub.asset_dataviews(asset=\"FV32\", multiple_asset=True, filter=\"\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get the OCS namespace associated to the dataset\n",
    "\n",
    "Each data set belongs to a namespace within the Academic Hub OCS account. Since dataset may move over time, the function below always return the active namespace for the given dataset. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'academic_hub_01'"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "dataset = hub.current_dataset()\n",
    "namespace_id = hub.namespace_of(dataset)\n",
    "namespace_id"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get Data View structure\n",
    "\n",
    "With Stream Name, the column name under which stream data appears, its value type and engineering units if available. We display below the structure of the default data view. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "brewery-fv32\n",
      "Asset_Id              Column_Name Stream_Type Stream_UOM                        OCS_Stream_Name\n",
      "    FV32                      ADF       Float                                 B2_CL_C2_FV32/ADF\n",
      "    FV32           Bottom TIC OUT       Float          %          B2_CL_C2_FV32_TIC1380A/OUT.CV\n",
      "    FV32            Bottom TIC PV       Float         °F           B2_CL_C2_FV32_TIC1380A/PV.CV\n",
      "    FV32            Bottom TIC SP       Float         °F           B2_CL_C2_FV32_TIC1380A/SP.CV\n",
      "    FV32                    Brand    Category                            B2_CL_C2_FV32/BRAND.CV\n",
      "    FV32                Deviation       Float                B2_CL_C2_FV32/Prediction.Deviation\n",
      "    FV32                 Diacetyl     Integer        ppb                 B2_CL_C2_FV32/Diacetyl\n",
      "    FV32           End Phase Time       Float          m          B2_CL_C2_FV32/EndPhaseTime.CV\n",
      "    FV32            FV Full Plato       Float      Plato          B2_CL_C2_FV32/DcrsFvFullPlato\n",
      "    FV32  Fermentation Start Time   Timestamp             B2_CL_C2_FV32/Fermentation_Start_Time\n",
      "    FV32           Integrator Key       Float                      B2_CL_C2_FV32/Integrator Key\n",
      "    FV32           Middle TIC OUT       Float          %          B2_CL_C2_FV32_TIC1380B/OUT.CV\n",
      "    FV32            Middle TIC PV       Float         °F           B2_CL_C2_FV32_TIC1380B/PV.CV\n",
      "    FV32            Middle TIC SP       Float         °F           B2_CL_C2_FV32_TIC1380B/SP.CV\n",
      "    FV32                  PIC OUT       Float          %           B2_CL_C2_FV32_PIC1382/OUT.CV\n",
      "    FV32                   PIC PV       Float        psi            B2_CL_C2_FV32_PIC1382/PV.CV\n",
      "    FV32                   PIC SP       Float        psi            B2_CL_C2_FV32_PIC1382/SP.CV\n",
      "    FV32           Phase Duration     Integer                      B2_CL_C2_FV32/Phase Duration\n",
      "    FV32                    Plato       Float      Plato                    B2_CL_C2_FV32/Plato\n",
      "    FV32     Predicted Transition      String                B2_CL_C2_FV32/Predicted Transition\n",
      "    FV32                   Status    Category                           B2_CL_C2_FV32/STATUS.CV\n",
      "    FV32              Top TIC OUT       Float          %          B2_CL_C2_FV32_TIC1380C/OUT.CV\n",
      "    FV32               Top TIC PV       Float         °F           B2_CL_C2_FV32_TIC1380C/PV.CV\n",
      "    FV32               Top TIC SP       Float         °F           B2_CL_C2_FV32_TIC1380C/SP.CV\n",
      "    FV32         Vessel Procedure      String                     B2_CL_C2_FV32/VesselProcedure\n",
      "    FV32                 VesselID     Integer                            B2_CL_C2_FV32/VesselID\n",
      "    FV32                   Volume       Float        bbl             B2_CL_C2_FV32_LT1380/PV.CV\n",
      "    FV32                Volume In       Float        bbl        B2_CL_C2_FV32_FQ1380_A/TOTAL.CV\n",
      "    FV32               Volume Out       Float        bbl        B2_CL_C2_FV32_FQ1380_B/TOTAL.CV\n",
      "    FV32         Yeast Generation     Integer                         B2_CL_C2_FV32/YEASTGEN.CV\n",
      "    FV32      Yeast Out Totalizer       Float                   B2_CL_C2_FV32/YeastOutTotalizer\n",
      "    FV32             Yeast Strain    Category                            B2_CL_C2_FV32/YEAST.CV\n"
     ]
    }
   ],
   "source": [
    "dataview_id = hub.asset_dataviews(asset=\"FV32\", filter=\"default\")[0]\n",
    "print(dataview_id)\n",
    "print(hub.dataview_definition(namespace_id, dataview_id).to_string(index=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Getting interpolated data from a Data View\n",
    "\n",
    "Return interpolated data between a start and end date, with the requested interpolation interval (format is HH:MM:SS)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "  ==> Finished 'dataview_interpolated_pd' in       4.1001 secs [ 363 rows/sec ]\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Timestamp</th>\n",
       "      <th>Asset_Id</th>\n",
       "      <th>ADF</th>\n",
       "      <th>Volume</th>\n",
       "      <th>Volume In</th>\n",
       "      <th>Volume Out</th>\n",
       "      <th>Top TIC OUT</th>\n",
       "      <th>Top TIC PV</th>\n",
       "      <th>Top TIC SP</th>\n",
       "      <th>Middle TIC OUT</th>\n",
       "      <th>...</th>\n",
       "      <th>Deviation</th>\n",
       "      <th>Yeast Out Totalizer</th>\n",
       "      <th>End Phase Time</th>\n",
       "      <th>Vessel Procedure</th>\n",
       "      <th>Predicted Transition</th>\n",
       "      <th>Integrator Key</th>\n",
       "      <th>Phase Duration</th>\n",
       "      <th>Yeast Strain</th>\n",
       "      <th>Brand</th>\n",
       "      <th>Status</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2017-01-19 00:00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>0.104108</td>\n",
       "      <td>719.617</td>\n",
       "      <td>719.61707</td>\n",
       "      <td>0.0</td>\n",
       "      <td>8.699567</td>\n",
       "      <td>63.067005</td>\n",
       "      <td>63.0</td>\n",
       "      <td>17.355146</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>12.1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Realtime Hops</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2017-01-19 00:30:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>0.104108</td>\n",
       "      <td>719.617</td>\n",
       "      <td>719.61707</td>\n",
       "      <td>0.0</td>\n",
       "      <td>20.299335</td>\n",
       "      <td>63.055607</td>\n",
       "      <td>63.0</td>\n",
       "      <td>7.568751</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>12.1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Realtime Hops</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2017-01-19 01:00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>0.104108</td>\n",
       "      <td>719.617</td>\n",
       "      <td>719.61707</td>\n",
       "      <td>0.0</td>\n",
       "      <td>46.984615</td>\n",
       "      <td>63.241917</td>\n",
       "      <td>63.0</td>\n",
       "      <td>4.256329</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>12.1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Realtime Hops</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2017-01-19 01:30:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>0.104108</td>\n",
       "      <td>719.617</td>\n",
       "      <td>719.61707</td>\n",
       "      <td>0.0</td>\n",
       "      <td>74.284065</td>\n",
       "      <td>63.305080</td>\n",
       "      <td>63.0</td>\n",
       "      <td>17.092400</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>12.1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Realtime Hops</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2017-01-19 02:00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>0.104108</td>\n",
       "      <td>719.617</td>\n",
       "      <td>719.61707</td>\n",
       "      <td>0.0</td>\n",
       "      <td>42.702755</td>\n",
       "      <td>63.150780</td>\n",
       "      <td>63.0</td>\n",
       "      <td>46.463210</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>12.1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Realtime Hops</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1484</th>\n",
       "      <td>2017-02-18 22:00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>0.653248</td>\n",
       "      <td>725.297</td>\n",
       "      <td>725.29740</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>63.400000</td>\n",
       "      <td>68.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>337.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Kerberos</td>\n",
       "      <td>Diacetyl Rest</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1485</th>\n",
       "      <td>2017-02-18 22:30:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>0.653248</td>\n",
       "      <td>725.297</td>\n",
       "      <td>725.29740</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>63.350674</td>\n",
       "      <td>68.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>337.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Kerberos</td>\n",
       "      <td>Diacetyl Rest</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1486</th>\n",
       "      <td>2017-02-18 23:00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>0.653248</td>\n",
       "      <td>725.297</td>\n",
       "      <td>725.29740</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>63.199997</td>\n",
       "      <td>68.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>337.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Kerberos</td>\n",
       "      <td>Diacetyl Rest</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1487</th>\n",
       "      <td>2017-02-18 23:30:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>0.653248</td>\n",
       "      <td>725.297</td>\n",
       "      <td>725.29740</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>63.199997</td>\n",
       "      <td>68.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>337.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Kerberos</td>\n",
       "      <td>Diacetyl Rest</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1488</th>\n",
       "      <td>2017-02-19 00:00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>0.653248</td>\n",
       "      <td>725.297</td>\n",
       "      <td>725.29740</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>63.400000</td>\n",
       "      <td>68.0</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>337.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Kerberos</td>\n",
       "      <td>Diacetyl Rest</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1489 rows × 34 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "               Timestamp Asset_Id       ADF   Volume  Volume In  Volume Out  \\\n",
       "0    2017-01-19 00:00:00     FV32  0.104108  719.617  719.61707         0.0   \n",
       "1    2017-01-19 00:30:00     FV32  0.104108  719.617  719.61707         0.0   \n",
       "2    2017-01-19 01:00:00     FV32  0.104108  719.617  719.61707         0.0   \n",
       "3    2017-01-19 01:30:00     FV32  0.104108  719.617  719.61707         0.0   \n",
       "4    2017-01-19 02:00:00     FV32  0.104108  719.617  719.61707         0.0   \n",
       "...                  ...      ...       ...      ...        ...         ...   \n",
       "1484 2017-02-18 22:00:00     FV32  0.653248  725.297  725.29740         0.0   \n",
       "1485 2017-02-18 22:30:00     FV32  0.653248  725.297  725.29740         0.0   \n",
       "1486 2017-02-18 23:00:00     FV32  0.653248  725.297  725.29740         0.0   \n",
       "1487 2017-02-18 23:30:00     FV32  0.653248  725.297  725.29740         0.0   \n",
       "1488 2017-02-19 00:00:00     FV32  0.653248  725.297  725.29740         0.0   \n",
       "\n",
       "      Top TIC OUT  Top TIC PV  Top TIC SP  Middle TIC OUT  ...  Deviation  \\\n",
       "0        8.699567   63.067005        63.0       17.355146  ...        NaN   \n",
       "1       20.299335   63.055607        63.0        7.568751  ...        NaN   \n",
       "2       46.984615   63.241917        63.0        4.256329  ...        NaN   \n",
       "3       74.284065   63.305080        63.0       17.092400  ...        NaN   \n",
       "4       42.702755   63.150780        63.0       46.463210  ...        NaN   \n",
       "...           ...         ...         ...             ...  ...        ...   \n",
       "1484     0.000000   63.400000        68.0        0.000000  ...        NaN   \n",
       "1485     0.000000   63.350674        68.0        0.000000  ...        NaN   \n",
       "1486     0.000000   63.199997        68.0        0.000000  ...        NaN   \n",
       "1487     0.000000   63.199997        68.0        0.000000  ...        NaN   \n",
       "1488     0.000000   63.400000        68.0        0.000000  ...        NaN   \n",
       "\n",
       "      Yeast Out Totalizer  End Phase Time  Vessel Procedure  \\\n",
       "0                     NaN             NaN               NaN   \n",
       "1                     NaN             NaN               NaN   \n",
       "2                     NaN             NaN               NaN   \n",
       "3                     NaN             NaN               NaN   \n",
       "4                     NaN             NaN               NaN   \n",
       "...                   ...             ...               ...   \n",
       "1484                  NaN             NaN               NaN   \n",
       "1485                  NaN             NaN               NaN   \n",
       "1486                  NaN             NaN               NaN   \n",
       "1487                  NaN             NaN               NaN   \n",
       "1488                  NaN             NaN               NaN   \n",
       "\n",
       "      Predicted Transition  Integrator Key  Phase Duration  Yeast Strain  \\\n",
       "0                      NaN            12.1             NaN      NCYC1187   \n",
       "1                      NaN            12.1             NaN      NCYC1187   \n",
       "2                      NaN            12.1             NaN      NCYC1187   \n",
       "3                      NaN            12.1             NaN      NCYC1187   \n",
       "4                      NaN            12.1             NaN      NCYC1187   \n",
       "...                    ...             ...             ...           ...   \n",
       "1484                   NaN           337.0             NaN      NCYC1187   \n",
       "1485                   NaN           337.0             NaN      NCYC1187   \n",
       "1486                   NaN           337.0             NaN      NCYC1187   \n",
       "1487                   NaN           337.0             NaN      NCYC1187   \n",
       "1488                   NaN           337.0             NaN      NCYC1187   \n",
       "\n",
       "              Brand         Status  \n",
       "0     Realtime Hops   Fermentation  \n",
       "1     Realtime Hops   Fermentation  \n",
       "2     Realtime Hops   Fermentation  \n",
       "3     Realtime Hops   Fermentation  \n",
       "4     Realtime Hops   Fermentation  \n",
       "...             ...            ...  \n",
       "1484       Kerberos  Diacetyl Rest  \n",
       "1485       Kerberos  Diacetyl Rest  \n",
       "1486       Kerberos  Diacetyl Rest  \n",
       "1487       Kerberos  Diacetyl Rest  \n",
       "1488       Kerberos  Diacetyl Rest  \n",
       "\n",
       "[1489 rows x 34 columns]"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Use the first commented out line to access a full 3-year worth of data\n",
    "# df_fv32= hub.dataview_interpolated_pd(namespace_id, dataview_id, \"2017-01-19\", \"2020-01-19\", \"00:30:00\")\n",
    "# \n",
    "# This next line is for a single month of data\n",
    "df_fv32 = hub.dataview_interpolated_pd(namespace_id, dataview_id, \"2017-01-19\", \"2017-02-19\", \"00:30:00\")\n",
    "df_fv32"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 1489 entries, 0 to 1488\n",
      "Data columns (total 34 columns):\n",
      " #   Column                   Non-Null Count  Dtype         \n",
      "---  ------                   --------------  -----         \n",
      " 0   Timestamp                1489 non-null   datetime64[ns]\n",
      " 1   Asset_Id                 1489 non-null   object        \n",
      " 2   ADF                      753 non-null    float64       \n",
      " 3   Volume                   1486 non-null   float64       \n",
      " 4   Volume In                1486 non-null   float64       \n",
      " 5   Volume Out               1486 non-null   float64       \n",
      " 6   Top TIC OUT              1486 non-null   float64       \n",
      " 7   Top TIC PV               1486 non-null   float64       \n",
      " 8   Top TIC SP               1486 non-null   float64       \n",
      " 9   Middle TIC OUT           1486 non-null   float64       \n",
      " 10  Middle TIC PV            1486 non-null   float64       \n",
      " 11  Middle TIC SP            1486 non-null   float64       \n",
      " 12  Bottom TIC OUT           1486 non-null   float64       \n",
      " 13  Bottom TIC PV            1486 non-null   float64       \n",
      " 14  Bottom TIC SP            1486 non-null   float64       \n",
      " 15  PIC PV                   1486 non-null   float64       \n",
      " 16  PIC SP                   1486 non-null   float64       \n",
      " 17  Plato                    753 non-null    float64       \n",
      " 18  PIC OUT                  1486 non-null   float64       \n",
      " 19  FV Full Plato            1347 non-null   float64       \n",
      " 20  Fermentation Start Time  1303 non-null   object        \n",
      " 21  Yeast Generation         1486 non-null   float64       \n",
      " 22  Diacetyl                 932 non-null    float64       \n",
      " 23  VesselID                 1489 non-null   int64         \n",
      " 24  Deviation                0 non-null      float64       \n",
      " 25  Yeast Out Totalizer      0 non-null      float64       \n",
      " 26  End Phase Time           0 non-null      float64       \n",
      " 27  Vessel Procedure         0 non-null      float64       \n",
      " 28  Predicted Transition     0 non-null      float64       \n",
      " 29  Integrator Key           1489 non-null   float64       \n",
      " 30  Phase Duration           0 non-null      float64       \n",
      " 31  Yeast Strain             1489 non-null   object        \n",
      " 32  Brand                    1489 non-null   object        \n",
      " 33  Status                   1489 non-null   object        \n",
      "dtypes: datetime64[ns](1), float64(27), int64(1), object(5)\n",
      "memory usage: 395.6+ KB\n"
     ]
    }
   ],
   "source": [
    "# Information about the dataframe - this is a Pandas operation \n",
    "df_fv32.info()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Getting stored data from Data View\n",
    "\n",
    "Some analysis requires access to the raw (stored) sensor data instead of interpolated values. The method `hub.dataview_stored_pd` returns this information using a narrow CSV with the following 4 columns:\n",
    "\n",
    "| **Timestamp** | **Asset_Id** | **Field** | **Value** |\n",
    "\n",
    "where:\n",
    "\n",
    "* Timestamp: recorded time (ISO8601 format)\n",
    "* Asset_Id: asset identifier \n",
    "* Field: name of the sensor \n",
    "* Value: actual value recorded\n",
    "\n",
    "So each row corresponds to a single event. \n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "++++++++++++++++++++++++++++++++++++++++\n",
      "  ==> Finished 'dataview_stored_pd' in             57.6391 secs [ 17.36K rows/sec ]\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Timestamp</th>\n",
       "      <th>Asset_Id</th>\n",
       "      <th>Field</th>\n",
       "      <th>Value</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2017-01-19 05:39:13.047012300+00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>ADF</td>\n",
       "      <td>0.104108</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2017-01-19 05:49:00+00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>ADF</td>\n",
       "      <td>0.296614</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2017-01-19 13:29:13.340011500+00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>ADF</td>\n",
       "      <td>0.296614</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2017-01-19 16:13:00+00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>ADF</td>\n",
       "      <td>0.474311</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2017-01-19 21:19:13.616012500+00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>ADF</td>\n",
       "      <td>0.474311</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>663</th>\n",
       "      <td>2017-02-18 01:10:37.212005600+00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>Status</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>664</th>\n",
       "      <td>2017-02-18 06:24:38.409011800+00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>Status</td>\n",
       "      <td>Free Rise</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>665</th>\n",
       "      <td>2017-02-18 06:25:30.363006500+00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>Status</td>\n",
       "      <td>Diacetyl Rest</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>666</th>\n",
       "      <td>2017-02-18 14:20:37.643005300+00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>Status</td>\n",
       "      <td>Diacetyl Rest</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>667</th>\n",
       "      <td>2017-02-18 22:10:37.899002+00:00</td>\n",
       "      <td>FV32</td>\n",
       "      <td>Status</td>\n",
       "      <td>Diacetyl Rest</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1000668 rows × 4 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                              Timestamp Asset_Id   Field          Value\n",
       "0   2017-01-19 05:39:13.047012300+00:00     FV32     ADF       0.104108\n",
       "1             2017-01-19 05:49:00+00:00     FV32     ADF       0.296614\n",
       "2   2017-01-19 13:29:13.340011500+00:00     FV32     ADF       0.296614\n",
       "3             2017-01-19 16:13:00+00:00     FV32     ADF       0.474311\n",
       "4   2017-01-19 21:19:13.616012500+00:00     FV32     ADF       0.474311\n",
       "..                                  ...      ...     ...            ...\n",
       "663 2017-02-18 01:10:37.212005600+00:00     FV32  Status   Fermentation\n",
       "664 2017-02-18 06:24:38.409011800+00:00     FV32  Status      Free Rise\n",
       "665 2017-02-18 06:25:30.363006500+00:00     FV32  Status  Diacetyl Rest\n",
       "666 2017-02-18 14:20:37.643005300+00:00     FV32  Status  Diacetyl Rest\n",
       "667    2017-02-18 22:10:37.899002+00:00     FV32  Status  Diacetyl Rest\n",
       "\n",
       "[1000668 rows x 4 columns]"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Stored data for FV32, one month worth \n",
    "\n",
    "df_stored = hub.dataview_stored_pd(namespace_id, dataview_id, \"2017-01-19\", \"2017-02-19\")\n",
    "df_stored"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### NOTE: the maximum number of rows for stored DV is 2,000,000\n",
    "\n",
    "Depending on time range and how many events were recorded during that period, a single stored data view request may not contain all the data. \n",
    "\n",
    "The boolean method `hub.remaining_data()` returns `True` if more data exists. In this case, the `resume` option for `hub.dataview_stored_pd` should be set to true. \n",
    "\n",
    "The following cell shows:\n",
    "\n",
    "* How to request all stored data in a loop\n",
    "* Save one CSV file per stored data view result (with unique filename)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++\n",
      "  ==> Finished 'dataview_stored_pd' in             113.5466 secs [ 17.61K rows/sec ]\n",
      "Saving brewery-fv32-01.csv... done\n",
      "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++\n",
      "  ==> Finished 'dataview_stored_pd' in             118.8359 secs [ 16.83K rows/sec ]\n",
      "Saving brewery-fv32-02.csv... done\n",
      "+++++++++++++++\n",
      "  ==> Finished 'dataview_stored_pd' in             23.5318 secs [ 16.98K rows/sec ]\n",
      "Saving brewery-fv32-03.csv... done\n"
     ]
    }
   ],
   "source": [
    "i = 0\n",
    "while True:\n",
    "    i += 1\n",
    "    df_stored_chunk = hub.dataview_stored_pd(namespace_id, dataview_id, \"2017-01-19\", \"2017-06-19\", \n",
    "                                             resume=hub.remaining_data())\n",
    "    filename = f\"{dataview_id}-{i:02d}.csv\"\n",
    "    print(f\"Saving {filename}... \", end=\"\")\n",
    "    df_stored_chunk.to_csv(filename, index=False)\n",
    "    print(\"done\")\n",
    "    if not hub.remaining_data():\n",
    "        break"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Data Views with multiple assets\n",
    "\n",
    "Some Data Views return data for fermenter vessels 31 up to 36. Cell below is how to get their names. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['brewery-fv01--28', 'brewery-fv31--36', 'brewery-fv37--46']"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "multi_asset_dvs = hub.asset_dataviews(multiple_asset=True)\n",
    "multi_asset_dvs"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get result\n",
    "\n",
    "The column \"Asset_Id\" indicates which asset the data row belongs to. The data order is all data for FV31 in increasing time, followed by FV32 and so on up to FV36. \n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "++\n",
      "  ==> Finished 'dataview_interpolated_pd' in       10.7046 secs [ 754 rows/sec ]\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Timestamp</th>\n",
       "      <th>Asset_Id</th>\n",
       "      <th>ADF</th>\n",
       "      <th>Volume</th>\n",
       "      <th>Volume In</th>\n",
       "      <th>Volume Out</th>\n",
       "      <th>Top TIC OUT</th>\n",
       "      <th>Top TIC PV</th>\n",
       "      <th>Top TIC SP</th>\n",
       "      <th>Middle TIC OUT</th>\n",
       "      <th>...</th>\n",
       "      <th>Deviation</th>\n",
       "      <th>Yeast Out Totalizer</th>\n",
       "      <th>End Phase Time</th>\n",
       "      <th>Vessel Procedure</th>\n",
       "      <th>Predicted Transition</th>\n",
       "      <th>Integrator Key</th>\n",
       "      <th>Phase Duration</th>\n",
       "      <th>Yeast Strain</th>\n",
       "      <th>Brand</th>\n",
       "      <th>Status</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2017-02-01 00:00:00</td>\n",
       "      <td>FV31</td>\n",
       "      <td>0.719046</td>\n",
       "      <td>698.33700</td>\n",
       "      <td>698.33730</td>\n",
       "      <td>0.0</td>\n",
       "      <td>100.0</td>\n",
       "      <td>53.674717</td>\n",
       "      <td>30.0</td>\n",
       "      <td>100.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>-1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Grey Horse</td>\n",
       "      <td>Cooling</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2017-02-01 00:30:00</td>\n",
       "      <td>FV31</td>\n",
       "      <td>0.719046</td>\n",
       "      <td>698.33700</td>\n",
       "      <td>698.33730</td>\n",
       "      <td>0.0</td>\n",
       "      <td>100.0</td>\n",
       "      <td>52.928270</td>\n",
       "      <td>30.0</td>\n",
       "      <td>100.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>-1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Grey Horse</td>\n",
       "      <td>Cooling</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2017-02-01 01:00:00</td>\n",
       "      <td>FV31</td>\n",
       "      <td>0.719046</td>\n",
       "      <td>698.33700</td>\n",
       "      <td>698.33730</td>\n",
       "      <td>0.0</td>\n",
       "      <td>100.0</td>\n",
       "      <td>52.507034</td>\n",
       "      <td>30.0</td>\n",
       "      <td>100.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>-1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Grey Horse</td>\n",
       "      <td>Cooling</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2017-02-01 01:30:00</td>\n",
       "      <td>FV31</td>\n",
       "      <td>0.719046</td>\n",
       "      <td>698.33700</td>\n",
       "      <td>698.33730</td>\n",
       "      <td>0.0</td>\n",
       "      <td>100.0</td>\n",
       "      <td>51.933790</td>\n",
       "      <td>30.0</td>\n",
       "      <td>100.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>-1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Grey Horse</td>\n",
       "      <td>Cooling</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2017-02-01 02:00:00</td>\n",
       "      <td>FV31</td>\n",
       "      <td>0.719046</td>\n",
       "      <td>698.33700</td>\n",
       "      <td>698.33730</td>\n",
       "      <td>0.0</td>\n",
       "      <td>100.0</td>\n",
       "      <td>51.517723</td>\n",
       "      <td>30.0</td>\n",
       "      <td>100.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>-1.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Grey Horse</td>\n",
       "      <td>Cooling</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8065</th>\n",
       "      <td>2017-02-28 22:00:00</td>\n",
       "      <td>FV36</td>\n",
       "      <td>0.328751</td>\n",
       "      <td>743.10034</td>\n",
       "      <td>743.10034</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>64.711590</td>\n",
       "      <td>65.0</td>\n",
       "      <td>25.075735</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>8.4</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Adele</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8066</th>\n",
       "      <td>2017-02-28 22:30:00</td>\n",
       "      <td>FV36</td>\n",
       "      <td>0.328751</td>\n",
       "      <td>743.10034</td>\n",
       "      <td>743.10034</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>64.600006</td>\n",
       "      <td>65.0</td>\n",
       "      <td>60.707240</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>8.4</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Adele</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8067</th>\n",
       "      <td>2017-02-28 23:00:00</td>\n",
       "      <td>FV36</td>\n",
       "      <td>0.328751</td>\n",
       "      <td>743.10034</td>\n",
       "      <td>743.10034</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>64.600006</td>\n",
       "      <td>65.0</td>\n",
       "      <td>36.788890</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>8.4</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Adele</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8068</th>\n",
       "      <td>2017-02-28 23:30:00</td>\n",
       "      <td>FV36</td>\n",
       "      <td>0.328751</td>\n",
       "      <td>743.10034</td>\n",
       "      <td>743.10034</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>64.412796</td>\n",
       "      <td>65.0</td>\n",
       "      <td>39.635340</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>8.4</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Adele</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8069</th>\n",
       "      <td>2017-03-01 00:00:00</td>\n",
       "      <td>FV36</td>\n",
       "      <td>0.328751</td>\n",
       "      <td>743.10034</td>\n",
       "      <td>743.10034</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>64.600006</td>\n",
       "      <td>65.0</td>\n",
       "      <td>38.640602</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>8.4</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NCYC1187</td>\n",
       "      <td>Adele</td>\n",
       "      <td>Fermentation</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>8070 rows × 34 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "               Timestamp Asset_Id       ADF     Volume  Volume In  Volume Out  \\\n",
       "0    2017-02-01 00:00:00     FV31  0.719046  698.33700  698.33730         0.0   \n",
       "1    2017-02-01 00:30:00     FV31  0.719046  698.33700  698.33730         0.0   \n",
       "2    2017-02-01 01:00:00     FV31  0.719046  698.33700  698.33730         0.0   \n",
       "3    2017-02-01 01:30:00     FV31  0.719046  698.33700  698.33730         0.0   \n",
       "4    2017-02-01 02:00:00     FV31  0.719046  698.33700  698.33730         0.0   \n",
       "...                  ...      ...       ...        ...        ...         ...   \n",
       "8065 2017-02-28 22:00:00     FV36  0.328751  743.10034  743.10034         0.0   \n",
       "8066 2017-02-28 22:30:00     FV36  0.328751  743.10034  743.10034         0.0   \n",
       "8067 2017-02-28 23:00:00     FV36  0.328751  743.10034  743.10034         0.0   \n",
       "8068 2017-02-28 23:30:00     FV36  0.328751  743.10034  743.10034         0.0   \n",
       "8069 2017-03-01 00:00:00     FV36  0.328751  743.10034  743.10034         0.0   \n",
       "\n",
       "      Top TIC OUT  Top TIC PV  Top TIC SP  Middle TIC OUT  ...  Deviation  \\\n",
       "0           100.0   53.674717        30.0      100.000000  ...        NaN   \n",
       "1           100.0   52.928270        30.0      100.000000  ...        NaN   \n",
       "2           100.0   52.507034        30.0      100.000000  ...        NaN   \n",
       "3           100.0   51.933790        30.0      100.000000  ...        NaN   \n",
       "4           100.0   51.517723        30.0      100.000000  ...        NaN   \n",
       "...           ...         ...         ...             ...  ...        ...   \n",
       "8065          0.0   64.711590        65.0       25.075735  ...        NaN   \n",
       "8066          0.0   64.600006        65.0       60.707240  ...        NaN   \n",
       "8067          0.0   64.600006        65.0       36.788890  ...        NaN   \n",
       "8068          0.0   64.412796        65.0       39.635340  ...        NaN   \n",
       "8069          0.0   64.600006        65.0       38.640602  ...        NaN   \n",
       "\n",
       "      Yeast Out Totalizer  End Phase Time  Vessel Procedure  \\\n",
       "0                     NaN             NaN               NaN   \n",
       "1                     NaN             NaN               NaN   \n",
       "2                     NaN             NaN               NaN   \n",
       "3                     NaN             NaN               NaN   \n",
       "4                     NaN             NaN               NaN   \n",
       "...                   ...             ...               ...   \n",
       "8065                  NaN             NaN               NaN   \n",
       "8066                  NaN             NaN               NaN   \n",
       "8067                  NaN             NaN               NaN   \n",
       "8068                  NaN             NaN               NaN   \n",
       "8069                  NaN             NaN               NaN   \n",
       "\n",
       "      Predicted Transition  Integrator Key  Phase Duration  Yeast Strain  \\\n",
       "0                      NaN            -1.0             NaN      NCYC1187   \n",
       "1                      NaN            -1.0             NaN      NCYC1187   \n",
       "2                      NaN            -1.0             NaN      NCYC1187   \n",
       "3                      NaN            -1.0             NaN      NCYC1187   \n",
       "4                      NaN            -1.0             NaN      NCYC1187   \n",
       "...                    ...             ...             ...           ...   \n",
       "8065                   NaN             8.4             NaN      NCYC1187   \n",
       "8066                   NaN             8.4             NaN      NCYC1187   \n",
       "8067                   NaN             8.4             NaN      NCYC1187   \n",
       "8068                   NaN             8.4             NaN      NCYC1187   \n",
       "8069                   NaN             8.4             NaN      NCYC1187   \n",
       "\n",
       "           Brand        Status  \n",
       "0     Grey Horse       Cooling  \n",
       "1     Grey Horse       Cooling  \n",
       "2     Grey Horse       Cooling  \n",
       "3     Grey Horse       Cooling  \n",
       "4     Grey Horse       Cooling  \n",
       "...          ...           ...  \n",
       "8065       Adele  Fermentation  \n",
       "8066       Adele  Fermentation  \n",
       "8067       Adele  Fermentation  \n",
       "8068       Adele  Fermentation  \n",
       "8069       Adele  Fermentation  \n",
       "\n",
       "[8070 rows x 34 columns]"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_fv31_36 = hub.dataview_interpolated_pd(namespace_id, multi_asset_dvs[1], \"2017-02-01\", \"2017-03-01\", \"00:30:00\")\n",
    "df_fv31_36"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 8070 entries, 0 to 8069\n",
      "Data columns (total 34 columns):\n",
      " #   Column                   Non-Null Count  Dtype         \n",
      "---  ------                   --------------  -----         \n",
      " 0   Timestamp                8070 non-null   datetime64[ns]\n",
      " 1   Asset_Id                 8070 non-null   object        \n",
      " 2   ADF                      4051 non-null   float64       \n",
      " 3   Volume                   8070 non-null   float64       \n",
      " 4   Volume In                8070 non-null   float64       \n",
      " 5   Volume Out               8070 non-null   float64       \n",
      " 6   Top TIC OUT              8070 non-null   float64       \n",
      " 7   Top TIC PV               8070 non-null   float64       \n",
      " 8   Top TIC SP               8070 non-null   float64       \n",
      " 9   Middle TIC OUT           8070 non-null   float64       \n",
      " 10  Middle TIC PV            8070 non-null   float64       \n",
      " 11  Middle TIC SP            8070 non-null   float64       \n",
      " 12  Bottom TIC OUT           8070 non-null   float64       \n",
      " 13  Bottom TIC PV            8070 non-null   float64       \n",
      " 14  Bottom TIC SP            8070 non-null   float64       \n",
      " 15  PIC PV                   8070 non-null   float64       \n",
      " 16  PIC SP                   8070 non-null   float64       \n",
      " 17  Plato                    4051 non-null   float64       \n",
      " 18  PIC OUT                  8070 non-null   float64       \n",
      " 19  FV Full Plato            7350 non-null   float64       \n",
      " 20  Fermentation Start Time  7083 non-null   object        \n",
      " 21  Yeast Generation         8070 non-null   int64         \n",
      " 22  Diacetyl                 5652 non-null   float64       \n",
      " 23  VesselID                 8070 non-null   int64         \n",
      " 24  Deviation                0 non-null      float64       \n",
      " 25  Yeast Out Totalizer      0 non-null      float64       \n",
      " 26  End Phase Time           0 non-null      float64       \n",
      " 27  Vessel Procedure         0 non-null      float64       \n",
      " 28  Predicted Transition     0 non-null      float64       \n",
      " 29  Integrator Key           8070 non-null   float64       \n",
      " 30  Phase Duration           0 non-null      float64       \n",
      " 31  Yeast Strain             8070 non-null   object        \n",
      " 32  Brand                    8070 non-null   object        \n",
      " 33  Status                   8070 non-null   object        \n",
      "dtypes: datetime64[ns](1), float64(26), int64(2), object(5)\n",
      "memory usage: 2.1+ MB\n"
     ]
    }
   ],
   "source": [
    "df_fv31_36.info()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.9"
  },
  "toc": {
   "base_numbering": 1,
   "nav_menu": {},
   "number_sections": true,
   "sideBar": true,
   "skip_h1_title": false,
   "title_cell": "Table of Contents",
   "title_sidebar": "Contents",
   "toc_cell": false,
   "toc_position": {},
   "toc_section_display": true,
   "toc_window_display": false
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}