Gradio_inference_on_LiLT_model_finetuned_on_DocLayNet_base_in_any_language_at_levelparagraphs_ml512.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "XznbrlmEuJC5"
      },
      "source": [
        "# Document AI | Inference APP at paragraph level with a Document Understanding model (LiLT fine-tuned on DocLayNet dataset)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "LW1SgajBuTuy"
      },
      "source": [
        "- Credit: \n",
        "  - notebook created from the notebook [Fine_tune_LiLT_on_a_custom_dataset_in_any_language.ipynb](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/LiLT/Fine_tune_LiLT_on_a_custom_dataset%2C_in_any_language.ipynb) of [Niels ROGGE](https://github.com/NielsRogge)\n",
        "  -  dataset from IBM Research ([DocLayNet](https://github.com/DS4SD/DocLayNet))\n",
        "- Author of this notebook: [Pierre GUILLOU](https://www.linkedin.com/in/pierreguillou/)\n",
        "- Date: 02/16/2023\n",
        "- Blog posts: \n",
        "  - Layout XLM base\n",
        "    - (03/05/2023) [Document AI | Inference APP and fine-tuning notebook for Document Understanding at line level with LayoutXLM base]()\n",
        "  - LiLT base\n",
        "    - (02/16/2023) [Document AI | Inference APP and fine-tuning notebook for Document Understanding at paragraph level](https://medium.com/@pierre_guillou/document-ai-inference-app-and-fine-tuning-notebook-for-document-understanding-at-paragraph-level-c18d16e53cf8)\n",
        "    - (02/14/2023) [Document AI | Inference APP for Document Understanding at line level](https://medium.com/@pierre_guillou/document-ai-inference-app-for-document-understanding-at-line-level-a35bbfa98893)\n",
        "    - (02/10/2023) [Document AI | Document Understanding model at line level with LiLT, Tesseract and DocLayNet dataset](https://medium.com/@pierre_guillou/document-ai-document-understanding-model-at-line-level-with-lilt-tesseract-and-doclaynet-dataset-347107a643b8)\n",
        "    - (01/31/2023) [Document AI | DocLayNet image viewer APP](https://medium.com/@pierre_guillou/document-ai-doclaynet-image-viewer-app-3ac54c19956)\n",
        "    - (01/27/2023) [Document AI | Processing of DocLayNet dataset to be used by layout models of the Hugging Face hub (finetuning, inference)](https://medium.com/@pierre_guillou/document-ai-processing-of-doclaynet-dataset-to-be-used-by-layout-models-of-the-hugging-face-hub-308d8bd81cdb)\n",
        "- Notebooks (paragraph level)\n",
        "  - LiLT base\n",
        "    - [Document AI | Inference APP at paragraph level with a Document Understanding model (LiLT fine-tuned on DocLayNet dataset)](https://github.com/piegu/language-models/blob/master/Gradio_inference_on_LiLT_model_finetuned_on_DocLayNet_base_in_any_language_at_levelparagraphs_ml512.ipynb)\n",
        "    - [Document AI | Inference at paragraph level with a Document Understanding model (LiLT fine-tuned on DocLayNet dataset)](https://github.com/piegu/language-models/blob/master/inference_on_LiLT_model_finetuned_on_DocLayNet_base_in_any_language_at_levelparagraphs_ml512.ipynb)\n",
        "    - [Document AI | Fine-tune LiLT on DocLayNet base in any language at paragraph level (chunk of 512 tokens with overlap)](https://github.com/piegu/language-models/blob/master/Fine_tune_LiLT_on_DocLayNet_base_in_any_language_at_paragraphlevel_ml_512.ipynb)\n",
        "- Notebooks (line level)\n",
        "  - Layout XLM base\n",
        "    - [Document AI | Inference at line level with a Document Understanding model (LayoutXLM base fine-tuned on DocLayNet dataset)](https://github.com/piegu/language-models/blob/master/inference_on_LayoutXLM_base_model_finetuned_on_DocLayNet_base_in_any_language_at_levellines_ml384.ipynb)\n",
        "    - [Document AI | Inference APP at line level with a Document Understanding model (LayoutXLM base fine-tuned on DocLayNet base dataset)](https://github.com/piegu/language-models/blob/master/Gradio_inference_on_LayoutXLM_base_model_finetuned_on_DocLayNet_base_in_any_language_at_levellines_ml384.ipynb)\n",
        "    - [Document AI | Fine-tune LayoutXLM base on DocLayNet base in any language at line level (chunk of 384 tokens with overlap)](https://github.com/piegu/language-models/blob/master/Fine_tune_LayoutXLM_base_on_DocLayNet_base_in_any_language_at_linelevel_ml_384.ipynb)\n",
        "  - LiLT base\n",
        "    - [Document AI | Inference at line level with a Document Understanding model (LiLT fine-tuned on DocLayNet dataset)](https://github.com/piegu/language-models/blob/master/inference_on_LiLT_model_finetuned_on_DocLayNet_base_in_any_language_at_levellines_ml384.ipynb)\n",
        "    - [Document AI | Inference APP at line level with a Document Understanding model (LiLT fine-tuned on DocLayNet dataset)](https://github.com/piegu/language-models/blob/master/Gradio_inference_on_LiLT_model_finetuned_on_DocLayNet_base_in_any_language_at_levellines_ml384.ipynb)\n",
        "    - [Document AI | Fine-tune LiLT on DocLayNet base in any language at line level (chunk of 384 tokens with overlap)](https://github.com/piegu/language-models/blob/master/Fine_tune_LiLT_on_DocLayNet_base_in_any_language_at_linelevel_ml_384.ipynb)\n",
        "    - [DocLayNet image viewer APP](https://github.com/piegu/language-models/blob/master/DocLayNet_image_viewer_APP.ipynb)\n",
        "    - [Processing of DocLayNet dataset to be used by layout models of the Hugging Face hub (finetuning, inference)](processing_DocLayNet_dataset_to_be_used_by_layout_models_of_HF_hub.ipynb)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "FpHg6WpKqVyV"
      },
      "source": [
        "## Inference at paragraph level"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "7GYz14mjI30i"
      },
      "source": [
        "LiLT (Language-Independent Layout Transformer) is a Document Understanding model that uses both layout and text in order to detect labels of bounding boxes.\n",
        "\n",
        "It relies on an external OCR engine to get words and bboxes from the document image. Thus, let's run in this APP an OCR engine ourselves ([PyTesseract](https://github.com/madmaze/pytesseract#python-tesseract)) as we'll need to do it in real life to get the bounding boxes, then run LiLT (already fine-tuned on the DocLayNet dataset at line level: [pierreguillou/lilt-xlm-roberta-base-finetuned-with-DocLayNet-base-at-linelevel-ml384](https://huggingface.co/pierreguillou/lilt-xlm-roberta-base-finetuned-with-DocLayNet-base-at-linelevel-ml384)) on the individual tokens and visualize the result at paragraph level!"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "-TEUFTN_ngoo"
      },
      "source": [
        "## Install PDF2image, LangDetect & PyTesseract OCR "
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "bflle1CCngoo"
      },
      "source": [
        "### PDF2image"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "yVYWSQdNngoo"
      },
      "outputs": [],
      "source": [
        "%%capture\n",
        "!apt-get install poppler-utils\n",
        "!pip install pdf2image"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### LangDetect"
      ],
      "metadata": {
        "id": "mnfTZnF4mQbh"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "!pip install -q langdetect"
      ],
      "metadata": {
        "id": "ifCo1BUsmRqk",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "2efb080c-2ba7-481b-89b7-bd3cd4f144f0"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "\u001b[?25l     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m0.0/981.5 KB\u001b[0m \u001b[31m?\u001b[0m eta \u001b[36m-:--:--\u001b[0m\r\u001b[2K     \u001b[91m━━━━━━━━━━━━\u001b[0m\u001b[91m╸\u001b[0m\u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m317.4/981.5 KB\u001b[0m \u001b[31m9.3 MB/s\u001b[0m eta \u001b[36m0:00:01\u001b[0m\r\u001b[2K     \u001b[91m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m\u001b[91m╸\u001b[0m \u001b[32m972.8/981.5 KB\u001b[0m \u001b[31m16.7 MB/s\u001b[0m eta \u001b[36m0:00:01\u001b[0m\r\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m981.5/981.5 KB\u001b[0m \u001b[31m11.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25h  Preparing metadata (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
            "  Building wheel for langdetect (setup.py) ... \u001b[?25l\u001b[?25hdone\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ibTxXBjfngop"
      },
      "source": [
        "### Tesseract OCR"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "nJr6VB10ngop"
      },
      "outputs": [],
      "source": [
        "%%capture\n",
        "!sudo apt install tesseract-ocr-all # english + osd (Orientation and script detection module)\n",
        "# !sudo apt-get install tesseract-ocr-por # portuguese\n",
        "\n",
        "import os\n",
        "print(os.popen(f'cat /etc/debian_version').read())\n",
        "print(os.popen(f'cat /etc/issue').read())\n",
        "print(os.popen(f'apt search tesseract').read())\n",
        "\n",
        "!pip install pytesseract"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "kv0y3aXf8Vv8"
      },
      "source": [
        "## Kill runtime"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "In Colab, it is needed in order to update libraries with their new installed version (pillow)."
      ],
      "metadata": {
        "id": "aN1xa3OvC8IU"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "import os\n",
        "os.kill(os.getpid(), 9)"
      ],
      "metadata": {
        "id": "AJssRCQYW7AM"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Set-up environment"
      ],
      "metadata": {
        "id": "XkVI_eWTDaAb"
      }
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "gA3leN0cdb3g"
      },
      "source": [
        "### Libraries"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "-bkmxJuxdb3g",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "84e02385-0bc7-4b3d-b5c5-abf1e4f865e0"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m6.3/6.3 MB\u001b[0m \u001b[31m41.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m469.0/469.0 KB\u001b[0m \u001b[31m35.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m14.3/14.3 MB\u001b[0m \u001b[31m74.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m244.3/244.3 KB\u001b[0m \u001b[31m23.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m7.6/7.6 MB\u001b[0m \u001b[31m56.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m199.1/199.1 KB\u001b[0m \u001b[31m10.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m212.2/212.2 KB\u001b[0m \u001b[31m22.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.0/1.0 MB\u001b[0m \u001b[31m40.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m132.9/132.9 KB\u001b[0m \u001b[31m10.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m110.5/110.5 KB\u001b[0m \u001b[31m10.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25h  Preparing metadata (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m50.5/50.5 KB\u001b[0m \u001b[31m4.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m140.9/140.9 KB\u001b[0m \u001b[31m12.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m84.5/84.5 KB\u001b[0m \u001b[31m5.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m71.5/71.5 KB\u001b[0m \u001b[31m2.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m56.3/56.3 KB\u001b[0m \u001b[31m5.4 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m56.9/56.9 KB\u001b[0m \u001b[31m6.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m2.1/2.1 MB\u001b[0m \u001b[31m80.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m106.5/106.5 KB\u001b[0m \u001b[31m10.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m45.7/45.7 KB\u001b[0m \u001b[31m4.1 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m199.2/199.2 KB\u001b[0m \u001b[31m20.0 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m264.6/264.6 KB\u001b[0m \u001b[31m25.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m114.2/114.2 KB\u001b[0m \u001b[31m11.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m158.8/158.8 KB\u001b[0m \u001b[31m13.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m66.4/66.4 KB\u001b[0m \u001b[31m7.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m69.6/69.6 KB\u001b[0m \u001b[31m8.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m58.3/58.3 KB\u001b[0m \u001b[31m6.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K     \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m80.6/80.6 KB\u001b[0m \u001b[31m8.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25h  Building wheel for ffmpy (setup.py) ... \u001b[?25l\u001b[?25hdone\n"
          ]
        }
      ],
      "source": [
        "!pip install -q transformers datasets gradio pypdf"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "vgk_wOQ8xezs"
      },
      "outputs": [],
      "source": [
        "import os \n",
        "from operator import itemgetter\n",
        "import collections\n",
        "import string\n",
        "import re\n",
        "\n",
        "import pypdf\n",
        "from pypdf import PdfReader\n",
        "from pypdf.errors import PdfReadError\n",
        "\n",
        "import pdf2image\n",
        "from pdf2image import convert_from_path\n",
        "import langdetect\n",
        "from langdetect import detect_langs\n",
        "import pytesseract\n",
        "\n",
        "import pandas as pd\n",
        "import numpy as np\n",
        "import random\n",
        "from google.colab import files\n",
        "\n",
        "import tempfile\n",
        "from matplotlib import font_manager\n",
        "from PIL import Image, ImageDraw, ImageFont\n",
        "import cv2\n",
        "# In Colab, use cv2_imshow instead of cv2.imshow\n",
        "from google.colab.patches import cv2_imshow\n",
        "from IPython.display import display\n",
        "\n",
        "import itertools\n",
        "import gradio as gr\n",
        "\n",
        "import pathlib\n",
        "from pathlib import Path\n",
        "import shutil"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Key parameters"
      ],
      "metadata": {
        "id": "TrlF26R14NYP"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# categories colors\n",
        "label2color = {\n",
        "    'Caption': 'brown',\n",
        "    'Footnote': 'orange',\n",
        "    'Formula': 'gray',\n",
        "    'List-item': 'yellow',\n",
        "    'Page-footer': 'red',\n",
        "    'Page-header': 'red',\n",
        "    'Picture': 'violet',\n",
        "    'Section-header': 'orange',\n",
        "    'Table': 'green',\n",
        "    'Text': 'blue',\n",
        "    'Title': 'pink'\n",
        "    }\n",
        "\n",
        "# bounding boxes start and end of a sequence\n",
        "cls_box = [0, 0, 0, 0]\n",
        "sep_box = cls_box\n",
        "\n",
        "# model\n",
        "model_id = \"pierreguillou/lilt-xlm-roberta-base-finetuned-with-DocLayNet-base-at-paragraphlevel-ml512\"\n",
        "\n",
        "# (tokenization) The maximum length of a feature (sequence)\n",
        "if str(384) in model_id:\n",
        "  max_length = 384 \n",
        "elif str(512) in model_id:\n",
        "  max_length = 512 \n",
        "else:\n",
        "  print(\"Error with max_length of chunks!\")\n",
        "\n",
        "# (tokenization) overlap\n",
        "doc_stride = 128 # The authorized overlap between two part of the context when splitting it is needed.\n",
        "\n",
        "# max PDF page images that will be displayed\n",
        "max_imgboxes = 2\n",
        "\n",
        "# get files\n",
        "examples_dir = 'files/'\n",
        "Path(examples_dir).mkdir(parents=True, exist_ok=True)\n",
        "from huggingface_hub import hf_hub_download\n",
        "files = [\"example.pdf\", \"blank.pdf\", \"blank.png\", \"languages_iso.csv\", \"languages_tesseract.csv\", \"wo_content.png\"]\n",
        "for file_name in files:\n",
        "    path_to_file = hf_hub_download(\n",
        "        repo_id = \"pierreguillou/Inference-APP-Document-Understanding-at-paragraphlevel-v1\", \n",
        "        filename = \"files/\" + file_name,\n",
        "        repo_type = \"space\"\n",
        "        )\n",
        "    shutil.copy(path_to_file,examples_dir)\n",
        "\n",
        "# path to files\n",
        "image_wo_content = examples_dir + \"wo_content.png\" # image without content\n",
        "pdf_blank = examples_dir + \"blank.pdf\" # blank PDF\n",
        "image_blank = examples_dir + \"blank.png\" # blank image\n",
        "\n",
        "## get langdetect2Tesseract dictionary\n",
        "t = \"files/languages_tesseract.csv\"\n",
        "l = \"files/languages_iso.csv\"\n",
        "\n",
        "df_t = pd.read_csv(t)\n",
        "df_l = pd.read_csv(l)\n",
        "\n",
        "langs_t = df_t[\"Language\"].to_list()\n",
        "langs_t = [lang_t.lower().strip().translate(str.maketrans('', '', string.punctuation)) for lang_t in langs_t]\n",
        "langs_l = df_l[\"Language\"].to_list()\n",
        "langs_l = [lang_l.lower().strip().translate(str.maketrans('', '', string.punctuation)) for lang_l in langs_l]\n",
        "langscode_t = df_t[\"LangCode\"].to_list()\n",
        "langscode_l = df_l[\"LangCode\"].to_list()\n",
        "\n",
        "Tesseract2langdetect, langdetect2Tesseract = dict(), dict()\n",
        "for lang_t, langcode_t in zip(langs_t,langscode_t):\n",
        "  try:\n",
        "    if lang_t == \"Chinese - Simplified\".lower().strip().translate(str.maketrans('', '', string.punctuation)): lang_t = \"chinese\"\n",
        "    index = langs_l.index(lang_t)\n",
        "    langcode_l = langscode_l[index]\n",
        "    Tesseract2langdetect[langcode_t] = langcode_l\n",
        "  except: \n",
        "    continue\n",
        "\n",
        "langdetect2Tesseract = {v:k for k,v in Tesseract2langdetect.items()}"
      ],
      "metadata": {
        "id": "M5lNEstH4P39",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "referenced_widgets": [
            "f8307f5d20ae466cabbc5a737319c656",
            "3d6bfe0ff5fa43f382ba753e74fa7746",
            "7027515efa2e417b80548d29c27509d6",
            "397ffd57dffb4d639cb1fd914f289e6c",
            "54fa820ed125449a911b201d06658e69",
            "a8f703e7444d453b95c4805ade8d669d",
            "3d930a7331c3454eb6dd28e955526cb4",
            "ba21f339c2d44e69839cb80cdcdc6a0c",
            "b5191e2b11574755b772603e4128249b",
            "d821b2128fba43baaf9819965b994642",
            "83f152978275437183117e98bbf7398d",
            "8257d4352bc64e9abf9d55a7a95bb588",
            "ba3ecaf3e3924807a34c1870ae4e7287",
            "858ff01c7540454db9efa8069ceaa3c3",
            "e0c2d088295e40c385c4e0e14c46c763",
            "27bab17403ba49b9bc2628f43f3b1ff0",
            "0d34e8a615824fada2c5ca9a34ab9cf5",
            "1efab4667e1946e5b6f426bd6742b693",
            "05bf650484bf45149bdb4067c0153635",
            "8801f2ab59714e769b8dd190c1d3e260",
            "d6176327252f4c22854bfbff9c6c5b16",
            "eea1c16252df4394a1719f465fe78645",
            "53d43cc7792345caa880ac8e5ed2e8f1",
            "f03a72ad34fc45e3bedfbd2a1bebdb41",
            "62760e1b567d434299547c66450ecda9",
            "3ec12e2e6d0d4fcf9a769f93b853abd1",
            "e488059a8d014d8581399c0d19558025",
            "1fda4ef537414154a6b8622b656e4496",
            "08d4e34851f64022b8bbdc200a06380d",
            "d30100bb94664b4cb4edb4e1e3c3277c",
            "e3cb2dacd99b46ba8520f1216c55b327",
            "5fa8f42ccb53457cab95a809936c7d26",
            "3b493fcc3d2449f998eddac1e5879436",
            "174236ee673340939d7835cff792f4e4",
            "d5bc16b25e0c4c0a83d46c43aa3a982f",
            "592aa146667346b3b2b9b7929ad0667d",
            "436f6a41bbb14382b6907340639a9535",
            "7c662d15d6864f0d95bcb910f8167a8e",
            "602f742904bd452cb0d4fcf1e9ccb578",
            "c14ce5e15ef546a081e8fcabd576f8cf",
            "39a4ac3a42c6455690bdaaa0cbf777ee",
            "5a4fa1d42e104660a395fcf358768040",
            "6280caf8330d42e5a327388a3db7ec54",
            "8a33ea70dea4475794dfe5d4f454fa58",
            "c72596e503b943d9baafa9d165096cf5",
            "58aecf0e47e1411d9e980fc924aa4e26",
            "358aafe4ad91430683ec684c97050dd0",
            "2b923764935b4f90bb977bc3a5756785",
            "c04f1a3841544271837e6ec9019cd5e3",
            "60ae20f91f72456891af6e3e17d880ef",
            "8ea4854353e94d34a33bbaac87251f37",
            "0fd1388539e4446ba6e0004301cbfd81",
            "a901d27ec12d479e8b04a79b64d47a29",
            "8194077608994b53abe690d8a58b70cf",
            "fb94b041e3c44541aaf8b3a645ce36fc",
            "22c225da3e5547c8854f8a1c30a254cc",
            "2d63611bd2ff421082ced7cdbe60df58",
            "169ec589b18a46ce842ba99550813864",
            "e19abc210c544625aad60c85bddcfeb2",
            "8c84ca93833f4c9b95e8f7a435b79cdf",
            "aa1d26b4c4d94980bc78c1035d2acd10",
            "b2635c3e0f914c67ad775c73c0fe2e6e",
            "01f3c149e4574e4dbd885a2bbf49821d",
            "bb8d3eb84bbe498f95da693054203435",
            "2331d8fa504f4d8c87eecd1bb8c578c8",
            "37dad57a21754e8ab3d3ebb4bd5048a2"
          ]
        },
        "outputId": "f2d25cc8-5953-43c1-d2ae-60607c8308fd"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading (…)in/files/example.pdf:   0%|          | 0.00/343k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "f8307f5d20ae466cabbc5a737319c656"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading (…)main/files/blank.pdf:   0%|          | 0.00/1.15k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "8257d4352bc64e9abf9d55a7a95bb588"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading (…)main/files/blank.png:   0%|          | 0.00/3.99k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "53d43cc7792345caa880ac8e5ed2e8f1"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading (…)es/languages_iso.csv:   0%|          | 0.00/2.52k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "174236ee673340939d7835cff792f4e4"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading (…)guages_tesseract.csv:   0%|          | 0.00/2.13k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "c72596e503b943d9baafa9d165096cf5"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading (…)files/wo_content.png:   0%|          | 0.00/27.6k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "22c225da3e5547c8854f8a1c30a254cc"
            }
          },
          "metadata": {}
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Functions"
      ],
      "metadata": {
        "id": "vTaFBY91nUWa"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "#### General"
      ],
      "metadata": {
        "id": "WO1bn3pmNzmX"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# get text and bounding boxes from an image\n",
        "# https://stackoverflow.com/questions/61347755/how-can-i-get-line-coordinates-that-readed-by-tesseract\n",
        "# https://medium.com/geekculture/tesseract-ocr-understanding-the-contents-of-documents-beyond-their-text-a98704b7c655\n",
        "def get_data_paragraph(results, factor, conf_min=0):\n",
        "\n",
        "  data = {}\n",
        "  for i in range(len(results['line_num'])):\n",
        "    level = results['level'][i]\n",
        "    block_num = results['block_num'][i]\n",
        "    par_num = results['par_num'][i]\n",
        "    line_num = results['line_num'][i]\n",
        "    top, left = results['top'][i], results['left'][i]\n",
        "    width, height = results['width'][i], results['height'][i]\n",
        "    conf = results['conf'][i]\n",
        "    text = results['text'][i]\n",
        "    if not (text == '' or text.isspace()):\n",
        "      if conf >= conf_min:\n",
        "        tup = (text, left, top, width, height)\n",
        "        if block_num in list(data.keys()):\n",
        "          if par_num in list(data[block_num].keys()):\n",
        "            if line_num in list(data[block_num][par_num].keys()):\n",
        "              data[block_num][par_num][line_num].append(tup)\n",
        "            else:\n",
        "              data[block_num][par_num][line_num] = [tup]\n",
        "          else:\n",
        "            data[block_num][par_num] = {}\n",
        "            data[block_num][par_num][line_num] = [tup]\n",
        "        else:\n",
        "            data[block_num] = {}\n",
        "            data[block_num][par_num] = {}\n",
        "            data[block_num][par_num][line_num] = [tup]\n",
        "\n",
        "  # get paragraphs dicionnary with list of lines\n",
        "  par_data = {}\n",
        "  par_idx = 1\n",
        "  for _, b  in data.items():\n",
        "    for _, p in b.items():\n",
        "      line_data = {}\n",
        "      line_idx = 1\n",
        "      for _, l in p.items():\n",
        "        line_data[line_idx] = l\n",
        "        line_idx += 1\n",
        "      par_data[par_idx] = line_data \n",
        "      par_idx += 1\n",
        "\n",
        "  # get lines of texts, grouped by paragraph\n",
        "  texts_pars = list()\n",
        "  row_indexes = list()\n",
        "  texts_lines = list()\n",
        "  texts_lines_par = list()\n",
        "  row_index = 0\n",
        "  for _,par in par_data.items():\n",
        "    count_lines = 0\n",
        "    lines_par = list()\n",
        "    for _,line in par.items():\n",
        "      if count_lines == 0: row_indexes.append(row_index)\n",
        "      line_text = ' '.join([item[0] for item in line])\n",
        "      texts_lines.append(line_text)\n",
        "      lines_par.append(line_text)\n",
        "      count_lines += 1\n",
        "      row_index += 1\n",
        "    # lines.append(\"\\n\")\n",
        "    row_index += 1\n",
        "    texts_lines_par.append(lines_par)\n",
        "    texts_pars.append(' '.join(lines_par))\n",
        "  # lines = lines[:-1]\n",
        "  \n",
        "  # get paragraphes boxes (par_boxes)\n",
        "  # get lines boxes (line_boxes)\n",
        "  par_boxes = list()\n",
        "  par_idx = 1\n",
        "  line_boxes, lines_par_boxes = list(), list()\n",
        "  line_idx = 1\n",
        "  for _, par in par_data.items():\n",
        "    xmins, ymins, xmaxs, ymaxs = list(), list(), list(), list()\n",
        "    line_boxes_par = list()\n",
        "    count_line_par = 0\n",
        "    for _, line in par.items():\n",
        "      xmin, ymin = line[0][1], line[0][2]\n",
        "      xmax, ymax = (line[-1][1] + line[-1][3]), (line[-1][2] + line[-1][4])\n",
        "      line_boxes.append([int(xmin/factor), int(ymin/factor), int(xmax/factor), int(ymax/factor)])\n",
        "      line_boxes_par.append([int(xmin/factor), int(ymin/factor), int(xmax/factor), int(ymax/factor)])\n",
        "      xmins.append(xmin)\n",
        "      ymins.append(ymin)\n",
        "      xmaxs.append(xmax)\n",
        "      ymaxs.append(ymax)\n",
        "      line_idx += 1\n",
        "      count_line_par += 1\n",
        "    xmin, ymin, xmax, ymax = min(xmins), min(ymins), max(xmaxs), max(ymaxs)\n",
        "    par_bbox = [int(xmin/factor), int(ymin/factor), int(xmax/factor), int(ymax/factor)]\n",
        "    par_boxes.append(par_bbox)\n",
        "    lines_par_boxes.append(line_boxes_par)\n",
        "    par_idx += 1\n",
        "\n",
        "  return texts_lines, texts_pars, texts_lines_par, row_indexes, par_boxes, line_boxes, lines_par_boxes \n",
        "\n",
        "# rescale image to get 300dpi\n",
        "def set_image_dpi_resize(image):\n",
        "    \"\"\"\n",
        "    Rescaling image to 300dpi while resizing\n",
        "    :param image: An image\n",
        "    :return: A rescaled image\n",
        "    \"\"\"\n",
        "    length_x, width_y = image.size\n",
        "    factor = min(1, float(1024.0 / length_x))\n",
        "    size = int(factor * length_x), int(factor * width_y)\n",
        "    # image_resize = image.resize(size, Image.Resampling.LANCZOS)\n",
        "    image_resize = image.resize(size, Image.LANCZOS)\n",
        "    temp_file = tempfile.NamedTemporaryFile(delete=False, suffix='1.png')\n",
        "    temp_filename = temp_file.name\n",
        "    image_resize.save(temp_filename, dpi=(300, 300))\n",
        "    return factor, temp_filename"
      ],
      "metadata": {
        "id": "cTBsm30Wkd-2"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "# it is important that each bounding box should be in (upper left, lower right) format.\n",
        "# source: https://github.com/NielsRogge/Transformers-Tutorials/issues/129\n",
        "def upperleft_to_lowerright(bbox):\n",
        "  x0, y0, x1, y1 = tuple(bbox)\n",
        "  if bbox[2] < bbox[0]:\n",
        "    x0 = bbox[2]\n",
        "    x1 = bbox[0] \n",
        "  if bbox[3] < bbox[1]:\n",
        "    y0 = bbox[3]\n",
        "    y1 = bbox[1] \n",
        "  return [x0, y0, x1, y1]\n",
        "\n",
        "# convert boundings boxes (left, top, width, height) format to (left, top, left+widght, top+height) format. \n",
        "def convert_box(bbox):\n",
        "    x, y, w, h = tuple(bbox) # the row comes in (left, top, width, height) format\n",
        "    return [x, y, x+w, y+h] # we turn it into (left, top, left+widght, top+height) to get the actual box \n",
        "\n",
        "# LiLT model gets 1000x10000 pixels images\n",
        "def normalize_box(bbox, width, height):\n",
        "    return [\n",
        "        int(1000 * (bbox[0] / width)),\n",
        "        int(1000 * (bbox[1] / height)),\n",
        "        int(1000 * (bbox[2] / width)),\n",
        "        int(1000 * (bbox[3] / height)),\n",
        "    ]\n",
        "\n",
        "# LiLT model gets 1000x10000 pixels images\n",
        "def denormalize_box(bbox, width, height):\n",
        "    return [\n",
        "        int(width * (bbox[0] / 1000)),\n",
        "        int(height * (bbox[1] / 1000)),\n",
        "        int(width* (bbox[2] / 1000)),\n",
        "        int(height * (bbox[3] / 1000)),\n",
        "    ]\n",
        "\n",
        "# get back original size\n",
        "def original_box(box, original_width, original_height, coco_width, coco_height):\n",
        "    return [\n",
        "        int(original_width * (box[0] / coco_width)),\n",
        "        int(original_height * (box[1] / coco_height)),\n",
        "        int(original_width * (box[2] / coco_width)),\n",
        "        int(original_height* (box[3] / coco_height)),\n",
        "    ]\n",
        "\n",
        "def get_blocks(bboxes_block, categories, texts):\n",
        "\n",
        " # get list of unique block boxes\n",
        "    bbox_block_dict, bboxes_block_list, bbox_block_prec = dict(), list(), list()\n",
        "    for count_block, bbox_block in enumerate(bboxes_block):\n",
        "      if bbox_block != bbox_block_prec:\n",
        "        bbox_block_indexes = [i for i, bbox in enumerate(bboxes_block) if bbox == bbox_block]\n",
        "        bbox_block_dict[count_block] = bbox_block_indexes\n",
        "        bboxes_block_list.append(bbox_block)\n",
        "      bbox_block_prec = bbox_block\n",
        "\n",
        "    # get list of categories and texts by unique block boxes\n",
        "    category_block_list, text_block_list = list(), list()\n",
        "    for bbox_block in bboxes_block_list:\n",
        "      count_block = bboxes_block.index(bbox_block)\n",
        "      bbox_block_indexes = bbox_block_dict[count_block]\n",
        "      category_block = np.array(categories, dtype=object)[bbox_block_indexes].tolist()[0]\n",
        "      category_block_list.append(category_block)\n",
        "      text_block = np.array(texts, dtype=object)[bbox_block_indexes].tolist()\n",
        "      text_block = [text.replace(\"\\n\",\"\").strip() for text in text_block]\n",
        "      if id2label[category_block] == \"Text\" or id2label[category_block] == \"Caption\" or id2label[category_block] == \"Footnote\":\n",
        "        text_block = ' '.join(text_block)\n",
        "      else:\n",
        "        text_block = '\\n'.join(text_block)\n",
        "      text_block_list.append(text_block)\n",
        "\n",
        "    return bboxes_block_list, category_block_list, text_block_list\n",
        "\n",
        "# function to sort bounding boxes\n",
        "def get_sorted_boxes(bboxes):\n",
        "\n",
        "  # sort by y from page top to bottom \n",
        "  sorted_bboxes = sorted(bboxes, key=itemgetter(1), reverse=False)\n",
        "  y_list = [bbox[1] for bbox in sorted_bboxes]\n",
        "\n",
        "  # sort by x from page left to right when boxes with same y\n",
        "  if len(list(set(y_list))) != len(y_list):\n",
        "    y_list_duplicates_indexes = dict()\n",
        "    y_list_duplicates = [item for item, count in collections.Counter(y_list).items() if count > 1]\n",
        "    for item in y_list_duplicates:\n",
        "      y_list_duplicates_indexes[item] = [i for i, e in enumerate(y_list) if e == item]\n",
        "      bbox_list_y_duplicates = sorted(np.array(sorted_bboxes, dtype=object)[y_list_duplicates_indexes[item]].tolist(), key=itemgetter(0), reverse=False)\n",
        "      np_array_bboxes = np.array(sorted_bboxes)\n",
        "      np_array_bboxes[y_list_duplicates_indexes[item]] = np.array(bbox_list_y_duplicates)\n",
        "      sorted_bboxes = np_array_bboxes.tolist()\n",
        "\n",
        "  return sorted_bboxes\n",
        "\n",
        "# sort data from y = 0 to end of page (and after, x=0 to end of page when necessary)\n",
        "def sort_data(bboxes, categories, texts):\n",
        "\n",
        "    sorted_bboxes = get_sorted_boxes(bboxes)\n",
        "    sorted_bboxes_indexes = [bboxes.index(bbox) for bbox in sorted_bboxes]\n",
        "    sorted_categories = np.array(categories, dtype=object)[sorted_bboxes_indexes].tolist()\n",
        "    sorted_texts = np.array(texts, dtype=object)[sorted_bboxes_indexes].tolist()\n",
        "\n",
        "    return sorted_bboxes, sorted_categories, sorted_texts\n",
        "\n",
        "# sort data from y = 0 to end of page (and after, x=0 to end of page when necessary)\n",
        "def sort_data_wo_labels(bboxes, texts):\n",
        "\n",
        "    sorted_bboxes = get_sorted_boxes(bboxes)\n",
        "    sorted_bboxes_indexes = [bboxes.index(bbox) for bbox in sorted_bboxes]\n",
        "    sorted_texts = np.array(texts, dtype=object)[sorted_bboxes_indexes].tolist()\n",
        "\n",
        "    return sorted_bboxes, sorted_texts"
      ],
      "metadata": {
        "id": "vB4LOBjWHQgw"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "#### PDF processing"
      ],
      "metadata": {
        "id": "Q4N2b_hKLla-"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# get filename and images of PDF pages\n",
        "def pdf_to_images(uploaded_pdf):\n",
        "\n",
        "    # Check if None object\n",
        "    if uploaded_pdf is None:\n",
        "        path_to_file = pdf_blank\n",
        "        filename = path_to_file.replace(examples_dir,\"\")\n",
        "        msg = \"Invalid PDF file.\"\n",
        "        images = [Image.open(image_blank)]\n",
        "    else:\n",
        "        # path to the uploaded PDF\n",
        "        path_to_file = uploaded_pdf.name\n",
        "        filename = path_to_file.replace(\"/tmp/\",\"\")\n",
        "\n",
        "        try:\n",
        "            PdfReader(path_to_file)\n",
        "        except PdfReadError:\n",
        "            path_to_file = pdf_blank\n",
        "            filename = path_to_file.replace(examples_dir,\"\")\n",
        "            msg = \"invalid PDF file.\"\n",
        "            images = [Image.open(image_blank)]\n",
        "        else:\n",
        "            try:\n",
        "                images = convert_from_path(path_to_file, last_page=max_imgboxes)\n",
        "                num_imgs = len(images)\n",
        "                msg = f'The PDF \"{filename}\" was converted into {num_imgs} images.'\n",
        "            except:\n",
        "                msg = f'Error with the PDF \"{filename}\": it was not converted into images.'\n",
        "                images = [Image.open(image_wo_content)]\n",
        "\n",
        "    return filename, msg, images"
      ],
      "metadata": {
        "id": "jD2xDwlZDMfK"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "# Extraction of image data (text and bounding boxes)\n",
        "def extraction_data_from_image(images):\n",
        "\n",
        "    num_imgs = len(images)\n",
        "\n",
        "    if num_imgs > 0:\n",
        "\n",
        "        # https://pyimagesearch.com/2021/11/15/tesseract-page-segmentation-modes-psms-explained-how-to-improve-your-ocr-accuracy/\n",
        "        custom_config = r'--oem 3 --psm 3 -l eng' # default config PyTesseract: --oem 3 --psm 3 -l eng+deu+fra+jpn+por+spa+rus+hin+chi_sim\n",
        "        results, texts_lines, texts_pars, texts_lines_par, row_indexes, par_boxes, line_boxes, lines_par_boxes = dict(), dict(), dict(), dict(), dict(), dict(), dict(), dict()\n",
        "        images_ids_list, texts_lines_list, texts_pars_list, texts_lines_par_list, par_boxes_list, line_boxes_list, lines_par_boxes_list, images_list, page_no_list, num_pages_list = list(), list(), list(), list(), list(), list(), list(), list(), list(), list()\n",
        "        \n",
        "        try: \n",
        "            for i,image in enumerate(images):\n",
        "                # image preprocessing\n",
        "                # https://docs.opencv.org/3.0-beta/doc/py_tutorials/py_imgproc/py_thresholding/py_thresholding.html\n",
        "                img = image.copy()\n",
        "                factor, path_to_img = set_image_dpi_resize(img) # Rescaling to 300dpi\n",
        "                img = Image.open(path_to_img)\n",
        "                img = np.array(img, dtype='uint8') # convert PIL to cv2\n",
        "                img = cv2.cvtColor(img, cv2.COLOR_BGR2GRAY) # gray scale image\n",
        "                ret,img = cv2.threshold(img,127,255,cv2.THRESH_BINARY)\n",
        "                \n",
        "                # OCR PyTesseract | get langs of page\n",
        "                txt = pytesseract.image_to_string(img, config=custom_config)\n",
        "                txt = txt.strip().lower()\n",
        "                txt = re.sub(r\" +\", \" \", txt) # multiple space\n",
        "                txt = re.sub(r\"(\\n\\s*)+\\n+\", \"\\n\", txt) # multiple line\n",
        "                # txt = os.popen(f'tesseract {img_filepath} - {custom_config}').read()\n",
        "                try:\n",
        "                    langs = detect_langs(txt)\n",
        "                    langs = [langdetect2Tesseract[langs[i].lang] for i in range(len(langs))]\n",
        "                    langs_string = '+'.join(langs)\n",
        "                except:\n",
        "                    langs_string = \"eng\"\n",
        "                langs_string += '+osd'\n",
        "                custom_config = f'--oem 3 --psm 3 -l {langs_string}' # default config PyTesseract: --oem 3 --psm 3\n",
        "\n",
        "                # OCR PyTesseract | get data\n",
        "                results[i] = pytesseract.image_to_data(img, config=custom_config, output_type=pytesseract.Output.DICT)\n",
        "                # results[i] = os.popen(f'tesseract {img_filepath} - {custom_config}').read()\n",
        "\n",
        "                texts_lines[i], texts_pars[i], texts_lines_par[i], row_indexes[i], par_boxes[i], line_boxes[i], lines_par_boxes[i] = get_data_paragraph(results[i], factor, conf_min=0)\n",
        "                texts_lines_list.append(texts_lines[i])\n",
        "                texts_pars_list.append(texts_pars[i])\n",
        "                texts_lines_par_list.append(texts_lines_par[i])\n",
        "                par_boxes_list.append(par_boxes[i])\n",
        "                line_boxes_list.append(line_boxes[i])\n",
        "                lines_par_boxes_list.append(lines_par_boxes[i])\n",
        "                images_ids_list.append(i)\n",
        "                images_list.append(images[i])\n",
        "                page_no_list.append(i)\n",
        "                num_pages_list.append(num_imgs) \n",
        "\n",
        "        except:\n",
        "            print(f\"There was an error within the extraction of PDF text by the OCR!\")\n",
        "        else: \n",
        "            from datasets import Dataset\n",
        "            dataset = Dataset.from_dict({\"images_ids\": images_ids_list, \"images\": images_list, \"page_no\": page_no_list, \"num_pages\": num_pages_list, \"texts_line\": texts_lines_list, \"texts_par\": texts_pars_list, \"texts_lines_par\": texts_lines_par_list, \"bboxes_par\": par_boxes_list, \"bboxes_lines_par\":lines_par_boxes_list})\n",
        "                    \n",
        "            # print(f\"The text data was successfully extracted by the OCR!\")\n",
        "\n",
        "            return dataset, texts_lines, texts_pars, texts_lines_par, row_indexes, par_boxes, line_boxes, lines_par_boxes"
      ],
      "metadata": {
        "id": "wNtk9pQzm44D"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "#### Inference"
      ],
      "metadata": {
        "id": "9VJoRifzojvD"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "def prepare_inference_features_paragraph(example, cls_box = cls_box, sep_box = sep_box):\n",
        "\n",
        "  images_ids_list, chunks_ids_list, input_ids_list, attention_mask_list, bb_list = list(), list(), list(), list(), list()\n",
        "\n",
        "  # get batch\n",
        "  # batch_page_hash = example[\"page_hash\"] \n",
        "  batch_images_ids = example[\"images_ids\"]\n",
        "  batch_images = example[\"images\"]\n",
        "  batch_bboxes_par = example[\"bboxes_par\"]\n",
        "  batch_texts_par = example[\"texts_par\"]  \n",
        "  batch_images_size = [image.size for image in batch_images]\n",
        "\n",
        "  batch_width, batch_height = [image_size[0] for image_size in batch_images_size], [image_size[1] for image_size in batch_images_size]\n",
        "\n",
        "  # add a dimension if not a batch but only one image\n",
        "  if not isinstance(batch_images_ids, list): \n",
        "    batch_images_ids = [batch_images_ids]\n",
        "    batch_images = [batch_images]\n",
        "    batch_bboxes_par = [batch_bboxes_par]\n",
        "    batch_texts_par = [batch_texts_par]\n",
        "    batch_width, batch_height = [batch_width], [batch_height] \n",
        "\n",
        "  # process all images of the batch\n",
        "  for num_batch, (image_id, boxes, texts_par, width, height) in enumerate(zip(batch_images_ids, batch_bboxes_par, batch_texts_par, batch_width, batch_height)):\n",
        "    tokens_list = []\n",
        "    bboxes_list = []\n",
        "\n",
        "    # add a dimension if only on image\n",
        "    if not isinstance(texts_par, list):\n",
        "      texts_par, boxes = [texts_par], [boxes]\n",
        "\n",
        "    # convert boxes to original\n",
        "    normalize_bboxes_par = [normalize_box(upperleft_to_lowerright(box), width, height) for box in boxes]\n",
        "\n",
        "    # sort boxes with texts\n",
        "    # we want sorted lists from top to bottom of the image\n",
        "    boxes, texts_par = sort_data_wo_labels(normalize_bboxes_par, texts_par)\n",
        "\n",
        "    count = 0\n",
        "    for box, text_par in zip(boxes, texts_par):\n",
        "      tokens_par = tokenizer.tokenize(text_par)\n",
        "      num_tokens_par = len(tokens_par) # get number of tokens\n",
        "      tokens_list.extend(tokens_par)\n",
        "      bboxes_list.extend([box] * num_tokens_par) # number of boxes must be the same as the number of tokens\n",
        "\n",
        "    # use of return_overflowing_tokens=True / stride=doc_stride\n",
        "    # to get parts of image with overlap\n",
        "    # source: https://huggingface.co/course/chapter6/3b?fw=tf#handling-long-contexts\n",
        "    encodings = tokenizer(\" \".join(texts_par), \n",
        "                          truncation=True,\n",
        "                          padding=\"max_length\", \n",
        "                          max_length=max_length, \n",
        "                          stride=doc_stride, \n",
        "                          return_overflowing_tokens=True, \n",
        "                          return_offsets_mapping=True\n",
        "                          )\n",
        "\n",
        "    otsm = encodings.pop(\"overflow_to_sample_mapping\")\n",
        "    offset_mapping = encodings.pop(\"offset_mapping\")\n",
        "\n",
        "    # Let's label those examples and get their boxes   \n",
        "    sequence_length_prev = 0   \n",
        "    for i, offsets in enumerate(offset_mapping):\n",
        "      # truncate tokens, boxes and labels based on length of chunk - 2 (special tokens <s> and </s>)\n",
        "      sequence_length = len(encodings.input_ids[i]) - 2\n",
        "      if i == 0: start = 0\n",
        "      else: start += sequence_length_prev - doc_stride\n",
        "      end = start + sequence_length\n",
        "      sequence_length_prev = sequence_length\n",
        "\n",
        "      # get tokens, boxes and labels of this image chunk\n",
        "      bb = [cls_box] + bboxes_list[start:end] + [sep_box]\n",
        "\n",
        "      # as the last chunk can have a length < max_length\n",
        "      # we must to add [tokenizer.pad_token] (tokens), [sep_box] (boxes) and [-100] (labels)\n",
        "      if len(bb) < max_length:\n",
        "        bb = bb + [sep_box] * (max_length - len(bb))\n",
        "\n",
        "      # append results\n",
        "      input_ids_list.append(encodings[\"input_ids\"][i])\n",
        "      attention_mask_list.append(encodings[\"attention_mask\"][i])\n",
        "      bb_list.append(bb)\n",
        "      images_ids_list.append(image_id)\n",
        "      chunks_ids_list.append(i)\n",
        "        \n",
        "  return {\n",
        "      \"images_ids\": images_ids_list,\n",
        "      \"chunk_ids\": chunks_ids_list,\n",
        "      \"input_ids\": input_ids_list,\n",
        "      \"attention_mask\": attention_mask_list,\n",
        "      \"normalized_bboxes\": bb_list,\n",
        "  }"
      ],
      "metadata": {
        "id": "r7Dn5UwSlF2D"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "from torch.utils.data import Dataset\n",
        "\n",
        "class CustomDataset(Dataset):\n",
        "  def __init__(self, dataset, tokenizer):\n",
        "    self.dataset = dataset\n",
        "    self.tokenizer = tokenizer\n",
        "\n",
        "  def __len__(self):\n",
        "    return len(self.dataset)\n",
        "\n",
        "  def __getitem__(self, idx):\n",
        "    # get item\n",
        "    example = self.dataset[idx]\n",
        "    encoding = dict()\n",
        "    encoding[\"images_ids\"] = example[\"images_ids\"]\n",
        "    encoding[\"chunk_ids\"] = example[\"chunk_ids\"]\n",
        "    encoding[\"input_ids\"] = example[\"input_ids\"]\n",
        "    encoding[\"attention_mask\"] = example[\"attention_mask\"]\n",
        "    encoding[\"bbox\"] = example[\"normalized_bboxes\"]\n",
        "    \n",
        "    return encoding"
      ],
      "metadata": {
        "id": "NktbxAN6H3Uf"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "import torch.nn.functional as F\n",
        "\n",
        "# get predictions at token level\n",
        "def predictions_token_level(images, custom_encoded_dataset):\n",
        "\n",
        "    num_imgs = len(images)\n",
        "    if num_imgs > 0:\n",
        "\n",
        "        chunk_ids, input_ids, bboxes, outputs, token_predictions  = dict(), dict(), dict(), dict(), dict()\n",
        "        normalize_batch_bboxes_lines_pars = dict()\n",
        "        images_ids_list = list()\n",
        "\n",
        "        for i,encoding in enumerate(custom_encoded_dataset):\n",
        "\n",
        "            # get custom encoded data\n",
        "            image_id = encoding['images_ids']\n",
        "            chunk_id = encoding['chunk_ids']\n",
        "            input_id = torch.tensor(encoding['input_ids'])[None]\n",
        "            attention_mask = torch.tensor(encoding['attention_mask'])[None]\n",
        "            bbox = torch.tensor(encoding['bbox'])[None]\n",
        "\n",
        "            # save data in dictionnaries\n",
        "            if image_id not in images_ids_list: images_ids_list.append(image_id)\n",
        "\n",
        "            if image_id in chunk_ids: chunk_ids[image_id].append(chunk_id)\n",
        "            else: chunk_ids[image_id] = [chunk_id]\n",
        "\n",
        "            if image_id in input_ids: input_ids[image_id].append(input_id)\n",
        "            else: input_ids[image_id] = [input_id]\n",
        "\n",
        "            if image_id in bboxes: bboxes[image_id].append(bbox)\n",
        "            else: bboxes[image_id] = [bbox]\n",
        "\n",
        "            # get prediction with forward pass\n",
        "            with torch.no_grad():\n",
        "                output = model(\n",
        "                    input_ids=input_id,\n",
        "                    attention_mask=attention_mask,\n",
        "                    bbox=bbox\n",
        "                    )\n",
        "              \n",
        "            # save probabilities of predictions in dictionnary\n",
        "            if image_id in outputs: outputs[image_id].append(F.softmax(output.logits.squeeze(), dim=-1))\n",
        "            else: outputs[image_id] = [F.softmax(output.logits.squeeze(), dim=-1)]\n",
        "\n",
        "        return outputs, images_ids_list, chunk_ids, input_ids, bboxes\n",
        "\n",
        "    else:\n",
        "        print(\"An error occurred while getting predictions!\")"
      ],
      "metadata": {
        "id": "A-A9ipniOJhV"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "from functools import reduce\n",
        "\n",
        "# Get predictions (line level)\n",
        "def predictions_paragraph_level_gradio(dataset, outputs, images_ids_list, chunk_ids, input_ids, bboxes):\n",
        "\n",
        "    ten_probs_dict, ten_input_ids_dict, ten_bboxes_dict = dict(), dict(), dict()\n",
        "    bboxes_list_dict, input_ids_dict_dict, probs_dict_dict, df = dict(), dict(), dict(), dict()\n",
        "\n",
        "    if len(images_ids_list) > 0:\n",
        "\n",
        "        for i, image_id in enumerate(images_ids_list):\n",
        "\n",
        "            # get image information\n",
        "            images_list = dataset.filter(lambda example: example[\"images_ids\"] == image_id)[\"images\"]\n",
        "            image = images_list[0]\n",
        "            width, height = image.size\n",
        "\n",
        "            # get data\n",
        "            chunk_ids_list = chunk_ids[image_id]\n",
        "            outputs_list = outputs[image_id]\n",
        "            input_ids_list = input_ids[image_id]\n",
        "            bboxes_list = bboxes[image_id]\n",
        "\n",
        "            # create zeros tensors\n",
        "            ten_probs = torch.zeros((outputs_list[0].shape[0] - 2)*len(outputs_list), outputs_list[0].shape[1])\n",
        "            ten_input_ids = torch.ones(size=(1, (outputs_list[0].shape[0] - 2)*len(outputs_list)), dtype =int)\n",
        "            ten_bboxes = torch.zeros(size=(1, (outputs_list[0].shape[0] - 2)*len(outputs_list), 4), dtype =int)\n",
        "\n",
        "            if len(outputs_list) > 1:\n",
        "              \n",
        "                for num_output, (output, input_id, bbox) in enumerate(zip(outputs_list, input_ids_list, bboxes_list)):\n",
        "                    start = num_output*(max_length - 2) - max(0,num_output)*doc_stride\n",
        "                    end = start + (max_length - 2)\n",
        "                    \n",
        "                    if num_output == 0:\n",
        "                        ten_probs[start:end,:] += output[1:-1]\n",
        "                        ten_input_ids[:,start:end] = input_id[:,1:-1]\n",
        "                        ten_bboxes[:,start:end,:] = bbox[:,1:-1,:]\n",
        "                    else:\n",
        "                        ten_probs[start:start + doc_stride,:] += output[1:1 + doc_stride]\n",
        "                        ten_probs[start:start + doc_stride,:] = ten_probs[start:start + doc_stride,:] * 0.5\n",
        "                        ten_probs[start + doc_stride:end,:] += output[1 + doc_stride:-1]\n",
        "\n",
        "                        ten_input_ids[:,start:start + doc_stride] = input_id[:,1:1 + doc_stride]\n",
        "                        ten_input_ids[:,start + doc_stride:end] = input_id[:,1 + doc_stride:-1]\n",
        "\n",
        "                        ten_bboxes[:,start:start + doc_stride,:] = bbox[:,1:1 + doc_stride,:]\n",
        "                        ten_bboxes[:,start + doc_stride:end,:] = bbox[:,1 + doc_stride:-1,:]\n",
        "              \n",
        "            else:\n",
        "                ten_probs += outputs_list[0][1:-1] \n",
        "                ten_input_ids = input_ids_list[0][:,1:-1] \n",
        "                ten_bboxes = bboxes_list[0][:,1:-1] \n",
        "\n",
        "            ten_probs_list, ten_input_ids_list, ten_bboxes_list = ten_probs.tolist(), ten_input_ids.tolist()[0], ten_bboxes.tolist()[0]\n",
        "            bboxes_list = list()\n",
        "            input_ids_dict, probs_dict = dict(), dict()\n",
        "            bbox_prev = [-100, -100, -100, -100]\n",
        "            for probs, input_id, bbox in zip(ten_probs_list, ten_input_ids_list, ten_bboxes_list):\n",
        "                bbox = denormalize_box(bbox, width, height)\n",
        "                if bbox != bbox_prev and bbox != cls_box and bbox != sep_box and bbox[0] != bbox[2] and bbox[1] != bbox[3]:\n",
        "                    bboxes_list.append(bbox)\n",
        "                    input_ids_dict[str(bbox)] = [input_id]\n",
        "                    probs_dict[str(bbox)] = [probs]\n",
        "                elif bbox != cls_box and bbox != sep_box and bbox[0] != bbox[2] and bbox[1] != bbox[3]:\n",
        "                    input_ids_dict[str(bbox)].append(input_id)\n",
        "                    probs_dict[str(bbox)].append(probs)\n",
        "                bbox_prev = bbox\n",
        "                \n",
        "            probs_bbox = dict()\n",
        "            for i,bbox in enumerate(bboxes_list):\n",
        "                probs = probs_dict[str(bbox)]\n",
        "                probs = np.array(probs).T.tolist()\n",
        "            \n",
        "                probs_label = list()\n",
        "                for probs_list in probs:\n",
        "                    prob_label = reduce(lambda x, y: x*y, probs_list)\n",
        "                    prob_label  = prob_label**(1./(len(probs_list))) # normalization\n",
        "                    probs_label.append(prob_label)\n",
        "                max_value = max(probs_label)\n",
        "                max_index = probs_label.index(max_value)\n",
        "                probs_bbox[str(bbox)] = max_index\n",
        "\n",
        "            bboxes_list_dict[image_id] = bboxes_list\n",
        "            input_ids_dict_dict[image_id] = input_ids_dict\n",
        "            probs_dict_dict[image_id] = probs_bbox\n",
        "\n",
        "            df[image_id] = pd.DataFrame()\n",
        "            df[image_id][\"bboxes\"] = bboxes_list\n",
        "            df[image_id][\"texts\"] = [tokenizer.decode(input_ids_dict[str(bbox)]) for bbox in bboxes_list]\n",
        "            df[image_id][\"labels\"] = [id2label[probs_bbox[str(bbox)]] for bbox in bboxes_list]\n",
        "\n",
        "        return probs_bbox, bboxes_list_dict, input_ids_dict_dict, probs_dict_dict, df\n",
        "\n",
        "    else:\n",
        "        print(\"An error occurred while getting predictions!\")"
      ],
      "metadata": {
        "id": "pMfevZTrR6sb"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "# Get labeled images with lines bounding boxes\n",
        "def get_labeled_images_gradio(dataset, images_ids_list, bboxes_list_dict, probs_dict_dict):\n",
        "\n",
        "    labeled_images = list()\n",
        "\n",
        "    for i, image_id in enumerate(images_ids_list):\n",
        "\n",
        "        # get image\n",
        "        images_list = dataset.filter(lambda example: example[\"images_ids\"] == image_id)[\"images\"]\n",
        "        image = images_list[0]\n",
        "        width, height = image.size\n",
        "\n",
        "        # get predicted boxes and labels\n",
        "        bboxes_list = bboxes_list_dict[image_id]\n",
        "        probs_bbox = probs_dict_dict[image_id]\n",
        "\n",
        "        draw = ImageDraw.Draw(image)\n",
        "        # https://stackoverflow.com/questions/66274858/choosing-a-pil-imagefont-by-font-name-rather-than-filename-and-cross-platform-f\n",
        "        font = font_manager.FontProperties(family='sans-serif', weight='bold')\n",
        "        font_file = font_manager.findfont(font)\n",
        "        font_size = 30\n",
        "        font = ImageFont.truetype(font_file, font_size)\n",
        "\n",
        "        for bbox in bboxes_list:\n",
        "              predicted_label = id2label[probs_bbox[str(bbox)]]\n",
        "              draw.rectangle(bbox, outline=label2color[predicted_label])\n",
        "              draw.text((bbox[0] + 10, bbox[1] - font_size), text=predicted_label, fill=label2color[predicted_label], font=font)\n",
        "\n",
        "        labeled_images.append(image)\n",
        "\n",
        "    return labeled_images"
      ],
      "metadata": {
        "id": "d9exNV7WS2XM"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "# get data of encoded chunk\n",
        "def get_encoded_chunk_inference(index_chunk=None):\n",
        "\n",
        "  # get datasets\n",
        "  example = dataset\n",
        "  encoded_example = encoded_dataset\n",
        "\n",
        "  # get randomly a document in dataset\n",
        "  if index_chunk == None: index_chunk = random.randint(0, len(encoded_example)-1)\n",
        "  encoded_example = encoded_example[index_chunk]\n",
        "  encoded_image_ids = encoded_example[\"images_ids\"]\n",
        "\n",
        "  # get the image\n",
        "  example = example.filter(lambda example: example[\"images_ids\"] ==  encoded_image_ids)[0]\n",
        "  image = example[\"images\"] # original image\n",
        "  width, height = image.size\n",
        "  page_no = example[\"page_no\"]\n",
        "  num_pages = example[\"num_pages\"]\n",
        "\n",
        "  # get boxes, texts, categories\n",
        "  bboxes, input_ids  = encoded_example[\"normalized_bboxes\"][1:-1], encoded_example[\"input_ids\"][1:-1]\n",
        "  bboxes = [denormalize_box(bbox, width, height) for bbox in bboxes]\n",
        "  num_tokens = len(input_ids) + 2\n",
        "\n",
        "  # get unique bboxes and corresponding labels\n",
        "  bboxes_list, input_ids_list = list(), list()\n",
        "  input_ids_dict = dict()\n",
        "  bbox_prev = [-100, -100, -100, -100]\n",
        "  for i, (bbox, input_id) in enumerate(zip(bboxes, input_ids)):\n",
        "    if bbox != bbox_prev:\n",
        "      bboxes_list.append(bbox)\n",
        "      input_ids_dict[str(bbox)] = [input_id]\n",
        "    else:\n",
        "      input_ids_dict[str(bbox)].append(input_id)\n",
        "    \n",
        "    # start_indexes_list.append(i)\n",
        "    bbox_prev = bbox\n",
        "  \n",
        "  # do not keep \"</s><pad><pad>...\"\n",
        "  if input_ids_dict[str(bboxes_list[-1])][0] == (tokenizer.convert_tokens_to_ids('</s>')):\n",
        "    del input_ids_dict[str(bboxes_list[-1])]\n",
        "    bboxes_list = bboxes_list[:-1]\n",
        "\n",
        "  # get texts by line\n",
        "  input_ids_list = input_ids_dict.values()\n",
        "  texts_list = [tokenizer.decode(input_ids) for input_ids in input_ids_list]\n",
        "  \n",
        "  # display DataFrame\n",
        "  df = pd.DataFrame({\"texts\": texts_list, \"input_ids\": input_ids_list, \"bboxes\": bboxes_list})\n",
        "\n",
        "  return image, df, num_tokens, page_no, num_pages"
      ],
      "metadata": {
        "id": "5AyQ5NfQomMV"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "# display chunk of PDF image and its data\n",
        "def display_chunk_paragraphs_inference(index_chunk=None):\n",
        "\n",
        "  # get image and image data\n",
        "  image, df, num_tokens, page_no, num_pages = get_encoded_chunk_inference(index_chunk=index_chunk)\n",
        "\n",
        "  # get data from dataframe\n",
        "  input_ids = df[\"input_ids\"]\n",
        "  texts = df[\"texts\"]\n",
        "  bboxes = df[\"bboxes\"]\n",
        "\n",
        "  print(f'Chunk ({num_tokens} tokens) of the PDF (page: {page_no+1} / {num_pages})\\n')\n",
        "\n",
        "  # display image with bounding boxes\n",
        "  print(\">> PDF image with bounding boxes of paragraphs\\n\")\n",
        "  draw = ImageDraw.Draw(image)\n",
        "            \n",
        "  labels = list()\n",
        "  for box, text in zip(bboxes, texts):\n",
        "      color = \"red\"\n",
        "      draw.rectangle(box, outline=color)\n",
        "\n",
        "  # resize image to original\n",
        "  width, height = image.size\n",
        "  image = image.resize((int(0.5*width), int(0.5*height)))\n",
        "\n",
        "  # convert to cv and display\n",
        "  img = np.array(image, dtype='uint8') # PIL to cv2\n",
        "  cv2_imshow(img)\n",
        "  cv2.waitKey(0)\n",
        "\n",
        "  # display image dataframe\n",
        "  print(\"\\n>> Dataframe of annotated paragraphs\\n\")\n",
        "  cols = [\"texts\",\t\"bboxes\"]\n",
        "  df = df[cols]\n",
        "  display(df)"
      ],
      "metadata": {
        "id": "yYeb88pWoUFS"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "#### APP function"
      ],
      "metadata": {
        "id": "QO-nRIOxCeko"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# APP outputs \n",
        "def app_outputs(uploaded_pdf):\n",
        "    filename, msg, images = pdf_to_images(uploaded_pdf)\n",
        "    num_images = len(images)\n",
        "\n",
        "    if not msg.startswith(\"Error with the PDF\"):\n",
        "    \n",
        "        # Extraction of image data (text and bounding boxes)\n",
        "        dataset, texts_lines, texts_pars, texts_lines_par, row_indexes, par_boxes, line_boxes, lines_par_boxes = extraction_data_from_image(images)\n",
        "        # prepare our data in the format of the model\n",
        "        encoded_dataset = dataset.map(prepare_inference_features_paragraph, batched=True, batch_size=64, remove_columns=dataset.column_names)\n",
        "        custom_encoded_dataset = CustomDataset(encoded_dataset, tokenizer)\n",
        "        # Get predictions (token level)\n",
        "        outputs, images_ids_list, chunk_ids, input_ids, bboxes = predictions_token_level(images, custom_encoded_dataset)\n",
        "        # Get predictions (line level)\n",
        "        probs_bbox, bboxes_list_dict, input_ids_dict_dict, probs_dict_dict, df = predictions_paragraph_level_gradio(dataset, outputs, images_ids_list, chunk_ids, input_ids, bboxes)\n",
        "        # Get labeled images with lines bounding boxes\n",
        "        labeled_images = get_labeled_images_gradio(dataset, images_ids_list, bboxes_list_dict, probs_dict_dict)\n",
        "\n",
        "        img_files = list()\n",
        "        # get image of PDF with bounding boxes\n",
        "        for i in range(num_images):\n",
        "            if filename != \"files/blank.png\": img_file = f\"img_{i}_\" + filename.replace(\".pdf\", \".png\")\n",
        "            else: img_file = filename.replace(\".pdf\", \".png\")\n",
        "            labeled_images[i].save(img_file)\n",
        "            img_files.append(img_file)\n",
        "\n",
        "        if num_images < max_imgboxes:\n",
        "            num_true_images = num_images\n",
        "            img_files += [image_blank]*(max_imgboxes - num_images)\n",
        "            labeled_images += [Image.open(image_blank)]*(max_imgboxes - num_images)\n",
        "            for count in range(max_imgboxes - num_images):\n",
        "                df[num_images + count] = pd.DataFrame()\n",
        "        else:\n",
        "            num_true_images = max_imgboxes\n",
        "            img_files = img_files[:max_imgboxes]\n",
        "            labeled_images = labeled_images[:max_imgboxes]\n",
        "            df = dict(itertools.islice(df.items(), max_imgboxes))\n",
        "\n",
        "        for num_page in range(num_true_images):\n",
        "            example = dataset[num_page]\n",
        "            df_num_page = df[num_page]\n",
        "            width, height = example[\"images\"].size\n",
        "\n",
        "            # apply same transformations\n",
        "            bboxes_par_list = [denormalize_box(normalize_box(upperleft_to_lowerright(bbox), width, height), width, height) for bbox in example['bboxes_par']]\n",
        "\n",
        "            texts_list = list()\n",
        "            for bbox_par, label in zip(df_num_page[\"bboxes\"].tolist(), df_num_page[\"labels\"]):\n",
        "                index_par = bboxes_par_list.index(bbox_par)\n",
        "                bboxes_lines_par_list = dataset[num_page][\"bboxes_lines_par\"][index_par]\n",
        "                texts_lines_par_list = dataset[num_page][\"texts_lines_par\"][index_par]\n",
        "                boxes, texts = sort_data_wo_labels(bboxes_lines_par_list, texts_lines_par_list)\n",
        "                # apply text startegy in function of label\n",
        "                if label == \"Text\" or label == \"Caption\" or label == \"Footnote\":\n",
        "                    texts = ' '.join(texts)\n",
        "                else:\n",
        "                    texts = '\\n'.join(texts)\n",
        "                texts_list.append(texts)\n",
        "\n",
        "            df[num_page][\"Paragraph text\"] = texts_list\n",
        "\n",
        "            cols = [\"bboxes\", \"Paragraph text\", \"labels\"]\n",
        "            df[num_page] = df[num_page][cols]\n",
        "\n",
        "        # save \n",
        "        csv_files = list()\n",
        "        for i in range(max_imgboxes):\n",
        "            csv_file = f\"csv_{i}_\" + filename.replace(\".pdf\", \".csv\")\n",
        "            csv_files.append(gr.File.update(value=csv_file, visible=True))\n",
        "            df[i].to_csv(csv_file, encoding=\"utf-8\", index=False)\n",
        "\n",
        "    else:  \n",
        "        img_files, labeled_images, csv_files = [\"\"]*max_imgboxes, [\"\"]*max_imgboxes, [\"\"]*max_imgboxes\n",
        "        img_files[0], img_files[1] = image_blank, image_blank\n",
        "        labeled_images[0], labeled_images[1] = Image.open(image_blank), Image.open(image_blank)\n",
        "        csv_file = \"csv_wo_content.csv\"\n",
        "        csv_files[0], csv_files[1] = gr.File.update(value=csv_file, visible=True), gr.File.update(value=csv_file, visible=True)\n",
        "        df, df_empty = dict(), pd.DataFrame()\n",
        "        df[0], df[1] = df_empty.to_csv(csv_file, encoding=\"utf-8\", index=False), df_empty.to_csv(csv_file, encoding=\"utf-8\", index=False)\n",
        "    \n",
        "    return msg, img_files[0], img_files[1], labeled_images[0], labeled_images[1], csv_files[0], csv_files[1], df[0], df[1]"
      ],
      "metadata": {
        "id": "MbBPAYF8Cg8d"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "CQdS0CydNesH"
      },
      "source": [
        "## Model & tokenizer"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "referenced_widgets": [
            "1b8bcf4713534aad8e46c3f0abfecf96",
            "d9416e8ef0404012a96241c9c0fe0e15",
            "44719bcc727b4a09b6bebc6537292141",
            "6754595de85c4930b2f3c6d927d4ce22",
            "602f6c666e3546a2802b536933f9280f",
            "d226d04a6796469b95c9d3890814e02d",
            "0ef0ffdaaddd4ce39652c5491563c8bd",
            "e23449ee40b3492299847977798abb53",
            "1fc34baf06da4e0280c886080ebee091",
            "4831d6edde9f4ccf8b46a5f369b87f77",
            "4addca685bfb4194ad58383ce424c4da",
            "74585637963f43d8aab4d86c46c53dd4",
            "26ea33c8e20b4d84bf000ab60a4cc2a9",
            "a375b6f21d1d4838ac067f6d4ed2b045",
            "068e77f344aa45e7a8224f5a384208f8",
            "ce4a28d933084d92b62ac9a1b5fa318d",
            "11c1300e65904fd1bf381b5633a7772c",
            "f9031d71803a4b92b7054da15345f556",
            "79fa8bdbc22042f2bb7b4778eed6626b",
            "1f50f0beef224359ab0e4918ca523259",
            "e07aac8a78da4e4fbc55fb7c20019141",
            "80797d9139bd4470bbf5451cf1d23d85",
            "38e847006ded42d58541b7b742d2574d",
            "6dab8c81213d4617987286febc9eabf7",
            "7ed0450cb9a640789af0cb6a38d1a42b",
            "518137d19eed46f2bc6b81fcf2822977",
            "d5d21e24f2b14400b114757787b47555",
            "fe6cfa0458f04ca9b97a3b735113fa74",
            "df091029d0cf48f1a6c976b2aeed6916",
            "a70696f14b65456da2f70407857c3c9d",
            "2b31d7b431794ee1bea1e69ac3cc9ad7",
            "a982d3b7cd0a4683a87087555e6b0515",
            "77a4a830c12949d1993389e9df4550be",
            "909f78a2e7f64265847cae8be4938abb",
            "4de996de615d49078f877c4e21f33951",
            "f2ba24d856444ef08d5134e576ef5cfb",
            "0f3670bdcb1f4a1c95e7c7995e51f47c",
            "6b6f29a54ad948dd9f0b043aaa057fa0",
            "f395418e36f04d83b174c6e6c7e0f4f3",
            "ecd23a6565c34f05b2eadade61f629c6",
            "e42e31ebb7074a4dba5abd724d5af8fc",
            "e4d75a21389e4ed094a8ab21f95f2025",
            "7ebe6e5c7784461191e738d7ca9ec704",
            "f8ed02ea910b4cda8868ef6c1b93e4f5",
            "8cef0a3250f54a129c34127df6d4acae",
            "2a453fe19d9e47ef966e689ed400a63f",
            "8fcfdd4b109348d8bd18a36fd8404eec",
            "728d7350eeff4626b0371ba66ef76af4",
            "26b9470a22d449c69e3e25b19f8112e6",
            "34209c35571a40cc91c5d4e70b34b03f",
            "13c367ccf5fd4d6a87b97f067fc41cde",
            "0235c8417c0342138d135040d56b6c8a",
            "0a46e3bc3f42494198e9513a2cb52990",
            "73fbb91b47fe450db488b8e7122d7d94",
            "4070b064fd99467883734e3f7307d2e1",
            "a94910f5fcdd4ee5834ec0747b07e4df",
            "7d7f40f01d7e4f57b8840520bdb019cb",
            "2236214b2aa045cabab0cccc9525fffb",
            "0b2b24e96a2d43b2b4b436474292d465",
            "0222ac60b34f4e998a2258ed6ed591cf",
            "e6cee5fde8de44a182eca13ba5e4f529",
            "fe07a3a2472144498c878e8188b907e9",
            "2b5cf7805f7d412ab7e07f72abe55c6c",
            "3bd9073a7f6f4d01b9eb88c75113e01c",
            "62bde80746464d96a25d75d96a12d0be",
            "6351592d3b144f1bac412c5f251d34f1"
          ]
        },
        "id": "RtvKqWjUNhM_",
        "outputId": "80be8112-700b-4392-ac20-f3932472631a"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Moving 0 files to the new cache system\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "1b8bcf4713534aad8e46c3f0abfecf96"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading (…)okenizer_config.json:   0%|          | 0.00/463 [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "74585637963f43d8aab4d86c46c53dd4"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading tokenizer.json:   0%|          | 0.00/17.1M [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "38e847006ded42d58541b7b742d2574d"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading (…)cial_tokens_map.json:   0%|          | 0.00/280 [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "909f78a2e7f64265847cae8be4938abb"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading (…)lve/main/config.json:   0%|          | 0.00/1.27k [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "8cef0a3250f54a129c34127df6d4acae"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading pytorch_model.bin:   0%|          | 0.00/1.13G [00:00<?, ?B/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "a94910f5fcdd4ee5834ec0747b07e4df"
            }
          },
          "metadata": {}
        }
      ],
      "source": [
        "from transformers import AutoTokenizer, AutoModelForTokenClassification\n",
        "\n",
        "import torch\n",
        "device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n",
        "\n",
        "tokenizer = AutoTokenizer.from_pretrained(model_id)\n",
        "model = AutoModelForTokenClassification.from_pretrained(model_id);\n",
        "model.to(device);"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "KpeG4pMbO4yF"
      },
      "outputs": [],
      "source": [
        "# get labels\n",
        "id2label = model.config.id2label\n",
        "label2id = model.config.label2id\n",
        "num_labels = len(id2label)"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Gradio APP"
      ],
      "metadata": {
        "id": "7PHpV5RSXgyc"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# gradio APP\n",
        "with gr.Blocks(title=\"Inference APP for Document Understanding at paragraph level (v1 - LiLT base)\", css=\".gradio-container\") as demo:\n",
        "    gr.HTML(\"\"\"\n",
        "    <div style=\"font-family:'Times New Roman', 'Serif'; font-size:26pt; font-weight:bold; text-align:center;\"><h1>Inference APP for Document Understanding at paragraph level (v1 - LiLT base)</h1></div>\n",
        "    <div><p>(02/16/2023) This Inference APP uses the <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://huggingface.co/pierreguillou/lilt-xlm-roberta-base-finetuned-with-DocLayNet-base-at-paragraphlevel-ml512\" target=\"_blank\">model LiLT base combined with XLM-RoBERTa base and finetuned on the dataset DocLayNet base at paragraph level</a> (chunk size of 512 tokens).</p></div>\n",
        "    <div><p><a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://arxiv.org/abs/2202.13669\" target=\"_blank\">LiLT (Language-Independent Layout Transformer)</a> is a Document Understanding model that uses both layout and text in order to detect labels of bounding boxes. Combined with the model <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://huggingface.co/xlm-roberta-base\" target=\"_blank\">XML-RoBERTa base</a>, this finetuned model has the capacity to <b>understand any language</b>. Finetuned on the dataset <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://huggingface.co/datasets/pierreguillou/DocLayNet-base\" target=\"_blank\">DocLayNet base</a>, it can <b>classifly any bounding box (and its OCR text) to 11 labels</b> (Caption, Footnote, Formula, List-item, Page-footer, Page-header, Picture, Section-header, Table, Text, Title).</p></div>\n",
        "    <div><p>It relies on an external OCR engine to get words and bounding boxes from the document image. Thus, let's run in this APP an OCR engine (<a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://github.com/madmaze/pytesseract#python-tesseract\" target=\"_blank\">PyTesseract</a>) to get the bounding boxes, then run LiLT (already fine-tuned on the dataset DocLayNet base at paragraph level) on the individual tokens and then, visualize the result at paragraph level!</p></div>\n",
        "    <div><p><b>It allows to get all pages of any PDF (of any language) with bounding boxes labeled at paragraph level and the associated dataframes with labeled data (bounding boxes, texts, labels) :-)</b></p></div>\n",
        "    <div><p>However, the inference time per page can be high when running the model on CPU due to the number of paragraph predictions to be made. Therefore, to avoid running this APP for too long, <b>only the first 2 pages are processed by this APP</b>. If you want to increase this limit, you can either clone this APP in Hugging Face Space (or run its <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://github.com/piegu/language-models/blob/master/Gradio_inference_on_LiLT_model_finetuned_on_DocLayNet_base_in_any_language_at_levelparagraphs_ml512.ipynb\" target=\"_blank\">notebook</a> on your own plateform) and change the value of the parameter <code>max_imgboxes</code>, or run the inference notebook \"<a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://github.com/piegu/language-models/blob/master/inference_on_LiLT_model_finetuned_on_DocLayNet_base_in_any_language_at_levelparagraphs_ml512.ipynb\" target=\"_blank\">Document AI | Inference at paragraph level with a Document Understanding model (LiLT fine-tuned on DocLayNet dataset)</a>\" on your own platform as it does not have this limit.</p></div>\n",
        "    <div style=\"margin-top: 20px\"><p>Links to Document Understanding APPs:</p><ul><li>Line level: <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://huggingface.co/spaces/pierreguillou/Inference-APP-Document-Understanding-at-linelevel-v1\" target=\"_blank\">v1 (LiLT base)</a> | <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://huggingface.co/spaces/pierreguillou/Inference-APP-Document-Understanding-at-linelevel-v2\" target=\"_blank\">v2 (LayoutXLM base)</a> | <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://huggingface.co/spaces/pierreguillou/Inference-APP-Document-Understanding-at-linelevel-v3\" target=\"_blank\">v3 (LilT base vs LayoutXLM base)</a></li><li>Paragraph level: <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://huggingface.co/spaces/pierreguillou/Inference-APP-Document-Understanding-at-paragraphlevel-v1\" target=\"_blank\">v1 (LiLT base)</a></li></ul></div>\n",
        "    <div style=\"margin-top: 20px\"><p>More information about the DocLayNet datasets, the finetuning of the model and this APP in the following blog posts:</p>\n",
        "    <ul><li>(02/16/2023) <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://medium.com/@pierre_guillou/document-ai-inference-app-and-fine-tuning-notebook-for-document-understanding-at-paragraph-level-c18d16e53cf8\" target=\"_blank\">Document AI | Inference APP and fine-tuning notebook for Document Understanding at paragraph level</a></li><li>(02/14/2023) <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://medium.com/@pierre_guillou/document-ai-inference-app-for-document-understanding-at-line-level-a35bbfa98893\" target=\"_blank\">Document AI | Inference APP for Document Understanding at line level</a></li><li>(02/10/2023) <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://medium.com/@pierre_guillou/document-ai-document-understanding-model-at-line-level-with-lilt-tesseract-and-doclaynet-dataset-347107a643b8\" target=\"_blank\">Document AI | Document Understanding model at line level with LiLT, Tesseract and DocLayNet dataset</a></li><li>(01/31/2023) <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://medium.com/@pierre_guillou/document-ai-doclaynet-image-viewer-app-3ac54c19956\" target=\"_blank\">Document AI | DocLayNet image viewer APP</a></li><li>(01/27/2023) <a style=\"text-decoration: none; border-bottom: #64b5f6 0.125em solid; color: #64b5f6\" href=\"https://medium.com/@pierre_guillou/document-ai-processing-of-doclaynet-dataset-to-be-used-by-layout-models-of-the-hugging-face-hub-308d8bd81cdb\" target=\"_blank\">Document AI | Processing of DocLayNet dataset to be used by layout models of the Hugging Face hub (finetuning, inference)</a></li></ul></div> \n",
        "    \"\"\")\n",
        "    with gr.Row():\n",
        "        pdf_file = gr.File(label=\"PDF\")\n",
        "    with gr.Row():\n",
        "        submit_btn = gr.Button(f\"Display first {max_imgboxes} labeled PDF pages\")\n",
        "        reset_btn = gr.Button(value=\"Clear\")\n",
        "    with gr.Row():\n",
        "        output_msg = gr.Textbox(label=\"Output message\")\n",
        "    with gr.Row():\n",
        "        fileboxes = []\n",
        "        for num_page in range(max_imgboxes):\n",
        "            file_path = gr.File(visible=True, label=f\"Image file of the PDF page n°{num_page}\")\n",
        "            fileboxes.append(file_path)\n",
        "    with gr.Row():\n",
        "        imgboxes = []\n",
        "        for num_page in range(max_imgboxes):\n",
        "            img = gr.Image(type=\"pil\", label=f\"Image of the PDF page n°{num_page}\")\n",
        "            imgboxes.append(img)\n",
        "    with gr.Row():\n",
        "        csvboxes = []\n",
        "        for num_page in range(max_imgboxes):\n",
        "            csv = gr.File(visible=True, label=f\"CSV file at line level (page {num_page})\")\n",
        "            csvboxes.append(csv)\n",
        "    with gr.Row():\n",
        "        dfboxes = []\n",
        "        for num_page in range(max_imgboxes):\n",
        "            df = gr.Dataframe(\n",
        "                      headers=[\"bounding boxes\", \"texts\", \"labels\"],\n",
        "                      datatype=[\"str\", \"str\", \"str\"],\n",
        "                      col_count=(3, \"fixed\"), \n",
        "                      visible=True,\n",
        "                      label=f\"Data of page {num_page}\",\n",
        "                      type=\"pandas\",\n",
        "                      wrap=True\n",
        "                    )\n",
        "            dfboxes.append(df)\n",
        "\n",
        "    outputboxes = [output_msg] + fileboxes + imgboxes + csvboxes + dfboxes\n",
        "    submit_btn.click(app_outputs, inputs=[pdf_file], outputs=outputboxes)\n",
        "    # https://github.com/gradio-app/gradio/pull/2044/files#diff-a91dd2749f68bb7d0099a0f4079a4fd2d10281e299e7b451cb1bb876a7c21975R91\n",
        "    reset_btn.click(\n",
        "        lambda: [pdf_file.update(value=None), output_msg.update(value=None)] + [filebox.update(value=None) for filebox in fileboxes] + [imgbox.update(value=None) for imgbox in imgboxes] + [csvbox.update(value=None) for csvbox in csvboxes] + [dfbox.update(value=None) for dfbox in dfboxes],\n",
        "        inputs=[],\n",
        "        outputs=[pdf_file, output_msg] + fileboxes + imgboxes + csvboxes + dfboxes\n",
        "        )\n",
        "    \n",
        "    gr.Examples(\n",
        "        [[\"files/example.pdf\"]],\n",
        "        [pdf_file],\n",
        "        outputboxes,\n",
        "        fn=app_outputs,\n",
        "        cache_examples=True,\n",
        "        )\n",
        "    \n",
        "demo.launch(share=True)"
      ],
      "metadata": {
        "id": "WT8eMuN0OG1k"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "# END"
      ],
      "metadata": {
        "id": "F2POOE3IOMyu"
      }
    }
  ],
  "metadata": {
    "colab": {
      "collapsed_sections": [
        "-TEUFTN_ngoo",
        "bflle1CCngoo",
        "mnfTZnF4mQbh",
        "ibTxXBjfngop",
        "kv0y3aXf8Vv8",
        "gA3leN0cdb3g",
        "TrlF26R14NYP",
        "WO1bn3pmNzmX",
        "Q4N2b_hKLla-",
        "QO-nRIOxCeko",
        "CQdS0CydNesH"
      ],
      "provenance": []
    },
    "gpuClass": "standard",
    "kernelspec": {
      "display_name": "Python 3",
      "language": "python",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.8.10"
    },
    "widgets": {
      "application/vnd.jupyter.widget-state+json": {
        "f8307f5d20ae466cabbc5a737319c656": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_3d6bfe0ff5fa43f382ba753e74fa7746",
              "IPY_MODEL_7027515efa2e417b80548d29c27509d6",
              "IPY_MODEL_397ffd57dffb4d639cb1fd914f289e6c"
            ],
            "layout": "IPY_MODEL_54fa820ed125449a911b201d06658e69"
          }
        },
        "3d6bfe0ff5fa43f382ba753e74fa7746": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a8f703e7444d453b95c4805ade8d669d",
            "placeholder": "​",
            "style": "IPY_MODEL_3d930a7331c3454eb6dd28e955526cb4",
            "value": "Downloading (…)in/files/example.pdf: 100%"
          }
        },
        "7027515efa2e417b80548d29c27509d6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_ba21f339c2d44e69839cb80cdcdc6a0c",
            "max": 343416,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_b5191e2b11574755b772603e4128249b",
            "value": 343416
          }
        },
        "397ffd57dffb4d639cb1fd914f289e6c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d821b2128fba43baaf9819965b994642",
            "placeholder": "​",
            "style": "IPY_MODEL_83f152978275437183117e98bbf7398d",
            "value": " 343k/343k [00:00&lt;00:00, 3.00MB/s]"
          }
        },
        "54fa820ed125449a911b201d06658e69": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a8f703e7444d453b95c4805ade8d669d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3d930a7331c3454eb6dd28e955526cb4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "ba21f339c2d44e69839cb80cdcdc6a0c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b5191e2b11574755b772603e4128249b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "d821b2128fba43baaf9819965b994642": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "83f152978275437183117e98bbf7398d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "8257d4352bc64e9abf9d55a7a95bb588": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_ba3ecaf3e3924807a34c1870ae4e7287",
              "IPY_MODEL_858ff01c7540454db9efa8069ceaa3c3",
              "IPY_MODEL_e0c2d088295e40c385c4e0e14c46c763"
            ],
            "layout": "IPY_MODEL_27bab17403ba49b9bc2628f43f3b1ff0"
          }
        },
        "ba3ecaf3e3924807a34c1870ae4e7287": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0d34e8a615824fada2c5ca9a34ab9cf5",
            "placeholder": "​",
            "style": "IPY_MODEL_1efab4667e1946e5b6f426bd6742b693",
            "value": "Downloading (…)main/files/blank.pdf: 100%"
          }
        },
        "858ff01c7540454db9efa8069ceaa3c3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_05bf650484bf45149bdb4067c0153635",
            "max": 1148,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_8801f2ab59714e769b8dd190c1d3e260",
            "value": 1148
          }
        },
        "e0c2d088295e40c385c4e0e14c46c763": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d6176327252f4c22854bfbff9c6c5b16",
            "placeholder": "​",
            "style": "IPY_MODEL_eea1c16252df4394a1719f465fe78645",
            "value": " 1.15k/1.15k [00:00&lt;00:00, 41.6kB/s]"
          }
        },
        "27bab17403ba49b9bc2628f43f3b1ff0": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0d34e8a615824fada2c5ca9a34ab9cf5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1efab4667e1946e5b6f426bd6742b693": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "05bf650484bf45149bdb4067c0153635": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8801f2ab59714e769b8dd190c1d3e260": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "d6176327252f4c22854bfbff9c6c5b16": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "eea1c16252df4394a1719f465fe78645": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "53d43cc7792345caa880ac8e5ed2e8f1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_f03a72ad34fc45e3bedfbd2a1bebdb41",
              "IPY_MODEL_62760e1b567d434299547c66450ecda9",
              "IPY_MODEL_3ec12e2e6d0d4fcf9a769f93b853abd1"
            ],
            "layout": "IPY_MODEL_e488059a8d014d8581399c0d19558025"
          }
        },
        "f03a72ad34fc45e3bedfbd2a1bebdb41": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_1fda4ef537414154a6b8622b656e4496",
            "placeholder": "​",
            "style": "IPY_MODEL_08d4e34851f64022b8bbdc200a06380d",
            "value": "Downloading (…)main/files/blank.png: 100%"
          }
        },
        "62760e1b567d434299547c66450ecda9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d30100bb94664b4cb4edb4e1e3c3277c",
            "max": 3994,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_e3cb2dacd99b46ba8520f1216c55b327",
            "value": 3994
          }
        },
        "3ec12e2e6d0d4fcf9a769f93b853abd1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5fa8f42ccb53457cab95a809936c7d26",
            "placeholder": "​",
            "style": "IPY_MODEL_3b493fcc3d2449f998eddac1e5879436",
            "value": " 3.99k/3.99k [00:00&lt;00:00, 109kB/s]"
          }
        },
        "e488059a8d014d8581399c0d19558025": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1fda4ef537414154a6b8622b656e4496": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "08d4e34851f64022b8bbdc200a06380d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d30100bb94664b4cb4edb4e1e3c3277c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e3cb2dacd99b46ba8520f1216c55b327": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "5fa8f42ccb53457cab95a809936c7d26": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3b493fcc3d2449f998eddac1e5879436": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "174236ee673340939d7835cff792f4e4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_d5bc16b25e0c4c0a83d46c43aa3a982f",
              "IPY_MODEL_592aa146667346b3b2b9b7929ad0667d",
              "IPY_MODEL_436f6a41bbb14382b6907340639a9535"
            ],
            "layout": "IPY_MODEL_7c662d15d6864f0d95bcb910f8167a8e"
          }
        },
        "d5bc16b25e0c4c0a83d46c43aa3a982f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_602f742904bd452cb0d4fcf1e9ccb578",
            "placeholder": "​",
            "style": "IPY_MODEL_c14ce5e15ef546a081e8fcabd576f8cf",
            "value": "Downloading (…)es/languages_iso.csv: 100%"
          }
        },
        "592aa146667346b3b2b9b7929ad0667d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_39a4ac3a42c6455690bdaaa0cbf777ee",
            "max": 2522,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_5a4fa1d42e104660a395fcf358768040",
            "value": 2522
          }
        },
        "436f6a41bbb14382b6907340639a9535": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6280caf8330d42e5a327388a3db7ec54",
            "placeholder": "​",
            "style": "IPY_MODEL_8a33ea70dea4475794dfe5d4f454fa58",
            "value": " 2.52k/2.52k [00:00&lt;00:00, 60.8kB/s]"
          }
        },
        "7c662d15d6864f0d95bcb910f8167a8e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "602f742904bd452cb0d4fcf1e9ccb578": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c14ce5e15ef546a081e8fcabd576f8cf": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "39a4ac3a42c6455690bdaaa0cbf777ee": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5a4fa1d42e104660a395fcf358768040": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "6280caf8330d42e5a327388a3db7ec54": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8a33ea70dea4475794dfe5d4f454fa58": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c72596e503b943d9baafa9d165096cf5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_58aecf0e47e1411d9e980fc924aa4e26",
              "IPY_MODEL_358aafe4ad91430683ec684c97050dd0",
              "IPY_MODEL_2b923764935b4f90bb977bc3a5756785"
            ],
            "layout": "IPY_MODEL_c04f1a3841544271837e6ec9019cd5e3"
          }
        },
        "58aecf0e47e1411d9e980fc924aa4e26": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_60ae20f91f72456891af6e3e17d880ef",
            "placeholder": "​",
            "style": "IPY_MODEL_8ea4854353e94d34a33bbaac87251f37",
            "value": "Downloading (…)guages_tesseract.csv: 100%"
          }
        },
        "358aafe4ad91430683ec684c97050dd0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0fd1388539e4446ba6e0004301cbfd81",
            "max": 2130,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_a901d27ec12d479e8b04a79b64d47a29",
            "value": 2130
          }
        },
        "2b923764935b4f90bb977bc3a5756785": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_8194077608994b53abe690d8a58b70cf",
            "placeholder": "​",
            "style": "IPY_MODEL_fb94b041e3c44541aaf8b3a645ce36fc",
            "value": " 2.13k/2.13k [00:00&lt;00:00, 71.6kB/s]"
          }
        },
        "c04f1a3841544271837e6ec9019cd5e3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "60ae20f91f72456891af6e3e17d880ef": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8ea4854353e94d34a33bbaac87251f37": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "0fd1388539e4446ba6e0004301cbfd81": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a901d27ec12d479e8b04a79b64d47a29": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "8194077608994b53abe690d8a58b70cf": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "fb94b041e3c44541aaf8b3a645ce36fc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "22c225da3e5547c8854f8a1c30a254cc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_2d63611bd2ff421082ced7cdbe60df58",
              "IPY_MODEL_169ec589b18a46ce842ba99550813864",
              "IPY_MODEL_e19abc210c544625aad60c85bddcfeb2"
            ],
            "layout": "IPY_MODEL_8c84ca93833f4c9b95e8f7a435b79cdf"
          }
        },
        "2d63611bd2ff421082ced7cdbe60df58": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_aa1d26b4c4d94980bc78c1035d2acd10",
            "placeholder": "​",
            "style": "IPY_MODEL_b2635c3e0f914c67ad775c73c0fe2e6e",
            "value": "Downloading (…)files/wo_content.png: 100%"
          }
        },
        "169ec589b18a46ce842ba99550813864": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_01f3c149e4574e4dbd885a2bbf49821d",
            "max": 27602,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_bb8d3eb84bbe498f95da693054203435",
            "value": 27602
          }
        },
        "e19abc210c544625aad60c85bddcfeb2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2331d8fa504f4d8c87eecd1bb8c578c8",
            "placeholder": "​",
            "style": "IPY_MODEL_37dad57a21754e8ab3d3ebb4bd5048a2",
            "value": " 27.6k/27.6k [00:00&lt;00:00, 767kB/s]"
          }
        },
        "8c84ca93833f4c9b95e8f7a435b79cdf": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "aa1d26b4c4d94980bc78c1035d2acd10": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b2635c3e0f914c67ad775c73c0fe2e6e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "01f3c149e4574e4dbd885a2bbf49821d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "bb8d3eb84bbe498f95da693054203435": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "2331d8fa504f4d8c87eecd1bb8c578c8": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "37dad57a21754e8ab3d3ebb4bd5048a2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "1b8bcf4713534aad8e46c3f0abfecf96": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_d9416e8ef0404012a96241c9c0fe0e15",
              "IPY_MODEL_44719bcc727b4a09b6bebc6537292141",
              "IPY_MODEL_6754595de85c4930b2f3c6d927d4ce22"
            ],
            "layout": "IPY_MODEL_602f6c666e3546a2802b536933f9280f"
          }
        },
        "d9416e8ef0404012a96241c9c0fe0e15": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d226d04a6796469b95c9d3890814e02d",
            "placeholder": "​",
            "style": "IPY_MODEL_0ef0ffdaaddd4ce39652c5491563c8bd",
            "value": ""
          }
        },
        "44719bcc727b4a09b6bebc6537292141": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e23449ee40b3492299847977798abb53",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_1fc34baf06da4e0280c886080ebee091",
            "value": 0
          }
        },
        "6754595de85c4930b2f3c6d927d4ce22": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_4831d6edde9f4ccf8b46a5f369b87f77",
            "placeholder": "​",
            "style": "IPY_MODEL_4addca685bfb4194ad58383ce424c4da",
            "value": " 0/0 [00:00&lt;?, ?it/s]"
          }
        },
        "602f6c666e3546a2802b536933f9280f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d226d04a6796469b95c9d3890814e02d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0ef0ffdaaddd4ce39652c5491563c8bd": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e23449ee40b3492299847977798abb53": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "20px"
          }
        },
        "1fc34baf06da4e0280c886080ebee091": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "4831d6edde9f4ccf8b46a5f369b87f77": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4addca685bfb4194ad58383ce424c4da": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "74585637963f43d8aab4d86c46c53dd4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_26ea33c8e20b4d84bf000ab60a4cc2a9",
              "IPY_MODEL_a375b6f21d1d4838ac067f6d4ed2b045",
              "IPY_MODEL_068e77f344aa45e7a8224f5a384208f8"
            ],
            "layout": "IPY_MODEL_ce4a28d933084d92b62ac9a1b5fa318d"
          }
        },
        "26ea33c8e20b4d84bf000ab60a4cc2a9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_11c1300e65904fd1bf381b5633a7772c",
            "placeholder": "​",
            "style": "IPY_MODEL_f9031d71803a4b92b7054da15345f556",
            "value": "Downloading (…)okenizer_config.json: 100%"
          }
        },
        "a375b6f21d1d4838ac067f6d4ed2b045": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_79fa8bdbc22042f2bb7b4778eed6626b",
            "max": 463,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_1f50f0beef224359ab0e4918ca523259",
            "value": 463
          }
        },
        "068e77f344aa45e7a8224f5a384208f8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e07aac8a78da4e4fbc55fb7c20019141",
            "placeholder": "​",
            "style": "IPY_MODEL_80797d9139bd4470bbf5451cf1d23d85",
            "value": " 463/463 [00:00&lt;00:00, 4.71kB/s]"
          }
        },
        "ce4a28d933084d92b62ac9a1b5fa318d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "11c1300e65904fd1bf381b5633a7772c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f9031d71803a4b92b7054da15345f556": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "79fa8bdbc22042f2bb7b4778eed6626b": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1f50f0beef224359ab0e4918ca523259": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "e07aac8a78da4e4fbc55fb7c20019141": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "80797d9139bd4470bbf5451cf1d23d85": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "38e847006ded42d58541b7b742d2574d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_6dab8c81213d4617987286febc9eabf7",
              "IPY_MODEL_7ed0450cb9a640789af0cb6a38d1a42b",
              "IPY_MODEL_518137d19eed46f2bc6b81fcf2822977"
            ],
            "layout": "IPY_MODEL_d5d21e24f2b14400b114757787b47555"
          }
        },
        "6dab8c81213d4617987286febc9eabf7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_fe6cfa0458f04ca9b97a3b735113fa74",
            "placeholder": "​",
            "style": "IPY_MODEL_df091029d0cf48f1a6c976b2aeed6916",
            "value": "Downloading tokenizer.json: 100%"
          }
        },
        "7ed0450cb9a640789af0cb6a38d1a42b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a70696f14b65456da2f70407857c3c9d",
            "max": 17082660,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_2b31d7b431794ee1bea1e69ac3cc9ad7",
            "value": 17082660
          }
        },
        "518137d19eed46f2bc6b81fcf2822977": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a982d3b7cd0a4683a87087555e6b0515",
            "placeholder": "​",
            "style": "IPY_MODEL_77a4a830c12949d1993389e9df4550be",
            "value": " 17.1M/17.1M [00:00&lt;00:00, 28.9MB/s]"
          }
        },
        "d5d21e24f2b14400b114757787b47555": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "fe6cfa0458f04ca9b97a3b735113fa74": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "df091029d0cf48f1a6c976b2aeed6916": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "a70696f14b65456da2f70407857c3c9d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "2b31d7b431794ee1bea1e69ac3cc9ad7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "a982d3b7cd0a4683a87087555e6b0515": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "77a4a830c12949d1993389e9df4550be": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "909f78a2e7f64265847cae8be4938abb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_4de996de615d49078f877c4e21f33951",
              "IPY_MODEL_f2ba24d856444ef08d5134e576ef5cfb",
              "IPY_MODEL_0f3670bdcb1f4a1c95e7c7995e51f47c"
            ],
            "layout": "IPY_MODEL_6b6f29a54ad948dd9f0b043aaa057fa0"
          }
        },
        "4de996de615d49078f877c4e21f33951": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f395418e36f04d83b174c6e6c7e0f4f3",
            "placeholder": "​",
            "style": "IPY_MODEL_ecd23a6565c34f05b2eadade61f629c6",
            "value": "Downloading (…)cial_tokens_map.json: 100%"
          }
        },
        "f2ba24d856444ef08d5134e576ef5cfb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e42e31ebb7074a4dba5abd724d5af8fc",
            "max": 280,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_e4d75a21389e4ed094a8ab21f95f2025",
            "value": 280
          }
        },
        "0f3670bdcb1f4a1c95e7c7995e51f47c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_7ebe6e5c7784461191e738d7ca9ec704",
            "placeholder": "​",
            "style": "IPY_MODEL_f8ed02ea910b4cda8868ef6c1b93e4f5",
            "value": " 280/280 [00:00&lt;00:00, 4.71kB/s]"
          }
        },
        "6b6f29a54ad948dd9f0b043aaa057fa0": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f395418e36f04d83b174c6e6c7e0f4f3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ecd23a6565c34f05b2eadade61f629c6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e42e31ebb7074a4dba5abd724d5af8fc": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e4d75a21389e4ed094a8ab21f95f2025": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "7ebe6e5c7784461191e738d7ca9ec704": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f8ed02ea910b4cda8868ef6c1b93e4f5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "8cef0a3250f54a129c34127df6d4acae": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_2a453fe19d9e47ef966e689ed400a63f",
              "IPY_MODEL_8fcfdd4b109348d8bd18a36fd8404eec",
              "IPY_MODEL_728d7350eeff4626b0371ba66ef76af4"
            ],
            "layout": "IPY_MODEL_26b9470a22d449c69e3e25b19f8112e6"
          }
        },
        "2a453fe19d9e47ef966e689ed400a63f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_34209c35571a40cc91c5d4e70b34b03f",
            "placeholder": "​",
            "style": "IPY_MODEL_13c367ccf5fd4d6a87b97f067fc41cde",
            "value": "Downloading (…)lve/main/config.json: 100%"
          }
        },
        "8fcfdd4b109348d8bd18a36fd8404eec": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0235c8417c0342138d135040d56b6c8a",
            "max": 1266,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_0a46e3bc3f42494198e9513a2cb52990",
            "value": 1266
          }
        },
        "728d7350eeff4626b0371ba66ef76af4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_73fbb91b47fe450db488b8e7122d7d94",
            "placeholder": "​",
            "style": "IPY_MODEL_4070b064fd99467883734e3f7307d2e1",
            "value": " 1.27k/1.27k [00:00&lt;00:00, 10.0kB/s]"
          }
        },
        "26b9470a22d449c69e3e25b19f8112e6": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "34209c35571a40cc91c5d4e70b34b03f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "13c367ccf5fd4d6a87b97f067fc41cde": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "0235c8417c0342138d135040d56b6c8a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0a46e3bc3f42494198e9513a2cb52990": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "73fbb91b47fe450db488b8e7122d7d94": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4070b064fd99467883734e3f7307d2e1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "a94910f5fcdd4ee5834ec0747b07e4df": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_7d7f40f01d7e4f57b8840520bdb019cb",
              "IPY_MODEL_2236214b2aa045cabab0cccc9525fffb",
              "IPY_MODEL_0b2b24e96a2d43b2b4b436474292d465"
            ],
            "layout": "IPY_MODEL_0222ac60b34f4e998a2258ed6ed591cf"
          }
        },
        "7d7f40f01d7e4f57b8840520bdb019cb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e6cee5fde8de44a182eca13ba5e4f529",
            "placeholder": "​",
            "style": "IPY_MODEL_fe07a3a2472144498c878e8188b907e9",
            "value": "Downloading pytorch_model.bin: 100%"
          }
        },
        "2236214b2aa045cabab0cccc9525fffb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2b5cf7805f7d412ab7e07f72abe55c6c",
            "max": 1134425553,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_3bd9073a7f6f4d01b9eb88c75113e01c",
            "value": 1134425553
          }
        },
        "0b2b24e96a2d43b2b4b436474292d465": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_62bde80746464d96a25d75d96a12d0be",
            "placeholder": "​",
            "style": "IPY_MODEL_6351592d3b144f1bac412c5f251d34f1",
            "value": " 1.13G/1.13G [01:23&lt;00:00, 8.50MB/s]"
          }
        },
        "0222ac60b34f4e998a2258ed6ed591cf": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e6cee5fde8de44a182eca13ba5e4f529": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "fe07a3a2472144498c878e8188b907e9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2b5cf7805f7d412ab7e07f72abe55c6c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3bd9073a7f6f4d01b9eb88c75113e01c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "62bde80746464d96a25d75d96a12d0be": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6351592d3b144f1bac412c5f251d34f1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        }
      }
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}