02 - 02 - IMDB sentiment analysis - FC NN.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Let's actually do sentiment prediction based on movie reviews"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Version:  2.0.0\n",
      "Eager mode:  True\n",
      "Hub version:  0.7.0\n",
      "GPU is NOT AVAILABLE\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "\n",
    "import tensorflow as tf\n",
    "import tensorflow_hub as hub\n",
    "import tensorflow_datasets as tfds\n",
    "\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "print(\"Version: \", tf.__version__)\n",
    "print(\"Eager mode: \", tf.executing_eagerly())\n",
    "print(\"Hub version: \", hub.__version__)\n",
    "print(\"GPU is\", \"available\" if tf.test.is_gpu_available() else \"NOT AVAILABLE\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "train_data, test_data = tfds.load(name=\"imdb_reviews\", split=[\"train\", \"test\"], \n",
    "                                  batch_size=-1, as_supervised=True)\n",
    "\n",
    "train_examples, train_labels = tfds.as_numpy(train_data)\n",
    "test_examples, test_labels = tfds.as_numpy(test_data)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Training entries: 25000, test entries: 25000\n"
     ]
    }
   ],
   "source": [
    "print(\"Training entries: {}, test entries: {}\".format(len(train_examples), len(test_examples)))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([b\"As a lifelong fan of Dickens, I have invariably been disappointed by adaptations of his novels.<br /><br />Although his works presented an extremely accurate re-telling of human life at every level in Victorian Britain, throughout them all was a pervasive thread of humour that could be both playful or sarcastic as the narrative dictated. In a way, he was a literary caricaturist and cartoonist. He could be serious and hilarious in the same sentence. He pricked pride, lampooned arrogance, celebrated modesty, and empathised with loneliness and poverty. It may be a clich\\xc3\\xa9, but he was a people's writer.<br /><br />And it is the comedy that is so often missing from his interpretations. At the time of writing, Oliver Twist is being dramatised in serial form on BBC television. All of the misery and cruelty is their, but non of the humour, irony, and savage lampoonery. The result is just a dark, dismal experience: the story penned by a journalist rather than a novelist. It's not really Dickens at all.<br /><br />'Oliver!', on the other hand, is much closer to the mark. The mockery of officialdom is perfectly interpreted, from the blustering beadle to the drunken magistrate. The classic stand-off between the beadle and Mr Brownlow, in which the law is described as 'a ass, a idiot' couldn't have been better done. Harry Secombe is an ideal choice.<br /><br />But the blinding cruelty is also there, the callous indifference of the state, the cold, hunger, poverty and loneliness are all presented just as surely as The Master would have wished.<br /><br />And then there is crime. Ron Moody is a treasure as the sleazy Jewish fence, whilst Oliver Reid has Bill Sykes to perfection.<br /><br />Perhaps not surprisingly, Lionel Bart - himself a Jew from London's east-end - takes a liberty with Fagin by re-interpreting him as a much more benign fellow than was Dicken's original. In the novel, he was utterly ruthless, sending some of his own boys to the gallows in order to protect himself (though he was also caught and hanged). Whereas in the movie, he is presented as something of a wayward father-figure, a sort of charitable thief rather than a corrupter of children, the latter being a long-standing anti-semitic sentiment. Otherwise, very few liberties are taken with Dickens's original. All of the most memorable elements are included. Just enough menace and violence is retained to ensure narrative fidelity whilst at the same time allowing for children' sensibilities. Nancy is still beaten to death, Bullseye narrowly escapes drowning, and Bill Sykes gets a faithfully graphic come-uppance.<br /><br />Every song is excellent, though they do incline towards schmaltz. Mark Lester mimes his wonderfully. Both his and my favourite scene is the one in which the world comes alive to 'who will buy'. It's schmaltzy, but it's Dickens through and through.<br /><br />I could go on. I could commend the wonderful set-pieces, the contrast of the rich and poor. There is top-quality acting from more British regulars than you could shake a stick at.<br /><br />I ought to give it 10 points, but I'm feeling more like Scrooge today. Soak it up with your Christmas dinner. No original has been better realised.\",\n",
       "       b\"Oh yeah! Jenna Jameson did it again! Yeah Baby! This movie rocks. It was one of the 1st movies i saw of her. And i have to say i feel in love with her, she was great in this move.<br /><br />Her performance was outstanding and what i liked the most was the scenery and the wardrobe it was amazing you can tell that they put a lot into the movie the girls cloth were amazing.<br /><br />I hope this comment helps and u can buy the movie, the storyline is awesome is very unique and i'm sure u are going to like it. Jenna amazed us once more and no wonder the movie won so many awards. Her make-up and wardrobe is very very sexy and the girls on girls scene is amazing. specially the one where she looks like an angel. It's a must see and i hope u share my interests\",\n",
       "       b\"I saw this film on True Movies (which automatically made me sceptical) but actually - it was good. Why? Not because of the amazing plot twists or breathtaking dialogue (of which there is little) but because actually, despite what people say I thought the film was accurate in it's depiction of teenagers dealing with pregnancy.<br /><br />It's NOT Dawson's Creek, they're not graceful, cool witty characters who breeze through sexuality with effortless knowledge. They're kids and they act like kids would. <br /><br />They're blunt, awkward and annoyingly confused about everything. Yes, this could be by accident and they could just be bad actors but I don't think so. Dermot Mulroney gives (when not trying to be cool) a very believable performance and I loved him for it. Patricia Arquette IS whiny and annoying, but she was pregnant and a teenagers? The combination of the two isn't exactly lavender on your pillow. The plot was VERY predictable and but so what? I believed them, his stress and inability to cope - her brave, yet slightly misguided attempts to bring them closer together. I think the characters, acted by anyone else, WOULD indeed have been annoying and unbelievable but they weren't. It reflects the surreality of the situation they're in, that he's sitting in class and she walks on campus with the baby. I felt angry at her for that, I felt angry at him for being such a child and for blaming her. I felt it all.<br /><br />In the end, I loved it and would recommend it.<br /><br />Watch out for the scene where Dermot Mulroney runs from the disastrous counselling session - career performance.\",\n",
       "       b'This was a wonderfully clever and entertaining movie that I shall never tire of watching many, many times. The casting was magnificent in matching up the young with the older characters. There are those of us out here who really do appreciate good actors and an intelligent story format. As for Judi Dench, she is beautiful and a gift to any kind of production in which she stars. I always make a point to see Judi Dench in all her performances. She is a superb actress and a pleasure to watch as each transformation of her character comes to life. I can only be grateful when I see such an outstanding picture for most of the motion pictures made more recently lack good characters, good scripts and good acting. The movie public needs heroes, not deviant manikins, who lack ingenuity and talent. How wonderful to see old favorites like Leslie Caron, Olympia Dukakis and Cleo Laine. I would like to see this movie win the awards it deserves. Thank you again for a tremendous night of entertainment. I congratulate the writer, director, producer, and all those who did such a fine job.',\n",
       "       b'I have no idea what the other reviewer is talking about- this was a wonderful movie, and created a sense of the era that feels like time travel. The characters are truly young, Mary is a strong match for Byron, Claire is juvenile and a tad annoying, Polidori is a convincing beaten-down sycophant... all are beautiful, curious, and decadent... not the frightening wrecks they are in Gothic.<br /><br />Gothic works as an independent piece of shock film, and I loved it for different reasons, but this works like a Merchant and Ivory film, and was from my readings the best capture of what the summer must have felt like. Romantic, yes, but completely rekindles my interest in the lives of Shelley and Byron every time I think about the film. One of my all-time favorites.',\n",
       "       b\"This was soul-provoking! I am an Iranian, and living in th 21st century, I didn't know that such big tribes have been living in such conditions at the time of my grandfather!<br /><br />You see that today, or even in 1925, on one side of the world a lady or a baby could have everything served for him or her clean and on-demand, but here 80 years ago, people ventured their life to go to somewhere with more grass. It's really interesting that these Persians bear those difficulties to find pasture for their sheep, but they lose many the sheep on their way.<br /><br />I praise the Americans who accompanied this tribe, they were as tough as Bakhtiari people.\",\n",
       "       b'Just because someone is under the age of 10 does not mean they are stupid. If your child likes this film you\\'d better have him/her tested. I am continually amazed at how so many people can be involved in something that turns out so bad. This \"film\" is a showcase for digital wizardry AND NOTHING ELSE. The writing is horrid. I can\\'t remember when I\\'ve heard such bad dialogue. The songs are beyond wretched. The acting is sub-par but then the actors were not given much. Who decided to employ Joey Fatone? He cannot sing and he is ugly as sin.<br /><br />The worst thing is the obviousness of it all. It is as if the writers went out of their way to make it all as stupid as possible. Great children\\'s movies are wicked, smart and full of wit - films like Shrek and Toy Story in recent years, Willie Wonka and The Witches to mention two of the past. But in the continual dumbing-down of American more are flocking to dreck like Finding Nemo (yes, that\\'s right), the recent Charlie & The Chocolate Factory and eye-crossing trash like Red Riding Hood.',\n",
       "       b\"I absolutely LOVED this movie when I was a kid. I cried every time I watched it. It wasn't weird to me. I totally identified with the characters. I would love to see it again (and hope I wont be disappointed!). Pufnstuf rocks!!!! I was really drawn in to the fantasy world. And to me the movie was loooong. I wonder if I ever saw the series and have confused them? The acting I thought was strong. I loved Jack Wilde. He was so dreamy to an 10 year old (when I first saw the movie, not in 1970. I can still remember the characters vividly. The flute was totally believable and I can still 'feel' the evil woods. Witchy poo was scary - I wouldn't want to cross her path.\",\n",
       "       b'A very close and sharp discription of the bubbling and dynamic emotional world of specialy one 18year old guy, that makes his first experiences in his gay love to an other boy, during an vacation with a part of his family.<br /><br />I liked this film because of his extremly clear and surrogated storytelling , with all this \"Sound-close-ups\" and quiet moments wich had been full of intensive moods.<br /><br />',\n",
       "       b\"This is the most depressing film I have ever seen. I first saw it as a child and even thinking about it now really upsets me. I know it was set in a time when life was hard and I know these people were poor and the crops were vital. Yes, I get all that. What I find hard to take is I can't remember one single light moment in the entire film. Maybe it was true to life, I don't know. I'm quite sure the acting was top notch and the direction and quality of filming etc etc was wonderful and I know that every film can't have a happy ending but as a family film it is dire in my opinion.<br /><br />I wouldn't recommend it to anyone who wants to be entertained by a film. I can't stress enough how this film affected me as a child. I was talking about it recently and all the sad memories came flooding back. I think it would have all but the heartless reaching for the Prozac.\"],\n",
       "      dtype=object)"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_examples[:10]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 1, 1, 1, 1, 1, 0, 1, 1, 0])"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_labels[:10]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "* https://tfhub.dev/google/tf2-preview/gnews-swivel-20dim/1\n",
    "* https://tfhub.dev/google/tf2-preview/gnews-swivel-20dim-with-oov/1 - same, but with 2.5% vocabulary converted to OOV buckets.\n",
    "* https://tfhub.dev/google/tf2-preview/nnlm-en-dim50/1 - A much larger model with ~1M vocabulary size and 50 dimensions.\n",
    "* https://tfhub.dev/google/tf2-preview/nnlm-en-dim128/1 - Even larger model with ~1M vocabulary size and 128 dimensions."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<tf.Tensor: id=303, shape=(3, 20), dtype=float32, numpy=\n",
       "array([[ 3.9819887 , -4.4838037 ,  5.177359  , -2.3643482 , -3.2938678 ,\n",
       "        -3.5364532 , -2.4786978 ,  2.5525482 ,  6.688532  , -2.3076782 ,\n",
       "        -1.9807833 ,  1.1315885 , -3.0339816 , -0.7604128 , -5.743445  ,\n",
       "         3.4242578 ,  4.790099  , -4.03061   , -5.992149  , -1.7297493 ],\n",
       "       [ 3.4232912 , -4.230874  ,  4.1488533 , -0.29553518, -6.802391  ,\n",
       "        -2.5163853 , -4.4002395 ,  1.905792  ,  4.7512794 , -0.40538004,\n",
       "        -4.3401685 ,  1.0361497 ,  0.9744097 ,  0.71507156, -6.2657013 ,\n",
       "         0.16533905,  4.560262  , -1.3106939 , -3.1121316 , -2.1338716 ],\n",
       "       [ 3.8508697 , -5.003031  ,  4.8700504 , -0.04324996, -5.893603  ,\n",
       "        -5.2983093 , -4.004676  ,  4.1236343 ,  6.267754  ,  0.11632943,\n",
       "        -3.5934832 ,  0.8023905 ,  0.56146765,  0.9192484 , -7.3066816 ,\n",
       "         2.8202746 ,  6.2000837 , -3.5709393 , -4.564525  , -2.305622  ]],\n",
       "      dtype=float32)>"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model = \"https://tfhub.dev/google/tf2-preview/gnews-swivel-20dim/1\"\n",
    "hub_layer = hub.KerasLayer(model, output_shape=[20], input_shape=[], \n",
    "                           dtype=tf.string, trainable=True)\n",
    "hub_layer(train_examples[:3])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Model: \"sequential\"\n",
      "_________________________________________________________________\n",
      "Layer (type)                 Output Shape              Param #   \n",
      "=================================================================\n",
      "keras_layer (KerasLayer)     (None, 20)                400020    \n",
      "_________________________________________________________________\n",
      "dense (Dense)                (None, 16)                336       \n",
      "_________________________________________________________________\n",
      "dense_1 (Dense)              (None, 1)                 17        \n",
      "=================================================================\n",
      "Total params: 400,373\n",
      "Trainable params: 400,373\n",
      "Non-trainable params: 0\n",
      "_________________________________________________________________\n"
     ]
    }
   ],
   "source": [
    "model = tf.keras.Sequential()\n",
    "model.add(hub_layer)\n",
    "model.add(tf.keras.layers.Dense(16, activation='relu'))\n",
    "model.add(tf.keras.layers.Dense(1, activation='sigmoid'))\n",
    "\n",
    "model.summary()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "model.compile(optimizer='adam',\n",
    "              loss='binary_crossentropy',\n",
    "              metrics=['accuracy'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "x_val = train_examples[:10000]\n",
    "partial_x_train = train_examples[10000:]\n",
    "\n",
    "y_val = train_labels[:10000]\n",
    "partial_y_train = train_labels[10000:]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(10000,)\n"
     ]
    }
   ],
   "source": [
    "print(x_val.shape)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train on 15000 samples, validate on 10000 samples\n",
      "Epoch 1/40\n",
      "15000/15000 [==============================] - 2s 150us/sample - loss: 1.0169 - accuracy: 0.5727 - val_loss: 0.7266 - val_accuracy: 0.5966\n",
      "Epoch 2/40\n",
      "15000/15000 [==============================] - 1s 97us/sample - loss: 0.6639 - accuracy: 0.6367 - val_loss: 0.6367 - val_accuracy: 0.6582\n",
      "Epoch 3/40\n",
      "15000/15000 [==============================] - 1s 98us/sample - loss: 0.6173 - accuracy: 0.6645 - val_loss: 0.6033 - val_accuracy: 0.6840\n",
      "Epoch 4/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.5845 - accuracy: 0.6909 - val_loss: 0.5756 - val_accuracy: 0.7101\n",
      "Epoch 5/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.5539 - accuracy: 0.7222 - val_loss: 0.5508 - val_accuracy: 0.7301\n",
      "Epoch 6/40\n",
      "15000/15000 [==============================] - 1s 95us/sample - loss: 0.5229 - accuracy: 0.7487 - val_loss: 0.5252 - val_accuracy: 0.7455\n",
      "Epoch 7/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.4920 - accuracy: 0.7741 - val_loss: 0.4979 - val_accuracy: 0.7673\n",
      "Epoch 8/40\n",
      "15000/15000 [==============================] - 1s 96us/sample - loss: 0.4602 - accuracy: 0.7960 - val_loss: 0.4714 - val_accuracy: 0.7862\n",
      "Epoch 9/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.4292 - accuracy: 0.8153 - val_loss: 0.4466 - val_accuracy: 0.7993\n",
      "Epoch 10/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.3995 - accuracy: 0.8323 - val_loss: 0.4254 - val_accuracy: 0.8115\n",
      "Epoch 11/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.3713 - accuracy: 0.8466 - val_loss: 0.4031 - val_accuracy: 0.8247\n",
      "Epoch 12/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.3452 - accuracy: 0.8609 - val_loss: 0.3851 - val_accuracy: 0.8338\n",
      "Epoch 13/40\n",
      "15000/15000 [==============================] - 1s 92us/sample - loss: 0.3215 - accuracy: 0.8748 - val_loss: 0.3699 - val_accuracy: 0.8420\n",
      "Epoch 14/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.2997 - accuracy: 0.8840 - val_loss: 0.3552 - val_accuracy: 0.8490\n",
      "Epoch 15/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.2800 - accuracy: 0.8929 - val_loss: 0.3438 - val_accuracy: 0.8536\n",
      "Epoch 16/40\n",
      "15000/15000 [==============================] - 1s 93us/sample - loss: 0.2620 - accuracy: 0.9011 - val_loss: 0.3353 - val_accuracy: 0.8578\n",
      "Epoch 17/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.2455 - accuracy: 0.9085 - val_loss: 0.3256 - val_accuracy: 0.8629\n",
      "Epoch 18/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.2308 - accuracy: 0.9137 - val_loss: 0.3189 - val_accuracy: 0.8656\n",
      "Epoch 19/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.2165 - accuracy: 0.9217 - val_loss: 0.3133 - val_accuracy: 0.8683\n",
      "Epoch 20/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.2039 - accuracy: 0.9270 - val_loss: 0.3092 - val_accuracy: 0.8721\n",
      "Epoch 21/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.1926 - accuracy: 0.9327 - val_loss: 0.3073 - val_accuracy: 0.8728\n",
      "Epoch 22/40\n",
      "15000/15000 [==============================] - 1s 95us/sample - loss: 0.1816 - accuracy: 0.9364 - val_loss: 0.3047 - val_accuracy: 0.8737\n",
      "Epoch 23/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.1712 - accuracy: 0.9413 - val_loss: 0.3026 - val_accuracy: 0.8749\n",
      "Epoch 24/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.1617 - accuracy: 0.9461 - val_loss: 0.3040 - val_accuracy: 0.8733\n",
      "Epoch 25/40\n",
      "15000/15000 [==============================] - 1s 93us/sample - loss: 0.1523 - accuracy: 0.9507 - val_loss: 0.3014 - val_accuracy: 0.8749\n",
      "Epoch 26/40\n",
      "15000/15000 [==============================] - 1s 93us/sample - loss: 0.1440 - accuracy: 0.9534 - val_loss: 0.3020 - val_accuracy: 0.8752\n",
      "Epoch 27/40\n",
      "15000/15000 [==============================] - 1s 93us/sample - loss: 0.1364 - accuracy: 0.9575 - val_loss: 0.3069 - val_accuracy: 0.8741\n",
      "Epoch 28/40\n",
      "15000/15000 [==============================] - 1s 93us/sample - loss: 0.1293 - accuracy: 0.9607 - val_loss: 0.3037 - val_accuracy: 0.8777\n",
      "Epoch 29/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.1215 - accuracy: 0.9639 - val_loss: 0.3056 - val_accuracy: 0.8783\n",
      "Epoch 30/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.1150 - accuracy: 0.9671 - val_loss: 0.3077 - val_accuracy: 0.8776\n",
      "Epoch 31/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.1087 - accuracy: 0.9695 - val_loss: 0.3106 - val_accuracy: 0.8784\n",
      "Epoch 32/40\n",
      "15000/15000 [==============================] - 1s 93us/sample - loss: 0.1030 - accuracy: 0.9722 - val_loss: 0.3136 - val_accuracy: 0.8768\n",
      "Epoch 33/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.0968 - accuracy: 0.9749 - val_loss: 0.3174 - val_accuracy: 0.8763\n",
      "Epoch 34/40\n",
      "15000/15000 [==============================] - 1s 93us/sample - loss: 0.0915 - accuracy: 0.9766 - val_loss: 0.3206 - val_accuracy: 0.8765\n",
      "Epoch 35/40\n",
      "15000/15000 [==============================] - 1s 95us/sample - loss: 0.0863 - accuracy: 0.9791 - val_loss: 0.3240 - val_accuracy: 0.8762\n",
      "Epoch 36/40\n",
      "15000/15000 [==============================] - 1s 96us/sample - loss: 0.0813 - accuracy: 0.9814 - val_loss: 0.3275 - val_accuracy: 0.8763\n",
      "Epoch 37/40\n",
      "15000/15000 [==============================] - 1s 96us/sample - loss: 0.0771 - accuracy: 0.9835 - val_loss: 0.3316 - val_accuracy: 0.8758\n",
      "Epoch 38/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.0726 - accuracy: 0.9841 - val_loss: 0.3384 - val_accuracy: 0.8751\n",
      "Epoch 39/40\n",
      "15000/15000 [==============================] - 1s 94us/sample - loss: 0.0684 - accuracy: 0.9858 - val_loss: 0.3417 - val_accuracy: 0.8751\n",
      "Epoch 40/40\n",
      "15000/15000 [==============================] - 1s 95us/sample - loss: 0.0646 - accuracy: 0.9877 - val_loss: 0.3512 - val_accuracy: 0.8729\n",
      "CPU times: user 1min 15s, sys: 7.59 s, total: 1min 23s\n",
      "Wall time: 57.5 s\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "# ~1 minute\n",
    "history = model.fit(partial_x_train,\n",
    "                    partial_y_train,\n",
    "                    epochs=40,\n",
    "                    batch_size=512,\n",
    "                    validation_data=(x_val, y_val),\n",
    "                    verbose=1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\r",
      "25000/1 [================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================] - 2s 89us/sample - loss: 0.3742 - accuracy: 0.8609\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[0.37507408984184265, 0.86092]\n"
     ]
    }
   ],
   "source": [
    "results = model.evaluate(test_data, test_labels)\n",
    "print(results)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "dict_keys(['loss', 'accuracy', 'val_loss', 'val_accuracy'])"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "history_dict = history.history\n",
    "history_dict.keys()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEWCAYAAABrDZDcAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8QZhcZAAAgAElEQVR4nO3de5xVdb3/8dcHGO73ixcYZLBMGS4KTmihIWQetIQfyjEQ8lJGejQr8xSJlVGUmqnhIcsuWjLKoTwaXjmlFHUsBRRBRAR10AHkMgrIxXSYz++P79ozm2HPntves/ee/X4+Huux97rstT97wazP+l7Wd5m7IyIi+atNpgMQEZHMUiIQEclzSgQiInlOiUBEJM8pEYiI5DklAhGRPKdEICllZm3NbK+ZHZPKbTPJzD5sZinvZ21mZ5pZWdz8ejM7vSHbNuG7fmVm1zX180n2+wMzuyfV+5WW1S7TAUhmmdneuNnOwL+Ag9H8l9y9tDH7c/eDQNdUb5sP3P34VOzHzC4DZrj7GXH7viwV+5bWSYkgz7l79Yk4uuK8zN3/XNf2ZtbO3StbIjYRaRmqGpKkoqL/f5vZ/Wb2LjDDzD5mZv80s11mttXM5plZQbR9OzNzMyuK5hdE6x83s3fN7B9mNrix20brzzazV8xst5ndYWb/Z2aX1BF3Q2L8kpltNLN3zGxe3GfbmtltZlZhZq8BE5Icn9lmtrDWsvlmdmv0/jIzWxf9nlejq/W69lVuZmdE7zub2b1RbGuBk2tte72ZvRbtd62ZTYyWDwf+Czg9qnbbGXdsb4j7/OXRb68ws4fM7OiGHJv6mNnkKJ5dZvaUmR0ft+46M9tiZnvM7OW433qqmT0XLd9mZj9u6PdJiri7Jk24O0AZcGatZT8A3gfOJVw4dAI+CpxCKFEeC7wCXBVt3w5woCiaXwDsBEqAAuC/gQVN2PYI4F1gUrTuGuAD4JI6fktDYvwj0AMoAt6O/XbgKmAtUAj0AZaFP5WE33MssBfoErfv7UBJNH9utI0B44EDwIho3ZlAWdy+yoEzove3AH8BegGDgJdqbXsBcHT0b3JhFMOR0brLgL/UinMBcEP0/qwoxpOAjsDPgKcacmwS/P4fAPdE74dEcYyP/o2uA9ZH74cCm4Cjom0HA8dG75cD06L33YBTMv23kG+TSgTSEH9394fdvcrdD7j7cnd/xt0r3f014C5gbJLP/8HdV7j7B0Ap4QTU2G0/A6xy9z9G624jJI2EGhjjj9x9t7uXEU66se+6ALjN3cvdvQK4Mcn3vAa8SEhQAJ8C3nH3FdH6h939NQ+eAp4EEjYI13IB8AN3f8fdNxGu8uO/d5G7b43+Te4jJPGSBuwXYDrwK3df5e7vAbOAsWZWGLdNXccmmanAYnd/Kvo3upGQTE4BKglJZ2hUvfh6dOwgJPTjzKyPu7/r7s808HdIiigRSEO8GT9jZieY2aNm9paZ7QHmAH2TfP6tuPf7Sd5AXNe2/ePjcHcnXEEn1MAYG/RdhCvZZO4DpkXvL4zmY3F8xsyeMbO3zWwX4Wo82bGKOTpZDGZ2iZm9EFXB7AJOaOB+Ify+6v25+x7gHWBA3DaN+Tera79VhH+jAe6+Hvg64d9he1TVeFS06aVAMbDezJ41s3Ma+DskRZQIpCFqd538BeEq+MPu3h34DqHqI522EqpqADAz49ATV23NiXErMDBuvr7urYuAM81sAKFkcF8UYyfgD8CPCNU2PYH/bWAcb9UVg5kdC9wJXAH0ifb7ctx+6+vquoVQ3RTbXzdCFdTmBsTVmP22IfybbQZw9wXuPoZQLdSWcFxw9/XuPpVQ/fcT4AEz69jMWKQRlAikKboBu4F9ZjYE+FILfOcjwCgzO9fM2gFfAfqlKcZFwFfNbICZ9QG+mWxjd38L+DtwD7De3TdEqzoA7YEdwEEz+wzwyUbEcJ2Z9bRwn8VVceu6Ek72Owg58YuEEkHMNqAw1jiewP3AF8xshJl1IJyQ/+budZawGhHzRDM7I/ru/yS06zxjZkPMbFz0fQeiqYrwAz5nZn2jEsTu6LdVNTMWaQQlAmmKrwMXE/7If0Fo1E0rd98GfBa4FagAPgQ8T7jvIdUx3kmoy19DaMj8QwM+cx+h8be6WsjddwFfAx4kNLhOISS0hvguoWRSBjwO/C5uv6uBO4Bno22OB+Lr1f8EbAC2mVl8FU/s808QqmgejD5/DKHdoFncfS3hmN9JSFITgIlRe0EH4GZCu85bhBLI7Oij5wDrLPRKuwX4rLu/39x4pOEsVLWK5BYza0uoipji7n/LdDwiuUwlAskZZjYhqirpAHyb0Nvk2QyHJZLzlAgkl5wGvEaodvg3YLK711U1JCINpKohEZE8pxKBiEiey7lB5/r27etFRUWZDkNEJKesXLlyp7sn7HKdc4mgqKiIFStWZDoMEZGcYmZ13iGvqiERkTynRCAikueUCERE8lzOtRGISMv64IMPKC8v57333st0KNIAHTt2pLCwkIKCuoaaOpwSgYgkVV5eTrdu3SgqKiIM+irZyt2pqKigvLycwYMH1/+BSF5UDZWWQlERtGkTXksb9Th2kfz23nvv0adPHyWBHGBm9OnTp9Glt1ZfIigthZkzYf/+ML9pU5gHmN7s8RZF8oOSQO5oyr9Vqy8RzJ5dkwRi9u8Py0VEJA8SwRtvNG65iGSXiooKTjrpJE466SSOOuooBgwYUD3//vsNe2zBpZdeyvr165NuM3/+fEpTVG982mmnsWrVqpTsqyWkrWrIzH5DeOD4dncflmC9AT8lPJRiP3CJuz+X6jiOOSZUByVaLiKpV1oaStxvvBH+zubObV41bJ8+fapPqjfccANdu3bl2muvPWQbd8fdadMm8bXt3XffXe/3XHnllU0PMsels0RwD+EJRXU5GzgummYSnmqUcnPnQufOhy7r3DksF5HUirXJbdoE7jVtcunooLFx40aKi4uZPn06Q4cOZevWrcycOZOSkhKGDh3KnDlzqreNXaFXVlbSs2dPZs2axYknnsjHPvYxtm/fDsD111/P7bffXr39rFmzGD16NMcffzxPP/00APv27eP888+nuLiYKVOmUFJSUu+V/4IFCxg+fDjDhg3juuuuA6CyspLPfe5z1cvnzZsHwG233UZxcTEjRoxgxowZKT9mdUlbicDdl5lZUZJNJgG/8zAO9j+jB44c7e5bUxlH7EoklVcoIpJYsja5dPzNvfzyy/zud7+jpKQEgBtvvJHevXtTWVnJuHHjmDJlCsXFxYd8Zvfu3YwdO5Ybb7yRa665ht/85jfMmjXrsH27O88++yyLFy9mzpw5PPHEE9xxxx0cddRRPPDAA7zwwguMGjUqaXzl5eVcf/31rFixgh49enDmmWfyyCOP0K9fP3bu3MmaNWsA2LVrFwA333wzmzZton379tXLWkIm2wgGAG/GzZdHyw5jZjPNbIWZrdixY0ejv2j6dCgrg6qq8KokIJIeLd0m96EPfag6CQDcf//9jBo1ilGjRrFu3Tpeeumlwz7TqVMnzj77bABOPvlkysrKEu77vPPOO2ybv//970ydOhWAE088kaFDhyaN75lnnmH8+PH07duXgoICLrzwQpYtW8aHP/xh1q9fz9VXX82SJUvo0aMHAEOHDmXGjBmUlpY26oaw5sqJxmJ3v8vdS9y9pF+/hKOoikgWqKvtLV1tcl26dKl+v2HDBn7605/y1FNPsXr1aiZMmJCwP3379u2r37dt25bKysqE++7QoUO92zRVnz59WL16Naeffjrz58/nS1/6EgBLlizh8ssvZ/ny5YwePZqDBw+m9HvrkslEsBkYGDdfGC0TkRyVyTa5PXv20K1bN7p3787WrVtZsmRJyr9jzJgxLFq0CIA1a9YkLHHEO+WUU1i6dCkVFRVUVlaycOFCxo4dy44dO3B3/v3f/505c+bw3HPPcfDgQcrLyxk/fjw333wzO3fuZH/terY0yeQNZYuBq8xsIXAKsDvV7QMi0rIy2SY3atQoiouLOeGEExg0aBBjxoxJ+Xd8+ctf5qKLLqK4uLh6ilXrJFJYWMj3v/99zjjjDNydc889l09/+tM899xzfOELX8DdMTNuuukmKisrufDCC3n33Xepqqri2muvpVu3bin/DYmk7ZnFZnY/cAbQF9gGfBcoAHD3n0fdR/+L0LNoP3Cpu9f7xJmSkhLXg2lEWs66desYMmRIpsPICpWVlVRWVtKxY0c2bNjAWWedxYYNG2jXLrsGaUj0b2ZmK929JNH26ew1NK2e9Q7kb8ddEck5e/fu5ZOf/CSVlZW4O7/4xS+yLgk0Re7/AhGRFtKzZ09WrlyZ6TBSLid6DYmISPooEYiI5DklAhGRPKdEICKS55QIRCSrjRs37rCbw26//XauuOKKpJ/r2rUrAFu2bGHKlCkJtznjjDOorzv67bfffsiNXeecc05KxgG64YYbuOWWW5q9n1RQIhCRrDZt2jQWLlx4yLKFCxcybVrSHurV+vfvzx/+8Icmf3/tRPDYY4/Rs2fPJu8vGykRiEhWmzJlCo8++mj1Q2jKysrYsmULp59+enW//lGjRjF8+HD++Mc/Hvb5srIyhg0Lj0Q5cOAAU6dOZciQIUyePJkDBw5Ub3fFFVdUD2H93e9+F4B58+axZcsWxo0bx7hx4wAoKipi586dANx6660MGzaMYcOGVQ9hXVZWxpAhQ/jiF7/I0KFDOeussw75nkRWrVrFqaeeyogRI5g8eTLvvPNO9ffHhqWODXb317/+tfrBPCNHjuTdd99t8rGN0X0EItJgX/0qpPrBWyedBNE5NKHevXszevRoHn/8cSZNmsTChQu54IILMDM6duzIgw8+SPfu3dm5cyennnoqEydOrPO5vXfeeSedO3dm3bp1rF69+pBhpOfOnUvv3r05ePAgn/zkJ1m9ejVXX301t956K0uXLqVv376H7GvlypXcfffdPPPMM7g7p5xyCmPHjqVXr15s2LCB+++/n1/+8pdccMEFPPDAA0mfL3DRRRdxxx13MHbsWL7zne/wve99j9tvv50bb7yR119/nQ4dOlRXR91yyy3Mnz+fMWPGsHfvXjp27NiIo52YSgQikvXiq4fiq4Xcneuuu44RI0Zw5plnsnnzZrZt21bnfpYtW1Z9Qh4xYgQjRoyoXrdo0SJGjRrFyJEjWbt2bb0Dyv39739n8uTJdOnSha5du3Leeefxt7/9DYDBgwdz0kknAcmHuobwfIRdu3YxduxYAC6++GKWLVtWHeP06dNZsGBB9R3MY8aM4ZprrmHevHns2rUrJXc2q0QgIg2W7Mo9nSZNmsTXvvY1nnvuOfbv38/JJ58MQGlpKTt27GDlypUUFBRQVFSUcOjp+rz++uvccsstLF++nF69enHJJZc0aT8xsSGsIQxjXV/VUF0effRRli1bxsMPP8zcuXNZs2YNs2bN4tOf/jSPPfYYY8aMYcmSJZxwwglNjhVUIhCRHNC1a1fGjRvH5z//+UMaiXfv3s0RRxxBQUEBS5cuZVOiB5TH+cQnPsF9990HwIsvvsjq1auBMIR1ly5d6NGjB9u2bePxxx+v/ky3bt0S1sOffvrpPPTQQ+zfv599+/bx4IMPcvrppzf6t/Xo0YNevXpVlybuvfdexo4dS1VVFW+++Sbjxo3jpptuYvfu3ezdu5dXX32V4cOH881vfpOPfvSjvPzyy43+ztpUIhCRnDBt2jQmT558SA+i6dOnc+655zJ8+HBKSkrqvTK+4ooruPTSSxkyZAhDhgypLlmceOKJjBw5khNOOIGBAwceMoT1zJkzmTBhAv3792fp0qXVy0eNGsUll1zC6NGjAbjssssYOXJk0mqguvz2t7/l8ssvZ//+/Rx77LHcfffdHDx4kBkzZrB7927cnauvvpqePXvy7W9/m6VLl9KmTRuGDh1a/bS15kjbMNTpomGoRVqWhqHOPY0dhlpVQyIieU6JQEQkzykRiEi9cq0KOZ815d9KiUBEkurYsSMVFRVKBjnA3amoqGj0TWbqNSQiSRUWFlJeXs6OHTsyHYo0QMeOHSksLGzUZ5QIRCSpgoICBg8enOkwJI1UNSQikueUCERE8pwSgYhInlMiEBHJc0oEIiJ5TolARCTPKRGIiOQ5JQIRkTynRCAikueUCERE8pwSgYhInlMiEBHJc2lNBGY2wczWm9lGM5uVYP0xZrbUzJ43s9Vmdk464xERkcOlLRGYWVtgPnA2UAxMM7PiWptdDyxy95HAVOBn6YpHREQSS2eJYDSw0d1fc/f3gYXApFrbONA9et8D2JLGeEREJIF0JoIBwJtx8+XRsng3ADPMrBx4DPhyoh2Z2UwzW2FmK/RwDBGR1Mp0Y/E04B53LwTOAe41s8Nicve73L3E3Uv69evX4kGKiLRm6UwEm4GBcfOF0bJ4XwAWAbj7P4COQN80xiQiIrWkMxEsB44zs8Fm1p7QGLy41jZvAJ8EMLMhhESguh8RkRaUtkTg7pXAVcASYB2hd9BaM5tjZhOjzb4OfNHMXgDuBy5xd09XTCIicri0Prze3R8jNALHL/tO3PuXgDHpjEFERJLLdGOxiIhkmBKBiEieUyIQEclzSgQiInlOiUBEJM8pEYiI5DklAhGRPKdEICKS5/ImEezZA488kukoRESyT94kgp/8BCZOhLKyTEciIpJd8iYRXHYZmMHPf57pSEREskveJIKBA2HSJPjVr+C99zIdjYhI9sibRABw5ZVQUQGLFmU6EhGR7JFXiWD8eDjhBJg/P9ORiIhkj7xKBGbwH/8Bzz4LK1ZkOhoRkeyQV4kA4KKLoEsXlQpERGLyLhH06AGf+xwsXBjaC0RE8l3eJQIIjcbvvQe/+U2mIxERyby8TATDhsEnPgF33gkHD2Y6GhGRzMrLRAChVPD66/DEE5mOREQks/I2EUyeDEcfHRqNS0uhqAjatAmvpaWZjk5EpOW0y3QAmVJQADNnwpw5sHRpzd3GmzaF5QDTp2cuPhGRlpK3JQIIJ3z3w4ec2L8fZs/OTEwiIi0trxNB//51r3vjjZaLQ0Qkk/I6EQAceWTi5ccc07JxiIhkSt4ngltuCUNPxOvcGebOzUw8IiItLe8TwYwZcMklNfODBsFdd6mhWETyR94nAoB586B7dzj//HBvgZKAiOQTJQKga1f4ylfggQfgi1+EyspMRyQi0nKUCCLf+x58+9vw61+HJ5nt21ezTjeciUhrlrc3lNVmFm4uGzAgPLNg3Dh45BH405/C/Qb794ftdMOZiLQ25u6ZjqFRSkpKfEWanyqzeDFMnRruMzhwALZsOXybQYOgrCytYYiIpIyZrXT3kkTrVDWUwMSJ8OSTsGtX4iQAuuFMRFqPtCYCM5tgZuvNbKOZzapjmwvM7CUzW2tm96Uznsb42Mfg6aehXR2VZ7rhTERai7QlAjNrC8wHzgaKgWlmVlxrm+OAbwFj3H0o8NV0xdMUH/kI3H67bjgTkdYtnSWC0cBGd3/N3d8HFgKTam3zRWC+u78D4O7b0xhPk1x5ZbjBrFOnMN+5M9x2mxqKRaT1SGciGAC8GTdfHi2L9xHgI2b2f2b2TzObkGhHZjbTzFaY2YodO3akKdy6XXYZ7N0LN90E778PP/oRPPNMzXp1LxWRXJbpxuJ2wHHAGcA04Jdm1rP2Ru5+l7uXuHtJv379WjjEoE0b+MY34G9/C/OnnQY//jHce2/oTrppUxjSOta9VMlARHJFOhPBZmBg3HxhtCxeObDY3T9w99eBVwiJIWudeio8/3y46ewb3zj0HoMYPc9ARHJJOhPBcuA4MxtsZu2BqcDiWts8RCgNYGZ9CVVFr6UxppTo2RN+/3u4887DH2oTo+6lIpIrGpQIzOxDZtYhen+GmV2dqAonnrtXAlcBS4B1wCJ3X2tmc8xsYrTZEqDCzF4ClgL/6e4VTf0xLckMLr88PPc4EXUvFZFc0aA7i81sFVACFAGPAX8Ehrr7OWmNLoGWuLO4MUpLw0B1Bw7ULOvQIYxZpJ5FIpItUnFncVV0hT8ZuMPd/xOo41o4v0yfDr/8ZRhyAqBt29CzaMWKmrYD9SoSkWzW0ETwgZlNAy4GHomWFaQnpNwzfXoYd8gd3nkHrrgi3Ig2YgRcf716FYlIdmtoIrgU+Bgw191fN7PBwL3pCyt3desG8+fD0qXhxD93rnoViUh2a/Too2bWCxjo7qvTE1Jy2dZGkMy+feGhN4mYQVVVy8YjIvmr2W0EZvYXM+tuZr2B5wg3ft2ayiBboy5datoOalOvIhHJFg2tGurh7nuA84DfufspwJnpC6v1mDs3jE8UzwwuvTQz8YiI1NbQRNDOzI4GLqCmsVgaYPr0MGjdoEEhARxxBPTuHZ6GNns2/OtfmY5QRPJdQxPBHMLNX6+6+3IzOxbYkL6wWpdYr6KqKti2DV59FS65BH74wzDUdf/+6loqIpnToGcWu/vvgd/Hzb8GnJ+uoFq7Hj3CDWc9e8KtcS0teh6yiGRCQxuLC83sQTPbHk0PmFlhuoNr7R544PBl6loqIi2toVVDdxMGjOsfTQ9Hy6QZ6hqYbtOmlo1DRPJbQxNBP3e/290ro+keIDMPBmhFknUhvfLKQ8cvEhFJl4Ymggozm2FmbaNpBpATo4Rms0RdSzt1gnPOgZ/9DEaPhrVrMxObiOSPhiaCzxO6jr4FbAWmAJekKaa8Ubtr6aBBYQC7Rx+FJ56A7dth5Ejo0yesV68iEUmHRg8xUf1Bs6+6++0pjqdeuTTERHP97Gfw5S8fOhRF584heahXkYg0RiqGoU7kmmZ8Vhrg5psPH49IvYpEJNWakwgsZVFIQsl6FdX1iEwRkcZqTiJoWp2SNFiyXkUlJfDCCy0Xi4i0XkkTgZm9a2Z7EkzvEu4nkDRK1Kuoc2f4xjegoiL0KvrJTzSctYg0T9JE4O7d3L17gqmbuzdoeAppukS9iu66C266CdasCd1Mr70WPvUpKC/PdLQikqua3GsoU/Kp11B93MPYRL/+dXjfuzf89KcwY0amIxORbJOuXkOSYffdF6ZYLn/7bbj44vC8ZBGRhlIiyGGzZx/+POSqKrjmmnAPgtoORKQhlAhyWF3dS93DWEXjx8PGjS0bk4jkHiWCHFZX99JjjgntBqtWwYgRcNttcPBgy8YmIrlDiSCH1dW99Ic/hM9/PgxYN358qCoqKYGlSzMTp4hkNyWCHFZX99LYOEQDBsDUqdC3bygdjB8fEsIGPWRUROKo+2grVloaupfWblBu2zYMZved70CvXpmJTURalrqP5qlEvYogPPNg3jz48IfD6wcftHxsIpI9lAhasbp6Fe3bB88/H5518JWvwPDh4fkHIpKflAhasWS9ikaMgD/9CR5+ONxvcPbZMGkSvPZay8YoIpmnRNCK1dWraO7c8N4MPvOZMG7RjTfCk09CcTF897uJq5REpHVKayIwswlmtt7MNprZrCTbnW9mbmYJGzKkaerrVQShQfn44+Fb34KePWHUKJgzJySEBx+sGb5CRFqvtCUCM2sLzAfOBoqBaWZWnGC7bsBXgGfSFUs+mz4dyspC9U9Z2eFJYObM8KAbd9i8OTzjYPZs6NYNzjsP/u3f4OWXMxW9iLSEdJYIRgMb3f01d38fWAhMSrDd94GbAD1zq4Ul6lW0fz8sWBAak+fNg2efhWHD4KKL4KWXMhOniKRXOhPBAODNuPnyaFk1MxsFDHT3R5PtyMxmmtkKM1uxY8eO1Eeap+rqVfTGG9CuXbjX4JVX4Oqr4YEHQkI4/3xYubJl4xSR9MpYY7GZtQFuBb5e37bufpe7l7h7Sb9+/dIfXJ5I1qso5ogj4NZbQ/XR7NmhQbmkBCZMgGXLWiZOEUmvdCaCzcDAuPnCaFlMN2AY8BczKwNOBRarwbjl1NerKF7fvvD974fSwo9+BM89B2PHwumnwyOPaFA7kVyWzkSwHDjOzAabWXtgKrA4ttLdd7t7X3cvcvci4J/ARHfX+BEtpL5eRaWlUFQEbdqE19JS6N4dZs0KDc/z5oXXc8+FD30oDHb31luZ+z0i0jRpSwTuXglcBSwB1gGL3H2tmc0xs4np+l5pnLp6FdXuUbRpU5gvLQ3rO3cObQivvgqLFoVEMHs2DBwIU6bAn/+sB+OI5AoNOicJFRWFk39tgwaFhJHIK6+EEsU990BFRUgOM2fCpZeCmnZEMkuDzkmjJetRVJePfARuuQXKy0PJoX9/+OY3w3DYF1wQhrRQKUEk+ygRSEIN6VFUl44d4cILQ6+itWvhqqvgqafgrLNCKeEHPwg3r4lIdlAikIQa06MomeLi0P1082a4//6QCL797ZBQzj0XFi/WMNgimaZEIAk1dJyi2r2K6tKhQ3ha2p//DBs3hiqjFSvCiKd9+4Z1paXw9tvp/mUiuaeiAv7nf+pun2suNRZLkyR6+lnnzocni2QqK8NzEB56KNyLsG1beHramDGhtHDuuWFAPJF8s2tXqFpdujRMq1eH3ns/+Ul4BnlTJGssViKQJmlKr6Jkqqpg+fLwfISHHw7/8QGOOy7cuDZmDHz842HerDmRi2QH93DC3749TG+9Fcb2Wro0jPVVVRXa2z7+cRg3Lkwf/Si0b9+071MikJRr0ybxENVmqekZtGlTSAiPPw5PPx3+YAD69Al/GLGppOTwtgyRbLFnT3jexwsvhIub11+vOfFv3x5KxfHat4dTT6058Z9ySkgGqaBEICmX6hJBMlVVYSjsp58O0z/+UTM0dkFB+MMZPz5Mp5wS2iNEWop7qMMvLw83WK5efeiJP6Znz1CiPfLIMIZX7DU29esX1qfrwkaJQFKuIW0EpaXhbuM33gi9hObObXj7QX0qKuCf/6ypR125MiSMTp3gtNPC1dT48XDyyWEkVZGm2Ls3VNls2xZet24NPeDKy+HNN8NreTn86181n2nTJtxTc+KJ4ZGwI0aE94WFma3WVCKQtEh2ok9FY3JjxBrXnnoqTGvWhOWdOsHQoeGPcfjwmlfd6Zy/9u+vObFv25b4fWx+377DP19QEG6SLCysmQYODK+DBoUu0506tfzvqo8SgbS4lqw6SmT7dvjLX0KpYSZ9zO4AAAzxSURBVM2aUEzfvr1m/VFHhaRQXByu3o4/Prz27x+u6CR3xBpdt2wJV+vbtoV/6x07al7j3+/dm3g/ffqE6pqjjqqZ4udj7/v1y83/I0oE0uLS3ZjcFNu21SSF2OvLLx9eajnuuJAUPvKRkNDir/q6d1evpZbgDrt3hxP3zp01rzt3hn/H2El/y5YwHThw+D4KCsJJu1+/mjr4fv1qTujxr0ccEbZvzZIlAtWeSlocc0ziEkH8EBXpbENI5Mgjw3TmmTXLqqrCieSVV8K0fn14ff75cANP7ecsdO1akxgGDIAePcLznbt1C+vi33fvDr16Qe/eoaEwV9oq9u4NvV369m16V8WY998PJ/Q9ew59rahIPO3cWfO+do+amE6dwrHv3x9Gjw6vsWnAgJoTe48eStoNlSP/NSXXzJ2buI0gNkRF7TaE2DDXkN5kUFubNjUn9vHjD133wQchScQaBGtPTz0VTmzvvtuwUk58Yoglh+7dwwmre/fDpzZtwpXugQPhOMW/vvdeOCHG9lV7ip0EKyvD76j9um9fOOavv14zlZWF1507a2Lu0SPxVXVBQfjdiaZYItm9+9BG1EQKCkKVTGw6/vjwGvuevn0Pf+3SpdH/zFIPVQ1J2iS74s90G0IquYeT8969h58M33knDJtR+/Xtt0O99p49NcmkMX+KBQWpG6OpoCAc98GDa6YePcJVee169thUWVlTAoovCcXmY8kt/jX+fe/e4YTftauu2luK2ggk62RjG0ImVVXVJI/Y1XRVVShFde4crv47dQrvO3YMQ3F88EFIJrHEEj+98044lgUFYWrX7tDXjh1Dch48uPEN5O5hysUG03ymNgLJOtnYhpBJbdrUVAk1VHxjaEsy01V8a6OcLhlR3zDX9T0qU0RSR4lAMqK+Ya5nzz60oRnC/OzZLR+rSGunNgLJSmpDEEktPbNYck59j8pszENxRCQ5JQLJSsnaENR+IJJaSgSSlZK1Iaj9QCS1lAgka02fHm4uq6oKr7GG5DfeSLx9/HJVHYk0nBKB5JyGtB+o6kik4ZQIJOfUdw+Cqo5EGkeJQHJOffcgqOpIpHE0xITkpOnT6x5uor7hK7Jl5FORbKESgbQ6qjoSaRwlAml1VHUk0jiqGpJWSVVHIg2nEoHkHVUdiRxKiUDyjqqORA6V1kRgZhPMbL2ZbTSzWQnWX2NmL5nZajN70swGpTMekZi67loG3bAm+SdticDM2gLzgbOBYmCamRXX2ux5oMTdRwB/AG5OVzwiDdXcqiOVFiTXpLNEMBrY6O6vufv7wEJgUvwG7r7U3WN/Uv8ECtMYj0iDNKfqSKUFyUXpTAQDgDfj5sujZXX5AvB4ohVmNtPMVpjZih07dqQwRJHEmlp1pIZmyUVZ0VhsZjOAEuDHida7+13uXuLuJf1a+kndIrUkqzpSQ7PkonQmgs3AwLj5wmjZIczsTGA2MNHd/5XGeERSIlnVkRqaJRelMxEsB44zs8Fm1h6YCiyO38DMRgK/ICSB7WmMRSSl6qo6SsU9CioxSEtLWyJw90rgKmAJsA5Y5O5rzWyOmU2MNvsx0BX4vZmtMrPFdexOJCc09x4FlRgkE8zdMx1Do5SUlPiKFSsyHYZIkxQVJR7eYtCgULKobz2EpDB7dkgexxwTShsa+kLqY2Yr3b0k0bqsaCwWyRf1VR2pxCCZoEQg0oLqqzqqr7FZbQySDkoEIi0s2T0K6S4xKElIIhqGWiSLxJJCXW0A9Q2hXV+JQcNrSyIqEYhkmXSVGFStJHVRIhDJIc1pY0hFQ7QSReuk7qMirUjtp6tBKDHcdVe48m9O19Vk+1bVUvZT91GRPJGsxNDchmhVLbVeSgQirUxdbQzN7bqqqqXWS1VDIgLUX/XT3LuiVbWUWaoaEpF61VdiSHfVkkoLmaNEICLVknVdTWfVkqqVMkuJQEQarDn3ODTnyW5KFOmlRCAiKdGcqqVUVCspUTSDu+fUdPLJJ7uI5KYFC9wHDXI3C68LFoTlgwa5h1P4odOgQWG9WeL1Zg37/IIF7p07H7quc+ea708WW2sBrPA6zqsZP7E3dlIiEGl96jtRZzpRtIYkkSwRqGpIRDKuuT2WmnsPRLKqp7yodqorQ2TrpBKBSH5KdlWezhJFa6l2QlVDItLapStRtJb2CSUCEcl7TU0UmW6fqC/2hlIiEBGpR10n22xvyG6oZIlAjcUiIjR9sL5MNmSnihKBiEg9mjP0RroTRSooEYiINFMmE0UqKBGIiKRZOhNFKrRL3a5ERKQppk+v+5kMseWzZ4fqoGOOCUkglc9wUCIQEclyyRJFKqhqSEQkzykRiIjkOSUCEZE8p0QgIpLnlAhERPKchSEocoeZ7QA21bG6L7CzBcNprGyOT7E1jWJrGsXWNM2JbZC790u0IucSQTJmtsLdSzIdR12yOT7F1jSKrWkUW9OkKzZVDYmI5DklAhGRPNfaEsFdmQ6gHtkcn2JrGsXWNIqtadISW6tqIxARkcZrbSUCERFpJCUCEZE812oSgZlNMLP1ZrbRzGZlOp54ZlZmZmvMbJWZrchwLL8xs+1m9mLcst5m9icz2xC99sqi2G4ws83RsVtlZudkKLaBZrbUzF4ys7Vm9pVoecaPXZLYMn7szKyjmT1rZi9EsX0vWj7YzJ6J/l7/28zaZ1Fs95jZ63HH7aSWji0uxrZm9ryZPRLNp+e41fUw41yagLbAq8CxQHvgBaA403HFxVcG9M10HFEsnwBGAS/GLbsZmBW9nwXclEWx3QBcmwXH7WhgVPS+G/AKUJwNxy5JbBk/doABXaP3BcAzwKnAImBqtPznwBVZFNs9wJRM/5+L4roGuA94JJpPy3FrLSWC0cBGd3/N3d8HFgKTMhxTVnL3ZcDbtRZPAn4bvf8t8P9aNKhIHbFlBXff6u7PRe/fBdYBA8iCY5cktozzYG80WxBNDowH/hAtz9Rxqyu2rGBmhcCngV9F80aajltrSQQDgDfj5svJkj+EiAP/a2YrzWxmpoNJ4Eh33xq9fws4MpPBJHCVma2Oqo4yUm0Vz8yKgJGEK8isOna1YoMsOHZR9cYqYDvwJ0LpfZe7V0abZOzvtXZs7h47bnOj43abmXXIRGzA7cA3gKpovg9pOm6tJRFku9PcfRRwNnClmX0i0wHVxUOZM2uuioA7gQ8BJwFbgZ9kMhgz6wo8AHzV3ffEr8v0sUsQW1YcO3c/6O4nAYWE0vsJmYgjkdqxmdkw4FuEGD8K9Aa+2dJxmdlngO3uvrIlvq+1JILNwMC4+cJoWVZw983R63bgQcIfQzbZZmZHA0Sv2zMcTzV33xb9sVYBvySDx87MCggn2lJ3/59ocVYcu0SxZdOxi+LZBSwFPgb0NLPYo3Iz/vcaF9uEqKrN3f1fwN1k5riNASaaWRmhqns88FPSdNxaSyJYDhwXtai3B6YCizMcEwBm1sXMusXeA2cBLyb/VItbDFwcvb8Y+GMGYzlE7CQbmUyGjl1UP/trYJ273xq3KuPHrq7YsuHYmVk/M+sZve8EfIrQhrEUmBJtlqnjlii2l+MSuxHq4Fv8uLn7t9y90N2LCOezp9x9Ouk6bpluFU/VBJxD6C3xKjA70/HExXUsoRfTC8DaTMcG3E+oJviAUMf4BULd45PABuDPQO8siu1eYA2wmnDSPTpDsZ1GqPZZDayKpnOy4dgliS3jxw4YATwfxfAi8J1o+bHAs8BG4PdAhyyK7anouL0ILCDqWZSpCTiDml5DaTluGmJCRCTPtZaqIRERaSIlAhGRPKdEICKS55QIRETynBKBiEieUyIQiZjZwbgRJ1dZCkexNbOi+FFVRbJJu/o3EckbBzwMNyCSV1QiEKmHhedJ3GzhmRLPmtmHo+VFZvZUNDjZk2Z2TLT8SDN7MBrn/gUz+3i0q7Zm9sto7Pv/je5mxcyujp4lsNrMFmboZ0oeUyIQqdGpVtXQZ+PW7Xb34cB/EUaFBLgD+K27jwBKgXnR8nnAX939RMLzFdZGy48D5rv7UGAXcH60fBYwMtrP5en6cSJ10Z3FIhEz2+vuXRMsLwPGu/tr0eBub7l7HzPbSRi24YNo+VZ372tmO4BCD4OWxfZRRBjm+Lho/ptAgbv/wMyeAPYCDwEPec0Y+SItQiUCkYbxOt43xr/i3h+kpo3u08B8QulhedzokiItQolApGE+G/f6j+j904SRIQGmA3+L3j8JXAHVDz7pUddOzawNMNDdlxLGve8BHFYqEUknXXmI1OgUPa0q5gl3j3Uh7WVmqwlX9dOiZV8G7jaz/wR2AJdGy78C3GVmXyBc+V9BGFU1kbbAgihZGDDPw9j4Ii1GbQQi9YjaCErcfWemYxFJB1UNiYjkOZUIRETynEoEIiJ5TolARCTPKRGIiOQ5JQIRkTynRCAikuf+P46MKisAgERoAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "acc = history_dict['accuracy']\n",
    "val_acc = history_dict['val_accuracy']\n",
    "loss = history_dict['loss']\n",
    "val_loss = history_dict['val_loss']\n",
    "\n",
    "epochs = range(1, len(acc) + 1)\n",
    "\n",
    "# \"bo\" is for \"blue dot\"\n",
    "plt.plot(epochs, loss, 'bo', label='Training loss')\n",
    "# b is for \"solid blue line\"\n",
    "plt.plot(epochs, val_loss, 'b', label='Validation loss')\n",
    "plt.title('Training and validation loss')\n",
    "plt.xlabel('Epochs')\n",
    "plt.ylabel('Loss')\n",
    "plt.legend()\n",
    "\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEWCAYAAABrDZDcAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8QZhcZAAAgAElEQVR4nO3deZwU5bn3/8/FsC8iW9SAMohG9gGcoB5AxSXiSlSMIP4SNUok6uOWY4z6CPEJmsU1ifFIlqOJqCHJUTExmoOiqFHDqICAEZFFWYRhFRiUAa7fH3f1TM8w3dPMTE/3dH/fr1e9urqquvrqGqir7qXuMndHRETyV7NMByAiIpmlRCAikueUCERE8pwSgYhInlMiEBHJc0oEIiJ5TolA9mFmBWa23cwOa8htM8nMjjCzBu8rbWanmNmKuPcfmNnIVLatw3f9xsxuqevnRRJpnukApP7MbHvc27bAF8Ce6P133H36/uzP3fcA7Rt623zg7kc1xH7M7HLgYnc/MW7flzfEvkWqUyLIAe5ecSKOrjgvd/dZibY3s+buvrsxYhOpjf49Zp6qhvKAmf3IzP5oZk+Y2TbgYjM7zszeNLMtZrbWzH5uZi2i7ZubmZtZYfT+sWj9381sm5m9YWa99nfbaP3pZrbEzLaa2S/M7HUzuyRB3KnE+B0zW2pmm83s53GfLTCz+8xso5ktA0YnOT63mtmT1ZY9aGb3RvOXm9n70e/5KLpaT7SvVWZ2YjTf1sz+EMW2CDi62ra3mdmyaL+LzOycaPlA4JfAyKjabUPcsZ0S9/kro9++0cyeNrNDUjk2+3OcY/GY2Swz22Rmn5rZTXHf83+jY/KZmZWY2ZdrqoYzs9dif+foeM6JvmcTcJuZHWlms6Pv2BAdt45xn+8Z/cbSaP0DZtY6irlv3HaHmFmZmXVJ9HulBu6uKYcmYAVwSrVlPwJ2AWcTkn8b4KvAMYRS4eHAEuDqaPvmgAOF0fvHgA1AMdAC+CPwWB22/RKwDRgTrbsBKAcuSfBbUonxGaAjUAhsiv124GpgEdAD6ALMCf/ca/yew4HtQLu4fa8HiqP3Z0fbGHASsBMYFK07BVgRt69VwInR/N3Ay0AnoCewuNq23wAOif4mF0UxHBStuxx4uVqcjwFTovmvRTEOBloDvwJeSuXY7Odx7gisA64FWgEHAMOidT8A5gNHRr9hMNAZOKL6sQZei/2do9+2G5gEFBD+PX4FOBloGf07eR24O+73LIyOZ7to++HRumnA1LjvuRF4KtP/D5valPEANDXwHzRxInipls99D/hTNF/Tyf2/4rY9B1hYh20vA16NW2fAWhIkghRjPDZu/f8A34vm5xCqyGLrzqh+cqq27zeBi6L504EPkmz7V+CqaD5ZIvg4/m8BfDd+2xr2uxA4M5qvLRE8CtwZt+4AQrtQj9qOzX4e5/8PmJtgu49i8VZbnkoiWFZLDGNj3wuMBD4FCmrYbjiwHLDo/TzgvIb+f5Xrk6qG8scn8W/MrI+Z/S0q6n8G3AF0TfL5T+Pmy0jeQJxo2y/Hx+Hhf+6qRDtJMcaUvgtYmSRegMeB8dH8RdH7WBxnmdlbUbXFFsLVeLJjFXNIshjM7BIzmx9Vb2wB+qS4Xwi/r2J/7v4ZsBnoHrdNSn+zWo7zoYQTfk2SratN9X+PB5vZDDNbHcXwSLUYVnjomFCFu79OKF2MMLMBwGHA3+oYU95SIsgf1btOPky4Aj3C3Q8AbidcoafTWsIVKwBmZlQ9cVVXnxjXEk4gMbV1b50BnGJm3QlVV49HMbYB/gzcRai2ORD4R4pxfJooBjM7HHiIUD3SJdrvv+P2W1tX1zWE6qbY/joQqqBWpxBXdcmO8ydA7wSfS7RuRxRT27hlB1fbpvrv+wmht9vAKIZLqsXQ08wKEsTxe+BiQullhrt/kWA7SUCJIH91ALYCO6LGtu80wnf+FRhqZmebWXNCvXO3NMU4A7jOzLpHDYffT7axu39KqL54hFAt9GG0qhWh3roU2GNmZxHqslON4RYzO9DCfRZXx61rTzgZlhJy4hWEEkHMOqBHfKNtNU8A3zazQWbWipCoXnX3hCWsJJId55nAYWZ2tZm1MrMDzGxYtO43wI/MrLcFg82sMyEBfkrolFBgZhOJS1pJYtgBbDWzQwnVUzFvABuBOy00wLcxs+Fx6/9AqEq6iJAUZD8pEeSvG4FvERpvHyY06qaVu68DLgTuJfzH7g28S7gSbOgYHwJeBN4D5hKu6mvzOKHOv6JayN23ANcDTxEaXMcSEloqJhNKJiuAvxN3knL3BcAvgH9F2xwFvBX32f8FPgTWmVl8FU/s888TqnCeij5/GDAhxbiqS3ic3X0rcCpwPiE5LQFOiFb/DHiacJw/IzTcto6q/K4AbiF0HDii2m+ryWRgGCEhzQT+EhfDbuAsoC+hdPAx4e8QW7+C8Hf+wt3/uZ+/XahsYBFpdFFRfw0w1t1fzXQ80nSZ2e8JDdBTMh1LU6QbyqRRmdloQg+dnYTuh+WEq2KROonaW8YAAzMdS1OlqiFpbCOAZYS68dOAc9W4J3VlZncR7mW4090/znQ8TZWqhkRE8pxKBCIiea7JtRF07drVCwsLMx2GiEiT8vbbb29w9xq7a6ctEZjZ7whdvta7+4Aa1hvwAOHW/zLC7efv1LbfwsJCSkpKGjpcEZGcZmYJ765PZ9XQIyQZ8ZEwnsuR0TSR0O9bREQaWdoSgbvPIdyAk8gY4PcevAkcGBtGV0REGk8mG4u7U3XgqVUkGHfGzCZGY52XlJaWNkpwIiL5okk0Frv7NMLt6xQXF+/T37W8vJxVq1bx+eefN3pskrrWrVvTo0cPWrRINHyOiGRCJhPBaqqOzNiDuo2cyKpVq+jQoQOFhYWENmjJNu7Oxo0bWbVqFb169ar9AyLSaDJZNTQT+GY0auGxwFZ3X1uXHX3++ed06dJFSSCLmRldunRRqU2kDqZPh8JCaNYsvE6f3rD7T1siMLMnCMPHHmXhOa7ftvCM1SujTZ4jDDWwFPg14elN9fm+esUr6ae/kUjNkp3op0+HiRNh5UpwD68TJzZsMkhnr6Hx7n6Iu7dw9x7u/lt3/y93/69ovbv7Ve7e290HurtuDhCRJqm2K/b6nOhvvRXKyqrur6wsLG8oGmKiAWzcuJHBgwczePBgDj74YLp3717xfteuXSnt49JLL+WDDz5Ius2DDz7I9IYuE4pIrepzIq/vif7jBEPpJVpeJ5l+aPL+TkcffbRXt3jx4n2WJfPYY+49e7qbhdfHHtuvjyc1efJk/9nPfrbP8r179/qePXsa7ouaqP39W4k0lkTnhccec2/b1j2cxsPUtm3l+p49q66LTT17prberOb1Zql9PlVAievh9UFj1LfFLF26lH79+jFhwgT69+/P2rVrmThxIsXFxfTv35877rijYtsRI0Ywb948du/ezYEHHsjNN99MUVERxx13HOvXrwfgtttu4/7776/Y/uabb2bYsGEcddRR/POf4cFMO3bs4Pzzz6dfv36MHTuW4uJi5s2bt09skydP5qtf/SoDBgzgyiuvxKNRaJcsWcJJJ51EUVERQ4cOZcWKFQDceeedDBw4kKKiIm5tyDKpSBZIdl6o7xV7besPS/A07djyqVOhbduq69q2DcsbTKIMka1TfUsEDZVdE4kvEXz44YduZj537tyK9Rs3bnR39/Lych8xYoQvWrTI3d2HDx/u7777rpeXlzvgzz33nLu7X3/99X7XXXe5u/utt97q9913X8X2N910k7u7P/PMM37aaae5u/tdd93l3/3ud93dfd68ed6sWTN/991394kzFsfevXt93LhxFd83dOhQnzlzpru779y503fs2OEzZ870ESNGeFlZWZXP1oVKBJIutZX0k61Pdl6o7xV7betrK3Gk8ttSgUoElRqlvi1O7969KS4urnj/xBNPMHToUIYOHcr777/P4sWL9/lMmzZtOP300wE4+uijK67KqzvvvPP22ea1115j3LhxABQVFdG/f/8aP/viiy8ybNgwioqKeOWVV1i0aBGbN29mw4YNnH322UC4Aaxt27bMmjWLyy67jDZt2gDQuXPn/T8QImlU33r6ZOeF+l6x17Z+wgSYNg169gSz8DptWlgeM2ECrFgBe/eG1wl1fTp1AnmXCGr7oza0du3aVcx/+OGHPPDAA7z00kssWLCA0aNH19ivvmXLlhXzBQUF7N69u8Z9t2rVqtZtalJWVsbVV1/NU089xYIFC7jsssvUv1+yXrIG29qqb2pbn+y8UN8TeTac6GuTd4mgUerbEvjss8/o0KEDBxxwAGvXruWFF15o8O8YPnw4M2bMAOC9996rscSxc+dOmjVrRteuXdm2bRt/+ctfAOjUqRPdunXj2WefBcKNemVlZZx66qn87ne/Y+fOnQBs2pRsLEGRuqlPz5z61tMnOy80xIk80yf62uRdIkjlj5ouQ4cOpV+/fvTp04dvfvObDB8+vMG/45prrmH16tX069ePH/7wh/Tr14+OHTtW2aZLly5861vfol+/fpx++ukcc8wxFeumT5/OPffcw6BBgxgxYgSlpaWcddZZjB49muLiYgYPHsx9993X4HFLfkh0sq9vF8vaSvq1rU/lqj6bT+T1lqjxIFunhug+msvKy8t9586d7u6+ZMkSLyws9PLy8gxHVUl/q/yVrFG0vl0sa2twTaVBNtehxuL8sX37doYPH05RURHnn38+Dz/8MM2bN4lBZiUH1LUev75dLBuinj6vJcoQ2TqpRNC06W/VtCXrxljbVXeyq/qG6GIpyaESgYjUVzrr8Ruii6XUnRKBiFSoTxfNTPfMkbpT5bGIAJVX/LGTfeyKH8JJN5V6/JUr910fX48PlW0CsZJAfD2+Tu6ZoRKBSB6pzxV/Q4yJo6v67KRE0ABGjRq1z81h999/P5MmTUr6ufbt2wOwZs0axo4dW+M2J554IiUlyR/VcP/991MW9z/4jDPOYMuWLamELjmorn3161O1A6rHb9IStSJn65SNvYYefvhhv+SSS6osO+aYY/yVV15J+rl27drVuu8TTjihyqB1NenZs6eXlpbWHmgWyPTfKtfVp69+KgMypnMId0kv1GsovcaOHcvf/va3iofQrFixgjVr1jBy5Ei2b9/OySefzNChQxk4cCDPPPPMPp9fsWIFAwYMAMLwD+PGjaNv376ce+65FcM6AEyaNKliCOvJkycD8POf/5w1a9YwatQoRo0aBUBhYSEbNmwA4N5772XAgAEMGDCgYgjrFStW0LdvX6644gr69+/P1772tSrfE/Pss89yzDHHMGTIEE455RTWrVsHhHsVLr30UgYOHMigQYMqhqh4/vnnGTp0KEVFRZx88skNcmxlX+nqq6+qnTyWKENk61RbieDaa91POKFhp2uvrT3bnnnmmf7000+7exgK+sYbb3T3cKfv1q1b3d29tLTUe/fu7Xv37nX3yhLB8uXLvX///u7ufs899/ill17q7u7z58/3goKCihJBbPjn3bt3+wknnODz5893931LBLH3JSUlPmDAAN++fbtv27bN+/Xr5++8844vX77cCwoKKoanvuCCC/wPf/jDPr9p06ZNFbH++te/9htuuMHd3W+66Sa/Nu6gbNq0ydevX+89evTwZcuWVYm1OpUI6iedffVj+9cVf25CJYL0Gz9+PE8++SQATz75JOPHjwdCor3lllsYNGgQp5xyCqtXr664sq7JnDlzuPjiiwEYNGgQgwYNqlg3Y8YMhg4dypAhQ1i0aFGNA8rFe+211zj33HNp164d7du357zzzuPVV18FoFevXgwePBhIPNT1qlWrOO200xg4cCA/+9nPWLRoEQCzZs3iqquuqtiuU6dOvPnmmxx//PH06tUL0FDV9ZGuBl1d8UsiOdd9NKr9aHRjxozh+uuv55133qGsrIyjjz4aCIO4lZaW8vbbb9OiRQsKCwvrNOTz8uXLufvuu5k7dy6dOnXikksuqdfQ0bEhrCEMY11T1dA111zDDTfcwDnnnMPLL7/MlClT6vx9kpr6duGcOrXq56FqX31I3H1T8pdKBA2kffv2jBo1issuu6yiNACwdetWvvSlL9GiRQtmz57Nypo6Wsc5/vjjefzxxwFYuHAhCxYsAMIQ1u3ataNjx46sW7eOv//97xWf6dChA9u2bdtnXyNHjuTpp5+mrKyMHTt28NRTTzFy5MiUf9PWrVvp3r07AI8++mjF8lNPPZUHH3yw4v3mzZs59thjmTNnDsuXLwc0VHVd1bcLZ96Poil1okTQgMaPH8/8+fOrJIIJEyZQUlLCwIED+f3vf0+fPn2S7mPSpEls376dvn37cvvtt1eULIqKihgyZAh9+vThoosuqjKE9cSJExk9enRFY3HM0KFDueSSSxg2bBjHHHMMl19+OUOGDEn590yZMoULLriAo48+mq5du1Ysv+2229i8eTMDBgygqKiI2bNn061bN6ZNm8Z5551HUVERF154Ycrfk2+SVf2oQVcyIlHjQbZO2dh9VFKXD3+r+gzMpgZdSRfUWCzSOOo7MJuu+CUTlAhEGlB9B2bT3bmSCTmTCELJR7JZLv2NEtXz1/cBK6Arfml8OZEIWrduzcaNG3PqRJNr3J2NGzfSunXrTIdSb8mqfxpiYDaRxpYT9xH06NGDVatWUVpamulQJInWrVvTo0ePTIdRb8mqf5L14wf15ZfsZE3tKrq4uNhrG41TpL6mT098sm7WLJQEqjML1TnJPiuSKWb2trsX17QuJ0oEIg2ptrt7U3kAi0780pTkRBuBSENqiC6eIk2JEoHkpfrc3asunpJrVDUkeae+VT+x7XTil1yhEoHkHVX9iFSlRCA5SVU/IqlT1ZDkHFX9iOwflQgk56jqR2T/KBFIk6SqH5GGk9ZEYGajzewDM1tqZjfXsL6nmb1oZgvM7GUza/rjD0ja1TbUswZ2E9k/aUsEZlYAPAicDvQDxptZv2qb3Q383t0HAXcAd6UrHskdqvoRaVjpLBEMA5a6+zJ33wU8CYyptk0/4KVofnYN60X2oaofkYaVzkTQHfgk7v2qaFm8+cB50fy5QAcz61J9R2Y20cxKzKxEI4zmj0TtAKr6EWlYmW4s/h5wgpm9C5wArAb2VN/I3ae5e7G7F3fr1q2xY5QMSNYOoKofkYaVzvsIVgOHxr3vES2r4O5riEoEZtYeON/dt6QxJmkikrUDrFhRuY2Gehapv7Q9j8DMmgNLgJMJCWAucJG7L4rbpiuwyd33mtlUYI+7355sv3oeQX6obcx/Edk/yZ5HkLaqIXffDVwNvAC8D8xw90VmdoeZnRNtdiLwgZktAQ4CVLgXILV2ABFpGGltI3D359z9K+7e292nRstud/eZ0fyf3f3IaJvL3f2LdMYj2SXZTWFqBxBpPJluLJY8VdtNYeoCKtJ49MxiyYjCwpoHfuvZs7IxWEQaTkbaCESSqe2mMBFpPBqGWtJm+vTEXTxTGQpastP27bBmDezcGbr07ty573zz5qFNp127fac2beDzz8N+tm3b93XXLujWDQ45JExf/jIceGCoIpT0UCKQtKjtmQBTp1ZdD2oMzkZ798KSJfDGG/Dmm2FauLDxu/C2alWZGLp2DcmkdeuwvHXryqlVKygogD17YPfu8Fp9atYMWrQIyapFi6rzzZtX/m73fV9jsVT/3th3t2lTc+JrluV1L2ojkLRIpQ0gWYkhF+3aBZ99Vjlt2QIbN4Zp06bK+djUvHnlya/6dPDBIYmuXVvztG4dfPEFlJeHaffuyvny8hBPx47QqVPl1Llz5XxZGbz1Vpi2bKnc/phj4Ljj4IgjQuJu2zac6OJfW7cO31dWBjt27DuVlYVt27eHDh3Ca/x8y5awfn3i37ZhQ/htn39e+RqbajqdFRRUnfburXocGkOsdNSyZfKSTZcu0Ls3HH54mGLzPXuGRFUfydoIlAgkLXL5hrDPP4eSEpg7N5wkazrZxab4E/8XtXSObt06nAi6dAkn5d27K09+1e+yTiRWpXLQQeFkG7virX4FDLB1K2zeHJLQ5s2V065d4e83YAAce2zldNRR2X1l6x5O7nv2hN9aUFB7vLGSQ3zCNAtTs2b7vrqH4xNLPNUT0c6dyf897NqVPP5162DZMli+vOq/l2bNwsXSnXfC+PF1Oz7JEoGqhiQtcqkNoLQU/vlPeP11eO01ePvtqv+h4+vC4+e//GXo2xcOOKDmqWPHqif+6vdNxLiHuvP4q+JPPw3bx5cSDjqo/leN7pVJp127+u2rsZmFK+79ESsltGqVnpjqau/e0A6zbBl89FF4XbYs/I3TQSUCSYvqbQQQTlzZfC/A3r2hmmrx4jAtXBjqxD/4IKxv2RKKi2H48DAdd1yor87mq2SRGJUIpNHFTvbZ2AawZ09op4id8BcvhkWL4P33qyaugw6Cr34VLrkERowISaB160xFLZI+KhFInWV7Y+/evaFYHTvRx076//53qMuN6d4d+vULU//+4bVv31BdI5IrVCKQBldb99BM+fxzeOkleOYZmDkz1KXHHHZYOMmPGlV5wu/TJ/RRF8lnKhFInWTTEBGbN8Nzz8HTT8Pzz4cbk9q3hzPOgNNOg4EDwwm/Q4fGjUskm6hEIA0uk0NE7NkD8+aFK/8XXoBXXgnd/g4+OJRGxoyBk07Kvp4gItlKiUDqpDG7h+7dG+r4Z88OJ/9XXqm8yalvX7jxRvj612HYMPXgEakLJQKpk3QPEbF6dbjaf+GFkABKS8Pyww+H888PV/yjRoX+8yJSP0oEklCyXkEN3T30iy/CzVrPPx+mhQvD8kMOgdGjK0/8PXvW/3eJSFVqLJYaNcYNYdu2wRNPwLPPhiqfsrJwZ+zIkeHkP3p0GOZAo06K1J/GGpL9ls5eQR9+CL/8JTzySBiD5/DD4fTTw4n/xBNDjx8RaVjqNST7raF7Be3dG+r7f/EL+Pvfw5X/N74B11wTRrQUkcxRIpAaNVSvoM8+C1f+v/xlKAkcfDBMmQLf+U6YF5HMU2c7qdHUqfuOhrk/vYK2boU77ghVSddeG0bYfPzxkFwmT1YSEMkmKhFIjeraK2jrVnjgAbjvvtDXf8wYuOWW0MdfRLKTSgR5bvr00DDcrFl4nT69ct2ECaFheO/e8JosCWzdCv/v/4V9TJ4MJ5wA77wThn1QEhDJbioR5LGGGDjus89CCeDeeytLAJMnw5Ah6YlZRBqeSgR57NZb930EYllZWF6b8nJ48MHwTNXbb69aAlASEGlalAjyWF26iLqH4Z0HDoSrrw43fJWUKAGINGVKBHksUVfQRMtLSsIwD2PGhLt9Y3cEH310+mIUkfRTIshjqXYRXbkSLr44PLZx8WL41a/gvffgrLM0/INILlAiyGMTJoSxg3r2DCf0nj2rjiXkHu4EPuoo+MtfQjfQpUth0iRorm4GIjlD/53z3IQJNfcQ+vzzcMJ/5JFw5f+rX8GhhzZ6eCLSCGotEZjZNWbWqTGCkYaX7D6BRFavDr2AHnkkdAV95hklAZFclkqJ4CBgrpm9A/wOeMGb2pCleaou9wm8/np48MuOHfDUU+HJXyKS22otEbj7bcCRwG+BS4APzexOM+ud5tiknvb3PoFp00KvoA4d4M03lQRE8kVKjcVRCeDTaNoNdAL+bGY/TWNsUk+p3iewaxdceWUYEfTkk+Ff/4L+/dMfn4hkh1TaCK41s7eBnwKvAwPdfRJwNHB+muOTekjlPoE1a8JjIB9+GL7/ffjrX6GTWoRE8koqJYLOwHnufpq7/8ndywHcfS9wVlqjk3qp7T6B55+HoiJ4993wyMgf/xgKCho/ThHJrFQSwd+BTbE3ZnaAmR0D4O7vpyswqb9E9wl84xvwgx+Ex0MefHC4Y3jcuExHKyKZkkoieAjYHvd+e7SsVmY22sw+MLOlZnZzDesPM7PZZvaumS0wszNSC1tSVX0o6eOPD88F/vGP4YorQntA374ZDlJEMiqVRGDx3UWjKqFau52aWQHwIHA60A8Yb2b9qm12GzDD3YcA44BfpRq47L+//hUGD4YFC8LTwqZNgzZtMh2ViGRaKolgmZn9HzNrEU3XAstS+NwwYKm7L3P3XcCTwJhq2zhwQDTfEViTauCSul274MYb4eyzQ0PxO+/A+PGZjkpEskUqieBK4D+A1cAq4BhgYgqf6w58Evd+VbQs3hTgYjNbBTwHXJPCfiVObXcOr1oVqoPuvReuugreeAOOPDITkYpItqq1isfd1xOqbdJhPPCIu99jZscBfzCzAVH1UwUzm0iUfA5L1CcyD9V25/Crr8LYsbBzJ/zpT2FeRKS6VOr6WwPfBvoDrWPL3f2yWj66GogfoaZHtCzet4HR0f7eiL6rK7A+fiN3nwZMAyguLtbwFpFEdw7fckt4bOR118Hhh8PLL6tBWEQSS6Vq6A/AwcBpwCuEE/q2FD43FzjSzHqZWUtCqWJmtW0+Bk4GMLO+hERTmlrokuzO4auvhtGj1StIRGqXSiI4wt3/L7DD3R8FziS0EyTl7ruBq4EXgPcJvYMWmdkdZnZOtNmNwBVmNh94ArhEA9qlLlkt2e23h1FDO3ZsvHhEpGlKZfTR8uh1i5kNIIw39KVUdu7uzxEageOX3R43vxgYnlqoUt3UqVXbCGKuuw5++MPMxCQiTU8qJYJp0fMIbiNU7SwGfpLWqCQlsTuHO3cO75s3h5/8BO67L7NxiUjTkrREYGbNgM/cfTMwBzi8UaKSlLVoAZs2heEinnhCVUEisv+Slgiibpw3NVIssp9efx2++U0YPhz+53+UBESkblKpGpplZt8zs0PNrHNsSntkktTSpTBmTGgwfvppaN269s+IiNQklURwIXAVoWro7WgqSWdQUqmmO4c3bAhVQQDPPQddu2YyQhFp6lK5s7hXYwQi+6rpzuErrggPkv/kE3jpJTjiiMzGKCJNXyp3Fn+zpuXu/vuGD0fi1XTn8M6dsGQJzJgB//EfmYlLRHJLKvcRfDVuvjXhTuB3ACWCNEt05zDABRc0XhwikttSqRqqMiKomR1IGFJa0uyww0J1UE3LRUQaSiqNxdXtAMjsoDwAABBiSURBVNRu0AhqeuZwmzZw552ZiUdEclMqbQTPEh4gAyFx9ANmpDMoCSZMCD2EbrghPGry0EPhrrvCchGRhpJKG8HdcfO7gZXuvipN8Uic8nL44x+hXbvwVDH1EBKRdEglEXwMrHX3zwHMrI2ZFbr7irRGJtxyS3ii2B//qCQgIumTShvBn4D4J4btiZZJGj37LNx9N3z3u/CNb2Q6GhHJZakkgubRw+cBiOZbpi8kWbkSvvUtGDIE7rkn09GISK5LJRGUxj1IBjMbA2xIX0j5bdcuuPBC2LMnPGdYYwiJSLqlkgiuBG4xs4/N7GPg+8B30htW/qg+ltDXvw5vvQW//S307p3p6EQkH6RyQ9lHwLFm1j56vz3tUeWJmsYSWrkSTj0Vxo7NbGwikj9qLRGY2Z1mdqC7b3f37WbWycx+1BjB5bqaxhIC+OCDxo9FRPJXKlVDp7v7ltib6GllZ6QvpPyRaCyhTz5p3DhEJL+lkggKzKxV7I2ZtQFaJdleUpRozCCNJSQijSmVRDAdeNHMvm1mlwP/Czya3rDyw+23h0bieG3bhjGGREQaSyqNxT8xs/nAKYQxh14AeqY7sFy3dSs88gi4Q+fOsHlzKAlMnaqxhESkcaUyxATAOkISuABYDvwlbRHlgQ0b4LTTYMECeOKJcN+AiEimJEwEZvYVYHw0bQD+CJi7j2qk2HLS6tWhe+jy5fDMM3CGmt1FJMOSlQj+DbwKnOXuSwHM7PpGiSpHffQRnHIKbNwIzz8PJ5yQ6YhERJI3Fp8HrAVmm9mvzexkwBonrNyzcCGMHAnbtoWHzisJiEi2SJgI3P1pdx8H9AFmA9cBXzKzh8zsa40VYC5YvLjyxD9nDhQXZzYeEZF4tXYfdfcd7v64u58N9ADeJYw3JCnYuBHOPhtatoTXXoN+/TIdkYhIVfv1zGJ33+zu09z95HQFlEvKy8OzBGJ3EB9xRBhYbvr0jIYlIlJFXR5eLym68cbQHtCsGXz6abhnYOXKMNCckoGIZAslgjT5zW/gF7+ADh3CMwbilZWFAedERLKBEkEavPZaeMTk174WegnVJNGAcyIijU2JoIF9/DGcd15oC3jySeiZYDAODSwnItlCiaAB7dgBY8bAF1/AzJnQqVMYO6ht26rbaWA5EckmSgQNxB0uvRTmzw/jB/XpE5ZPmADTpoWSgVl4nTZNA8uJSPZIddA5qcXUqeFh8z/96b7jB02YoBO/iGQvlQgawBtvhGcLTJgA3/tepqMREdk/SgT1VF4e7gvo3h0eeihU/4iINCVpTQRmNtrMPjCzpWZ2cw3r7zOzedG0xMy21LSfbHbPPWFAuV/+MtwzICLS1KStjcDMCoAHgVOBVcBcM5vp7otj27j79XHbXwMMSVc86fDRR/DDH8K554beQiIiTVE6SwTDgKXuvszddwFPAslOl+OBJ9IYT4NyDzeNtWgR7iAWEWmq0pkIugOfxL1fFS3bh5n1BHoBLyVYP9HMSsyspLS0tMEDrYsnnoB//APuvDO0D4iINFXZ0lg8Dvizu++paWU04mmxuxd369atkUPb16ZNcN11MGwYTJqU6WhEROonnYlgNXBo3Pse0bKajKMJVQvddFNIBtOmQUFBGEm0sDCMMqphpkWkqUnnDWVzgSPNrBchAYwDLqq+kZn1AToBb6QxlgYzZw789rfwn/8JRUXhpD9xYhhRFCqHmQbdRCYiTUPaSgTuvhu4GngBeB+Y4e6LzOwOMzsnbtNxwJPu7umKpaF88QV85zvhqn/y5LDs1lsrk0CMhpkWkaYkrUNMuPtzwHPVlt1e7f2UdMbQkH7yE/j3v+G556Bdu7As0XDSGmZaRJqKbGksznoffBDGE7rwQjj99MrliYaT1jDTItJUKBGkwB2uvDIMH33//VXXaZhpEWnqlAhS8N//DS+/HKqGDj646joNMy0iTZ01gTbaKoqLi72kpKTRvm/dOujbFwYMCMmgmVKniDRBZva2uxfXtE6ntVpcd1148ti0aUoCIpKbdGpL4rnnwnOHb7218oljIiK5Rokgge3bw/ARffvC97+f6WhERNJHj6pM4Pbbw70Ar70GrVplOhoRkfRRiaAGc+fCAw+ELqPDh2ssIRHJbSoRVFNeDldcAQcdBD/+scYSEpHcpxJBNffdB/Pnh0dPduyosYREJPcpEcT56COYMgW+/nU477ywTGMJiUiuUyKIxIaRaN48lAZiNJaQiOQ6JYLI9Okwa1ZoF4h/9KTGEhKRXKdEEHnooTCMxJVXVl2usYREJNep1xDw2Wfw1lvhxrGahpGYMEEnfhHJXSoRAK+8Anv2wCmnZDoSEZHGp0RAaBto0waOOy7TkYiIND4lAkIiGDkSWrfOdCQiIo0v7xPBmjWweLGqhUQkf+V9InjxxfCqRCAi+SrvE8GsWdChQ7ibWIPKiUg+yuvuo+4wc2YYO2jbtrBMg8qJSL7J6xLB++/Dli2h62g8DSonIvkkrxPBrFmJ12lQORHJF3mfCJonqBzToHIiki/yNhGUl8PLL8Pxx2tQORHJb3mbCObODQ3EkyZpUDkRyW9522to1qxw4h81Crp00YlfRPJX3pYIZs2CoUNDEhARyWd5mQi2b4c33tDdxCIikKeJYM4c2L0bTj0105GIiGReXiaCWbPCSKPDh2c6EhGRzMvbRDBihIadFhGBPEwEn34K772n9gERkZi8SwQadlpEpKq8SwSzZkHnzjB4cKYjERHJDnmVCNxDIjjpJCgoyHQ0IiLZIa8SwZIlsGqVqoVEROKlNRGY2Wgz+8DMlprZzQm2+YaZLTazRWb2eDrjiQ07rUQgIlIpbWMNmVkB8CBwKrAKmGtmM919cdw2RwI/AIa7+2Yz+1K64oGQCHr1gt690/ktIiJNSzpLBMOApe6+zN13AU8CY6ptcwXwoLtvBnD39ekKZvdumD1bpQERkerSmQi6A5/EvV8VLYv3FeArZva6mb1pZqNr2pGZTTSzEjMrKS0trVMwb78NW7cqEYiIVJfpxuLmwJHAicB44NdmdmD1jdx9mrsXu3txt27d6vRFsfaBk06qa6giIrkpnc8jWA0cGve+R7Qs3irgLXcvB5ab2RJCYpjb0MFMnBjuHejataH3LCLStKWzRDAXONLMeplZS2AcMLPaNk8TSgOYWVdCVdGydATTrRuceWY69iwi0rSlLRG4+27gauAF4H1ghrsvMrM7zOycaLMXgI1mthiYDfynu29MV0wiIrIvc/dMx7BfiouLvaSkJNNhiIg0KWb2trsX17Qu043FIiKSYUoEIiJ5TolARCTPKRGIiOS5vEgE06dDYSE0axZep0/PdEQiItkjnTeUZYXp08PNZGVl4f3KleE9wIQJmYtLRCRb5HyJ4NZbK5NATFlZWC4iInmQCD7+eP+Wi4jkm5xPBIcdtn/LRUTyTc4ngqlToW3bqsvatg3LRUQkDxLBhAkwbRr07Alm4XXaNDUUi4jE5HyvIQgnfZ34RURqlvMlAhERSU6JQEQkzykRiIjkOSUCEZE8p0QgIpLnmtwTysysFFiZYHVXYEMjhrO/sjk+xVY3iq1uFFvd1Ce2nu7eraYVTS4RJGNmJYkexZYNsjk+xVY3iq1uFFvdpCs2VQ2JiOQ5JQIRkTyXa4lgWqYDqEU2x6fY6kax1Y1iq5u0xJZTbQQiIrL/cq1EICIi+0mJQEQkz+VMIjCz0Wb2gZktNbObMx1PPDNbYWbvmdk8MyvJcCy/M7P1ZrYwbllnM/tfM/sweu2URbFNMbPV0bGbZ2ZnZCi2Q81stpktNrNFZnZttDzjxy5JbBk/dmbW2sz+ZWbzo9h+GC3vZWZvRf9f/2hmLbMotkfMbHnccRvc2LHFxVhgZu+a2V+j9+k5bu7e5CegAPgIOBxoCcwH+mU6rrj4VgBdMx1HFMvxwFBgYdyynwI3R/M3Az/JotimAN/LguN2CDA0mu8ALAH6ZcOxSxJbxo8dYED7aL4F8BZwLDADGBct/y9gUhbF9ggwNtP/5qK4bgAeB/4avU/LccuVEsEwYKm7L3P3XcCTwJgMx5SV3H0OsKna4jHAo9H8o8DXGzWoSILYsoK7r3X3d6L5bcD7QHey4NgliS3jPNgevW0RTQ6cBPw5Wp6p45YotqxgZj2AM4HfRO+NNB23XEkE3YFP4t6vIkv+I0Qc+IeZvW1mEzMdTA0Ocve10fynwEGZDKYGV5vZgqjqKCPVVvHMrBAYQriCzKpjVy02yIJjF1VvzAPWA/9LKL1vcffd0SYZ+/9aPTZ3jx23qdFxu8/MWmUiNuB+4CZgb/S+C2k6brmSCLLdCHcfCpwOXGVmx2c6oEQ8lDmz5qoIeAjoDQwG1gL3ZDIYM2sP/AW4zt0/i1+X6WNXQ2xZcezcfY+7DwZ6EErvfTIRR02qx2ZmA4AfEGL8KtAZ+H5jx2VmZwHr3f3txvi+XEkEq4FD4973iJZlBXdfHb2uB54i/GfIJuvM7BCA6HV9huOp4O7rov+se4Ffk8FjZ2YtCCfa6e7+P9HirDh2NcWWTccuimcLMBs4DjjQzGKPys34/9e42EZHVW3u7l8A/01mjttw4BwzW0Go6j4JeIA0HbdcSQRzgSOjFvWWwDhgZoZjAsDM2plZh9g88DVgYfJPNbqZwLei+W8Bz2QwlipiJ9nIuWTo2EX1s78F3nf3e+NWZfzYJYotG46dmXUzswOj+TbAqYQ2jNnA2GizTB23mmL7d1xiN0IdfKMfN3f/gbv3cPdCwvnsJXefQLqOW6ZbxRtqAs4g9Jb4CLg10/HExXU4oRfTfGBRpmMDniBUE5QT6hi/Tah7fBH4EJgFdM6i2P4AvAcsIJx0D8lQbCMI1T4LgHnRdEY2HLsksWX82AGDgHejGBYCt0fLDwf+BSwF/gS0yqLYXoqO20LgMaKeRZmagBOp7DWUluOmISZERPJcrlQNiYhIHSkRiIjkOSUCEZE8p0QgIpLnlAhERPKcEoFIxMz2xI04Oc8acBRbMyuMH1VVJJs0r30Tkbyx08NwAyJ5RSUCkVpYeJ7ETy08U+JfZnZEtLzQzF6KBid70cwOi5YfZGZPRePczzez/4h2VWBmv47Gvv9HdDcrZvZ/omcJLDCzJzP0MyWPKRGIVGpTrWrowrh1W919IPBLwqiQAL8AHnX3QcB04OfR8p8Dr7h7EeH5Coui5UcCD7p7f2ALcH60/GZgSLSfK9P140QS0Z3FIhEz2+7u7WtYvgI4yd2XRYO7feruXcxsA2HYhvJo+Vp372pmpUAPD4OWxfZRSBjm+Mjo/feBFu7+IzN7HtgOPA087ZVj5Is0CpUIRFLjCeb3xxdx83uobKM7E3iQUHqYGze6pEijUCIQSc2Fca9vRPP/JIwMCTABeDWafxGYBBUPPumYaKdm1gw41N1nE8a97wjsUyoRSSddeYhUahM9rSrmeXePdSHtZGYLCFf146Nl1wD/bWb/CZQCl0bLrwWmmdm3CVf+kwijqtakAHgsShYG/NzD2PgijUZtBCK1iNoIit19Q6ZjEUkHVQ2JiOQ5lQhERPKcSgQiInlOiUBEJM8pEYiI5DklAhGRPKdEICKS5/5/WVA+qT6zMwsAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.clf()   # clear figure\n",
    "\n",
    "plt.plot(epochs, acc, 'bo', label='Training acc')\n",
    "plt.plot(epochs, val_acc, 'b', label='Validation acc')\n",
    "plt.title('Training and validation accuracy')\n",
    "plt.xlabel('Epochs')\n",
    "plt.ylabel('Accuracy')\n",
    "plt.legend()\n",
    "\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "b\"Outside of the fact that George Lopez is a pretentious jerk, his show is terrible.<br /><br />Nothing about Lopez has ever been funny. I have watched his stand-up and have never uttered any resemblance to a laugh.<br /><br />His stuff comes across as vindictive and his animosity towards white people oozes out of every single pore of his body.<br /><br />I have laughed at white people jokes from many a comedian and love many of them.<br /><br />This guy has a grudge that won't end.<br /><br />I feel bad for Hispanics who have only this show to represent themselves.<br /><br />The shows plots are always cookie cutter with an Hispanic accent.<br /><br />Canned laugh at the dumbest comments and scenes.<br /><br />Might be why this show is always on at 2AM in replay.\""
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "partial_x_train[1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "partial_y_train[1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[0.00243256],\n",
       "       [0.12461526],\n",
       "       [0.99865204]], dtype=float32)"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model.predict(partial_x_train[0:3])\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "b'As we all know the sub-genre of sex comedies is pretty crowded. Simply being excessively raunchy isn\\'t enough anymore. I\\'ve seen and heard so many disgusting jokes and actions that a sex comedy really needs to have other positive points to appeal to me these days.<br /><br />Coming into the 40 Year Old Virgin I knew basically what to expect; I did see the commercials after all; \"is it true that if you don\\'t use it, you lose it?\" What I didn\\'t expect to find is a heart and honest attempts at character development. There\\'s still the weird \"off-the-wall\" characters that we see so much in Adam Sandler movies and there\\'s still enough inappropriate language to sink Noah\\'s Ark but somehow the movie has a worthwhile love story and yes even a message.<br /><br />The main character Andy is (unfortunately for me) a person I can relate to. In the first shot I see that he even shares my love for Mystery Science Theater 3000 (he has a poster for the movie on his wall) and throughout the movie we get to see his really neat collection of antiquities. Andy also has plenty of video games and a working knowledge of films and technology. Andy doesn\\'t want to buy a car because he prefers his bike. Most importantly of all; Andy is a nice person, he doesn\\'t swear and he respect women so much that he stays away from them. Combine all these factors and everybody begins to think he\\'s a serial murderer. It\\'s like my life story.<br /><br />The other characters each have funny little stories to go along with their slightly exaggerated personalities and they all work on a certain level but not the way Andy does. I felt that it was sort of distracting in a way since Andy and his girlfriend Trish are really the only truly human characters in the entire movie.<br /><br />I suppose since I mentioned one flaw I might as well bring the other noticeable one to light. The story is clever but too predictable and as far as romances go; it\\'s quite simple. It deals with Andy\\'s relationship with Trish for a long time and we all know what\\'s going to happen in the end. Sure its final detour is a bit different than we may expect but you know what\\'s going to happen in the end, and I assure you it does. These are definitely small stains on the movie but there\\'s so much good here that I can easily ignore it\\'s few faults.<br /><br />When I say \"good\" I mean \"bad\" of course. This is a sex comedy and it wants to be bad. For the most part I think it succeeded. There are so many hilarious scenes such as Andy trying to get rid of an erection after refusing to have sex with Trish. Or the scene where Andy goes with his Trish\\'s daughter to a sexual education class where he ends up asking more questions than anybody else. Ah and we must not forget the soon to be classic chest waxing sequence \"Ooh! Como se llama!\" An interesting little note about that scene; the actor Steve Carell actually did wax his belly and the pain shown is real. Of course they only did one take but it was still a very brave thing to do on his part.<br /><br />Actually since we\\'re talking about Steve Carell, I\\'d like to say that he has now risen on my list of respected comedians which is sort of odd since I didn\\'t even know who he was prior to seeing this film. I was just so impressed by his writing, acting and timing that I now really want to keep an eye out for his future roles. This man has talent it The 40 Year Old Virgin proves that.<br /><br />To be honest I had doubts about this film but early word was positive and I knew it was something I was eventually going to see. I\\'m glad that I did too since it\\'s probably one of the funniest movies I\\'ve seen in a long time and it doubles as something you feel is worth watching. It\\'s not simply a series of sex gags lumped together rather it\\'s a series of sex gags entwined with a very worthwhile character and a truly touching romance. Now excuse me while I go puke my guts out; I can\\'t believe I just wrote that...<br /><br />My review from Frider Waves: http://friderwaves.com/index.php?page=virgin'"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "partial_x_train[2]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[0.8562],\n",
       "       [0.01  ],\n",
       "       [0.9305]], dtype=float32)"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%precision 7\n",
    "np.set_printoptions(precision=4, suppress=True)\n",
    "model.predict(['good movie','bad actor', 'I would love to see more action.'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[0.0455],\n",
       "       [0.0455]], dtype=float32)"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model.predict(['good movie but bad actor', 'bad movie but good actor'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[0.8888],\n",
       "       [0.9403]], dtype=float32)"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model.predict(['Good', 'good'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}