24.1 Pytorch Practice_Fashion MNIST.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# PyTorch实践_Fashion MNIST"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Fashion-MNIST介绍"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "我们在神经网络介绍中，通过CNN对MNIST数据集做了分类实践，MNIST是做什么的呢？\n",
    "\n",
    "经典的 MNIST 数据集包含了大量的手写数字。十几年来，来自机器学习、机器视觉、人工智能、深度学习领域的研究员们把这个数据集作为衡量算法的基准之一。你会在很多的会议，期刊的论文中发现这个数据集的身影。实际上，MNIST 数据集已经成为算法作者的必测的数据集之一。有人曾调侃道：\" 如果一个算法在 MNIST 不 work, 那么它就根本没法用；而如果它在 MNIST 上 work, 它在其他数据上也可能不 work！\"\n",
    "\n",
    "<img src='./image/mnist.png' />\n",
    "\n",
    "但是对于MNIST的诟病也有很多：\n",
    "\n",
    ">MNIST 太简单了，很多算法在测试集上的性能已经达到 99.6%！不妨看看我们基于 scikit-learn 上对经典机器学习算法的评测 和这段代码： \"Most pairs of MNIST digits can be distinguished pretty well by just one pixel\"（翻译：大多数 MNIST 只需要一个像素就可以区分开！）\n",
    "\n",
    ">MNIST 被用烂了。参考：\"Ian Goodfellow wants people to move away from mnist\"（翻译：Ian Goodfellow 希望人们不要再用 MNIST 了。）\n",
    "\n",
    ">MNIST 数字识别的任务不代表现代机器学习。参考：\"Fran ç ois Cholle: Ideas on MNIST do not transfer to real CV\" （翻译：在 MNIST 上看似有效的想法没法迁移到真正的机器视觉问题上。）\n",
    "\n",
    "FashionMNIST 是一个替代 MNIST 手写数字集的图像数据集。 它是由 Zalando（一家德国的时尚科技公司）旗下的研究部门提供。其涵盖了来自 10 种类别的共 7 万个不同商品的正面图片。FashionMNIST 的大小、格式和训练集 / 测试集划分与原始的 MNIST 完全一致。60000/10000 的训练测试数据划分，28x28 的灰度图片。你可以直接用它来测试你的机器学习和深度学习算法性能，且不需要改动任何的代码。\n",
    "\n",
    "简单来说：\n",
    "Fashion-MNIST 的目的是要成为 MNIST 数据集的一个直接替代品。作为算法作者，你不需要修改任何的代码，就可以直接使用这个数据集。Fashion-MNIST 的图片大小，训练、测试样本数及类别数与经典 MNIST 完全相同。\n",
    "\n",
    "相关文章：[连 LeCun 都推荐的 Fashion-MNIST 数据集，是这位华人博士的成果](http://app.myzaker.com/news/article.php?pk=59a3e2ebd1f149c0130000fb)\n",
    "\n",
    "具体GitHub的链接：[fashion-mnist](https://github.com/zalandoresearch/fashion-mnist)\n",
    "\n",
    "Fashion-MNIST的示意图：\n",
    "<img src='./image/fashion-mnist-sprite.png' />"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 相关文件下载"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "其GitHub有下载地址：\n",
    "<img src='./image/fmdl.png' />"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "将这四个文件下载下来，并解压，得到4个没有扩展名的二进制文件，train开头的文件是训练集，t10k开头的文件是测试集。\n",
    "\n",
    "一会我们将图像以及分类标签，从这四个文件拆分出来。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Fashion-MNIST的标签如下：\n",
    "<img src='./image/fmlabel.png' />"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "之后，将下载的fashion-mnist的压缩包，解压到合适目录，如```./pytorchdata_fashionmnist```：\n",
    "<img src='./image/fmpath.png' />"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "其中没有扩展名的二进制文件是我们的训练集以及测试集；\n",
    "\n",
    "train与test文件夹是提取的图片文件保存路径，每个文件都是```28*28```的图片\n",
    "\n",
    "train.txt与test.txt是图片与label的mapping信息，如：\n",
    "\n",
    "```\n",
    "./data/train/0.jpg 9\n",
    "./data/train/1.jpg 0\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 通过PyTorch训练CNN模型"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "下面我们开工，通过PyTorch制作一个CNN网络"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "导入需要的组件包\n",
    "\n",
    "skimage的目的，是将fashion-mnist的图片二进制数据，保存为图片文件到本地"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import os\n",
    "from skimage import io\n",
    "import torchvision.datasets.mnist as mnist\n",
    "import torch\n",
    "from torch.autograd import Variable\n",
    "from torchvision import transforms\n",
    "from torch.utils.data import Dataset, DataLoader\n",
    "import torch.backends.cudnn as cudnn\n",
    "from PIL import Image\n",
    "import matplotlib.pyplot as plt\n",
    "import re"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "设置fashion-mnist的相关数据文件目录"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "root = './pytorchdata_fashionmnist/'\n",
    "if not os.path.exists(root):\n",
    "    os.makedirs(root)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "定义图像转换函数\n",
    "\n",
    "- 图像二进制与图像分类标签，是配对的:\n",
    "<br>训练集文件为：train-image-idx3-ubyte与train-labels-idx1-ubyte\n",
    "<br>测试集文件为：t10k-image-idx3-ubyte与t10k-labels-idx1-ubyte\n",
    "\n",
    "- 训练集有60000张图片\n",
    "\n",
    "- 测试集有10000张图片\n",
    "\n",
    "- 通过mnist.read_image_file函数，读取图像二进制数据\n",
    "\n",
    "- 通过mnist.read_label_file函数，读取标签数据"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "def convert_to_img():\n",
    "    convertdict = {'train': 'train.txt_train', 'test': 'test.txt_t10k'}\n",
    "    for key, value in convertdict.items():\n",
    "        txtfile = value.split('_')[0]\n",
    "        if os.path.exists(os.path.join(root, txtfile)):\n",
    "            print('{0} data has been stored!'.format(key))\n",
    "            continue\n",
    "        imagepre = value.split('_')[1]\n",
    "        dataset = (mnist.read_image_file(os.path.join(root,\n",
    "                                                      '{0}-images-idx3-ubyte'.format(imagepre))),\n",
    "                   mnist.read_label_file(os.path.join(root,\n",
    "                                                      '{0}-labels-idx1-ubyte'.format(imagepre))))\n",
    "        print('{0} set size: {1}'.format(key, dataset[0].size()))\n",
    "        with open(os.path.join(root, txtfile), 'w', encoding='utf-8') as file:\n",
    "            data_path = os.path.join(root, key)\n",
    "            if not os.path.exists(data_path):\n",
    "                os.makedirs(data_path)\n",
    "            print('Save {0} image file begin'.format(key))\n",
    "            for i, (img, label) in enumerate(zip(dataset[0], dataset[1])):\n",
    "                print('save image file: {0}'.format(i + 1))\n",
    "                img_path = os.path.join(data_path,\n",
    "                                        str(i) + '.jpg').replace('\\\\', '/')\n",
    "                io.imsave(img_path, img.numpy())\n",
    "                labelnumlist = re.findall(r'\\d+', str(label))\n",
    "                if len(labelnumlist) > 0:\n",
    "                    file.write(img_path + ' ' + str(labelnumlist[0]) + '\\n')\n",
    "            print('Save {0} image file end'.format(key))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "通过PIL的Image模块，将图片加载并转为RGB三通道"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "def default_loader(path):\n",
    "    return Image.open(path).convert('RGB')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "继承torch.utils.data中的Dataset类，作为定制化的数据集生成类，其中target_transform一般为torchvision包的transforms模块的ToTensor类"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "class MyDataset(Dataset):\n",
    "    def __init__(self, txt, transform=None, target_transform=None, loader=default_loader):\n",
    "        with open(txt, 'r', encoding='utf-8') as fh:\n",
    "            imgs = []\n",
    "            for line in fh:\n",
    "                line = line.strip('\\n')\n",
    "                line = line.rstrip()\n",
    "                words = line.split()\n",
    "                imgs.append((words[0], int(words[1])))\n",
    "            self.imgs = imgs\n",
    "            self.transform = transform\n",
    "            self.target_transform = target_transform\n",
    "            self.loader = loader\n",
    "\n",
    "    def __getitem__(self, index):\n",
    "        fn, label = self.imgs[index]\n",
    "        img = self.loader(fn)\n",
    "        if self.transform is not None:\n",
    "            img = self.transform(img)\n",
    "        return img, label\n",
    "\n",
    "    def __len__(self):\n",
    "        return len(self.imgs)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "定义CNN神经网络\n",
    "\n",
    "- 继承自torch.nn.Module\n",
    "\n",
    "- 共3个卷积层，每个卷积层都有窗口大小与步长为2的池化层，使用ReLU作为卷积层激活函数\n",
    "\n",
    "- 一个输出层，进行10分类"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "class Net(torch.nn.Module):\n",
    "    def __init__(self):\n",
    "        super(Net, self).__init__()\n",
    "        self.conv1 = torch.nn.Sequential(\n",
    "            torch.nn.Conv2d(3, 32, 3, 1, 1),\n",
    "            torch.nn.ReLU(),\n",
    "            torch.nn.MaxPool2d(2))\n",
    "        self.conv2 = torch.nn.Sequential(\n",
    "            torch.nn.Conv2d(32, 64, 3, 1, 1),\n",
    "            torch.nn.ReLU(),\n",
    "            torch.nn.MaxPool2d(2)\n",
    "        )\n",
    "        self.conv3 = torch.nn.Sequential(\n",
    "            torch.nn.Conv2d(64, 64, 3, 1, 1),\n",
    "            torch.nn.ReLU(),\n",
    "            torch.nn.MaxPool2d(2)\n",
    "        )\n",
    "        self.dense = torch.nn.Sequential(\n",
    "            torch.nn.Linear(64 * 3 * 3, 128),\n",
    "            torch.nn.ReLU(),\n",
    "            torch.nn.Linear(128, 10)\n",
    "        )\n",
    "\n",
    "    def forward(self, x):\n",
    "        conv1_out = self.conv1(x)\n",
    "        conv2_out = self.conv2(conv1_out)\n",
    "        conv3_out = self.conv3(conv2_out)\n",
    "        res = conv3_out.view(conv3_out.size(0), -1)\n",
    "        out = self.dense(res)\n",
    "        return out"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "PyTorch可以通过torch.cuda.is_available()的函数判断当前系统是否支持GPU，从而可以自适应选择GPU或CPU"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "cuda\n"
     ]
    }
   ],
   "source": [
    "device = 'cuda' if torch.cuda.is_available() else 'cpu'\n",
    "print(device)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "初始化模型的方法\n",
    "\n",
    "- ```mymodel.to(device)```, 这一句即做到模型训练自适应（选择GPU或CPU）"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "def initialmodel():\n",
    "    mymodel = Net()\n",
    "    mymodel = mymodel.to(device)\n",
    "    if device == 'cuda':\n",
    "        mymodel = torch.nn.DataParallel(mymodel)\n",
    "        cudnn.benchmark = True\n",
    "    return mymodel"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "模型训练方法"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- epochcount，代表训练多少次\n",
    "- resume，代表是否接着之前训练完毕的模型继续训练\n",
    "- 首先通过MyDataset类，加载训练集，并且设置transforms.ToTensor()作为transform方法\n",
    "- PyTorch要求必须按照mini-batch的方式进行训练\n",
    "- 通过DataLoader加载训练集，设置每个批次为64条数据，shuffle=True，代表将训练集随机打散\n",
    "- 优化函数，选择Adam (torch.optim.Adam)\n",
    "- 损失函数，选择交叉熵 (torch.nn.CrossEntropyLoss)\n",
    "- 必须通过model变量.train()的方式，声明：要开始训练了\n",
    "- 前向传播结束之后，需要通过optimizer.zero_grad()，是把梯度置零，也就是把loss关于weight的导数变成0。\n",
    ">原因：根据pytorch中的backward()函数的计算，当网络参量进行反馈时，梯度是被积累的而不是被替换掉；但是在每一个batch时毫无疑问并不需要将两个batch的梯度混合起来累积，因此这里就需要每个batch设置一遍zero_grad 了。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "def train(epochcount=10, resume=True):\n",
    "    train_data = MyDataset(txt=os.path.join(root, 'train.txt'), transform=transforms.ToTensor())\n",
    "    train_loader = DataLoader(dataset=train_data, batch_size=64, shuffle=True)\n",
    "    startepoch = 0\n",
    "    if resume:\n",
    "        mymodel, startepoch = loadmodel()\n",
    "        if startepoch >= epochcount:\n",
    "            print('The epoch of trained model is {0}, greater than epoch count: {1}, need not train it!'.\n",
    "                  format(startepoch, epochcount))\n",
    "    else:\n",
    "        mymodel = initialmodel()\n",
    "    print(mymodel)\n",
    "    # 优化函数，选择Adam\n",
    "    optimizer = torch.optim.Adam(mymodel.parameters())\n",
    "    # 损失函数，选择交叉熵\n",
    "    loss_func = torch.nn.CrossEntropyLoss()\n",
    "    # 设置checkpoint的模型存放路径\n",
    "    modelfolder = os.path.join(os.path.join(root, 'model'))\n",
    "    if not os.path.exists(modelfolder):\n",
    "        os.makedirs(modelfolder)\n",
    "    modelfile = os.path.join(modelfolder, 'fashionmnist.pt')\n",
    "    for epoch in range(startepoch, epochcount):\n",
    "        print('epoch {}'.format(epoch + 1))\n",
    "        # 必须通过model变量.train()的方式，声明：要开始训练了\n",
    "        mymodel.train()\n",
    "        # training-----------------------------\n",
    "        train_loss = 0.\n",
    "        train_acc = 0.\n",
    "        best_acc = 0\n",
    "        for i, (batch_x, batch_y) in enumerate(train_loader):\n",
    "            print('Train epoch:{0} iter: {1} begin'.format(epoch, i + 1))\n",
    "            # 自适应训练数据是否支持GPU\n",
    "            batch_x, batch_y = Variable(batch_x.to(device)), Variable(batch_y.to(device))\n",
    "            out = mymodel(batch_x)\n",
    "            # 动态更新loss与accuracy的数量\n",
    "            loss = loss_func(out, batch_y)\n",
    "            train_loss += loss.data.item()\n",
    "            pred = torch.max(out, 1)[1]\n",
    "            # 通过torch.sum统计预测正确的数量\n",
    "            train_correct = torch.sum(pred == batch_y)\n",
    "            # train_correct是Tensor类型，需要通过item()，得到数值\n",
    "            train_acc += train_correct.item()\n",
    "            # optimizer.zero_grad()意思是把梯度置零，也就是把loss关于weight的导数变成0\n",
    "            optimizer.zero_grad()\n",
    "            loss.backward()\n",
    "            optimizer.step()\n",
    "            print('Train epoch:{0} iter: {1} end'.format(epoch, i + 1))\n",
    "        accrate = train_acc / (len(train_data))\n",
    "        # 输出每个epoch的损失率与准确率\n",
    "        print('Train Loss: {:.6f}, Acc: {:.6f}'.format(train_loss / (len(train_data)), accrate))\n",
    "        # 如果当前epoch的准确率是最高的，则保存模型。\n",
    "        # 模型的权重信息是通过state_dict()获得的，这也是模型的最关键信息\n",
    "        if accrate > best_acc:\n",
    "            print('save model for best accuate: {0} begin'.format(accrate))\n",
    "            best_acc = accrate\n",
    "            torch.save({\n",
    "                'epoch': epoch + 1,\n",
    "                'state_dict': mymodel.state_dict(),\n",
    "                'best_acc': best_acc,\n",
    "            }, modelfile)\n",
    "            print('save model for best accuate: {0} end'.format(accrate))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "加载模型\n",
    "- 如果模型不存在，则返回初始化的模型\n",
    "- 否则，加载模型，主要是加载state_dict信息"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "def loadmodel():\n",
    "    modelfolder = os.path.join(os.path.join(root, 'model'))\n",
    "    modelfile = os.path.join(modelfolder, 'fashionmnist.pt')\n",
    "    if not os.path.exists(modelfile):\n",
    "        print('model not exist!')\n",
    "        return initialmodel(), 0\n",
    "    print('Loading best model: {0} begin'.format(modelfile))\n",
    "    mymodel = initialmodel()\n",
    "    checkpoint = torch.load(modelfile)\n",
    "    epoch = checkpoint['epoch']\n",
    "    best_acc = checkpoint['best_acc']\n",
    "    mymodel.load_state_dict(checkpoint['state_dict'])\n",
    "    print('Loading best model end, epoch is {0}, training accuracy is {1}'.format(epoch, best_acc))\n",
    "    return mymodel, epoch"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "测试模型\n",
    "\n",
    "- 测试集加载与训练集加载方式是一样的\n",
    "- 必须调用model变量.evel()方法，以便在运行推断之前将dropout和batch规范化层设置为评估模式。如果不这样做，将会产生不一致的推断结果。\n",
    "- 评估过程中需要加入：with torch.no_grad()，适用于推断阶段，不需要反向传播\n",
    "- 评估的过程与训练过程自评估方式是一样的"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "def test():\n",
    "    test_data = MyDataset(txt=os.path.join(root, 'test.txt'), transform=transforms.ToTensor())\n",
    "    test_loader = DataLoader(dataset=test_data, batch_size=64)\n",
    "    mymodel, epoch = loadmodel()\n",
    "    if epoch == 0:\n",
    "        print('Model not be trainned!')\n",
    "        return\n",
    "    # 您必须调用model.eval()，\n",
    "    # 以便在运行推断之前将dropout和batch规范化层设置为评估模式。\n",
    "    # 如果不这样做，将会产生不一致的推断结果。\n",
    "    mymodel.eval()\n",
    "    eval_loss = 0.\n",
    "    eval_acc = 0.\n",
    "    loss_func = torch.nn.CrossEntropyLoss()\n",
    "    # 适用于推断阶段，不需要反向传播\n",
    "    with torch.no_grad():\n",
    "        for i, (batch_x, batch_y) in enumerate(test_loader):\n",
    "            print('Validate iter: {0} begin'.format(i + 1))\n",
    "            batch_x, batch_y = Variable(batch_x.to(device)), Variable(batch_y.to(device))\n",
    "            out = mymodel(batch_x)\n",
    "            loss = loss_func(out, batch_y)\n",
    "            eval_loss += loss.data.item()\n",
    "            pred = torch.max(out, 1)[1]\n",
    "            num_correct = torch.sum(pred == batch_y)\n",
    "            eval_acc += num_correct.item()\n",
    "            print('Validate iter: {0} end'.format(i + 1))\n",
    "        print('Test Loss: {:.6f}, Acc: {:.6f}'.format(eval_loss / (len(test_data)), eval_acc / (len(test_data))))\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "测试用户自己的图片文件\n",
    "- 这种使用方式，即模拟真实业务场景的数据分类预测\n",
    "- torch.unsqueeze()，因为PyTorch训练模式只有mini-batch，所以哪怕对用户的某个图像进行预测，依然需要将其作为一个数量为1的batch，即将单张图片的：```[3, 28, 28]```转为```[1, 3, 28, 28]```。代码中有更详细的注释\n",
    ">torch.unsqueeze(),这个函数主要是对数据维度进行扩充。给指定位置加上维数为一的维度，比如原本有个三行的数据（3），在0的位置加了一维就变成一行三列（1,3）"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "def  preprocess(imgfile):\n",
    "    \"\"\"\n",
    "    图像预处理\n",
    "    1. 读取图像并转为RGB 3通道\n",
    "    2. 图片大小转为28x28\n",
    "    :param imgfile:\n",
    "    :return:\n",
    "    \"\"\"\n",
    "    # Image转为灰度，通过convert('L')完成，但是fashion-mnist图片已经都是灰度了，没有必要先转灰度\n",
    "    # 灰色图像的每个像素用8个bit表示，0表示黑，255表示白，其他数字表示不同的灰度。\n",
    "    # 在PIL中，从模式“RGB”转换为“L”模式是按照下面的公式转换的：\n",
    "    # L = R * 0.299 + G * 0.587+ B * 0.114\n",
    "    # image = Image.open(imgfile).convert('L').convert('RGB')\n",
    "    # 直接转为RGB通道\n",
    "    image = Image.open(imgfile).convert('RGB')\n",
    "    # 尺寸大小统一为28x28\n",
    "    image = image.resize((28, 28))\n",
    "    return image"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "def validateuserdata():\n",
    "    imgfile = os.path.join(root, 'train/80.jpg')\n",
    "    category = 1\n",
    "    image = preprocess(imgfile)\n",
    "    plt.figure(\"fashion-mnist\")\n",
    "    plt.imshow(image)\n",
    "    plt.show()\n",
    "    img = transforms.ToTensor()(image)\n",
    "    print('load image file: {0}, category: {1} success'.format(imgfile, category))\n",
    "    mymodel, epoch = loadmodel()\n",
    "    mymodel.eval()\n",
    "\n",
    "    with torch.no_grad():\n",
    "        datax = img.to(device)\n",
    "        # 如果直接将datax，作为参数去预测分类，会遇到如下错误：\n",
    "        # RuntimeError: Expected 4-dimensional input for 4-dimensional weight [64, 3, 3, 3],\n",
    "        # but got 3-dimensional input of size [3, 28, 28] instead\n",
    "        # 因为torch.nn仅仅支持mini-batches, 预测的输入数据应该符合: (batch_size, channels, height, width)\n",
    "        # 上述异常，是遗失batch dimension引起的。\n",
    "        # 最简单的方法是通过：datax.unsqueeze(0)，即使其变成[1, 3, 28, 28]的4-dimensions数据\n",
    "        print('Shape before Transorm: {0}'.format(datax.size()))\n",
    "        print('Channel: {0}, Width: {1}, Height: {2}'.format(datax.size()[0], datax.size()[1], datax.size()[2]))\n",
    "        datax = datax.unsqueeze(0)\n",
    "        print('Shape after Transorm: {0}'.format(datax.size()))\n",
    "        out = mymodel(datax)\n",
    "        pred = torch.max(out, 1)[1]\n",
    "        print(pred, pred.item())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "实际操作：包括提炼图片，训练模型，对测试集进行验证以及预测单个用户图片分类"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Convert image begin\n",
      "train data has been stored!\n",
      "test data has been stored!\n",
      "Convert image end\n",
      "\n",
      "Train model begin\n",
      "Loading best model: ./pytorchdata_fashionmnist/model\\fashionmnist.pt begin\n",
      "Loading best model end, epoch is 10, training accuracy is 0.9507333333333333\n",
      "DataParallel(\n",
      "  (module): Net(\n",
      "    (conv1): Sequential(\n",
      "      (0): Conv2d(3, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n",
      "      (1): ReLU()\n",
      "      (2): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n",
      "    )\n",
      "    (conv2): Sequential(\n",
      "      (0): Conv2d(32, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n",
      "      (1): ReLU()\n",
      "      (2): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n",
      "    )\n",
      "    (conv3): Sequential(\n",
      "      (0): Conv2d(64, 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))\n",
      "      (1): ReLU()\n",
      "      (2): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n",
      "    )\n",
      "    (dense): Sequential(\n",
      "      (0): Linear(in_features=576, out_features=128, bias=True)\n",
      "      (1): ReLU()\n",
      "      (2): Linear(in_features=128, out_features=10, bias=True)\n",
      "    )\n",
      "  )\n",
      ")\n",
      "epoch 11\n",
      "Train epoch:10 iter: 1 begin\n",
      "Train epoch:10 iter: 1 end\n",
      "Train epoch:10 iter: 2 begin\n",
      "Train epoch:10 iter: 2 end\n",
      "Train epoch:10 iter: 3 begin\n",
      "Train epoch:10 iter: 3 end\n",
      "Train epoch:10 iter: 4 begin\n",
      "Train epoch:10 iter: 4 end\n",
      "Train epoch:10 iter: 5 begin\n",
      "Train epoch:10 iter: 5 end\n",
      "Train epoch:10 iter: 6 begin\n",
      "Train epoch:10 iter: 6 end\n",
      "Train epoch:10 iter: 7 begin\n",
      "Train epoch:10 iter: 7 end\n",
      "Train epoch:10 iter: 8 begin\n",
      "Train epoch:10 iter: 8 end\n",
      "Train epoch:10 iter: 9 begin\n",
      "Train epoch:10 iter: 9 end\n",
      "Train epoch:10 iter: 10 begin\n",
      "Train epoch:10 iter: 10 end\n",
      "Train epoch:10 iter: 11 begin\n",
      "Train epoch:10 iter: 11 end\n",
      "Train epoch:10 iter: 12 begin\n",
      "Train epoch:10 iter: 12 end\n",
      "Train epoch:10 iter: 13 begin\n",
      "Train epoch:10 iter: 13 end\n",
      "Train epoch:10 iter: 14 begin\n",
      "Train epoch:10 iter: 14 end\n",
      "Train epoch:10 iter: 15 begin\n",
      "Train epoch:10 iter: 15 end\n",
      "Train epoch:10 iter: 16 begin\n",
      "Train epoch:10 iter: 16 end\n",
      "Train epoch:10 iter: 17 begin\n",
      "Train epoch:10 iter: 17 end\n",
      "Train epoch:10 iter: 18 begin\n",
      "Train epoch:10 iter: 18 end\n",
      "Train epoch:10 iter: 19 begin\n",
      "Train epoch:10 iter: 19 end\n",
      "Train epoch:10 iter: 20 begin\n",
      "Train epoch:10 iter: 20 end\n",
      "Train epoch:10 iter: 21 begin\n",
      "Train epoch:10 iter: 21 end\n",
      "Train epoch:10 iter: 22 begin\n",
      "Train epoch:10 iter: 22 end\n",
      "Train epoch:10 iter: 23 begin\n",
      "Train epoch:10 iter: 23 end\n",
      "Train epoch:10 iter: 24 begin\n",
      "Train epoch:10 iter: 24 end\n",
      "Train epoch:10 iter: 25 begin\n",
      "Train epoch:10 iter: 25 end\n",
      "Train epoch:10 iter: 26 begin\n",
      "Train epoch:10 iter: 26 end\n",
      "Train epoch:10 iter: 27 begin\n",
      "Train epoch:10 iter: 27 end\n",
      "Train epoch:10 iter: 28 begin\n",
      "Train epoch:10 iter: 28 end\n",
      "Train epoch:10 iter: 29 begin\n",
      "Train epoch:10 iter: 29 end\n",
      "Train epoch:10 iter: 30 begin\n",
      "Train epoch:10 iter: 30 end\n",
      "Train epoch:10 iter: 31 begin\n",
      "Train epoch:10 iter: 31 end\n",
      "Train epoch:10 iter: 32 begin\n",
      "Train epoch:10 iter: 32 end\n",
      "Train epoch:10 iter: 33 begin\n",
      "Train epoch:10 iter: 33 end\n",
      "Train epoch:10 iter: 34 begin\n",
      "Train epoch:10 iter: 34 end\n",
      "Train epoch:10 iter: 35 begin\n",
      "Train epoch:10 iter: 35 end\n",
      "Train epoch:10 iter: 36 begin\n",
      "Train epoch:10 iter: 36 end\n",
      "Train epoch:10 iter: 37 begin\n",
      "Train epoch:10 iter: 37 end\n",
      "Train epoch:10 iter: 38 begin\n",
      "Train epoch:10 iter: 38 end\n",
      "Train epoch:10 iter: 39 begin\n",
      "Train epoch:10 iter: 39 end\n",
      "Train epoch:10 iter: 40 begin\n",
      "Train epoch:10 iter: 40 end\n",
      "Train epoch:10 iter: 41 begin\n",
      "Train epoch:10 iter: 41 end\n",
      "Train epoch:10 iter: 42 begin\n",
      "Train epoch:10 iter: 42 end\n",
      "Train epoch:10 iter: 43 begin\n",
      "Train epoch:10 iter: 43 end\n",
      "Train epoch:10 iter: 44 begin\n",
      "Train epoch:10 iter: 44 end\n",
      "Train epoch:10 iter: 45 begin\n",
      "Train epoch:10 iter: 45 end\n",
      "Train epoch:10 iter: 46 begin\n",
      "Train epoch:10 iter: 46 end\n",
      "Train epoch:10 iter: 47 begin\n",
      "Train epoch:10 iter: 47 end\n",
      "Train epoch:10 iter: 48 begin\n",
      "Train epoch:10 iter: 48 end\n",
      "Train epoch:10 iter: 49 begin\n",
      "Train epoch:10 iter: 49 end\n",
      "Train epoch:10 iter: 50 begin\n",
      "Train epoch:10 iter: 50 end\n",
      "Train epoch:10 iter: 51 begin\n",
      "Train epoch:10 iter: 51 end\n",
      "Train epoch:10 iter: 52 begin\n",
      "Train epoch:10 iter: 52 end\n",
      "Train epoch:10 iter: 53 begin\n",
      "Train epoch:10 iter: 53 end\n",
      "Train epoch:10 iter: 54 begin\n",
      "Train epoch:10 iter: 54 end\n",
      "Train epoch:10 iter: 55 begin\n",
      "Train epoch:10 iter: 55 end\n",
      "Train epoch:10 iter: 56 begin\n",
      "Train epoch:10 iter: 56 end\n",
      "Train epoch:10 iter: 57 begin\n",
      "Train epoch:10 iter: 57 end\n",
      "Train epoch:10 iter: 58 begin\n",
      "Train epoch:10 iter: 58 end\n",
      "Train epoch:10 iter: 59 begin\n",
      "Train epoch:10 iter: 59 end\n",
      "Train epoch:10 iter: 60 begin\n",
      "Train epoch:10 iter: 60 end\n",
      "Train epoch:10 iter: 61 begin\n",
      "Train epoch:10 iter: 61 end\n",
      "Train epoch:10 iter: 62 begin\n",
      "Train epoch:10 iter: 62 end\n",
      "Train epoch:10 iter: 63 begin\n",
      "Train epoch:10 iter: 63 end\n",
      "Train epoch:10 iter: 64 begin\n",
      "Train epoch:10 iter: 64 end\n",
      "Train epoch:10 iter: 65 begin\n",
      "Train epoch:10 iter: 65 end\n",
      "Train epoch:10 iter: 66 begin\n",
      "Train epoch:10 iter: 66 end\n",
      "Train epoch:10 iter: 67 begin\n",
      "Train epoch:10 iter: 67 end\n",
      "Train epoch:10 iter: 68 begin\n",
      "Train epoch:10 iter: 68 end\n",
      "Train epoch:10 iter: 69 begin\n",
      "Train epoch:10 iter: 69 end\n",
      "Train epoch:10 iter: 70 begin\n",
      "Train epoch:10 iter: 70 end\n",
      "Train epoch:10 iter: 71 begin\n",
      "Train epoch:10 iter: 71 end\n",
      "Train epoch:10 iter: 72 begin\n",
      "Train epoch:10 iter: 72 end\n",
      "Train epoch:10 iter: 73 begin\n",
      "Train epoch:10 iter: 73 end\n",
      "Train epoch:10 iter: 74 begin\n",
      "Train epoch:10 iter: 74 end\n",
      "Train epoch:10 iter: 75 begin\n",
      "Train epoch:10 iter: 75 end\n",
      "Train epoch:10 iter: 76 begin\n",
      "Train epoch:10 iter: 76 end\n",
      "Train epoch:10 iter: 77 begin\n",
      "Train epoch:10 iter: 77 end\n",
      "Train epoch:10 iter: 78 begin\n",
      "Train epoch:10 iter: 78 end\n",
      "Train epoch:10 iter: 79 begin\n",
      "Train epoch:10 iter: 79 end\n",
      "Train epoch:10 iter: 80 begin\n",
      "Train epoch:10 iter: 80 end\n",
      "Train epoch:10 iter: 81 begin\n",
      "Train epoch:10 iter: 81 end\n",
      "Train epoch:10 iter: 82 begin\n",
      "Train epoch:10 iter: 82 end\n",
      "Train epoch:10 iter: 83 begin\n",
      "Train epoch:10 iter: 83 end\n",
      "Train epoch:10 iter: 84 begin\n",
      "Train epoch:10 iter: 84 end\n",
      "Train epoch:10 iter: 85 begin\n",
      "Train epoch:10 iter: 85 end\n",
      "Train epoch:10 iter: 86 begin\n",
      "Train epoch:10 iter: 86 end\n",
      "Train epoch:10 iter: 87 begin\n",
      "Train epoch:10 iter: 87 end\n",
      "Train epoch:10 iter: 88 begin\n",
      "Train epoch:10 iter: 88 end\n",
      "Train epoch:10 iter: 89 begin\n",
      "Train epoch:10 iter: 89 end\n",
      "Train epoch:10 iter: 90 begin\n",
      "Train epoch:10 iter: 90 end\n",
      "Train epoch:10 iter: 91 begin\n",
      "Train epoch:10 iter: 91 end\n",
      "Train epoch:10 iter: 92 begin\n",
      "Train epoch:10 iter: 92 end\n",
      "Train epoch:10 iter: 93 begin\n",
      "Train epoch:10 iter: 93 end\n",
      "Train epoch:10 iter: 94 begin\n",
      "Train epoch:10 iter: 94 end\n",
      "Train epoch:10 iter: 95 begin\n",
      "Train epoch:10 iter: 95 end\n",
      "Train epoch:10 iter: 96 begin\n",
      "Train epoch:10 iter: 96 end\n",
      "Train epoch:10 iter: 97 begin\n",
      "Train epoch:10 iter: 97 end\n",
      "Train epoch:10 iter: 98 begin\n",
      "Train epoch:10 iter: 98 end\n",
      "Train epoch:10 iter: 99 begin\n",
      "Train epoch:10 iter: 99 end\n",
      "Train epoch:10 iter: 100 begin\n",
      "Train epoch:10 iter: 100 end\n",
      "Train epoch:10 iter: 101 begin\n",
      "Train epoch:10 iter: 101 end\n",
      "Train epoch:10 iter: 102 begin\n",
      "Train epoch:10 iter: 102 end\n",
      "Train epoch:10 iter: 103 begin\n",
      "Train epoch:10 iter: 103 end\n",
      "Train epoch:10 iter: 104 begin\n",
      "Train epoch:10 iter: 104 end\n",
      "Train epoch:10 iter: 105 begin\n",
      "Train epoch:10 iter: 105 end\n",
      "Train epoch:10 iter: 106 begin\n",
      "Train epoch:10 iter: 106 end\n",
      "Train epoch:10 iter: 107 begin\n",
      "Train epoch:10 iter: 107 end\n",
      "Train epoch:10 iter: 108 begin\n",
      "Train epoch:10 iter: 108 end\n",
      "Train epoch:10 iter: 109 begin\n",
      "Train epoch:10 iter: 109 end\n",
      "Train epoch:10 iter: 110 begin\n",
      "Train epoch:10 iter: 110 end\n",
      "Train epoch:10 iter: 111 begin\n",
      "Train epoch:10 iter: 111 end\n",
      "Train epoch:10 iter: 112 begin\n",
      "Train epoch:10 iter: 112 end\n",
      "Train epoch:10 iter: 113 begin\n",
      "Train epoch:10 iter: 113 end\n",
      "Train epoch:10 iter: 114 begin\n",
      "Train epoch:10 iter: 114 end\n",
      "Train epoch:10 iter: 115 begin\n",
      "Train epoch:10 iter: 115 end\n",
      "Train epoch:10 iter: 116 begin\n",
      "Train epoch:10 iter: 116 end\n",
      "Train epoch:10 iter: 117 begin\n",
      "Train epoch:10 iter: 117 end\n",
      "Train epoch:10 iter: 118 begin\n",
      "Train epoch:10 iter: 118 end\n",
      "Train epoch:10 iter: 119 begin\n",
      "Train epoch:10 iter: 119 end\n",
      "Train epoch:10 iter: 120 begin\n",
      "Train epoch:10 iter: 120 end\n",
      "Train epoch:10 iter: 121 begin\n",
      "Train epoch:10 iter: 121 end\n",
      "Train epoch:10 iter: 122 begin\n",
      "Train epoch:10 iter: 122 end\n",
      "Train epoch:10 iter: 123 begin\n",
      "Train epoch:10 iter: 123 end\n",
      "Train epoch:10 iter: 124 begin\n",
      "Train epoch:10 iter: 124 end\n",
      "Train epoch:10 iter: 125 begin\n",
      "Train epoch:10 iter: 125 end\n",
      "Train epoch:10 iter: 126 begin\n",
      "Train epoch:10 iter: 126 end\n",
      "Train epoch:10 iter: 127 begin\n",
      "Train epoch:10 iter: 127 end\n",
      "Train epoch:10 iter: 128 begin\n",
      "Train epoch:10 iter: 128 end\n",
      "Train epoch:10 iter: 129 begin\n",
      "Train epoch:10 iter: 129 end\n",
      "Train epoch:10 iter: 130 begin\n",
      "Train epoch:10 iter: 130 end\n",
      "Train epoch:10 iter: 131 begin\n",
      "Train epoch:10 iter: 131 end\n",
      "Train epoch:10 iter: 132 begin\n",
      "Train epoch:10 iter: 132 end\n",
      "Train epoch:10 iter: 133 begin\n",
      "Train epoch:10 iter: 133 end\n",
      "Train epoch:10 iter: 134 begin\n",
      "Train epoch:10 iter: 134 end\n",
      "Train epoch:10 iter: 135 begin\n",
      "Train epoch:10 iter: 135 end\n",
      "Train epoch:10 iter: 136 begin\n",
      "Train epoch:10 iter: 136 end\n",
      "Train epoch:10 iter: 137 begin\n",
      "Train epoch:10 iter: 137 end\n",
      "Train epoch:10 iter: 138 begin\n",
      "Train epoch:10 iter: 138 end\n",
      "Train epoch:10 iter: 139 begin\n",
      "Train epoch:10 iter: 139 end\n",
      "Train epoch:10 iter: 140 begin\n",
      "Train epoch:10 iter: 140 end\n",
      "Train epoch:10 iter: 141 begin\n",
      "Train epoch:10 iter: 141 end\n",
      "Train epoch:10 iter: 142 begin\n",
      "Train epoch:10 iter: 142 end\n",
      "Train epoch:10 iter: 143 begin\n",
      "Train epoch:10 iter: 143 end\n",
      "Train epoch:10 iter: 144 begin\n",
      "Train epoch:10 iter: 144 end\n",
      "Train epoch:10 iter: 145 begin\n",
      "Train epoch:10 iter: 145 end\n",
      "Train epoch:10 iter: 146 begin\n",
      "Train epoch:10 iter: 146 end\n",
      "Train epoch:10 iter: 147 begin\n",
      "Train epoch:10 iter: 147 end\n",
      "Train epoch:10 iter: 148 begin\n",
      "Train epoch:10 iter: 148 end\n",
      "Train epoch:10 iter: 149 begin\n",
      "Train epoch:10 iter: 149 end\n",
      "Train epoch:10 iter: 150 begin\n",
      "Train epoch:10 iter: 150 end\n",
      "Train epoch:10 iter: 151 begin\n",
      "Train epoch:10 iter: 151 end\n",
      "Train epoch:10 iter: 152 begin\n",
      "Train epoch:10 iter: 152 end\n",
      "Train epoch:10 iter: 153 begin\n",
      "Train epoch:10 iter: 153 end\n",
      "Train epoch:10 iter: 154 begin\n",
      "Train epoch:10 iter: 154 end\n",
      "Train epoch:10 iter: 155 begin\n",
      "Train epoch:10 iter: 155 end\n",
      "Train epoch:10 iter: 156 begin\n",
      "Train epoch:10 iter: 156 end\n",
      "Train epoch:10 iter: 157 begin\n",
      "Train epoch:10 iter: 157 end\n",
      "Train epoch:10 iter: 158 begin\n",
      "Train epoch:10 iter: 158 end\n",
      "Train epoch:10 iter: 159 begin\n",
      "Train epoch:10 iter: 159 end\n",
      "Train epoch:10 iter: 160 begin\n",
      "Train epoch:10 iter: 160 end\n",
      "Train epoch:10 iter: 161 begin\n",
      "Train epoch:10 iter: 161 end\n",
      "Train epoch:10 iter: 162 begin\n",
      "Train epoch:10 iter: 162 end\n",
      "Train epoch:10 iter: 163 begin\n",
      "Train epoch:10 iter: 163 end\n",
      "Train epoch:10 iter: 164 begin\n",
      "Train epoch:10 iter: 164 end\n",
      "Train epoch:10 iter: 165 begin\n",
      "Train epoch:10 iter: 165 end\n",
      "Train epoch:10 iter: 166 begin\n",
      "Train epoch:10 iter: 166 end\n",
      "Train epoch:10 iter: 167 begin\n",
      "Train epoch:10 iter: 167 end\n",
      "Train epoch:10 iter: 168 begin\n",
      "Train epoch:10 iter: 168 end\n",
      "Train epoch:10 iter: 169 begin\n",
      "Train epoch:10 iter: 169 end\n",
      "Train epoch:10 iter: 170 begin\n",
      "Train epoch:10 iter: 170 end\n",
      "Train epoch:10 iter: 171 begin\n",
      "Train epoch:10 iter: 171 end\n",
      "Train epoch:10 iter: 172 begin\n",
      "Train epoch:10 iter: 172 end\n",
      "Train epoch:10 iter: 173 begin\n",
      "Train epoch:10 iter: 173 end\n",
      "Train epoch:10 iter: 174 begin\n",
      "Train epoch:10 iter: 174 end\n",
      "Train epoch:10 iter: 175 begin\n",
      "Train epoch:10 iter: 175 end\n",
      "Train epoch:10 iter: 176 begin\n",
      "Train epoch:10 iter: 176 end\n",
      "Train epoch:10 iter: 177 begin\n",
      "Train epoch:10 iter: 177 end\n",
      "Train epoch:10 iter: 178 begin\n",
      "Train epoch:10 iter: 178 end\n",
      "Train epoch:10 iter: 179 begin\n",
      "Train epoch:10 iter: 179 end\n",
      "Train epoch:10 iter: 180 begin\n",
      "Train epoch:10 iter: 180 end\n",
      "Train epoch:10 iter: 181 begin\n",
      "Train epoch:10 iter: 181 end\n",
      "Train epoch:10 iter: 182 begin\n",
      "Train epoch:10 iter: 182 end\n",
      "Train epoch:10 iter: 183 begin\n",
      "Train epoch:10 iter: 183 end\n",
      "Train epoch:10 iter: 184 begin\n",
      "Train epoch:10 iter: 184 end\n",
      "Train epoch:10 iter: 185 begin\n",
      "Train epoch:10 iter: 185 end\n",
      "Train epoch:10 iter: 186 begin\n",
      "Train epoch:10 iter: 186 end\n",
      "Train epoch:10 iter: 187 begin\n",
      "Train epoch:10 iter: 187 end\n",
      "Train epoch:10 iter: 188 begin\n",
      "Train epoch:10 iter: 188 end\n",
      "Train epoch:10 iter: 189 begin\n",
      "Train epoch:10 iter: 189 end\n",
      "Train epoch:10 iter: 190 begin\n",
      "Train epoch:10 iter: 190 end\n",
      "Train epoch:10 iter: 191 begin\n",
      "Train epoch:10 iter: 191 end\n",
      "Train epoch:10 iter: 192 begin\n",
      "Train epoch:10 iter: 192 end\n",
      "Train epoch:10 iter: 193 begin\n",
      "Train epoch:10 iter: 193 end\n",
      "Train epoch:10 iter: 194 begin\n",
      "Train epoch:10 iter: 194 end\n",
      "Train epoch:10 iter: 195 begin\n",
      "Train epoch:10 iter: 195 end\n",
      "Train epoch:10 iter: 196 begin\n",
      "Train epoch:10 iter: 196 end\n",
      "Train epoch:10 iter: 197 begin\n",
      "Train epoch:10 iter: 197 end\n",
      "Train epoch:10 iter: 198 begin\n",
      "Train epoch:10 iter: 198 end\n",
      "Train epoch:10 iter: 199 begin\n",
      "Train epoch:10 iter: 199 end\n",
      "Train epoch:10 iter: 200 begin\n",
      "Train epoch:10 iter: 200 end\n",
      "Train epoch:10 iter: 201 begin\n",
      "Train epoch:10 iter: 201 end\n",
      "Train epoch:10 iter: 202 begin\n",
      "Train epoch:10 iter: 202 end\n",
      "Train epoch:10 iter: 203 begin\n",
      "Train epoch:10 iter: 203 end\n",
      "Train epoch:10 iter: 204 begin\n",
      "Train epoch:10 iter: 204 end\n",
      "Train epoch:10 iter: 205 begin\n",
      "Train epoch:10 iter: 205 end\n",
      "Train epoch:10 iter: 206 begin\n",
      "Train epoch:10 iter: 206 end\n",
      "Train epoch:10 iter: 207 begin\n",
      "Train epoch:10 iter: 207 end\n",
      "Train epoch:10 iter: 208 begin\n",
      "Train epoch:10 iter: 208 end\n",
      "Train epoch:10 iter: 209 begin\n",
      "Train epoch:10 iter: 209 end\n",
      "Train epoch:10 iter: 210 begin\n",
      "Train epoch:10 iter: 210 end\n",
      "Train epoch:10 iter: 211 begin\n",
      "Train epoch:10 iter: 211 end\n",
      "Train epoch:10 iter: 212 begin\n",
      "Train epoch:10 iter: 212 end\n",
      "Train epoch:10 iter: 213 begin\n",
      "Train epoch:10 iter: 213 end\n",
      "Train epoch:10 iter: 214 begin\n",
      "Train epoch:10 iter: 214 end\n",
      "Train epoch:10 iter: 215 begin\n",
      "Train epoch:10 iter: 215 end\n",
      "Train epoch:10 iter: 216 begin\n",
      "Train epoch:10 iter: 216 end\n",
      "Train epoch:10 iter: 217 begin\n",
      "Train epoch:10 iter: 217 end\n",
      "Train epoch:10 iter: 218 begin\n",
      "Train epoch:10 iter: 218 end\n",
      "Train epoch:10 iter: 219 begin\n",
      "Train epoch:10 iter: 219 end\n",
      "Train epoch:10 iter: 220 begin\n",
      "Train epoch:10 iter: 220 end\n",
      "Train epoch:10 iter: 221 begin\n",
      "Train epoch:10 iter: 221 end\n",
      "Train epoch:10 iter: 222 begin\n",
      "Train epoch:10 iter: 222 end\n",
      "Train epoch:10 iter: 223 begin\n",
      "Train epoch:10 iter: 223 end\n",
      "Train epoch:10 iter: 224 begin\n",
      "Train epoch:10 iter: 224 end\n",
      "Train epoch:10 iter: 225 begin\n",
      "Train epoch:10 iter: 225 end\n",
      "Train epoch:10 iter: 226 begin\n",
      "Train epoch:10 iter: 226 end\n",
      "Train epoch:10 iter: 227 begin\n",
      "Train epoch:10 iter: 227 end\n",
      "Train epoch:10 iter: 228 begin\n",
      "Train epoch:10 iter: 228 end\n",
      "Train epoch:10 iter: 229 begin\n",
      "Train epoch:10 iter: 229 end\n",
      "Train epoch:10 iter: 230 begin\n",
      "Train epoch:10 iter: 230 end\n",
      "Train epoch:10 iter: 231 begin\n",
      "Train epoch:10 iter: 231 end\n",
      "Train epoch:10 iter: 232 begin\n",
      "Train epoch:10 iter: 232 end\n",
      "Train epoch:10 iter: 233 begin\n",
      "Train epoch:10 iter: 233 end\n",
      "Train epoch:10 iter: 234 begin\n",
      "Train epoch:10 iter: 234 end\n",
      "Train epoch:10 iter: 235 begin\n",
      "Train epoch:10 iter: 235 end\n",
      "Train epoch:10 iter: 236 begin\n",
      "Train epoch:10 iter: 236 end\n",
      "Train epoch:10 iter: 237 begin\n",
      "Train epoch:10 iter: 237 end\n",
      "Train epoch:10 iter: 238 begin\n",
      "Train epoch:10 iter: 238 end\n",
      "Train epoch:10 iter: 239 begin\n",
      "Train epoch:10 iter: 239 end\n",
      "Train epoch:10 iter: 240 begin\n",
      "Train epoch:10 iter: 240 end\n",
      "Train epoch:10 iter: 241 begin\n",
      "Train epoch:10 iter: 241 end\n",
      "Train epoch:10 iter: 242 begin\n",
      "Train epoch:10 iter: 242 end\n",
      "Train epoch:10 iter: 243 begin\n",
      "Train epoch:10 iter: 243 end\n",
      "Train epoch:10 iter: 244 begin\n",
      "Train epoch:10 iter: 244 end\n",
      "Train epoch:10 iter: 245 begin\n",
      "Train epoch:10 iter: 245 end\n",
      "Train epoch:10 iter: 246 begin\n",
      "Train epoch:10 iter: 246 end\n",
      "Train epoch:10 iter: 247 begin\n",
      "Train epoch:10 iter: 247 end\n",
      "Train epoch:10 iter: 248 begin\n",
      "Train epoch:10 iter: 248 end\n",
      "Train epoch:10 iter: 249 begin\n",
      "Train epoch:10 iter: 249 end\n",
      "Train epoch:10 iter: 250 begin\n",
      "Train epoch:10 iter: 250 end\n",
      "Train epoch:10 iter: 251 begin\n",
      "Train epoch:10 iter: 251 end\n",
      "Train epoch:10 iter: 252 begin\n",
      "Train epoch:10 iter: 252 end\n",
      "Train epoch:10 iter: 253 begin\n",
      "Train epoch:10 iter: 253 end\n",
      "Train epoch:10 iter: 254 begin\n",
      "Train epoch:10 iter: 254 end\n",
      "Train epoch:10 iter: 255 begin\n",
      "Train epoch:10 iter: 255 end\n",
      "Train epoch:10 iter: 256 begin\n",
      "Train epoch:10 iter: 256 end\n",
      "Train epoch:10 iter: 257 begin\n",
      "Train epoch:10 iter: 257 end\n",
      "Train epoch:10 iter: 258 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:10 iter: 258 end\n",
      "Train epoch:10 iter: 259 begin\n",
      "Train epoch:10 iter: 259 end\n",
      "Train epoch:10 iter: 260 begin\n",
      "Train epoch:10 iter: 260 end\n",
      "Train epoch:10 iter: 261 begin\n",
      "Train epoch:10 iter: 261 end\n",
      "Train epoch:10 iter: 262 begin\n",
      "Train epoch:10 iter: 262 end\n",
      "Train epoch:10 iter: 263 begin\n",
      "Train epoch:10 iter: 263 end\n",
      "Train epoch:10 iter: 264 begin\n",
      "Train epoch:10 iter: 264 end\n",
      "Train epoch:10 iter: 265 begin\n",
      "Train epoch:10 iter: 265 end\n",
      "Train epoch:10 iter: 266 begin\n",
      "Train epoch:10 iter: 266 end\n",
      "Train epoch:10 iter: 267 begin\n",
      "Train epoch:10 iter: 267 end\n",
      "Train epoch:10 iter: 268 begin\n",
      "Train epoch:10 iter: 268 end\n",
      "Train epoch:10 iter: 269 begin\n",
      "Train epoch:10 iter: 269 end\n",
      "Train epoch:10 iter: 270 begin\n",
      "Train epoch:10 iter: 270 end\n",
      "Train epoch:10 iter: 271 begin\n",
      "Train epoch:10 iter: 271 end\n",
      "Train epoch:10 iter: 272 begin\n",
      "Train epoch:10 iter: 272 end\n",
      "Train epoch:10 iter: 273 begin\n",
      "Train epoch:10 iter: 273 end\n",
      "Train epoch:10 iter: 274 begin\n",
      "Train epoch:10 iter: 274 end\n",
      "Train epoch:10 iter: 275 begin\n",
      "Train epoch:10 iter: 275 end\n",
      "Train epoch:10 iter: 276 begin\n",
      "Train epoch:10 iter: 276 end\n",
      "Train epoch:10 iter: 277 begin\n",
      "Train epoch:10 iter: 277 end\n",
      "Train epoch:10 iter: 278 begin\n",
      "Train epoch:10 iter: 278 end\n",
      "Train epoch:10 iter: 279 begin\n",
      "Train epoch:10 iter: 279 end\n",
      "Train epoch:10 iter: 280 begin\n",
      "Train epoch:10 iter: 280 end\n",
      "Train epoch:10 iter: 281 begin\n",
      "Train epoch:10 iter: 281 end\n",
      "Train epoch:10 iter: 282 begin\n",
      "Train epoch:10 iter: 282 end\n",
      "Train epoch:10 iter: 283 begin\n",
      "Train epoch:10 iter: 283 end\n",
      "Train epoch:10 iter: 284 begin\n",
      "Train epoch:10 iter: 284 end\n",
      "Train epoch:10 iter: 285 begin\n",
      "Train epoch:10 iter: 285 end\n",
      "Train epoch:10 iter: 286 begin\n",
      "Train epoch:10 iter: 286 end\n",
      "Train epoch:10 iter: 287 begin\n",
      "Train epoch:10 iter: 287 end\n",
      "Train epoch:10 iter: 288 begin\n",
      "Train epoch:10 iter: 288 end\n",
      "Train epoch:10 iter: 289 begin\n",
      "Train epoch:10 iter: 289 end\n",
      "Train epoch:10 iter: 290 begin\n",
      "Train epoch:10 iter: 290 end\n",
      "Train epoch:10 iter: 291 begin\n",
      "Train epoch:10 iter: 291 end\n",
      "Train epoch:10 iter: 292 begin\n",
      "Train epoch:10 iter: 292 end\n",
      "Train epoch:10 iter: 293 begin\n",
      "Train epoch:10 iter: 293 end\n",
      "Train epoch:10 iter: 294 begin\n",
      "Train epoch:10 iter: 294 end\n",
      "Train epoch:10 iter: 295 begin\n",
      "Train epoch:10 iter: 295 end\n",
      "Train epoch:10 iter: 296 begin\n",
      "Train epoch:10 iter: 296 end\n",
      "Train epoch:10 iter: 297 begin\n",
      "Train epoch:10 iter: 297 end\n",
      "Train epoch:10 iter: 298 begin\n",
      "Train epoch:10 iter: 298 end\n",
      "Train epoch:10 iter: 299 begin\n",
      "Train epoch:10 iter: 299 end\n",
      "Train epoch:10 iter: 300 begin\n",
      "Train epoch:10 iter: 300 end\n",
      "Train epoch:10 iter: 301 begin\n",
      "Train epoch:10 iter: 301 end\n",
      "Train epoch:10 iter: 302 begin\n",
      "Train epoch:10 iter: 302 end\n",
      "Train epoch:10 iter: 303 begin\n",
      "Train epoch:10 iter: 303 end\n",
      "Train epoch:10 iter: 304 begin\n",
      "Train epoch:10 iter: 304 end\n",
      "Train epoch:10 iter: 305 begin\n",
      "Train epoch:10 iter: 305 end\n",
      "Train epoch:10 iter: 306 begin\n",
      "Train epoch:10 iter: 306 end\n",
      "Train epoch:10 iter: 307 begin\n",
      "Train epoch:10 iter: 307 end\n",
      "Train epoch:10 iter: 308 begin\n",
      "Train epoch:10 iter: 308 end\n",
      "Train epoch:10 iter: 309 begin\n",
      "Train epoch:10 iter: 309 end\n",
      "Train epoch:10 iter: 310 begin\n",
      "Train epoch:10 iter: 310 end\n",
      "Train epoch:10 iter: 311 begin\n",
      "Train epoch:10 iter: 311 end\n",
      "Train epoch:10 iter: 312 begin\n",
      "Train epoch:10 iter: 312 end\n",
      "Train epoch:10 iter: 313 begin\n",
      "Train epoch:10 iter: 313 end\n",
      "Train epoch:10 iter: 314 begin\n",
      "Train epoch:10 iter: 314 end\n",
      "Train epoch:10 iter: 315 begin\n",
      "Train epoch:10 iter: 315 end\n",
      "Train epoch:10 iter: 316 begin\n",
      "Train epoch:10 iter: 316 end\n",
      "Train epoch:10 iter: 317 begin\n",
      "Train epoch:10 iter: 317 end\n",
      "Train epoch:10 iter: 318 begin\n",
      "Train epoch:10 iter: 318 end\n",
      "Train epoch:10 iter: 319 begin\n",
      "Train epoch:10 iter: 319 end\n",
      "Train epoch:10 iter: 320 begin\n",
      "Train epoch:10 iter: 320 end\n",
      "Train epoch:10 iter: 321 begin\n",
      "Train epoch:10 iter: 321 end\n",
      "Train epoch:10 iter: 322 begin\n",
      "Train epoch:10 iter: 322 end\n",
      "Train epoch:10 iter: 323 begin\n",
      "Train epoch:10 iter: 323 end\n",
      "Train epoch:10 iter: 324 begin\n",
      "Train epoch:10 iter: 324 end\n",
      "Train epoch:10 iter: 325 begin\n",
      "Train epoch:10 iter: 325 end\n",
      "Train epoch:10 iter: 326 begin\n",
      "Train epoch:10 iter: 326 end\n",
      "Train epoch:10 iter: 327 begin\n",
      "Train epoch:10 iter: 327 end\n",
      "Train epoch:10 iter: 328 begin\n",
      "Train epoch:10 iter: 328 end\n",
      "Train epoch:10 iter: 329 begin\n",
      "Train epoch:10 iter: 329 end\n",
      "Train epoch:10 iter: 330 begin\n",
      "Train epoch:10 iter: 330 end\n",
      "Train epoch:10 iter: 331 begin\n",
      "Train epoch:10 iter: 331 end\n",
      "Train epoch:10 iter: 332 begin\n",
      "Train epoch:10 iter: 332 end\n",
      "Train epoch:10 iter: 333 begin\n",
      "Train epoch:10 iter: 333 end\n",
      "Train epoch:10 iter: 334 begin\n",
      "Train epoch:10 iter: 334 end\n",
      "Train epoch:10 iter: 335 begin\n",
      "Train epoch:10 iter: 335 end\n",
      "Train epoch:10 iter: 336 begin\n",
      "Train epoch:10 iter: 336 end\n",
      "Train epoch:10 iter: 337 begin\n",
      "Train epoch:10 iter: 337 end\n",
      "Train epoch:10 iter: 338 begin\n",
      "Train epoch:10 iter: 338 end\n",
      "Train epoch:10 iter: 339 begin\n",
      "Train epoch:10 iter: 339 end\n",
      "Train epoch:10 iter: 340 begin\n",
      "Train epoch:10 iter: 340 end\n",
      "Train epoch:10 iter: 341 begin\n",
      "Train epoch:10 iter: 341 end\n",
      "Train epoch:10 iter: 342 begin\n",
      "Train epoch:10 iter: 342 end\n",
      "Train epoch:10 iter: 343 begin\n",
      "Train epoch:10 iter: 343 end\n",
      "Train epoch:10 iter: 344 begin\n",
      "Train epoch:10 iter: 344 end\n",
      "Train epoch:10 iter: 345 begin\n",
      "Train epoch:10 iter: 345 end\n",
      "Train epoch:10 iter: 346 begin\n",
      "Train epoch:10 iter: 346 end\n",
      "Train epoch:10 iter: 347 begin\n",
      "Train epoch:10 iter: 347 end\n",
      "Train epoch:10 iter: 348 begin\n",
      "Train epoch:10 iter: 348 end\n",
      "Train epoch:10 iter: 349 begin\n",
      "Train epoch:10 iter: 349 end\n",
      "Train epoch:10 iter: 350 begin\n",
      "Train epoch:10 iter: 350 end\n",
      "Train epoch:10 iter: 351 begin\n",
      "Train epoch:10 iter: 351 end\n",
      "Train epoch:10 iter: 352 begin\n",
      "Train epoch:10 iter: 352 end\n",
      "Train epoch:10 iter: 353 begin\n",
      "Train epoch:10 iter: 353 end\n",
      "Train epoch:10 iter: 354 begin\n",
      "Train epoch:10 iter: 354 end\n",
      "Train epoch:10 iter: 355 begin\n",
      "Train epoch:10 iter: 355 end\n",
      "Train epoch:10 iter: 356 begin\n",
      "Train epoch:10 iter: 356 end\n",
      "Train epoch:10 iter: 357 begin\n",
      "Train epoch:10 iter: 357 end\n",
      "Train epoch:10 iter: 358 begin\n",
      "Train epoch:10 iter: 358 end\n",
      "Train epoch:10 iter: 359 begin\n",
      "Train epoch:10 iter: 359 end\n",
      "Train epoch:10 iter: 360 begin\n",
      "Train epoch:10 iter: 360 end\n",
      "Train epoch:10 iter: 361 begin\n",
      "Train epoch:10 iter: 361 end\n",
      "Train epoch:10 iter: 362 begin\n",
      "Train epoch:10 iter: 362 end\n",
      "Train epoch:10 iter: 363 begin\n",
      "Train epoch:10 iter: 363 end\n",
      "Train epoch:10 iter: 364 begin\n",
      "Train epoch:10 iter: 364 end\n",
      "Train epoch:10 iter: 365 begin\n",
      "Train epoch:10 iter: 365 end\n",
      "Train epoch:10 iter: 366 begin\n",
      "Train epoch:10 iter: 366 end\n",
      "Train epoch:10 iter: 367 begin\n",
      "Train epoch:10 iter: 367 end\n",
      "Train epoch:10 iter: 368 begin\n",
      "Train epoch:10 iter: 368 end\n",
      "Train epoch:10 iter: 369 begin\n",
      "Train epoch:10 iter: 369 end\n",
      "Train epoch:10 iter: 370 begin\n",
      "Train epoch:10 iter: 370 end\n",
      "Train epoch:10 iter: 371 begin\n",
      "Train epoch:10 iter: 371 end\n",
      "Train epoch:10 iter: 372 begin\n",
      "Train epoch:10 iter: 372 end\n",
      "Train epoch:10 iter: 373 begin\n",
      "Train epoch:10 iter: 373 end\n",
      "Train epoch:10 iter: 374 begin\n",
      "Train epoch:10 iter: 374 end\n",
      "Train epoch:10 iter: 375 begin\n",
      "Train epoch:10 iter: 375 end\n",
      "Train epoch:10 iter: 376 begin\n",
      "Train epoch:10 iter: 376 end\n",
      "Train epoch:10 iter: 377 begin\n",
      "Train epoch:10 iter: 377 end\n",
      "Train epoch:10 iter: 378 begin\n",
      "Train epoch:10 iter: 378 end\n",
      "Train epoch:10 iter: 379 begin\n",
      "Train epoch:10 iter: 379 end\n",
      "Train epoch:10 iter: 380 begin\n",
      "Train epoch:10 iter: 380 end\n",
      "Train epoch:10 iter: 381 begin\n",
      "Train epoch:10 iter: 381 end\n",
      "Train epoch:10 iter: 382 begin\n",
      "Train epoch:10 iter: 382 end\n",
      "Train epoch:10 iter: 383 begin\n",
      "Train epoch:10 iter: 383 end\n",
      "Train epoch:10 iter: 384 begin\n",
      "Train epoch:10 iter: 384 end\n",
      "Train epoch:10 iter: 385 begin\n",
      "Train epoch:10 iter: 385 end\n",
      "Train epoch:10 iter: 386 begin\n",
      "Train epoch:10 iter: 386 end\n",
      "Train epoch:10 iter: 387 begin\n",
      "Train epoch:10 iter: 387 end\n",
      "Train epoch:10 iter: 388 begin\n",
      "Train epoch:10 iter: 388 end\n",
      "Train epoch:10 iter: 389 begin\n",
      "Train epoch:10 iter: 389 end\n",
      "Train epoch:10 iter: 390 begin\n",
      "Train epoch:10 iter: 390 end\n",
      "Train epoch:10 iter: 391 begin\n",
      "Train epoch:10 iter: 391 end\n",
      "Train epoch:10 iter: 392 begin\n",
      "Train epoch:10 iter: 392 end\n",
      "Train epoch:10 iter: 393 begin\n",
      "Train epoch:10 iter: 393 end\n",
      "Train epoch:10 iter: 394 begin\n",
      "Train epoch:10 iter: 394 end\n",
      "Train epoch:10 iter: 395 begin\n",
      "Train epoch:10 iter: 395 end\n",
      "Train epoch:10 iter: 396 begin\n",
      "Train epoch:10 iter: 396 end\n",
      "Train epoch:10 iter: 397 begin\n",
      "Train epoch:10 iter: 397 end\n",
      "Train epoch:10 iter: 398 begin\n",
      "Train epoch:10 iter: 398 end\n",
      "Train epoch:10 iter: 399 begin\n",
      "Train epoch:10 iter: 399 end\n",
      "Train epoch:10 iter: 400 begin\n",
      "Train epoch:10 iter: 400 end\n",
      "Train epoch:10 iter: 401 begin\n",
      "Train epoch:10 iter: 401 end\n",
      "Train epoch:10 iter: 402 begin\n",
      "Train epoch:10 iter: 402 end\n",
      "Train epoch:10 iter: 403 begin\n",
      "Train epoch:10 iter: 403 end\n",
      "Train epoch:10 iter: 404 begin\n",
      "Train epoch:10 iter: 404 end\n",
      "Train epoch:10 iter: 405 begin\n",
      "Train epoch:10 iter: 405 end\n",
      "Train epoch:10 iter: 406 begin\n",
      "Train epoch:10 iter: 406 end\n",
      "Train epoch:10 iter: 407 begin\n",
      "Train epoch:10 iter: 407 end\n",
      "Train epoch:10 iter: 408 begin\n",
      "Train epoch:10 iter: 408 end\n",
      "Train epoch:10 iter: 409 begin\n",
      "Train epoch:10 iter: 409 end\n",
      "Train epoch:10 iter: 410 begin\n",
      "Train epoch:10 iter: 410 end\n",
      "Train epoch:10 iter: 411 begin\n",
      "Train epoch:10 iter: 411 end\n",
      "Train epoch:10 iter: 412 begin\n",
      "Train epoch:10 iter: 412 end\n",
      "Train epoch:10 iter: 413 begin\n",
      "Train epoch:10 iter: 413 end\n",
      "Train epoch:10 iter: 414 begin\n",
      "Train epoch:10 iter: 414 end\n",
      "Train epoch:10 iter: 415 begin\n",
      "Train epoch:10 iter: 415 end\n",
      "Train epoch:10 iter: 416 begin\n",
      "Train epoch:10 iter: 416 end\n",
      "Train epoch:10 iter: 417 begin\n",
      "Train epoch:10 iter: 417 end\n",
      "Train epoch:10 iter: 418 begin\n",
      "Train epoch:10 iter: 418 end\n",
      "Train epoch:10 iter: 419 begin\n",
      "Train epoch:10 iter: 419 end\n",
      "Train epoch:10 iter: 420 begin\n",
      "Train epoch:10 iter: 420 end\n",
      "Train epoch:10 iter: 421 begin\n",
      "Train epoch:10 iter: 421 end\n",
      "Train epoch:10 iter: 422 begin\n",
      "Train epoch:10 iter: 422 end\n",
      "Train epoch:10 iter: 423 begin\n",
      "Train epoch:10 iter: 423 end\n",
      "Train epoch:10 iter: 424 begin\n",
      "Train epoch:10 iter: 424 end\n",
      "Train epoch:10 iter: 425 begin\n",
      "Train epoch:10 iter: 425 end\n",
      "Train epoch:10 iter: 426 begin\n",
      "Train epoch:10 iter: 426 end\n",
      "Train epoch:10 iter: 427 begin\n",
      "Train epoch:10 iter: 427 end\n",
      "Train epoch:10 iter: 428 begin\n",
      "Train epoch:10 iter: 428 end\n",
      "Train epoch:10 iter: 429 begin\n",
      "Train epoch:10 iter: 429 end\n",
      "Train epoch:10 iter: 430 begin\n",
      "Train epoch:10 iter: 430 end\n",
      "Train epoch:10 iter: 431 begin\n",
      "Train epoch:10 iter: 431 end\n",
      "Train epoch:10 iter: 432 begin\n",
      "Train epoch:10 iter: 432 end\n",
      "Train epoch:10 iter: 433 begin\n",
      "Train epoch:10 iter: 433 end\n",
      "Train epoch:10 iter: 434 begin\n",
      "Train epoch:10 iter: 434 end\n",
      "Train epoch:10 iter: 435 begin\n",
      "Train epoch:10 iter: 435 end\n",
      "Train epoch:10 iter: 436 begin\n",
      "Train epoch:10 iter: 436 end\n",
      "Train epoch:10 iter: 437 begin\n",
      "Train epoch:10 iter: 437 end\n",
      "Train epoch:10 iter: 438 begin\n",
      "Train epoch:10 iter: 438 end\n",
      "Train epoch:10 iter: 439 begin\n",
      "Train epoch:10 iter: 439 end\n",
      "Train epoch:10 iter: 440 begin\n",
      "Train epoch:10 iter: 440 end\n",
      "Train epoch:10 iter: 441 begin\n",
      "Train epoch:10 iter: 441 end\n",
      "Train epoch:10 iter: 442 begin\n",
      "Train epoch:10 iter: 442 end\n",
      "Train epoch:10 iter: 443 begin\n",
      "Train epoch:10 iter: 443 end\n",
      "Train epoch:10 iter: 444 begin\n",
      "Train epoch:10 iter: 444 end\n",
      "Train epoch:10 iter: 445 begin\n",
      "Train epoch:10 iter: 445 end\n",
      "Train epoch:10 iter: 446 begin\n",
      "Train epoch:10 iter: 446 end\n",
      "Train epoch:10 iter: 447 begin\n",
      "Train epoch:10 iter: 447 end\n",
      "Train epoch:10 iter: 448 begin\n",
      "Train epoch:10 iter: 448 end\n",
      "Train epoch:10 iter: 449 begin\n",
      "Train epoch:10 iter: 449 end\n",
      "Train epoch:10 iter: 450 begin\n",
      "Train epoch:10 iter: 450 end\n",
      "Train epoch:10 iter: 451 begin\n",
      "Train epoch:10 iter: 451 end\n",
      "Train epoch:10 iter: 452 begin\n",
      "Train epoch:10 iter: 452 end\n",
      "Train epoch:10 iter: 453 begin\n",
      "Train epoch:10 iter: 453 end\n",
      "Train epoch:10 iter: 454 begin\n",
      "Train epoch:10 iter: 454 end\n",
      "Train epoch:10 iter: 455 begin\n",
      "Train epoch:10 iter: 455 end\n",
      "Train epoch:10 iter: 456 begin\n",
      "Train epoch:10 iter: 456 end\n",
      "Train epoch:10 iter: 457 begin\n",
      "Train epoch:10 iter: 457 end\n",
      "Train epoch:10 iter: 458 begin\n",
      "Train epoch:10 iter: 458 end\n",
      "Train epoch:10 iter: 459 begin\n",
      "Train epoch:10 iter: 459 end\n",
      "Train epoch:10 iter: 460 begin\n",
      "Train epoch:10 iter: 460 end\n",
      "Train epoch:10 iter: 461 begin\n",
      "Train epoch:10 iter: 461 end\n",
      "Train epoch:10 iter: 462 begin\n",
      "Train epoch:10 iter: 462 end\n",
      "Train epoch:10 iter: 463 begin\n",
      "Train epoch:10 iter: 463 end\n",
      "Train epoch:10 iter: 464 begin\n",
      "Train epoch:10 iter: 464 end\n",
      "Train epoch:10 iter: 465 begin\n",
      "Train epoch:10 iter: 465 end\n",
      "Train epoch:10 iter: 466 begin\n",
      "Train epoch:10 iter: 466 end\n",
      "Train epoch:10 iter: 467 begin\n",
      "Train epoch:10 iter: 467 end\n",
      "Train epoch:10 iter: 468 begin\n",
      "Train epoch:10 iter: 468 end\n",
      "Train epoch:10 iter: 469 begin\n",
      "Train epoch:10 iter: 469 end\n",
      "Train epoch:10 iter: 470 begin\n",
      "Train epoch:10 iter: 470 end\n",
      "Train epoch:10 iter: 471 begin\n",
      "Train epoch:10 iter: 471 end\n",
      "Train epoch:10 iter: 472 begin\n",
      "Train epoch:10 iter: 472 end\n",
      "Train epoch:10 iter: 473 begin\n",
      "Train epoch:10 iter: 473 end\n",
      "Train epoch:10 iter: 474 begin\n",
      "Train epoch:10 iter: 474 end\n",
      "Train epoch:10 iter: 475 begin\n",
      "Train epoch:10 iter: 475 end\n",
      "Train epoch:10 iter: 476 begin\n",
      "Train epoch:10 iter: 476 end\n",
      "Train epoch:10 iter: 477 begin\n",
      "Train epoch:10 iter: 477 end\n",
      "Train epoch:10 iter: 478 begin\n",
      "Train epoch:10 iter: 478 end\n",
      "Train epoch:10 iter: 479 begin\n",
      "Train epoch:10 iter: 479 end\n",
      "Train epoch:10 iter: 480 begin\n",
      "Train epoch:10 iter: 480 end\n",
      "Train epoch:10 iter: 481 begin\n",
      "Train epoch:10 iter: 481 end\n",
      "Train epoch:10 iter: 482 begin\n",
      "Train epoch:10 iter: 482 end\n",
      "Train epoch:10 iter: 483 begin\n",
      "Train epoch:10 iter: 483 end\n",
      "Train epoch:10 iter: 484 begin\n",
      "Train epoch:10 iter: 484 end\n",
      "Train epoch:10 iter: 485 begin\n",
      "Train epoch:10 iter: 485 end\n",
      "Train epoch:10 iter: 486 begin\n",
      "Train epoch:10 iter: 486 end\n",
      "Train epoch:10 iter: 487 begin\n",
      "Train epoch:10 iter: 487 end\n",
      "Train epoch:10 iter: 488 begin\n",
      "Train epoch:10 iter: 488 end\n",
      "Train epoch:10 iter: 489 begin\n",
      "Train epoch:10 iter: 489 end\n",
      "Train epoch:10 iter: 490 begin\n",
      "Train epoch:10 iter: 490 end\n",
      "Train epoch:10 iter: 491 begin\n",
      "Train epoch:10 iter: 491 end\n",
      "Train epoch:10 iter: 492 begin\n",
      "Train epoch:10 iter: 492 end\n",
      "Train epoch:10 iter: 493 begin\n",
      "Train epoch:10 iter: 493 end\n",
      "Train epoch:10 iter: 494 begin\n",
      "Train epoch:10 iter: 494 end\n",
      "Train epoch:10 iter: 495 begin\n",
      "Train epoch:10 iter: 495 end\n",
      "Train epoch:10 iter: 496 begin\n",
      "Train epoch:10 iter: 496 end\n",
      "Train epoch:10 iter: 497 begin\n",
      "Train epoch:10 iter: 497 end\n",
      "Train epoch:10 iter: 498 begin\n",
      "Train epoch:10 iter: 498 end\n",
      "Train epoch:10 iter: 499 begin\n",
      "Train epoch:10 iter: 499 end\n",
      "Train epoch:10 iter: 500 begin\n",
      "Train epoch:10 iter: 500 end\n",
      "Train epoch:10 iter: 501 begin\n",
      "Train epoch:10 iter: 501 end\n",
      "Train epoch:10 iter: 502 begin\n",
      "Train epoch:10 iter: 502 end\n",
      "Train epoch:10 iter: 503 begin\n",
      "Train epoch:10 iter: 503 end\n",
      "Train epoch:10 iter: 504 begin\n",
      "Train epoch:10 iter: 504 end\n",
      "Train epoch:10 iter: 505 begin\n",
      "Train epoch:10 iter: 505 end\n",
      "Train epoch:10 iter: 506 begin\n",
      "Train epoch:10 iter: 506 end\n",
      "Train epoch:10 iter: 507 begin\n",
      "Train epoch:10 iter: 507 end\n",
      "Train epoch:10 iter: 508 begin\n",
      "Train epoch:10 iter: 508 end\n",
      "Train epoch:10 iter: 509 begin\n",
      "Train epoch:10 iter: 509 end\n",
      "Train epoch:10 iter: 510 begin\n",
      "Train epoch:10 iter: 510 end\n",
      "Train epoch:10 iter: 511 begin\n",
      "Train epoch:10 iter: 511 end\n",
      "Train epoch:10 iter: 512 begin\n",
      "Train epoch:10 iter: 512 end\n",
      "Train epoch:10 iter: 513 begin\n",
      "Train epoch:10 iter: 513 end\n",
      "Train epoch:10 iter: 514 begin\n",
      "Train epoch:10 iter: 514 end\n",
      "Train epoch:10 iter: 515 begin\n",
      "Train epoch:10 iter: 515 end\n",
      "Train epoch:10 iter: 516 begin\n",
      "Train epoch:10 iter: 516 end\n",
      "Train epoch:10 iter: 517 begin\n",
      "Train epoch:10 iter: 517 end\n",
      "Train epoch:10 iter: 518 begin\n",
      "Train epoch:10 iter: 518 end\n",
      "Train epoch:10 iter: 519 begin\n",
      "Train epoch:10 iter: 519 end\n",
      "Train epoch:10 iter: 520 begin\n",
      "Train epoch:10 iter: 520 end\n",
      "Train epoch:10 iter: 521 begin\n",
      "Train epoch:10 iter: 521 end\n",
      "Train epoch:10 iter: 522 begin\n",
      "Train epoch:10 iter: 522 end\n",
      "Train epoch:10 iter: 523 begin\n",
      "Train epoch:10 iter: 523 end\n",
      "Train epoch:10 iter: 524 begin\n",
      "Train epoch:10 iter: 524 end\n",
      "Train epoch:10 iter: 525 begin\n",
      "Train epoch:10 iter: 525 end\n",
      "Train epoch:10 iter: 526 begin\n",
      "Train epoch:10 iter: 526 end\n",
      "Train epoch:10 iter: 527 begin\n",
      "Train epoch:10 iter: 527 end\n",
      "Train epoch:10 iter: 528 begin\n",
      "Train epoch:10 iter: 528 end\n",
      "Train epoch:10 iter: 529 begin\n",
      "Train epoch:10 iter: 529 end\n",
      "Train epoch:10 iter: 530 begin\n",
      "Train epoch:10 iter: 530 end\n",
      "Train epoch:10 iter: 531 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:10 iter: 531 end\n",
      "Train epoch:10 iter: 532 begin\n",
      "Train epoch:10 iter: 532 end\n",
      "Train epoch:10 iter: 533 begin\n",
      "Train epoch:10 iter: 533 end\n",
      "Train epoch:10 iter: 534 begin\n",
      "Train epoch:10 iter: 534 end\n",
      "Train epoch:10 iter: 535 begin\n",
      "Train epoch:10 iter: 535 end\n",
      "Train epoch:10 iter: 536 begin\n",
      "Train epoch:10 iter: 536 end\n",
      "Train epoch:10 iter: 537 begin\n",
      "Train epoch:10 iter: 537 end\n",
      "Train epoch:10 iter: 538 begin\n",
      "Train epoch:10 iter: 538 end\n",
      "Train epoch:10 iter: 539 begin\n",
      "Train epoch:10 iter: 539 end\n",
      "Train epoch:10 iter: 540 begin\n",
      "Train epoch:10 iter: 540 end\n",
      "Train epoch:10 iter: 541 begin\n",
      "Train epoch:10 iter: 541 end\n",
      "Train epoch:10 iter: 542 begin\n",
      "Train epoch:10 iter: 542 end\n",
      "Train epoch:10 iter: 543 begin\n",
      "Train epoch:10 iter: 543 end\n",
      "Train epoch:10 iter: 544 begin\n",
      "Train epoch:10 iter: 544 end\n",
      "Train epoch:10 iter: 545 begin\n",
      "Train epoch:10 iter: 545 end\n",
      "Train epoch:10 iter: 546 begin\n",
      "Train epoch:10 iter: 546 end\n",
      "Train epoch:10 iter: 547 begin\n",
      "Train epoch:10 iter: 547 end\n",
      "Train epoch:10 iter: 548 begin\n",
      "Train epoch:10 iter: 548 end\n",
      "Train epoch:10 iter: 549 begin\n",
      "Train epoch:10 iter: 549 end\n",
      "Train epoch:10 iter: 550 begin\n",
      "Train epoch:10 iter: 550 end\n",
      "Train epoch:10 iter: 551 begin\n",
      "Train epoch:10 iter: 551 end\n",
      "Train epoch:10 iter: 552 begin\n",
      "Train epoch:10 iter: 552 end\n",
      "Train epoch:10 iter: 553 begin\n",
      "Train epoch:10 iter: 553 end\n",
      "Train epoch:10 iter: 554 begin\n",
      "Train epoch:10 iter: 554 end\n",
      "Train epoch:10 iter: 555 begin\n",
      "Train epoch:10 iter: 555 end\n",
      "Train epoch:10 iter: 556 begin\n",
      "Train epoch:10 iter: 556 end\n",
      "Train epoch:10 iter: 557 begin\n",
      "Train epoch:10 iter: 557 end\n",
      "Train epoch:10 iter: 558 begin\n",
      "Train epoch:10 iter: 558 end\n",
      "Train epoch:10 iter: 559 begin\n",
      "Train epoch:10 iter: 559 end\n",
      "Train epoch:10 iter: 560 begin\n",
      "Train epoch:10 iter: 560 end\n",
      "Train epoch:10 iter: 561 begin\n",
      "Train epoch:10 iter: 561 end\n",
      "Train epoch:10 iter: 562 begin\n",
      "Train epoch:10 iter: 562 end\n",
      "Train epoch:10 iter: 563 begin\n",
      "Train epoch:10 iter: 563 end\n",
      "Train epoch:10 iter: 564 begin\n",
      "Train epoch:10 iter: 564 end\n",
      "Train epoch:10 iter: 565 begin\n",
      "Train epoch:10 iter: 565 end\n",
      "Train epoch:10 iter: 566 begin\n",
      "Train epoch:10 iter: 566 end\n",
      "Train epoch:10 iter: 567 begin\n",
      "Train epoch:10 iter: 567 end\n",
      "Train epoch:10 iter: 568 begin\n",
      "Train epoch:10 iter: 568 end\n",
      "Train epoch:10 iter: 569 begin\n",
      "Train epoch:10 iter: 569 end\n",
      "Train epoch:10 iter: 570 begin\n",
      "Train epoch:10 iter: 570 end\n",
      "Train epoch:10 iter: 571 begin\n",
      "Train epoch:10 iter: 571 end\n",
      "Train epoch:10 iter: 572 begin\n",
      "Train epoch:10 iter: 572 end\n",
      "Train epoch:10 iter: 573 begin\n",
      "Train epoch:10 iter: 573 end\n",
      "Train epoch:10 iter: 574 begin\n",
      "Train epoch:10 iter: 574 end\n",
      "Train epoch:10 iter: 575 begin\n",
      "Train epoch:10 iter: 575 end\n",
      "Train epoch:10 iter: 576 begin\n",
      "Train epoch:10 iter: 576 end\n",
      "Train epoch:10 iter: 577 begin\n",
      "Train epoch:10 iter: 577 end\n",
      "Train epoch:10 iter: 578 begin\n",
      "Train epoch:10 iter: 578 end\n",
      "Train epoch:10 iter: 579 begin\n",
      "Train epoch:10 iter: 579 end\n",
      "Train epoch:10 iter: 580 begin\n",
      "Train epoch:10 iter: 580 end\n",
      "Train epoch:10 iter: 581 begin\n",
      "Train epoch:10 iter: 581 end\n",
      "Train epoch:10 iter: 582 begin\n",
      "Train epoch:10 iter: 582 end\n",
      "Train epoch:10 iter: 583 begin\n",
      "Train epoch:10 iter: 583 end\n",
      "Train epoch:10 iter: 584 begin\n",
      "Train epoch:10 iter: 584 end\n",
      "Train epoch:10 iter: 585 begin\n",
      "Train epoch:10 iter: 585 end\n",
      "Train epoch:10 iter: 586 begin\n",
      "Train epoch:10 iter: 586 end\n",
      "Train epoch:10 iter: 587 begin\n",
      "Train epoch:10 iter: 587 end\n",
      "Train epoch:10 iter: 588 begin\n",
      "Train epoch:10 iter: 588 end\n",
      "Train epoch:10 iter: 589 begin\n",
      "Train epoch:10 iter: 589 end\n",
      "Train epoch:10 iter: 590 begin\n",
      "Train epoch:10 iter: 590 end\n",
      "Train epoch:10 iter: 591 begin\n",
      "Train epoch:10 iter: 591 end\n",
      "Train epoch:10 iter: 592 begin\n",
      "Train epoch:10 iter: 592 end\n",
      "Train epoch:10 iter: 593 begin\n",
      "Train epoch:10 iter: 593 end\n",
      "Train epoch:10 iter: 594 begin\n",
      "Train epoch:10 iter: 594 end\n",
      "Train epoch:10 iter: 595 begin\n",
      "Train epoch:10 iter: 595 end\n",
      "Train epoch:10 iter: 596 begin\n",
      "Train epoch:10 iter: 596 end\n",
      "Train epoch:10 iter: 597 begin\n",
      "Train epoch:10 iter: 597 end\n",
      "Train epoch:10 iter: 598 begin\n",
      "Train epoch:10 iter: 598 end\n",
      "Train epoch:10 iter: 599 begin\n",
      "Train epoch:10 iter: 599 end\n",
      "Train epoch:10 iter: 600 begin\n",
      "Train epoch:10 iter: 600 end\n",
      "Train epoch:10 iter: 601 begin\n",
      "Train epoch:10 iter: 601 end\n",
      "Train epoch:10 iter: 602 begin\n",
      "Train epoch:10 iter: 602 end\n",
      "Train epoch:10 iter: 603 begin\n",
      "Train epoch:10 iter: 603 end\n",
      "Train epoch:10 iter: 604 begin\n",
      "Train epoch:10 iter: 604 end\n",
      "Train epoch:10 iter: 605 begin\n",
      "Train epoch:10 iter: 605 end\n",
      "Train epoch:10 iter: 606 begin\n",
      "Train epoch:10 iter: 606 end\n",
      "Train epoch:10 iter: 607 begin\n",
      "Train epoch:10 iter: 607 end\n",
      "Train epoch:10 iter: 608 begin\n",
      "Train epoch:10 iter: 608 end\n",
      "Train epoch:10 iter: 609 begin\n",
      "Train epoch:10 iter: 609 end\n",
      "Train epoch:10 iter: 610 begin\n",
      "Train epoch:10 iter: 610 end\n",
      "Train epoch:10 iter: 611 begin\n",
      "Train epoch:10 iter: 611 end\n",
      "Train epoch:10 iter: 612 begin\n",
      "Train epoch:10 iter: 612 end\n",
      "Train epoch:10 iter: 613 begin\n",
      "Train epoch:10 iter: 613 end\n",
      "Train epoch:10 iter: 614 begin\n",
      "Train epoch:10 iter: 614 end\n",
      "Train epoch:10 iter: 615 begin\n",
      "Train epoch:10 iter: 615 end\n",
      "Train epoch:10 iter: 616 begin\n",
      "Train epoch:10 iter: 616 end\n",
      "Train epoch:10 iter: 617 begin\n",
      "Train epoch:10 iter: 617 end\n",
      "Train epoch:10 iter: 618 begin\n",
      "Train epoch:10 iter: 618 end\n",
      "Train epoch:10 iter: 619 begin\n",
      "Train epoch:10 iter: 619 end\n",
      "Train epoch:10 iter: 620 begin\n",
      "Train epoch:10 iter: 620 end\n",
      "Train epoch:10 iter: 621 begin\n",
      "Train epoch:10 iter: 621 end\n",
      "Train epoch:10 iter: 622 begin\n",
      "Train epoch:10 iter: 622 end\n",
      "Train epoch:10 iter: 623 begin\n",
      "Train epoch:10 iter: 623 end\n",
      "Train epoch:10 iter: 624 begin\n",
      "Train epoch:10 iter: 624 end\n",
      "Train epoch:10 iter: 625 begin\n",
      "Train epoch:10 iter: 625 end\n",
      "Train epoch:10 iter: 626 begin\n",
      "Train epoch:10 iter: 626 end\n",
      "Train epoch:10 iter: 627 begin\n",
      "Train epoch:10 iter: 627 end\n",
      "Train epoch:10 iter: 628 begin\n",
      "Train epoch:10 iter: 628 end\n",
      "Train epoch:10 iter: 629 begin\n",
      "Train epoch:10 iter: 629 end\n",
      "Train epoch:10 iter: 630 begin\n",
      "Train epoch:10 iter: 630 end\n",
      "Train epoch:10 iter: 631 begin\n",
      "Train epoch:10 iter: 631 end\n",
      "Train epoch:10 iter: 632 begin\n",
      "Train epoch:10 iter: 632 end\n",
      "Train epoch:10 iter: 633 begin\n",
      "Train epoch:10 iter: 633 end\n",
      "Train epoch:10 iter: 634 begin\n",
      "Train epoch:10 iter: 634 end\n",
      "Train epoch:10 iter: 635 begin\n",
      "Train epoch:10 iter: 635 end\n",
      "Train epoch:10 iter: 636 begin\n",
      "Train epoch:10 iter: 636 end\n",
      "Train epoch:10 iter: 637 begin\n",
      "Train epoch:10 iter: 637 end\n",
      "Train epoch:10 iter: 638 begin\n",
      "Train epoch:10 iter: 638 end\n",
      "Train epoch:10 iter: 639 begin\n",
      "Train epoch:10 iter: 639 end\n",
      "Train epoch:10 iter: 640 begin\n",
      "Train epoch:10 iter: 640 end\n",
      "Train epoch:10 iter: 641 begin\n",
      "Train epoch:10 iter: 641 end\n",
      "Train epoch:10 iter: 642 begin\n",
      "Train epoch:10 iter: 642 end\n",
      "Train epoch:10 iter: 643 begin\n",
      "Train epoch:10 iter: 643 end\n",
      "Train epoch:10 iter: 644 begin\n",
      "Train epoch:10 iter: 644 end\n",
      "Train epoch:10 iter: 645 begin\n",
      "Train epoch:10 iter: 645 end\n",
      "Train epoch:10 iter: 646 begin\n",
      "Train epoch:10 iter: 646 end\n",
      "Train epoch:10 iter: 647 begin\n",
      "Train epoch:10 iter: 647 end\n",
      "Train epoch:10 iter: 648 begin\n",
      "Train epoch:10 iter: 648 end\n",
      "Train epoch:10 iter: 649 begin\n",
      "Train epoch:10 iter: 649 end\n",
      "Train epoch:10 iter: 650 begin\n",
      "Train epoch:10 iter: 650 end\n",
      "Train epoch:10 iter: 651 begin\n",
      "Train epoch:10 iter: 651 end\n",
      "Train epoch:10 iter: 652 begin\n",
      "Train epoch:10 iter: 652 end\n",
      "Train epoch:10 iter: 653 begin\n",
      "Train epoch:10 iter: 653 end\n",
      "Train epoch:10 iter: 654 begin\n",
      "Train epoch:10 iter: 654 end\n",
      "Train epoch:10 iter: 655 begin\n",
      "Train epoch:10 iter: 655 end\n",
      "Train epoch:10 iter: 656 begin\n",
      "Train epoch:10 iter: 656 end\n",
      "Train epoch:10 iter: 657 begin\n",
      "Train epoch:10 iter: 657 end\n",
      "Train epoch:10 iter: 658 begin\n",
      "Train epoch:10 iter: 658 end\n",
      "Train epoch:10 iter: 659 begin\n",
      "Train epoch:10 iter: 659 end\n",
      "Train epoch:10 iter: 660 begin\n",
      "Train epoch:10 iter: 660 end\n",
      "Train epoch:10 iter: 661 begin\n",
      "Train epoch:10 iter: 661 end\n",
      "Train epoch:10 iter: 662 begin\n",
      "Train epoch:10 iter: 662 end\n",
      "Train epoch:10 iter: 663 begin\n",
      "Train epoch:10 iter: 663 end\n",
      "Train epoch:10 iter: 664 begin\n",
      "Train epoch:10 iter: 664 end\n",
      "Train epoch:10 iter: 665 begin\n",
      "Train epoch:10 iter: 665 end\n",
      "Train epoch:10 iter: 666 begin\n",
      "Train epoch:10 iter: 666 end\n",
      "Train epoch:10 iter: 667 begin\n",
      "Train epoch:10 iter: 667 end\n",
      "Train epoch:10 iter: 668 begin\n",
      "Train epoch:10 iter: 668 end\n",
      "Train epoch:10 iter: 669 begin\n",
      "Train epoch:10 iter: 669 end\n",
      "Train epoch:10 iter: 670 begin\n",
      "Train epoch:10 iter: 670 end\n",
      "Train epoch:10 iter: 671 begin\n",
      "Train epoch:10 iter: 671 end\n",
      "Train epoch:10 iter: 672 begin\n",
      "Train epoch:10 iter: 672 end\n",
      "Train epoch:10 iter: 673 begin\n",
      "Train epoch:10 iter: 673 end\n",
      "Train epoch:10 iter: 674 begin\n",
      "Train epoch:10 iter: 674 end\n",
      "Train epoch:10 iter: 675 begin\n",
      "Train epoch:10 iter: 675 end\n",
      "Train epoch:10 iter: 676 begin\n",
      "Train epoch:10 iter: 676 end\n",
      "Train epoch:10 iter: 677 begin\n",
      "Train epoch:10 iter: 677 end\n",
      "Train epoch:10 iter: 678 begin\n",
      "Train epoch:10 iter: 678 end\n",
      "Train epoch:10 iter: 679 begin\n",
      "Train epoch:10 iter: 679 end\n",
      "Train epoch:10 iter: 680 begin\n",
      "Train epoch:10 iter: 680 end\n",
      "Train epoch:10 iter: 681 begin\n",
      "Train epoch:10 iter: 681 end\n",
      "Train epoch:10 iter: 682 begin\n",
      "Train epoch:10 iter: 682 end\n",
      "Train epoch:10 iter: 683 begin\n",
      "Train epoch:10 iter: 683 end\n",
      "Train epoch:10 iter: 684 begin\n",
      "Train epoch:10 iter: 684 end\n",
      "Train epoch:10 iter: 685 begin\n",
      "Train epoch:10 iter: 685 end\n",
      "Train epoch:10 iter: 686 begin\n",
      "Train epoch:10 iter: 686 end\n",
      "Train epoch:10 iter: 687 begin\n",
      "Train epoch:10 iter: 687 end\n",
      "Train epoch:10 iter: 688 begin\n",
      "Train epoch:10 iter: 688 end\n",
      "Train epoch:10 iter: 689 begin\n",
      "Train epoch:10 iter: 689 end\n",
      "Train epoch:10 iter: 690 begin\n",
      "Train epoch:10 iter: 690 end\n",
      "Train epoch:10 iter: 691 begin\n",
      "Train epoch:10 iter: 691 end\n",
      "Train epoch:10 iter: 692 begin\n",
      "Train epoch:10 iter: 692 end\n",
      "Train epoch:10 iter: 693 begin\n",
      "Train epoch:10 iter: 693 end\n",
      "Train epoch:10 iter: 694 begin\n",
      "Train epoch:10 iter: 694 end\n",
      "Train epoch:10 iter: 695 begin\n",
      "Train epoch:10 iter: 695 end\n",
      "Train epoch:10 iter: 696 begin\n",
      "Train epoch:10 iter: 696 end\n",
      "Train epoch:10 iter: 697 begin\n",
      "Train epoch:10 iter: 697 end\n",
      "Train epoch:10 iter: 698 begin\n",
      "Train epoch:10 iter: 698 end\n",
      "Train epoch:10 iter: 699 begin\n",
      "Train epoch:10 iter: 699 end\n",
      "Train epoch:10 iter: 700 begin\n",
      "Train epoch:10 iter: 700 end\n",
      "Train epoch:10 iter: 701 begin\n",
      "Train epoch:10 iter: 701 end\n",
      "Train epoch:10 iter: 702 begin\n",
      "Train epoch:10 iter: 702 end\n",
      "Train epoch:10 iter: 703 begin\n",
      "Train epoch:10 iter: 703 end\n",
      "Train epoch:10 iter: 704 begin\n",
      "Train epoch:10 iter: 704 end\n",
      "Train epoch:10 iter: 705 begin\n",
      "Train epoch:10 iter: 705 end\n",
      "Train epoch:10 iter: 706 begin\n",
      "Train epoch:10 iter: 706 end\n",
      "Train epoch:10 iter: 707 begin\n",
      "Train epoch:10 iter: 707 end\n",
      "Train epoch:10 iter: 708 begin\n",
      "Train epoch:10 iter: 708 end\n",
      "Train epoch:10 iter: 709 begin\n",
      "Train epoch:10 iter: 709 end\n",
      "Train epoch:10 iter: 710 begin\n",
      "Train epoch:10 iter: 710 end\n",
      "Train epoch:10 iter: 711 begin\n",
      "Train epoch:10 iter: 711 end\n",
      "Train epoch:10 iter: 712 begin\n",
      "Train epoch:10 iter: 712 end\n",
      "Train epoch:10 iter: 713 begin\n",
      "Train epoch:10 iter: 713 end\n",
      "Train epoch:10 iter: 714 begin\n",
      "Train epoch:10 iter: 714 end\n",
      "Train epoch:10 iter: 715 begin\n",
      "Train epoch:10 iter: 715 end\n",
      "Train epoch:10 iter: 716 begin\n",
      "Train epoch:10 iter: 716 end\n",
      "Train epoch:10 iter: 717 begin\n",
      "Train epoch:10 iter: 717 end\n",
      "Train epoch:10 iter: 718 begin\n",
      "Train epoch:10 iter: 718 end\n",
      "Train epoch:10 iter: 719 begin\n",
      "Train epoch:10 iter: 719 end\n",
      "Train epoch:10 iter: 720 begin\n",
      "Train epoch:10 iter: 720 end\n",
      "Train epoch:10 iter: 721 begin\n",
      "Train epoch:10 iter: 721 end\n",
      "Train epoch:10 iter: 722 begin\n",
      "Train epoch:10 iter: 722 end\n",
      "Train epoch:10 iter: 723 begin\n",
      "Train epoch:10 iter: 723 end\n",
      "Train epoch:10 iter: 724 begin\n",
      "Train epoch:10 iter: 724 end\n",
      "Train epoch:10 iter: 725 begin\n",
      "Train epoch:10 iter: 725 end\n",
      "Train epoch:10 iter: 726 begin\n",
      "Train epoch:10 iter: 726 end\n",
      "Train epoch:10 iter: 727 begin\n",
      "Train epoch:10 iter: 727 end\n",
      "Train epoch:10 iter: 728 begin\n",
      "Train epoch:10 iter: 728 end\n",
      "Train epoch:10 iter: 729 begin\n",
      "Train epoch:10 iter: 729 end\n",
      "Train epoch:10 iter: 730 begin\n",
      "Train epoch:10 iter: 730 end\n",
      "Train epoch:10 iter: 731 begin\n",
      "Train epoch:10 iter: 731 end\n",
      "Train epoch:10 iter: 732 begin\n",
      "Train epoch:10 iter: 732 end\n",
      "Train epoch:10 iter: 733 begin\n",
      "Train epoch:10 iter: 733 end\n",
      "Train epoch:10 iter: 734 begin\n",
      "Train epoch:10 iter: 734 end\n",
      "Train epoch:10 iter: 735 begin\n",
      "Train epoch:10 iter: 735 end\n",
      "Train epoch:10 iter: 736 begin\n",
      "Train epoch:10 iter: 736 end\n",
      "Train epoch:10 iter: 737 begin\n",
      "Train epoch:10 iter: 737 end\n",
      "Train epoch:10 iter: 738 begin\n",
      "Train epoch:10 iter: 738 end\n",
      "Train epoch:10 iter: 739 begin\n",
      "Train epoch:10 iter: 739 end\n",
      "Train epoch:10 iter: 740 begin\n",
      "Train epoch:10 iter: 740 end\n",
      "Train epoch:10 iter: 741 begin\n",
      "Train epoch:10 iter: 741 end\n",
      "Train epoch:10 iter: 742 begin\n",
      "Train epoch:10 iter: 742 end\n",
      "Train epoch:10 iter: 743 begin\n",
      "Train epoch:10 iter: 743 end\n",
      "Train epoch:10 iter: 744 begin\n",
      "Train epoch:10 iter: 744 end\n",
      "Train epoch:10 iter: 745 begin\n",
      "Train epoch:10 iter: 745 end\n",
      "Train epoch:10 iter: 746 begin\n",
      "Train epoch:10 iter: 746 end\n",
      "Train epoch:10 iter: 747 begin\n",
      "Train epoch:10 iter: 747 end\n",
      "Train epoch:10 iter: 748 begin\n",
      "Train epoch:10 iter: 748 end\n",
      "Train epoch:10 iter: 749 begin\n",
      "Train epoch:10 iter: 749 end\n",
      "Train epoch:10 iter: 750 begin\n",
      "Train epoch:10 iter: 750 end\n",
      "Train epoch:10 iter: 751 begin\n",
      "Train epoch:10 iter: 751 end\n",
      "Train epoch:10 iter: 752 begin\n",
      "Train epoch:10 iter: 752 end\n",
      "Train epoch:10 iter: 753 begin\n",
      "Train epoch:10 iter: 753 end\n",
      "Train epoch:10 iter: 754 begin\n",
      "Train epoch:10 iter: 754 end\n",
      "Train epoch:10 iter: 755 begin\n",
      "Train epoch:10 iter: 755 end\n",
      "Train epoch:10 iter: 756 begin\n",
      "Train epoch:10 iter: 756 end\n",
      "Train epoch:10 iter: 757 begin\n",
      "Train epoch:10 iter: 757 end\n",
      "Train epoch:10 iter: 758 begin\n",
      "Train epoch:10 iter: 758 end\n",
      "Train epoch:10 iter: 759 begin\n",
      "Train epoch:10 iter: 759 end\n",
      "Train epoch:10 iter: 760 begin\n",
      "Train epoch:10 iter: 760 end\n",
      "Train epoch:10 iter: 761 begin\n",
      "Train epoch:10 iter: 761 end\n",
      "Train epoch:10 iter: 762 begin\n",
      "Train epoch:10 iter: 762 end\n",
      "Train epoch:10 iter: 763 begin\n",
      "Train epoch:10 iter: 763 end\n",
      "Train epoch:10 iter: 764 begin\n",
      "Train epoch:10 iter: 764 end\n",
      "Train epoch:10 iter: 765 begin\n",
      "Train epoch:10 iter: 765 end\n",
      "Train epoch:10 iter: 766 begin\n",
      "Train epoch:10 iter: 766 end\n",
      "Train epoch:10 iter: 767 begin\n",
      "Train epoch:10 iter: 767 end\n",
      "Train epoch:10 iter: 768 begin\n",
      "Train epoch:10 iter: 768 end\n",
      "Train epoch:10 iter: 769 begin\n",
      "Train epoch:10 iter: 769 end\n",
      "Train epoch:10 iter: 770 begin\n",
      "Train epoch:10 iter: 770 end\n",
      "Train epoch:10 iter: 771 begin\n",
      "Train epoch:10 iter: 771 end\n",
      "Train epoch:10 iter: 772 begin\n",
      "Train epoch:10 iter: 772 end\n",
      "Train epoch:10 iter: 773 begin\n",
      "Train epoch:10 iter: 773 end\n",
      "Train epoch:10 iter: 774 begin\n",
      "Train epoch:10 iter: 774 end\n",
      "Train epoch:10 iter: 775 begin\n",
      "Train epoch:10 iter: 775 end\n",
      "Train epoch:10 iter: 776 begin\n",
      "Train epoch:10 iter: 776 end\n",
      "Train epoch:10 iter: 777 begin\n",
      "Train epoch:10 iter: 777 end\n",
      "Train epoch:10 iter: 778 begin\n",
      "Train epoch:10 iter: 778 end\n",
      "Train epoch:10 iter: 779 begin\n",
      "Train epoch:10 iter: 779 end\n",
      "Train epoch:10 iter: 780 begin\n",
      "Train epoch:10 iter: 780 end\n",
      "Train epoch:10 iter: 781 begin\n",
      "Train epoch:10 iter: 781 end\n",
      "Train epoch:10 iter: 782 begin\n",
      "Train epoch:10 iter: 782 end\n",
      "Train epoch:10 iter: 783 begin\n",
      "Train epoch:10 iter: 783 end\n",
      "Train epoch:10 iter: 784 begin\n",
      "Train epoch:10 iter: 784 end\n",
      "Train epoch:10 iter: 785 begin\n",
      "Train epoch:10 iter: 785 end\n",
      "Train epoch:10 iter: 786 begin\n",
      "Train epoch:10 iter: 786 end\n",
      "Train epoch:10 iter: 787 begin\n",
      "Train epoch:10 iter: 787 end\n",
      "Train epoch:10 iter: 788 begin\n",
      "Train epoch:10 iter: 788 end\n",
      "Train epoch:10 iter: 789 begin\n",
      "Train epoch:10 iter: 789 end\n",
      "Train epoch:10 iter: 790 begin\n",
      "Train epoch:10 iter: 790 end\n",
      "Train epoch:10 iter: 791 begin\n",
      "Train epoch:10 iter: 791 end\n",
      "Train epoch:10 iter: 792 begin\n",
      "Train epoch:10 iter: 792 end\n",
      "Train epoch:10 iter: 793 begin\n",
      "Train epoch:10 iter: 793 end\n",
      "Train epoch:10 iter: 794 begin\n",
      "Train epoch:10 iter: 794 end\n",
      "Train epoch:10 iter: 795 begin\n",
      "Train epoch:10 iter: 795 end\n",
      "Train epoch:10 iter: 796 begin\n",
      "Train epoch:10 iter: 796 end\n",
      "Train epoch:10 iter: 797 begin\n",
      "Train epoch:10 iter: 797 end\n",
      "Train epoch:10 iter: 798 begin\n",
      "Train epoch:10 iter: 798 end\n",
      "Train epoch:10 iter: 799 begin\n",
      "Train epoch:10 iter: 799 end\n",
      "Train epoch:10 iter: 800 begin\n",
      "Train epoch:10 iter: 800 end\n",
      "Train epoch:10 iter: 801 begin\n",
      "Train epoch:10 iter: 801 end\n",
      "Train epoch:10 iter: 802 begin\n",
      "Train epoch:10 iter: 802 end\n",
      "Train epoch:10 iter: 803 begin\n",
      "Train epoch:10 iter: 803 end\n",
      "Train epoch:10 iter: 804 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:10 iter: 804 end\n",
      "Train epoch:10 iter: 805 begin\n",
      "Train epoch:10 iter: 805 end\n",
      "Train epoch:10 iter: 806 begin\n",
      "Train epoch:10 iter: 806 end\n",
      "Train epoch:10 iter: 807 begin\n",
      "Train epoch:10 iter: 807 end\n",
      "Train epoch:10 iter: 808 begin\n",
      "Train epoch:10 iter: 808 end\n",
      "Train epoch:10 iter: 809 begin\n",
      "Train epoch:10 iter: 809 end\n",
      "Train epoch:10 iter: 810 begin\n",
      "Train epoch:10 iter: 810 end\n",
      "Train epoch:10 iter: 811 begin\n",
      "Train epoch:10 iter: 811 end\n",
      "Train epoch:10 iter: 812 begin\n",
      "Train epoch:10 iter: 812 end\n",
      "Train epoch:10 iter: 813 begin\n",
      "Train epoch:10 iter: 813 end\n",
      "Train epoch:10 iter: 814 begin\n",
      "Train epoch:10 iter: 814 end\n",
      "Train epoch:10 iter: 815 begin\n",
      "Train epoch:10 iter: 815 end\n",
      "Train epoch:10 iter: 816 begin\n",
      "Train epoch:10 iter: 816 end\n",
      "Train epoch:10 iter: 817 begin\n",
      "Train epoch:10 iter: 817 end\n",
      "Train epoch:10 iter: 818 begin\n",
      "Train epoch:10 iter: 818 end\n",
      "Train epoch:10 iter: 819 begin\n",
      "Train epoch:10 iter: 819 end\n",
      "Train epoch:10 iter: 820 begin\n",
      "Train epoch:10 iter: 820 end\n",
      "Train epoch:10 iter: 821 begin\n",
      "Train epoch:10 iter: 821 end\n",
      "Train epoch:10 iter: 822 begin\n",
      "Train epoch:10 iter: 822 end\n",
      "Train epoch:10 iter: 823 begin\n",
      "Train epoch:10 iter: 823 end\n",
      "Train epoch:10 iter: 824 begin\n",
      "Train epoch:10 iter: 824 end\n",
      "Train epoch:10 iter: 825 begin\n",
      "Train epoch:10 iter: 825 end\n",
      "Train epoch:10 iter: 826 begin\n",
      "Train epoch:10 iter: 826 end\n",
      "Train epoch:10 iter: 827 begin\n",
      "Train epoch:10 iter: 827 end\n",
      "Train epoch:10 iter: 828 begin\n",
      "Train epoch:10 iter: 828 end\n",
      "Train epoch:10 iter: 829 begin\n",
      "Train epoch:10 iter: 829 end\n",
      "Train epoch:10 iter: 830 begin\n",
      "Train epoch:10 iter: 830 end\n",
      "Train epoch:10 iter: 831 begin\n",
      "Train epoch:10 iter: 831 end\n",
      "Train epoch:10 iter: 832 begin\n",
      "Train epoch:10 iter: 832 end\n",
      "Train epoch:10 iter: 833 begin\n",
      "Train epoch:10 iter: 833 end\n",
      "Train epoch:10 iter: 834 begin\n",
      "Train epoch:10 iter: 834 end\n",
      "Train epoch:10 iter: 835 begin\n",
      "Train epoch:10 iter: 835 end\n",
      "Train epoch:10 iter: 836 begin\n",
      "Train epoch:10 iter: 836 end\n",
      "Train epoch:10 iter: 837 begin\n",
      "Train epoch:10 iter: 837 end\n",
      "Train epoch:10 iter: 838 begin\n",
      "Train epoch:10 iter: 838 end\n",
      "Train epoch:10 iter: 839 begin\n",
      "Train epoch:10 iter: 839 end\n",
      "Train epoch:10 iter: 840 begin\n",
      "Train epoch:10 iter: 840 end\n",
      "Train epoch:10 iter: 841 begin\n",
      "Train epoch:10 iter: 841 end\n",
      "Train epoch:10 iter: 842 begin\n",
      "Train epoch:10 iter: 842 end\n",
      "Train epoch:10 iter: 843 begin\n",
      "Train epoch:10 iter: 843 end\n",
      "Train epoch:10 iter: 844 begin\n",
      "Train epoch:10 iter: 844 end\n",
      "Train epoch:10 iter: 845 begin\n",
      "Train epoch:10 iter: 845 end\n",
      "Train epoch:10 iter: 846 begin\n",
      "Train epoch:10 iter: 846 end\n",
      "Train epoch:10 iter: 847 begin\n",
      "Train epoch:10 iter: 847 end\n",
      "Train epoch:10 iter: 848 begin\n",
      "Train epoch:10 iter: 848 end\n",
      "Train epoch:10 iter: 849 begin\n",
      "Train epoch:10 iter: 849 end\n",
      "Train epoch:10 iter: 850 begin\n",
      "Train epoch:10 iter: 850 end\n",
      "Train epoch:10 iter: 851 begin\n",
      "Train epoch:10 iter: 851 end\n",
      "Train epoch:10 iter: 852 begin\n",
      "Train epoch:10 iter: 852 end\n",
      "Train epoch:10 iter: 853 begin\n",
      "Train epoch:10 iter: 853 end\n",
      "Train epoch:10 iter: 854 begin\n",
      "Train epoch:10 iter: 854 end\n",
      "Train epoch:10 iter: 855 begin\n",
      "Train epoch:10 iter: 855 end\n",
      "Train epoch:10 iter: 856 begin\n",
      "Train epoch:10 iter: 856 end\n",
      "Train epoch:10 iter: 857 begin\n",
      "Train epoch:10 iter: 857 end\n",
      "Train epoch:10 iter: 858 begin\n",
      "Train epoch:10 iter: 858 end\n",
      "Train epoch:10 iter: 859 begin\n",
      "Train epoch:10 iter: 859 end\n",
      "Train epoch:10 iter: 860 begin\n",
      "Train epoch:10 iter: 860 end\n",
      "Train epoch:10 iter: 861 begin\n",
      "Train epoch:10 iter: 861 end\n",
      "Train epoch:10 iter: 862 begin\n",
      "Train epoch:10 iter: 862 end\n",
      "Train epoch:10 iter: 863 begin\n",
      "Train epoch:10 iter: 863 end\n",
      "Train epoch:10 iter: 864 begin\n",
      "Train epoch:10 iter: 864 end\n",
      "Train epoch:10 iter: 865 begin\n",
      "Train epoch:10 iter: 865 end\n",
      "Train epoch:10 iter: 866 begin\n",
      "Train epoch:10 iter: 866 end\n",
      "Train epoch:10 iter: 867 begin\n",
      "Train epoch:10 iter: 867 end\n",
      "Train epoch:10 iter: 868 begin\n",
      "Train epoch:10 iter: 868 end\n",
      "Train epoch:10 iter: 869 begin\n",
      "Train epoch:10 iter: 869 end\n",
      "Train epoch:10 iter: 870 begin\n",
      "Train epoch:10 iter: 870 end\n",
      "Train epoch:10 iter: 871 begin\n",
      "Train epoch:10 iter: 871 end\n",
      "Train epoch:10 iter: 872 begin\n",
      "Train epoch:10 iter: 872 end\n",
      "Train epoch:10 iter: 873 begin\n",
      "Train epoch:10 iter: 873 end\n",
      "Train epoch:10 iter: 874 begin\n",
      "Train epoch:10 iter: 874 end\n",
      "Train epoch:10 iter: 875 begin\n",
      "Train epoch:10 iter: 875 end\n",
      "Train epoch:10 iter: 876 begin\n",
      "Train epoch:10 iter: 876 end\n",
      "Train epoch:10 iter: 877 begin\n",
      "Train epoch:10 iter: 877 end\n",
      "Train epoch:10 iter: 878 begin\n",
      "Train epoch:10 iter: 878 end\n",
      "Train epoch:10 iter: 879 begin\n",
      "Train epoch:10 iter: 879 end\n",
      "Train epoch:10 iter: 880 begin\n",
      "Train epoch:10 iter: 880 end\n",
      "Train epoch:10 iter: 881 begin\n",
      "Train epoch:10 iter: 881 end\n",
      "Train epoch:10 iter: 882 begin\n",
      "Train epoch:10 iter: 882 end\n",
      "Train epoch:10 iter: 883 begin\n",
      "Train epoch:10 iter: 883 end\n",
      "Train epoch:10 iter: 884 begin\n",
      "Train epoch:10 iter: 884 end\n",
      "Train epoch:10 iter: 885 begin\n",
      "Train epoch:10 iter: 885 end\n",
      "Train epoch:10 iter: 886 begin\n",
      "Train epoch:10 iter: 886 end\n",
      "Train epoch:10 iter: 887 begin\n",
      "Train epoch:10 iter: 887 end\n",
      "Train epoch:10 iter: 888 begin\n",
      "Train epoch:10 iter: 888 end\n",
      "Train epoch:10 iter: 889 begin\n",
      "Train epoch:10 iter: 889 end\n",
      "Train epoch:10 iter: 890 begin\n",
      "Train epoch:10 iter: 890 end\n",
      "Train epoch:10 iter: 891 begin\n",
      "Train epoch:10 iter: 891 end\n",
      "Train epoch:10 iter: 892 begin\n",
      "Train epoch:10 iter: 892 end\n",
      "Train epoch:10 iter: 893 begin\n",
      "Train epoch:10 iter: 893 end\n",
      "Train epoch:10 iter: 894 begin\n",
      "Train epoch:10 iter: 894 end\n",
      "Train epoch:10 iter: 895 begin\n",
      "Train epoch:10 iter: 895 end\n",
      "Train epoch:10 iter: 896 begin\n",
      "Train epoch:10 iter: 896 end\n",
      "Train epoch:10 iter: 897 begin\n",
      "Train epoch:10 iter: 897 end\n",
      "Train epoch:10 iter: 898 begin\n",
      "Train epoch:10 iter: 898 end\n",
      "Train epoch:10 iter: 899 begin\n",
      "Train epoch:10 iter: 899 end\n",
      "Train epoch:10 iter: 900 begin\n",
      "Train epoch:10 iter: 900 end\n",
      "Train epoch:10 iter: 901 begin\n",
      "Train epoch:10 iter: 901 end\n",
      "Train epoch:10 iter: 902 begin\n",
      "Train epoch:10 iter: 902 end\n",
      "Train epoch:10 iter: 903 begin\n",
      "Train epoch:10 iter: 903 end\n",
      "Train epoch:10 iter: 904 begin\n",
      "Train epoch:10 iter: 904 end\n",
      "Train epoch:10 iter: 905 begin\n",
      "Train epoch:10 iter: 905 end\n",
      "Train epoch:10 iter: 906 begin\n",
      "Train epoch:10 iter: 906 end\n",
      "Train epoch:10 iter: 907 begin\n",
      "Train epoch:10 iter: 907 end\n",
      "Train epoch:10 iter: 908 begin\n",
      "Train epoch:10 iter: 908 end\n",
      "Train epoch:10 iter: 909 begin\n",
      "Train epoch:10 iter: 909 end\n",
      "Train epoch:10 iter: 910 begin\n",
      "Train epoch:10 iter: 910 end\n",
      "Train epoch:10 iter: 911 begin\n",
      "Train epoch:10 iter: 911 end\n",
      "Train epoch:10 iter: 912 begin\n",
      "Train epoch:10 iter: 912 end\n",
      "Train epoch:10 iter: 913 begin\n",
      "Train epoch:10 iter: 913 end\n",
      "Train epoch:10 iter: 914 begin\n",
      "Train epoch:10 iter: 914 end\n",
      "Train epoch:10 iter: 915 begin\n",
      "Train epoch:10 iter: 915 end\n",
      "Train epoch:10 iter: 916 begin\n",
      "Train epoch:10 iter: 916 end\n",
      "Train epoch:10 iter: 917 begin\n",
      "Train epoch:10 iter: 917 end\n",
      "Train epoch:10 iter: 918 begin\n",
      "Train epoch:10 iter: 918 end\n",
      "Train epoch:10 iter: 919 begin\n",
      "Train epoch:10 iter: 919 end\n",
      "Train epoch:10 iter: 920 begin\n",
      "Train epoch:10 iter: 920 end\n",
      "Train epoch:10 iter: 921 begin\n",
      "Train epoch:10 iter: 921 end\n",
      "Train epoch:10 iter: 922 begin\n",
      "Train epoch:10 iter: 922 end\n",
      "Train epoch:10 iter: 923 begin\n",
      "Train epoch:10 iter: 923 end\n",
      "Train epoch:10 iter: 924 begin\n",
      "Train epoch:10 iter: 924 end\n",
      "Train epoch:10 iter: 925 begin\n",
      "Train epoch:10 iter: 925 end\n",
      "Train epoch:10 iter: 926 begin\n",
      "Train epoch:10 iter: 926 end\n",
      "Train epoch:10 iter: 927 begin\n",
      "Train epoch:10 iter: 927 end\n",
      "Train epoch:10 iter: 928 begin\n",
      "Train epoch:10 iter: 928 end\n",
      "Train epoch:10 iter: 929 begin\n",
      "Train epoch:10 iter: 929 end\n",
      "Train epoch:10 iter: 930 begin\n",
      "Train epoch:10 iter: 930 end\n",
      "Train epoch:10 iter: 931 begin\n",
      "Train epoch:10 iter: 931 end\n",
      "Train epoch:10 iter: 932 begin\n",
      "Train epoch:10 iter: 932 end\n",
      "Train epoch:10 iter: 933 begin\n",
      "Train epoch:10 iter: 933 end\n",
      "Train epoch:10 iter: 934 begin\n",
      "Train epoch:10 iter: 934 end\n",
      "Train epoch:10 iter: 935 begin\n",
      "Train epoch:10 iter: 935 end\n",
      "Train epoch:10 iter: 936 begin\n",
      "Train epoch:10 iter: 936 end\n",
      "Train epoch:10 iter: 937 begin\n",
      "Train epoch:10 iter: 937 end\n",
      "Train epoch:10 iter: 938 begin\n",
      "Train epoch:10 iter: 938 end\n",
      "Train Loss: 0.001870, Acc: 0.954433\n",
      "save model for best accuate: 0.9544333333333334 begin\n",
      "save model for best accuate: 0.9544333333333334 end\n",
      "epoch 12\n",
      "Train epoch:11 iter: 1 begin\n",
      "Train epoch:11 iter: 1 end\n",
      "Train epoch:11 iter: 2 begin\n",
      "Train epoch:11 iter: 2 end\n",
      "Train epoch:11 iter: 3 begin\n",
      "Train epoch:11 iter: 3 end\n",
      "Train epoch:11 iter: 4 begin\n",
      "Train epoch:11 iter: 4 end\n",
      "Train epoch:11 iter: 5 begin\n",
      "Train epoch:11 iter: 5 end\n",
      "Train epoch:11 iter: 6 begin\n",
      "Train epoch:11 iter: 6 end\n",
      "Train epoch:11 iter: 7 begin\n",
      "Train epoch:11 iter: 7 end\n",
      "Train epoch:11 iter: 8 begin\n",
      "Train epoch:11 iter: 8 end\n",
      "Train epoch:11 iter: 9 begin\n",
      "Train epoch:11 iter: 9 end\n",
      "Train epoch:11 iter: 10 begin\n",
      "Train epoch:11 iter: 10 end\n",
      "Train epoch:11 iter: 11 begin\n",
      "Train epoch:11 iter: 11 end\n",
      "Train epoch:11 iter: 12 begin\n",
      "Train epoch:11 iter: 12 end\n",
      "Train epoch:11 iter: 13 begin\n",
      "Train epoch:11 iter: 13 end\n",
      "Train epoch:11 iter: 14 begin\n",
      "Train epoch:11 iter: 14 end\n",
      "Train epoch:11 iter: 15 begin\n",
      "Train epoch:11 iter: 15 end\n",
      "Train epoch:11 iter: 16 begin\n",
      "Train epoch:11 iter: 16 end\n",
      "Train epoch:11 iter: 17 begin\n",
      "Train epoch:11 iter: 17 end\n",
      "Train epoch:11 iter: 18 begin\n",
      "Train epoch:11 iter: 18 end\n",
      "Train epoch:11 iter: 19 begin\n",
      "Train epoch:11 iter: 19 end\n",
      "Train epoch:11 iter: 20 begin\n",
      "Train epoch:11 iter: 20 end\n",
      "Train epoch:11 iter: 21 begin\n",
      "Train epoch:11 iter: 21 end\n",
      "Train epoch:11 iter: 22 begin\n",
      "Train epoch:11 iter: 22 end\n",
      "Train epoch:11 iter: 23 begin\n",
      "Train epoch:11 iter: 23 end\n",
      "Train epoch:11 iter: 24 begin\n",
      "Train epoch:11 iter: 24 end\n",
      "Train epoch:11 iter: 25 begin\n",
      "Train epoch:11 iter: 25 end\n",
      "Train epoch:11 iter: 26 begin\n",
      "Train epoch:11 iter: 26 end\n",
      "Train epoch:11 iter: 27 begin\n",
      "Train epoch:11 iter: 27 end\n",
      "Train epoch:11 iter: 28 begin\n",
      "Train epoch:11 iter: 28 end\n",
      "Train epoch:11 iter: 29 begin\n",
      "Train epoch:11 iter: 29 end\n",
      "Train epoch:11 iter: 30 begin\n",
      "Train epoch:11 iter: 30 end\n",
      "Train epoch:11 iter: 31 begin\n",
      "Train epoch:11 iter: 31 end\n",
      "Train epoch:11 iter: 32 begin\n",
      "Train epoch:11 iter: 32 end\n",
      "Train epoch:11 iter: 33 begin\n",
      "Train epoch:11 iter: 33 end\n",
      "Train epoch:11 iter: 34 begin\n",
      "Train epoch:11 iter: 34 end\n",
      "Train epoch:11 iter: 35 begin\n",
      "Train epoch:11 iter: 35 end\n",
      "Train epoch:11 iter: 36 begin\n",
      "Train epoch:11 iter: 36 end\n",
      "Train epoch:11 iter: 37 begin\n",
      "Train epoch:11 iter: 37 end\n",
      "Train epoch:11 iter: 38 begin\n",
      "Train epoch:11 iter: 38 end\n",
      "Train epoch:11 iter: 39 begin\n",
      "Train epoch:11 iter: 39 end\n",
      "Train epoch:11 iter: 40 begin\n",
      "Train epoch:11 iter: 40 end\n",
      "Train epoch:11 iter: 41 begin\n",
      "Train epoch:11 iter: 41 end\n",
      "Train epoch:11 iter: 42 begin\n",
      "Train epoch:11 iter: 42 end\n",
      "Train epoch:11 iter: 43 begin\n",
      "Train epoch:11 iter: 43 end\n",
      "Train epoch:11 iter: 44 begin\n",
      "Train epoch:11 iter: 44 end\n",
      "Train epoch:11 iter: 45 begin\n",
      "Train epoch:11 iter: 45 end\n",
      "Train epoch:11 iter: 46 begin\n",
      "Train epoch:11 iter: 46 end\n",
      "Train epoch:11 iter: 47 begin\n",
      "Train epoch:11 iter: 47 end\n",
      "Train epoch:11 iter: 48 begin\n",
      "Train epoch:11 iter: 48 end\n",
      "Train epoch:11 iter: 49 begin\n",
      "Train epoch:11 iter: 49 end\n",
      "Train epoch:11 iter: 50 begin\n",
      "Train epoch:11 iter: 50 end\n",
      "Train epoch:11 iter: 51 begin\n",
      "Train epoch:11 iter: 51 end\n",
      "Train epoch:11 iter: 52 begin\n",
      "Train epoch:11 iter: 52 end\n",
      "Train epoch:11 iter: 53 begin\n",
      "Train epoch:11 iter: 53 end\n",
      "Train epoch:11 iter: 54 begin\n",
      "Train epoch:11 iter: 54 end\n",
      "Train epoch:11 iter: 55 begin\n",
      "Train epoch:11 iter: 55 end\n",
      "Train epoch:11 iter: 56 begin\n",
      "Train epoch:11 iter: 56 end\n",
      "Train epoch:11 iter: 57 begin\n",
      "Train epoch:11 iter: 57 end\n",
      "Train epoch:11 iter: 58 begin\n",
      "Train epoch:11 iter: 58 end\n",
      "Train epoch:11 iter: 59 begin\n",
      "Train epoch:11 iter: 59 end\n",
      "Train epoch:11 iter: 60 begin\n",
      "Train epoch:11 iter: 60 end\n",
      "Train epoch:11 iter: 61 begin\n",
      "Train epoch:11 iter: 61 end\n",
      "Train epoch:11 iter: 62 begin\n",
      "Train epoch:11 iter: 62 end\n",
      "Train epoch:11 iter: 63 begin\n",
      "Train epoch:11 iter: 63 end\n",
      "Train epoch:11 iter: 64 begin\n",
      "Train epoch:11 iter: 64 end\n",
      "Train epoch:11 iter: 65 begin\n",
      "Train epoch:11 iter: 65 end\n",
      "Train epoch:11 iter: 66 begin\n",
      "Train epoch:11 iter: 66 end\n",
      "Train epoch:11 iter: 67 begin\n",
      "Train epoch:11 iter: 67 end\n",
      "Train epoch:11 iter: 68 begin\n",
      "Train epoch:11 iter: 68 end\n",
      "Train epoch:11 iter: 69 begin\n",
      "Train epoch:11 iter: 69 end\n",
      "Train epoch:11 iter: 70 begin\n",
      "Train epoch:11 iter: 70 end\n",
      "Train epoch:11 iter: 71 begin\n",
      "Train epoch:11 iter: 71 end\n",
      "Train epoch:11 iter: 72 begin\n",
      "Train epoch:11 iter: 72 end\n",
      "Train epoch:11 iter: 73 begin\n",
      "Train epoch:11 iter: 73 end\n",
      "Train epoch:11 iter: 74 begin\n",
      "Train epoch:11 iter: 74 end\n",
      "Train epoch:11 iter: 75 begin\n",
      "Train epoch:11 iter: 75 end\n",
      "Train epoch:11 iter: 76 begin\n",
      "Train epoch:11 iter: 76 end\n",
      "Train epoch:11 iter: 77 begin\n",
      "Train epoch:11 iter: 77 end\n",
      "Train epoch:11 iter: 78 begin\n",
      "Train epoch:11 iter: 78 end\n",
      "Train epoch:11 iter: 79 begin\n",
      "Train epoch:11 iter: 79 end\n",
      "Train epoch:11 iter: 80 begin\n",
      "Train epoch:11 iter: 80 end\n",
      "Train epoch:11 iter: 81 begin\n",
      "Train epoch:11 iter: 81 end\n",
      "Train epoch:11 iter: 82 begin\n",
      "Train epoch:11 iter: 82 end\n",
      "Train epoch:11 iter: 83 begin\n",
      "Train epoch:11 iter: 83 end\n",
      "Train epoch:11 iter: 84 begin\n",
      "Train epoch:11 iter: 84 end\n",
      "Train epoch:11 iter: 85 begin\n",
      "Train epoch:11 iter: 85 end\n",
      "Train epoch:11 iter: 86 begin\n",
      "Train epoch:11 iter: 86 end\n",
      "Train epoch:11 iter: 87 begin\n",
      "Train epoch:11 iter: 87 end\n",
      "Train epoch:11 iter: 88 begin\n",
      "Train epoch:11 iter: 88 end\n",
      "Train epoch:11 iter: 89 begin\n",
      "Train epoch:11 iter: 89 end\n",
      "Train epoch:11 iter: 90 begin\n",
      "Train epoch:11 iter: 90 end\n",
      "Train epoch:11 iter: 91 begin\n",
      "Train epoch:11 iter: 91 end\n",
      "Train epoch:11 iter: 92 begin\n",
      "Train epoch:11 iter: 92 end\n",
      "Train epoch:11 iter: 93 begin\n",
      "Train epoch:11 iter: 93 end\n",
      "Train epoch:11 iter: 94 begin\n",
      "Train epoch:11 iter: 94 end\n",
      "Train epoch:11 iter: 95 begin\n",
      "Train epoch:11 iter: 95 end\n",
      "Train epoch:11 iter: 96 begin\n",
      "Train epoch:11 iter: 96 end\n",
      "Train epoch:11 iter: 97 begin\n",
      "Train epoch:11 iter: 97 end\n",
      "Train epoch:11 iter: 98 begin\n",
      "Train epoch:11 iter: 98 end\n",
      "Train epoch:11 iter: 99 begin\n",
      "Train epoch:11 iter: 99 end\n",
      "Train epoch:11 iter: 100 begin\n",
      "Train epoch:11 iter: 100 end\n",
      "Train epoch:11 iter: 101 begin\n",
      "Train epoch:11 iter: 101 end\n",
      "Train epoch:11 iter: 102 begin\n",
      "Train epoch:11 iter: 102 end\n",
      "Train epoch:11 iter: 103 begin\n",
      "Train epoch:11 iter: 103 end\n",
      "Train epoch:11 iter: 104 begin\n",
      "Train epoch:11 iter: 104 end\n",
      "Train epoch:11 iter: 105 begin\n",
      "Train epoch:11 iter: 105 end\n",
      "Train epoch:11 iter: 106 begin\n",
      "Train epoch:11 iter: 106 end\n",
      "Train epoch:11 iter: 107 begin\n",
      "Train epoch:11 iter: 107 end\n",
      "Train epoch:11 iter: 108 begin\n",
      "Train epoch:11 iter: 108 end\n",
      "Train epoch:11 iter: 109 begin\n",
      "Train epoch:11 iter: 109 end\n",
      "Train epoch:11 iter: 110 begin\n",
      "Train epoch:11 iter: 110 end\n",
      "Train epoch:11 iter: 111 begin\n",
      "Train epoch:11 iter: 111 end\n",
      "Train epoch:11 iter: 112 begin\n",
      "Train epoch:11 iter: 112 end\n",
      "Train epoch:11 iter: 113 begin\n",
      "Train epoch:11 iter: 113 end\n",
      "Train epoch:11 iter: 114 begin\n",
      "Train epoch:11 iter: 114 end\n",
      "Train epoch:11 iter: 115 begin\n",
      "Train epoch:11 iter: 115 end\n",
      "Train epoch:11 iter: 116 begin\n",
      "Train epoch:11 iter: 116 end\n",
      "Train epoch:11 iter: 117 begin\n",
      "Train epoch:11 iter: 117 end\n",
      "Train epoch:11 iter: 118 begin\n",
      "Train epoch:11 iter: 118 end\n",
      "Train epoch:11 iter: 119 begin\n",
      "Train epoch:11 iter: 119 end\n",
      "Train epoch:11 iter: 120 begin\n",
      "Train epoch:11 iter: 120 end\n",
      "Train epoch:11 iter: 121 begin\n",
      "Train epoch:11 iter: 121 end\n",
      "Train epoch:11 iter: 122 begin\n",
      "Train epoch:11 iter: 122 end\n",
      "Train epoch:11 iter: 123 begin\n",
      "Train epoch:11 iter: 123 end\n",
      "Train epoch:11 iter: 124 begin\n",
      "Train epoch:11 iter: 124 end\n",
      "Train epoch:11 iter: 125 begin\n",
      "Train epoch:11 iter: 125 end\n",
      "Train epoch:11 iter: 126 begin\n",
      "Train epoch:11 iter: 126 end\n",
      "Train epoch:11 iter: 127 begin\n",
      "Train epoch:11 iter: 127 end\n",
      "Train epoch:11 iter: 128 begin\n",
      "Train epoch:11 iter: 128 end\n",
      "Train epoch:11 iter: 129 begin\n",
      "Train epoch:11 iter: 129 end\n",
      "Train epoch:11 iter: 130 begin\n",
      "Train epoch:11 iter: 130 end\n",
      "Train epoch:11 iter: 131 begin\n",
      "Train epoch:11 iter: 131 end\n",
      "Train epoch:11 iter: 132 begin\n",
      "Train epoch:11 iter: 132 end\n",
      "Train epoch:11 iter: 133 begin\n",
      "Train epoch:11 iter: 133 end\n",
      "Train epoch:11 iter: 134 begin\n",
      "Train epoch:11 iter: 134 end\n",
      "Train epoch:11 iter: 135 begin\n",
      "Train epoch:11 iter: 135 end\n",
      "Train epoch:11 iter: 136 begin\n",
      "Train epoch:11 iter: 136 end\n",
      "Train epoch:11 iter: 137 begin\n",
      "Train epoch:11 iter: 137 end\n",
      "Train epoch:11 iter: 138 begin\n",
      "Train epoch:11 iter: 138 end\n",
      "Train epoch:11 iter: 139 begin\n",
      "Train epoch:11 iter: 139 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:11 iter: 140 begin\n",
      "Train epoch:11 iter: 140 end\n",
      "Train epoch:11 iter: 141 begin\n",
      "Train epoch:11 iter: 141 end\n",
      "Train epoch:11 iter: 142 begin\n",
      "Train epoch:11 iter: 142 end\n",
      "Train epoch:11 iter: 143 begin\n",
      "Train epoch:11 iter: 143 end\n",
      "Train epoch:11 iter: 144 begin\n",
      "Train epoch:11 iter: 144 end\n",
      "Train epoch:11 iter: 145 begin\n",
      "Train epoch:11 iter: 145 end\n",
      "Train epoch:11 iter: 146 begin\n",
      "Train epoch:11 iter: 146 end\n",
      "Train epoch:11 iter: 147 begin\n",
      "Train epoch:11 iter: 147 end\n",
      "Train epoch:11 iter: 148 begin\n",
      "Train epoch:11 iter: 148 end\n",
      "Train epoch:11 iter: 149 begin\n",
      "Train epoch:11 iter: 149 end\n",
      "Train epoch:11 iter: 150 begin\n",
      "Train epoch:11 iter: 150 end\n",
      "Train epoch:11 iter: 151 begin\n",
      "Train epoch:11 iter: 151 end\n",
      "Train epoch:11 iter: 152 begin\n",
      "Train epoch:11 iter: 152 end\n",
      "Train epoch:11 iter: 153 begin\n",
      "Train epoch:11 iter: 153 end\n",
      "Train epoch:11 iter: 154 begin\n",
      "Train epoch:11 iter: 154 end\n",
      "Train epoch:11 iter: 155 begin\n",
      "Train epoch:11 iter: 155 end\n",
      "Train epoch:11 iter: 156 begin\n",
      "Train epoch:11 iter: 156 end\n",
      "Train epoch:11 iter: 157 begin\n",
      "Train epoch:11 iter: 157 end\n",
      "Train epoch:11 iter: 158 begin\n",
      "Train epoch:11 iter: 158 end\n",
      "Train epoch:11 iter: 159 begin\n",
      "Train epoch:11 iter: 159 end\n",
      "Train epoch:11 iter: 160 begin\n",
      "Train epoch:11 iter: 160 end\n",
      "Train epoch:11 iter: 161 begin\n",
      "Train epoch:11 iter: 161 end\n",
      "Train epoch:11 iter: 162 begin\n",
      "Train epoch:11 iter: 162 end\n",
      "Train epoch:11 iter: 163 begin\n",
      "Train epoch:11 iter: 163 end\n",
      "Train epoch:11 iter: 164 begin\n",
      "Train epoch:11 iter: 164 end\n",
      "Train epoch:11 iter: 165 begin\n",
      "Train epoch:11 iter: 165 end\n",
      "Train epoch:11 iter: 166 begin\n",
      "Train epoch:11 iter: 166 end\n",
      "Train epoch:11 iter: 167 begin\n",
      "Train epoch:11 iter: 167 end\n",
      "Train epoch:11 iter: 168 begin\n",
      "Train epoch:11 iter: 168 end\n",
      "Train epoch:11 iter: 169 begin\n",
      "Train epoch:11 iter: 169 end\n",
      "Train epoch:11 iter: 170 begin\n",
      "Train epoch:11 iter: 170 end\n",
      "Train epoch:11 iter: 171 begin\n",
      "Train epoch:11 iter: 171 end\n",
      "Train epoch:11 iter: 172 begin\n",
      "Train epoch:11 iter: 172 end\n",
      "Train epoch:11 iter: 173 begin\n",
      "Train epoch:11 iter: 173 end\n",
      "Train epoch:11 iter: 174 begin\n",
      "Train epoch:11 iter: 174 end\n",
      "Train epoch:11 iter: 175 begin\n",
      "Train epoch:11 iter: 175 end\n",
      "Train epoch:11 iter: 176 begin\n",
      "Train epoch:11 iter: 176 end\n",
      "Train epoch:11 iter: 177 begin\n",
      "Train epoch:11 iter: 177 end\n",
      "Train epoch:11 iter: 178 begin\n",
      "Train epoch:11 iter: 178 end\n",
      "Train epoch:11 iter: 179 begin\n",
      "Train epoch:11 iter: 179 end\n",
      "Train epoch:11 iter: 180 begin\n",
      "Train epoch:11 iter: 180 end\n",
      "Train epoch:11 iter: 181 begin\n",
      "Train epoch:11 iter: 181 end\n",
      "Train epoch:11 iter: 182 begin\n",
      "Train epoch:11 iter: 182 end\n",
      "Train epoch:11 iter: 183 begin\n",
      "Train epoch:11 iter: 183 end\n",
      "Train epoch:11 iter: 184 begin\n",
      "Train epoch:11 iter: 184 end\n",
      "Train epoch:11 iter: 185 begin\n",
      "Train epoch:11 iter: 185 end\n",
      "Train epoch:11 iter: 186 begin\n",
      "Train epoch:11 iter: 186 end\n",
      "Train epoch:11 iter: 187 begin\n",
      "Train epoch:11 iter: 187 end\n",
      "Train epoch:11 iter: 188 begin\n",
      "Train epoch:11 iter: 188 end\n",
      "Train epoch:11 iter: 189 begin\n",
      "Train epoch:11 iter: 189 end\n",
      "Train epoch:11 iter: 190 begin\n",
      "Train epoch:11 iter: 190 end\n",
      "Train epoch:11 iter: 191 begin\n",
      "Train epoch:11 iter: 191 end\n",
      "Train epoch:11 iter: 192 begin\n",
      "Train epoch:11 iter: 192 end\n",
      "Train epoch:11 iter: 193 begin\n",
      "Train epoch:11 iter: 193 end\n",
      "Train epoch:11 iter: 194 begin\n",
      "Train epoch:11 iter: 194 end\n",
      "Train epoch:11 iter: 195 begin\n",
      "Train epoch:11 iter: 195 end\n",
      "Train epoch:11 iter: 196 begin\n",
      "Train epoch:11 iter: 196 end\n",
      "Train epoch:11 iter: 197 begin\n",
      "Train epoch:11 iter: 197 end\n",
      "Train epoch:11 iter: 198 begin\n",
      "Train epoch:11 iter: 198 end\n",
      "Train epoch:11 iter: 199 begin\n",
      "Train epoch:11 iter: 199 end\n",
      "Train epoch:11 iter: 200 begin\n",
      "Train epoch:11 iter: 200 end\n",
      "Train epoch:11 iter: 201 begin\n",
      "Train epoch:11 iter: 201 end\n",
      "Train epoch:11 iter: 202 begin\n",
      "Train epoch:11 iter: 202 end\n",
      "Train epoch:11 iter: 203 begin\n",
      "Train epoch:11 iter: 203 end\n",
      "Train epoch:11 iter: 204 begin\n",
      "Train epoch:11 iter: 204 end\n",
      "Train epoch:11 iter: 205 begin\n",
      "Train epoch:11 iter: 205 end\n",
      "Train epoch:11 iter: 206 begin\n",
      "Train epoch:11 iter: 206 end\n",
      "Train epoch:11 iter: 207 begin\n",
      "Train epoch:11 iter: 207 end\n",
      "Train epoch:11 iter: 208 begin\n",
      "Train epoch:11 iter: 208 end\n",
      "Train epoch:11 iter: 209 begin\n",
      "Train epoch:11 iter: 209 end\n",
      "Train epoch:11 iter: 210 begin\n",
      "Train epoch:11 iter: 210 end\n",
      "Train epoch:11 iter: 211 begin\n",
      "Train epoch:11 iter: 211 end\n",
      "Train epoch:11 iter: 212 begin\n",
      "Train epoch:11 iter: 212 end\n",
      "Train epoch:11 iter: 213 begin\n",
      "Train epoch:11 iter: 213 end\n",
      "Train epoch:11 iter: 214 begin\n",
      "Train epoch:11 iter: 214 end\n",
      "Train epoch:11 iter: 215 begin\n",
      "Train epoch:11 iter: 215 end\n",
      "Train epoch:11 iter: 216 begin\n",
      "Train epoch:11 iter: 216 end\n",
      "Train epoch:11 iter: 217 begin\n",
      "Train epoch:11 iter: 217 end\n",
      "Train epoch:11 iter: 218 begin\n",
      "Train epoch:11 iter: 218 end\n",
      "Train epoch:11 iter: 219 begin\n",
      "Train epoch:11 iter: 219 end\n",
      "Train epoch:11 iter: 220 begin\n",
      "Train epoch:11 iter: 220 end\n",
      "Train epoch:11 iter: 221 begin\n",
      "Train epoch:11 iter: 221 end\n",
      "Train epoch:11 iter: 222 begin\n",
      "Train epoch:11 iter: 222 end\n",
      "Train epoch:11 iter: 223 begin\n",
      "Train epoch:11 iter: 223 end\n",
      "Train epoch:11 iter: 224 begin\n",
      "Train epoch:11 iter: 224 end\n",
      "Train epoch:11 iter: 225 begin\n",
      "Train epoch:11 iter: 225 end\n",
      "Train epoch:11 iter: 226 begin\n",
      "Train epoch:11 iter: 226 end\n",
      "Train epoch:11 iter: 227 begin\n",
      "Train epoch:11 iter: 227 end\n",
      "Train epoch:11 iter: 228 begin\n",
      "Train epoch:11 iter: 228 end\n",
      "Train epoch:11 iter: 229 begin\n",
      "Train epoch:11 iter: 229 end\n",
      "Train epoch:11 iter: 230 begin\n",
      "Train epoch:11 iter: 230 end\n",
      "Train epoch:11 iter: 231 begin\n",
      "Train epoch:11 iter: 231 end\n",
      "Train epoch:11 iter: 232 begin\n",
      "Train epoch:11 iter: 232 end\n",
      "Train epoch:11 iter: 233 begin\n",
      "Train epoch:11 iter: 233 end\n",
      "Train epoch:11 iter: 234 begin\n",
      "Train epoch:11 iter: 234 end\n",
      "Train epoch:11 iter: 235 begin\n",
      "Train epoch:11 iter: 235 end\n",
      "Train epoch:11 iter: 236 begin\n",
      "Train epoch:11 iter: 236 end\n",
      "Train epoch:11 iter: 237 begin\n",
      "Train epoch:11 iter: 237 end\n",
      "Train epoch:11 iter: 238 begin\n",
      "Train epoch:11 iter: 238 end\n",
      "Train epoch:11 iter: 239 begin\n",
      "Train epoch:11 iter: 239 end\n",
      "Train epoch:11 iter: 240 begin\n",
      "Train epoch:11 iter: 240 end\n",
      "Train epoch:11 iter: 241 begin\n",
      "Train epoch:11 iter: 241 end\n",
      "Train epoch:11 iter: 242 begin\n",
      "Train epoch:11 iter: 242 end\n",
      "Train epoch:11 iter: 243 begin\n",
      "Train epoch:11 iter: 243 end\n",
      "Train epoch:11 iter: 244 begin\n",
      "Train epoch:11 iter: 244 end\n",
      "Train epoch:11 iter: 245 begin\n",
      "Train epoch:11 iter: 245 end\n",
      "Train epoch:11 iter: 246 begin\n",
      "Train epoch:11 iter: 246 end\n",
      "Train epoch:11 iter: 247 begin\n",
      "Train epoch:11 iter: 247 end\n",
      "Train epoch:11 iter: 248 begin\n",
      "Train epoch:11 iter: 248 end\n",
      "Train epoch:11 iter: 249 begin\n",
      "Train epoch:11 iter: 249 end\n",
      "Train epoch:11 iter: 250 begin\n",
      "Train epoch:11 iter: 250 end\n",
      "Train epoch:11 iter: 251 begin\n",
      "Train epoch:11 iter: 251 end\n",
      "Train epoch:11 iter: 252 begin\n",
      "Train epoch:11 iter: 252 end\n",
      "Train epoch:11 iter: 253 begin\n",
      "Train epoch:11 iter: 253 end\n",
      "Train epoch:11 iter: 254 begin\n",
      "Train epoch:11 iter: 254 end\n",
      "Train epoch:11 iter: 255 begin\n",
      "Train epoch:11 iter: 255 end\n",
      "Train epoch:11 iter: 256 begin\n",
      "Train epoch:11 iter: 256 end\n",
      "Train epoch:11 iter: 257 begin\n",
      "Train epoch:11 iter: 257 end\n",
      "Train epoch:11 iter: 258 begin\n",
      "Train epoch:11 iter: 258 end\n",
      "Train epoch:11 iter: 259 begin\n",
      "Train epoch:11 iter: 259 end\n",
      "Train epoch:11 iter: 260 begin\n",
      "Train epoch:11 iter: 260 end\n",
      "Train epoch:11 iter: 261 begin\n",
      "Train epoch:11 iter: 261 end\n",
      "Train epoch:11 iter: 262 begin\n",
      "Train epoch:11 iter: 262 end\n",
      "Train epoch:11 iter: 263 begin\n",
      "Train epoch:11 iter: 263 end\n",
      "Train epoch:11 iter: 264 begin\n",
      "Train epoch:11 iter: 264 end\n",
      "Train epoch:11 iter: 265 begin\n",
      "Train epoch:11 iter: 265 end\n",
      "Train epoch:11 iter: 266 begin\n",
      "Train epoch:11 iter: 266 end\n",
      "Train epoch:11 iter: 267 begin\n",
      "Train epoch:11 iter: 267 end\n",
      "Train epoch:11 iter: 268 begin\n",
      "Train epoch:11 iter: 268 end\n",
      "Train epoch:11 iter: 269 begin\n",
      "Train epoch:11 iter: 269 end\n",
      "Train epoch:11 iter: 270 begin\n",
      "Train epoch:11 iter: 270 end\n",
      "Train epoch:11 iter: 271 begin\n",
      "Train epoch:11 iter: 271 end\n",
      "Train epoch:11 iter: 272 begin\n",
      "Train epoch:11 iter: 272 end\n",
      "Train epoch:11 iter: 273 begin\n",
      "Train epoch:11 iter: 273 end\n",
      "Train epoch:11 iter: 274 begin\n",
      "Train epoch:11 iter: 274 end\n",
      "Train epoch:11 iter: 275 begin\n",
      "Train epoch:11 iter: 275 end\n",
      "Train epoch:11 iter: 276 begin\n",
      "Train epoch:11 iter: 276 end\n",
      "Train epoch:11 iter: 277 begin\n",
      "Train epoch:11 iter: 277 end\n",
      "Train epoch:11 iter: 278 begin\n",
      "Train epoch:11 iter: 278 end\n",
      "Train epoch:11 iter: 279 begin\n",
      "Train epoch:11 iter: 279 end\n",
      "Train epoch:11 iter: 280 begin\n",
      "Train epoch:11 iter: 280 end\n",
      "Train epoch:11 iter: 281 begin\n",
      "Train epoch:11 iter: 281 end\n",
      "Train epoch:11 iter: 282 begin\n",
      "Train epoch:11 iter: 282 end\n",
      "Train epoch:11 iter: 283 begin\n",
      "Train epoch:11 iter: 283 end\n",
      "Train epoch:11 iter: 284 begin\n",
      "Train epoch:11 iter: 284 end\n",
      "Train epoch:11 iter: 285 begin\n",
      "Train epoch:11 iter: 285 end\n",
      "Train epoch:11 iter: 286 begin\n",
      "Train epoch:11 iter: 286 end\n",
      "Train epoch:11 iter: 287 begin\n",
      "Train epoch:11 iter: 287 end\n",
      "Train epoch:11 iter: 288 begin\n",
      "Train epoch:11 iter: 288 end\n",
      "Train epoch:11 iter: 289 begin\n",
      "Train epoch:11 iter: 289 end\n",
      "Train epoch:11 iter: 290 begin\n",
      "Train epoch:11 iter: 290 end\n",
      "Train epoch:11 iter: 291 begin\n",
      "Train epoch:11 iter: 291 end\n",
      "Train epoch:11 iter: 292 begin\n",
      "Train epoch:11 iter: 292 end\n",
      "Train epoch:11 iter: 293 begin\n",
      "Train epoch:11 iter: 293 end\n",
      "Train epoch:11 iter: 294 begin\n",
      "Train epoch:11 iter: 294 end\n",
      "Train epoch:11 iter: 295 begin\n",
      "Train epoch:11 iter: 295 end\n",
      "Train epoch:11 iter: 296 begin\n",
      "Train epoch:11 iter: 296 end\n",
      "Train epoch:11 iter: 297 begin\n",
      "Train epoch:11 iter: 297 end\n",
      "Train epoch:11 iter: 298 begin\n",
      "Train epoch:11 iter: 298 end\n",
      "Train epoch:11 iter: 299 begin\n",
      "Train epoch:11 iter: 299 end\n",
      "Train epoch:11 iter: 300 begin\n",
      "Train epoch:11 iter: 300 end\n",
      "Train epoch:11 iter: 301 begin\n",
      "Train epoch:11 iter: 301 end\n",
      "Train epoch:11 iter: 302 begin\n",
      "Train epoch:11 iter: 302 end\n",
      "Train epoch:11 iter: 303 begin\n",
      "Train epoch:11 iter: 303 end\n",
      "Train epoch:11 iter: 304 begin\n",
      "Train epoch:11 iter: 304 end\n",
      "Train epoch:11 iter: 305 begin\n",
      "Train epoch:11 iter: 305 end\n",
      "Train epoch:11 iter: 306 begin\n",
      "Train epoch:11 iter: 306 end\n",
      "Train epoch:11 iter: 307 begin\n",
      "Train epoch:11 iter: 307 end\n",
      "Train epoch:11 iter: 308 begin\n",
      "Train epoch:11 iter: 308 end\n",
      "Train epoch:11 iter: 309 begin\n",
      "Train epoch:11 iter: 309 end\n",
      "Train epoch:11 iter: 310 begin\n",
      "Train epoch:11 iter: 310 end\n",
      "Train epoch:11 iter: 311 begin\n",
      "Train epoch:11 iter: 311 end\n",
      "Train epoch:11 iter: 312 begin\n",
      "Train epoch:11 iter: 312 end\n",
      "Train epoch:11 iter: 313 begin\n",
      "Train epoch:11 iter: 313 end\n",
      "Train epoch:11 iter: 314 begin\n",
      "Train epoch:11 iter: 314 end\n",
      "Train epoch:11 iter: 315 begin\n",
      "Train epoch:11 iter: 315 end\n",
      "Train epoch:11 iter: 316 begin\n",
      "Train epoch:11 iter: 316 end\n",
      "Train epoch:11 iter: 317 begin\n",
      "Train epoch:11 iter: 317 end\n",
      "Train epoch:11 iter: 318 begin\n",
      "Train epoch:11 iter: 318 end\n",
      "Train epoch:11 iter: 319 begin\n",
      "Train epoch:11 iter: 319 end\n",
      "Train epoch:11 iter: 320 begin\n",
      "Train epoch:11 iter: 320 end\n",
      "Train epoch:11 iter: 321 begin\n",
      "Train epoch:11 iter: 321 end\n",
      "Train epoch:11 iter: 322 begin\n",
      "Train epoch:11 iter: 322 end\n",
      "Train epoch:11 iter: 323 begin\n",
      "Train epoch:11 iter: 323 end\n",
      "Train epoch:11 iter: 324 begin\n",
      "Train epoch:11 iter: 324 end\n",
      "Train epoch:11 iter: 325 begin\n",
      "Train epoch:11 iter: 325 end\n",
      "Train epoch:11 iter: 326 begin\n",
      "Train epoch:11 iter: 326 end\n",
      "Train epoch:11 iter: 327 begin\n",
      "Train epoch:11 iter: 327 end\n",
      "Train epoch:11 iter: 328 begin\n",
      "Train epoch:11 iter: 328 end\n",
      "Train epoch:11 iter: 329 begin\n",
      "Train epoch:11 iter: 329 end\n",
      "Train epoch:11 iter: 330 begin\n",
      "Train epoch:11 iter: 330 end\n",
      "Train epoch:11 iter: 331 begin\n",
      "Train epoch:11 iter: 331 end\n",
      "Train epoch:11 iter: 332 begin\n",
      "Train epoch:11 iter: 332 end\n",
      "Train epoch:11 iter: 333 begin\n",
      "Train epoch:11 iter: 333 end\n",
      "Train epoch:11 iter: 334 begin\n",
      "Train epoch:11 iter: 334 end\n",
      "Train epoch:11 iter: 335 begin\n",
      "Train epoch:11 iter: 335 end\n",
      "Train epoch:11 iter: 336 begin\n",
      "Train epoch:11 iter: 336 end\n",
      "Train epoch:11 iter: 337 begin\n",
      "Train epoch:11 iter: 337 end\n",
      "Train epoch:11 iter: 338 begin\n",
      "Train epoch:11 iter: 338 end\n",
      "Train epoch:11 iter: 339 begin\n",
      "Train epoch:11 iter: 339 end\n",
      "Train epoch:11 iter: 340 begin\n",
      "Train epoch:11 iter: 340 end\n",
      "Train epoch:11 iter: 341 begin\n",
      "Train epoch:11 iter: 341 end\n",
      "Train epoch:11 iter: 342 begin\n",
      "Train epoch:11 iter: 342 end\n",
      "Train epoch:11 iter: 343 begin\n",
      "Train epoch:11 iter: 343 end\n",
      "Train epoch:11 iter: 344 begin\n",
      "Train epoch:11 iter: 344 end\n",
      "Train epoch:11 iter: 345 begin\n",
      "Train epoch:11 iter: 345 end\n",
      "Train epoch:11 iter: 346 begin\n",
      "Train epoch:11 iter: 346 end\n",
      "Train epoch:11 iter: 347 begin\n",
      "Train epoch:11 iter: 347 end\n",
      "Train epoch:11 iter: 348 begin\n",
      "Train epoch:11 iter: 348 end\n",
      "Train epoch:11 iter: 349 begin\n",
      "Train epoch:11 iter: 349 end\n",
      "Train epoch:11 iter: 350 begin\n",
      "Train epoch:11 iter: 350 end\n",
      "Train epoch:11 iter: 351 begin\n",
      "Train epoch:11 iter: 351 end\n",
      "Train epoch:11 iter: 352 begin\n",
      "Train epoch:11 iter: 352 end\n",
      "Train epoch:11 iter: 353 begin\n",
      "Train epoch:11 iter: 353 end\n",
      "Train epoch:11 iter: 354 begin\n",
      "Train epoch:11 iter: 354 end\n",
      "Train epoch:11 iter: 355 begin\n",
      "Train epoch:11 iter: 355 end\n",
      "Train epoch:11 iter: 356 begin\n",
      "Train epoch:11 iter: 356 end\n",
      "Train epoch:11 iter: 357 begin\n",
      "Train epoch:11 iter: 357 end\n",
      "Train epoch:11 iter: 358 begin\n",
      "Train epoch:11 iter: 358 end\n",
      "Train epoch:11 iter: 359 begin\n",
      "Train epoch:11 iter: 359 end\n",
      "Train epoch:11 iter: 360 begin\n",
      "Train epoch:11 iter: 360 end\n",
      "Train epoch:11 iter: 361 begin\n",
      "Train epoch:11 iter: 361 end\n",
      "Train epoch:11 iter: 362 begin\n",
      "Train epoch:11 iter: 362 end\n",
      "Train epoch:11 iter: 363 begin\n",
      "Train epoch:11 iter: 363 end\n",
      "Train epoch:11 iter: 364 begin\n",
      "Train epoch:11 iter: 364 end\n",
      "Train epoch:11 iter: 365 begin\n",
      "Train epoch:11 iter: 365 end\n",
      "Train epoch:11 iter: 366 begin\n",
      "Train epoch:11 iter: 366 end\n",
      "Train epoch:11 iter: 367 begin\n",
      "Train epoch:11 iter: 367 end\n",
      "Train epoch:11 iter: 368 begin\n",
      "Train epoch:11 iter: 368 end\n",
      "Train epoch:11 iter: 369 begin\n",
      "Train epoch:11 iter: 369 end\n",
      "Train epoch:11 iter: 370 begin\n",
      "Train epoch:11 iter: 370 end\n",
      "Train epoch:11 iter: 371 begin\n",
      "Train epoch:11 iter: 371 end\n",
      "Train epoch:11 iter: 372 begin\n",
      "Train epoch:11 iter: 372 end\n",
      "Train epoch:11 iter: 373 begin\n",
      "Train epoch:11 iter: 373 end\n",
      "Train epoch:11 iter: 374 begin\n",
      "Train epoch:11 iter: 374 end\n",
      "Train epoch:11 iter: 375 begin\n",
      "Train epoch:11 iter: 375 end\n",
      "Train epoch:11 iter: 376 begin\n",
      "Train epoch:11 iter: 376 end\n",
      "Train epoch:11 iter: 377 begin\n",
      "Train epoch:11 iter: 377 end\n",
      "Train epoch:11 iter: 378 begin\n",
      "Train epoch:11 iter: 378 end\n",
      "Train epoch:11 iter: 379 begin\n",
      "Train epoch:11 iter: 379 end\n",
      "Train epoch:11 iter: 380 begin\n",
      "Train epoch:11 iter: 380 end\n",
      "Train epoch:11 iter: 381 begin\n",
      "Train epoch:11 iter: 381 end\n",
      "Train epoch:11 iter: 382 begin\n",
      "Train epoch:11 iter: 382 end\n",
      "Train epoch:11 iter: 383 begin\n",
      "Train epoch:11 iter: 383 end\n",
      "Train epoch:11 iter: 384 begin\n",
      "Train epoch:11 iter: 384 end\n",
      "Train epoch:11 iter: 385 begin\n",
      "Train epoch:11 iter: 385 end\n",
      "Train epoch:11 iter: 386 begin\n",
      "Train epoch:11 iter: 386 end\n",
      "Train epoch:11 iter: 387 begin\n",
      "Train epoch:11 iter: 387 end\n",
      "Train epoch:11 iter: 388 begin\n",
      "Train epoch:11 iter: 388 end\n",
      "Train epoch:11 iter: 389 begin\n",
      "Train epoch:11 iter: 389 end\n",
      "Train epoch:11 iter: 390 begin\n",
      "Train epoch:11 iter: 390 end\n",
      "Train epoch:11 iter: 391 begin\n",
      "Train epoch:11 iter: 391 end\n",
      "Train epoch:11 iter: 392 begin\n",
      "Train epoch:11 iter: 392 end\n",
      "Train epoch:11 iter: 393 begin\n",
      "Train epoch:11 iter: 393 end\n",
      "Train epoch:11 iter: 394 begin\n",
      "Train epoch:11 iter: 394 end\n",
      "Train epoch:11 iter: 395 begin\n",
      "Train epoch:11 iter: 395 end\n",
      "Train epoch:11 iter: 396 begin\n",
      "Train epoch:11 iter: 396 end\n",
      "Train epoch:11 iter: 397 begin\n",
      "Train epoch:11 iter: 397 end\n",
      "Train epoch:11 iter: 398 begin\n",
      "Train epoch:11 iter: 398 end\n",
      "Train epoch:11 iter: 399 begin\n",
      "Train epoch:11 iter: 399 end\n",
      "Train epoch:11 iter: 400 begin\n",
      "Train epoch:11 iter: 400 end\n",
      "Train epoch:11 iter: 401 begin\n",
      "Train epoch:11 iter: 401 end\n",
      "Train epoch:11 iter: 402 begin\n",
      "Train epoch:11 iter: 402 end\n",
      "Train epoch:11 iter: 403 begin\n",
      "Train epoch:11 iter: 403 end\n",
      "Train epoch:11 iter: 404 begin\n",
      "Train epoch:11 iter: 404 end\n",
      "Train epoch:11 iter: 405 begin\n",
      "Train epoch:11 iter: 405 end\n",
      "Train epoch:11 iter: 406 begin\n",
      "Train epoch:11 iter: 406 end\n",
      "Train epoch:11 iter: 407 begin\n",
      "Train epoch:11 iter: 407 end\n",
      "Train epoch:11 iter: 408 begin\n",
      "Train epoch:11 iter: 408 end\n",
      "Train epoch:11 iter: 409 begin\n",
      "Train epoch:11 iter: 409 end\n",
      "Train epoch:11 iter: 410 begin\n",
      "Train epoch:11 iter: 410 end\n",
      "Train epoch:11 iter: 411 begin\n",
      "Train epoch:11 iter: 411 end\n",
      "Train epoch:11 iter: 412 begin\n",
      "Train epoch:11 iter: 412 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:11 iter: 413 begin\n",
      "Train epoch:11 iter: 413 end\n",
      "Train epoch:11 iter: 414 begin\n",
      "Train epoch:11 iter: 414 end\n",
      "Train epoch:11 iter: 415 begin\n",
      "Train epoch:11 iter: 415 end\n",
      "Train epoch:11 iter: 416 begin\n",
      "Train epoch:11 iter: 416 end\n",
      "Train epoch:11 iter: 417 begin\n",
      "Train epoch:11 iter: 417 end\n",
      "Train epoch:11 iter: 418 begin\n",
      "Train epoch:11 iter: 418 end\n",
      "Train epoch:11 iter: 419 begin\n",
      "Train epoch:11 iter: 419 end\n",
      "Train epoch:11 iter: 420 begin\n",
      "Train epoch:11 iter: 420 end\n",
      "Train epoch:11 iter: 421 begin\n",
      "Train epoch:11 iter: 421 end\n",
      "Train epoch:11 iter: 422 begin\n",
      "Train epoch:11 iter: 422 end\n",
      "Train epoch:11 iter: 423 begin\n",
      "Train epoch:11 iter: 423 end\n",
      "Train epoch:11 iter: 424 begin\n",
      "Train epoch:11 iter: 424 end\n",
      "Train epoch:11 iter: 425 begin\n",
      "Train epoch:11 iter: 425 end\n",
      "Train epoch:11 iter: 426 begin\n",
      "Train epoch:11 iter: 426 end\n",
      "Train epoch:11 iter: 427 begin\n",
      "Train epoch:11 iter: 427 end\n",
      "Train epoch:11 iter: 428 begin\n",
      "Train epoch:11 iter: 428 end\n",
      "Train epoch:11 iter: 429 begin\n",
      "Train epoch:11 iter: 429 end\n",
      "Train epoch:11 iter: 430 begin\n",
      "Train epoch:11 iter: 430 end\n",
      "Train epoch:11 iter: 431 begin\n",
      "Train epoch:11 iter: 431 end\n",
      "Train epoch:11 iter: 432 begin\n",
      "Train epoch:11 iter: 432 end\n",
      "Train epoch:11 iter: 433 begin\n",
      "Train epoch:11 iter: 433 end\n",
      "Train epoch:11 iter: 434 begin\n",
      "Train epoch:11 iter: 434 end\n",
      "Train epoch:11 iter: 435 begin\n",
      "Train epoch:11 iter: 435 end\n",
      "Train epoch:11 iter: 436 begin\n",
      "Train epoch:11 iter: 436 end\n",
      "Train epoch:11 iter: 437 begin\n",
      "Train epoch:11 iter: 437 end\n",
      "Train epoch:11 iter: 438 begin\n",
      "Train epoch:11 iter: 438 end\n",
      "Train epoch:11 iter: 439 begin\n",
      "Train epoch:11 iter: 439 end\n",
      "Train epoch:11 iter: 440 begin\n",
      "Train epoch:11 iter: 440 end\n",
      "Train epoch:11 iter: 441 begin\n",
      "Train epoch:11 iter: 441 end\n",
      "Train epoch:11 iter: 442 begin\n",
      "Train epoch:11 iter: 442 end\n",
      "Train epoch:11 iter: 443 begin\n",
      "Train epoch:11 iter: 443 end\n",
      "Train epoch:11 iter: 444 begin\n",
      "Train epoch:11 iter: 444 end\n",
      "Train epoch:11 iter: 445 begin\n",
      "Train epoch:11 iter: 445 end\n",
      "Train epoch:11 iter: 446 begin\n",
      "Train epoch:11 iter: 446 end\n",
      "Train epoch:11 iter: 447 begin\n",
      "Train epoch:11 iter: 447 end\n",
      "Train epoch:11 iter: 448 begin\n",
      "Train epoch:11 iter: 448 end\n",
      "Train epoch:11 iter: 449 begin\n",
      "Train epoch:11 iter: 449 end\n",
      "Train epoch:11 iter: 450 begin\n",
      "Train epoch:11 iter: 450 end\n",
      "Train epoch:11 iter: 451 begin\n",
      "Train epoch:11 iter: 451 end\n",
      "Train epoch:11 iter: 452 begin\n",
      "Train epoch:11 iter: 452 end\n",
      "Train epoch:11 iter: 453 begin\n",
      "Train epoch:11 iter: 453 end\n",
      "Train epoch:11 iter: 454 begin\n",
      "Train epoch:11 iter: 454 end\n",
      "Train epoch:11 iter: 455 begin\n",
      "Train epoch:11 iter: 455 end\n",
      "Train epoch:11 iter: 456 begin\n",
      "Train epoch:11 iter: 456 end\n",
      "Train epoch:11 iter: 457 begin\n",
      "Train epoch:11 iter: 457 end\n",
      "Train epoch:11 iter: 458 begin\n",
      "Train epoch:11 iter: 458 end\n",
      "Train epoch:11 iter: 459 begin\n",
      "Train epoch:11 iter: 459 end\n",
      "Train epoch:11 iter: 460 begin\n",
      "Train epoch:11 iter: 460 end\n",
      "Train epoch:11 iter: 461 begin\n",
      "Train epoch:11 iter: 461 end\n",
      "Train epoch:11 iter: 462 begin\n",
      "Train epoch:11 iter: 462 end\n",
      "Train epoch:11 iter: 463 begin\n",
      "Train epoch:11 iter: 463 end\n",
      "Train epoch:11 iter: 464 begin\n",
      "Train epoch:11 iter: 464 end\n",
      "Train epoch:11 iter: 465 begin\n",
      "Train epoch:11 iter: 465 end\n",
      "Train epoch:11 iter: 466 begin\n",
      "Train epoch:11 iter: 466 end\n",
      "Train epoch:11 iter: 467 begin\n",
      "Train epoch:11 iter: 467 end\n",
      "Train epoch:11 iter: 468 begin\n",
      "Train epoch:11 iter: 468 end\n",
      "Train epoch:11 iter: 469 begin\n",
      "Train epoch:11 iter: 469 end\n",
      "Train epoch:11 iter: 470 begin\n",
      "Train epoch:11 iter: 470 end\n",
      "Train epoch:11 iter: 471 begin\n",
      "Train epoch:11 iter: 471 end\n",
      "Train epoch:11 iter: 472 begin\n",
      "Train epoch:11 iter: 472 end\n",
      "Train epoch:11 iter: 473 begin\n",
      "Train epoch:11 iter: 473 end\n",
      "Train epoch:11 iter: 474 begin\n",
      "Train epoch:11 iter: 474 end\n",
      "Train epoch:11 iter: 475 begin\n",
      "Train epoch:11 iter: 475 end\n",
      "Train epoch:11 iter: 476 begin\n",
      "Train epoch:11 iter: 476 end\n",
      "Train epoch:11 iter: 477 begin\n",
      "Train epoch:11 iter: 477 end\n",
      "Train epoch:11 iter: 478 begin\n",
      "Train epoch:11 iter: 478 end\n",
      "Train epoch:11 iter: 479 begin\n",
      "Train epoch:11 iter: 479 end\n",
      "Train epoch:11 iter: 480 begin\n",
      "Train epoch:11 iter: 480 end\n",
      "Train epoch:11 iter: 481 begin\n",
      "Train epoch:11 iter: 481 end\n",
      "Train epoch:11 iter: 482 begin\n",
      "Train epoch:11 iter: 482 end\n",
      "Train epoch:11 iter: 483 begin\n",
      "Train epoch:11 iter: 483 end\n",
      "Train epoch:11 iter: 484 begin\n",
      "Train epoch:11 iter: 484 end\n",
      "Train epoch:11 iter: 485 begin\n",
      "Train epoch:11 iter: 485 end\n",
      "Train epoch:11 iter: 486 begin\n",
      "Train epoch:11 iter: 486 end\n",
      "Train epoch:11 iter: 487 begin\n",
      "Train epoch:11 iter: 487 end\n",
      "Train epoch:11 iter: 488 begin\n",
      "Train epoch:11 iter: 488 end\n",
      "Train epoch:11 iter: 489 begin\n",
      "Train epoch:11 iter: 489 end\n",
      "Train epoch:11 iter: 490 begin\n",
      "Train epoch:11 iter: 490 end\n",
      "Train epoch:11 iter: 491 begin\n",
      "Train epoch:11 iter: 491 end\n",
      "Train epoch:11 iter: 492 begin\n",
      "Train epoch:11 iter: 492 end\n",
      "Train epoch:11 iter: 493 begin\n",
      "Train epoch:11 iter: 493 end\n",
      "Train epoch:11 iter: 494 begin\n",
      "Train epoch:11 iter: 494 end\n",
      "Train epoch:11 iter: 495 begin\n",
      "Train epoch:11 iter: 495 end\n",
      "Train epoch:11 iter: 496 begin\n",
      "Train epoch:11 iter: 496 end\n",
      "Train epoch:11 iter: 497 begin\n",
      "Train epoch:11 iter: 497 end\n",
      "Train epoch:11 iter: 498 begin\n",
      "Train epoch:11 iter: 498 end\n",
      "Train epoch:11 iter: 499 begin\n",
      "Train epoch:11 iter: 499 end\n",
      "Train epoch:11 iter: 500 begin\n",
      "Train epoch:11 iter: 500 end\n",
      "Train epoch:11 iter: 501 begin\n",
      "Train epoch:11 iter: 501 end\n",
      "Train epoch:11 iter: 502 begin\n",
      "Train epoch:11 iter: 502 end\n",
      "Train epoch:11 iter: 503 begin\n",
      "Train epoch:11 iter: 503 end\n",
      "Train epoch:11 iter: 504 begin\n",
      "Train epoch:11 iter: 504 end\n",
      "Train epoch:11 iter: 505 begin\n",
      "Train epoch:11 iter: 505 end\n",
      "Train epoch:11 iter: 506 begin\n",
      "Train epoch:11 iter: 506 end\n",
      "Train epoch:11 iter: 507 begin\n",
      "Train epoch:11 iter: 507 end\n",
      "Train epoch:11 iter: 508 begin\n",
      "Train epoch:11 iter: 508 end\n",
      "Train epoch:11 iter: 509 begin\n",
      "Train epoch:11 iter: 509 end\n",
      "Train epoch:11 iter: 510 begin\n",
      "Train epoch:11 iter: 510 end\n",
      "Train epoch:11 iter: 511 begin\n",
      "Train epoch:11 iter: 511 end\n",
      "Train epoch:11 iter: 512 begin\n",
      "Train epoch:11 iter: 512 end\n",
      "Train epoch:11 iter: 513 begin\n",
      "Train epoch:11 iter: 513 end\n",
      "Train epoch:11 iter: 514 begin\n",
      "Train epoch:11 iter: 514 end\n",
      "Train epoch:11 iter: 515 begin\n",
      "Train epoch:11 iter: 515 end\n",
      "Train epoch:11 iter: 516 begin\n",
      "Train epoch:11 iter: 516 end\n",
      "Train epoch:11 iter: 517 begin\n",
      "Train epoch:11 iter: 517 end\n",
      "Train epoch:11 iter: 518 begin\n",
      "Train epoch:11 iter: 518 end\n",
      "Train epoch:11 iter: 519 begin\n",
      "Train epoch:11 iter: 519 end\n",
      "Train epoch:11 iter: 520 begin\n",
      "Train epoch:11 iter: 520 end\n",
      "Train epoch:11 iter: 521 begin\n",
      "Train epoch:11 iter: 521 end\n",
      "Train epoch:11 iter: 522 begin\n",
      "Train epoch:11 iter: 522 end\n",
      "Train epoch:11 iter: 523 begin\n",
      "Train epoch:11 iter: 523 end\n",
      "Train epoch:11 iter: 524 begin\n",
      "Train epoch:11 iter: 524 end\n",
      "Train epoch:11 iter: 525 begin\n",
      "Train epoch:11 iter: 525 end\n",
      "Train epoch:11 iter: 526 begin\n",
      "Train epoch:11 iter: 526 end\n",
      "Train epoch:11 iter: 527 begin\n",
      "Train epoch:11 iter: 527 end\n",
      "Train epoch:11 iter: 528 begin\n",
      "Train epoch:11 iter: 528 end\n",
      "Train epoch:11 iter: 529 begin\n",
      "Train epoch:11 iter: 529 end\n",
      "Train epoch:11 iter: 530 begin\n",
      "Train epoch:11 iter: 530 end\n",
      "Train epoch:11 iter: 531 begin\n",
      "Train epoch:11 iter: 531 end\n",
      "Train epoch:11 iter: 532 begin\n",
      "Train epoch:11 iter: 532 end\n",
      "Train epoch:11 iter: 533 begin\n",
      "Train epoch:11 iter: 533 end\n",
      "Train epoch:11 iter: 534 begin\n",
      "Train epoch:11 iter: 534 end\n",
      "Train epoch:11 iter: 535 begin\n",
      "Train epoch:11 iter: 535 end\n",
      "Train epoch:11 iter: 536 begin\n",
      "Train epoch:11 iter: 536 end\n",
      "Train epoch:11 iter: 537 begin\n",
      "Train epoch:11 iter: 537 end\n",
      "Train epoch:11 iter: 538 begin\n",
      "Train epoch:11 iter: 538 end\n",
      "Train epoch:11 iter: 539 begin\n",
      "Train epoch:11 iter: 539 end\n",
      "Train epoch:11 iter: 540 begin\n",
      "Train epoch:11 iter: 540 end\n",
      "Train epoch:11 iter: 541 begin\n",
      "Train epoch:11 iter: 541 end\n",
      "Train epoch:11 iter: 542 begin\n",
      "Train epoch:11 iter: 542 end\n",
      "Train epoch:11 iter: 543 begin\n",
      "Train epoch:11 iter: 543 end\n",
      "Train epoch:11 iter: 544 begin\n",
      "Train epoch:11 iter: 544 end\n",
      "Train epoch:11 iter: 545 begin\n",
      "Train epoch:11 iter: 545 end\n",
      "Train epoch:11 iter: 546 begin\n",
      "Train epoch:11 iter: 546 end\n",
      "Train epoch:11 iter: 547 begin\n",
      "Train epoch:11 iter: 547 end\n",
      "Train epoch:11 iter: 548 begin\n",
      "Train epoch:11 iter: 548 end\n",
      "Train epoch:11 iter: 549 begin\n",
      "Train epoch:11 iter: 549 end\n",
      "Train epoch:11 iter: 550 begin\n",
      "Train epoch:11 iter: 550 end\n",
      "Train epoch:11 iter: 551 begin\n",
      "Train epoch:11 iter: 551 end\n",
      "Train epoch:11 iter: 552 begin\n",
      "Train epoch:11 iter: 552 end\n",
      "Train epoch:11 iter: 553 begin\n",
      "Train epoch:11 iter: 553 end\n",
      "Train epoch:11 iter: 554 begin\n",
      "Train epoch:11 iter: 554 end\n",
      "Train epoch:11 iter: 555 begin\n",
      "Train epoch:11 iter: 555 end\n",
      "Train epoch:11 iter: 556 begin\n",
      "Train epoch:11 iter: 556 end\n",
      "Train epoch:11 iter: 557 begin\n",
      "Train epoch:11 iter: 557 end\n",
      "Train epoch:11 iter: 558 begin\n",
      "Train epoch:11 iter: 558 end\n",
      "Train epoch:11 iter: 559 begin\n",
      "Train epoch:11 iter: 559 end\n",
      "Train epoch:11 iter: 560 begin\n",
      "Train epoch:11 iter: 560 end\n",
      "Train epoch:11 iter: 561 begin\n",
      "Train epoch:11 iter: 561 end\n",
      "Train epoch:11 iter: 562 begin\n",
      "Train epoch:11 iter: 562 end\n",
      "Train epoch:11 iter: 563 begin\n",
      "Train epoch:11 iter: 563 end\n",
      "Train epoch:11 iter: 564 begin\n",
      "Train epoch:11 iter: 564 end\n",
      "Train epoch:11 iter: 565 begin\n",
      "Train epoch:11 iter: 565 end\n",
      "Train epoch:11 iter: 566 begin\n",
      "Train epoch:11 iter: 566 end\n",
      "Train epoch:11 iter: 567 begin\n",
      "Train epoch:11 iter: 567 end\n",
      "Train epoch:11 iter: 568 begin\n",
      "Train epoch:11 iter: 568 end\n",
      "Train epoch:11 iter: 569 begin\n",
      "Train epoch:11 iter: 569 end\n",
      "Train epoch:11 iter: 570 begin\n",
      "Train epoch:11 iter: 570 end\n",
      "Train epoch:11 iter: 571 begin\n",
      "Train epoch:11 iter: 571 end\n",
      "Train epoch:11 iter: 572 begin\n",
      "Train epoch:11 iter: 572 end\n",
      "Train epoch:11 iter: 573 begin\n",
      "Train epoch:11 iter: 573 end\n",
      "Train epoch:11 iter: 574 begin\n",
      "Train epoch:11 iter: 574 end\n",
      "Train epoch:11 iter: 575 begin\n",
      "Train epoch:11 iter: 575 end\n",
      "Train epoch:11 iter: 576 begin\n",
      "Train epoch:11 iter: 576 end\n",
      "Train epoch:11 iter: 577 begin\n",
      "Train epoch:11 iter: 577 end\n",
      "Train epoch:11 iter: 578 begin\n",
      "Train epoch:11 iter: 578 end\n",
      "Train epoch:11 iter: 579 begin\n",
      "Train epoch:11 iter: 579 end\n",
      "Train epoch:11 iter: 580 begin\n",
      "Train epoch:11 iter: 580 end\n",
      "Train epoch:11 iter: 581 begin\n",
      "Train epoch:11 iter: 581 end\n",
      "Train epoch:11 iter: 582 begin\n",
      "Train epoch:11 iter: 582 end\n",
      "Train epoch:11 iter: 583 begin\n",
      "Train epoch:11 iter: 583 end\n",
      "Train epoch:11 iter: 584 begin\n",
      "Train epoch:11 iter: 584 end\n",
      "Train epoch:11 iter: 585 begin\n",
      "Train epoch:11 iter: 585 end\n",
      "Train epoch:11 iter: 586 begin\n",
      "Train epoch:11 iter: 586 end\n",
      "Train epoch:11 iter: 587 begin\n",
      "Train epoch:11 iter: 587 end\n",
      "Train epoch:11 iter: 588 begin\n",
      "Train epoch:11 iter: 588 end\n",
      "Train epoch:11 iter: 589 begin\n",
      "Train epoch:11 iter: 589 end\n",
      "Train epoch:11 iter: 590 begin\n",
      "Train epoch:11 iter: 590 end\n",
      "Train epoch:11 iter: 591 begin\n",
      "Train epoch:11 iter: 591 end\n",
      "Train epoch:11 iter: 592 begin\n",
      "Train epoch:11 iter: 592 end\n",
      "Train epoch:11 iter: 593 begin\n",
      "Train epoch:11 iter: 593 end\n",
      "Train epoch:11 iter: 594 begin\n",
      "Train epoch:11 iter: 594 end\n",
      "Train epoch:11 iter: 595 begin\n",
      "Train epoch:11 iter: 595 end\n",
      "Train epoch:11 iter: 596 begin\n",
      "Train epoch:11 iter: 596 end\n",
      "Train epoch:11 iter: 597 begin\n",
      "Train epoch:11 iter: 597 end\n",
      "Train epoch:11 iter: 598 begin\n",
      "Train epoch:11 iter: 598 end\n",
      "Train epoch:11 iter: 599 begin\n",
      "Train epoch:11 iter: 599 end\n",
      "Train epoch:11 iter: 600 begin\n",
      "Train epoch:11 iter: 600 end\n",
      "Train epoch:11 iter: 601 begin\n",
      "Train epoch:11 iter: 601 end\n",
      "Train epoch:11 iter: 602 begin\n",
      "Train epoch:11 iter: 602 end\n",
      "Train epoch:11 iter: 603 begin\n",
      "Train epoch:11 iter: 603 end\n",
      "Train epoch:11 iter: 604 begin\n",
      "Train epoch:11 iter: 604 end\n",
      "Train epoch:11 iter: 605 begin\n",
      "Train epoch:11 iter: 605 end\n",
      "Train epoch:11 iter: 606 begin\n",
      "Train epoch:11 iter: 606 end\n",
      "Train epoch:11 iter: 607 begin\n",
      "Train epoch:11 iter: 607 end\n",
      "Train epoch:11 iter: 608 begin\n",
      "Train epoch:11 iter: 608 end\n",
      "Train epoch:11 iter: 609 begin\n",
      "Train epoch:11 iter: 609 end\n",
      "Train epoch:11 iter: 610 begin\n",
      "Train epoch:11 iter: 610 end\n",
      "Train epoch:11 iter: 611 begin\n",
      "Train epoch:11 iter: 611 end\n",
      "Train epoch:11 iter: 612 begin\n",
      "Train epoch:11 iter: 612 end\n",
      "Train epoch:11 iter: 613 begin\n",
      "Train epoch:11 iter: 613 end\n",
      "Train epoch:11 iter: 614 begin\n",
      "Train epoch:11 iter: 614 end\n",
      "Train epoch:11 iter: 615 begin\n",
      "Train epoch:11 iter: 615 end\n",
      "Train epoch:11 iter: 616 begin\n",
      "Train epoch:11 iter: 616 end\n",
      "Train epoch:11 iter: 617 begin\n",
      "Train epoch:11 iter: 617 end\n",
      "Train epoch:11 iter: 618 begin\n",
      "Train epoch:11 iter: 618 end\n",
      "Train epoch:11 iter: 619 begin\n",
      "Train epoch:11 iter: 619 end\n",
      "Train epoch:11 iter: 620 begin\n",
      "Train epoch:11 iter: 620 end\n",
      "Train epoch:11 iter: 621 begin\n",
      "Train epoch:11 iter: 621 end\n",
      "Train epoch:11 iter: 622 begin\n",
      "Train epoch:11 iter: 622 end\n",
      "Train epoch:11 iter: 623 begin\n",
      "Train epoch:11 iter: 623 end\n",
      "Train epoch:11 iter: 624 begin\n",
      "Train epoch:11 iter: 624 end\n",
      "Train epoch:11 iter: 625 begin\n",
      "Train epoch:11 iter: 625 end\n",
      "Train epoch:11 iter: 626 begin\n",
      "Train epoch:11 iter: 626 end\n",
      "Train epoch:11 iter: 627 begin\n",
      "Train epoch:11 iter: 627 end\n",
      "Train epoch:11 iter: 628 begin\n",
      "Train epoch:11 iter: 628 end\n",
      "Train epoch:11 iter: 629 begin\n",
      "Train epoch:11 iter: 629 end\n",
      "Train epoch:11 iter: 630 begin\n",
      "Train epoch:11 iter: 630 end\n",
      "Train epoch:11 iter: 631 begin\n",
      "Train epoch:11 iter: 631 end\n",
      "Train epoch:11 iter: 632 begin\n",
      "Train epoch:11 iter: 632 end\n",
      "Train epoch:11 iter: 633 begin\n",
      "Train epoch:11 iter: 633 end\n",
      "Train epoch:11 iter: 634 begin\n",
      "Train epoch:11 iter: 634 end\n",
      "Train epoch:11 iter: 635 begin\n",
      "Train epoch:11 iter: 635 end\n",
      "Train epoch:11 iter: 636 begin\n",
      "Train epoch:11 iter: 636 end\n",
      "Train epoch:11 iter: 637 begin\n",
      "Train epoch:11 iter: 637 end\n",
      "Train epoch:11 iter: 638 begin\n",
      "Train epoch:11 iter: 638 end\n",
      "Train epoch:11 iter: 639 begin\n",
      "Train epoch:11 iter: 639 end\n",
      "Train epoch:11 iter: 640 begin\n",
      "Train epoch:11 iter: 640 end\n",
      "Train epoch:11 iter: 641 begin\n",
      "Train epoch:11 iter: 641 end\n",
      "Train epoch:11 iter: 642 begin\n",
      "Train epoch:11 iter: 642 end\n",
      "Train epoch:11 iter: 643 begin\n",
      "Train epoch:11 iter: 643 end\n",
      "Train epoch:11 iter: 644 begin\n",
      "Train epoch:11 iter: 644 end\n",
      "Train epoch:11 iter: 645 begin\n",
      "Train epoch:11 iter: 645 end\n",
      "Train epoch:11 iter: 646 begin\n",
      "Train epoch:11 iter: 646 end\n",
      "Train epoch:11 iter: 647 begin\n",
      "Train epoch:11 iter: 647 end\n",
      "Train epoch:11 iter: 648 begin\n",
      "Train epoch:11 iter: 648 end\n",
      "Train epoch:11 iter: 649 begin\n",
      "Train epoch:11 iter: 649 end\n",
      "Train epoch:11 iter: 650 begin\n",
      "Train epoch:11 iter: 650 end\n",
      "Train epoch:11 iter: 651 begin\n",
      "Train epoch:11 iter: 651 end\n",
      "Train epoch:11 iter: 652 begin\n",
      "Train epoch:11 iter: 652 end\n",
      "Train epoch:11 iter: 653 begin\n",
      "Train epoch:11 iter: 653 end\n",
      "Train epoch:11 iter: 654 begin\n",
      "Train epoch:11 iter: 654 end\n",
      "Train epoch:11 iter: 655 begin\n",
      "Train epoch:11 iter: 655 end\n",
      "Train epoch:11 iter: 656 begin\n",
      "Train epoch:11 iter: 656 end\n",
      "Train epoch:11 iter: 657 begin\n",
      "Train epoch:11 iter: 657 end\n",
      "Train epoch:11 iter: 658 begin\n",
      "Train epoch:11 iter: 658 end\n",
      "Train epoch:11 iter: 659 begin\n",
      "Train epoch:11 iter: 659 end\n",
      "Train epoch:11 iter: 660 begin\n",
      "Train epoch:11 iter: 660 end\n",
      "Train epoch:11 iter: 661 begin\n",
      "Train epoch:11 iter: 661 end\n",
      "Train epoch:11 iter: 662 begin\n",
      "Train epoch:11 iter: 662 end\n",
      "Train epoch:11 iter: 663 begin\n",
      "Train epoch:11 iter: 663 end\n",
      "Train epoch:11 iter: 664 begin\n",
      "Train epoch:11 iter: 664 end\n",
      "Train epoch:11 iter: 665 begin\n",
      "Train epoch:11 iter: 665 end\n",
      "Train epoch:11 iter: 666 begin\n",
      "Train epoch:11 iter: 666 end\n",
      "Train epoch:11 iter: 667 begin\n",
      "Train epoch:11 iter: 667 end\n",
      "Train epoch:11 iter: 668 begin\n",
      "Train epoch:11 iter: 668 end\n",
      "Train epoch:11 iter: 669 begin\n",
      "Train epoch:11 iter: 669 end\n",
      "Train epoch:11 iter: 670 begin\n",
      "Train epoch:11 iter: 670 end\n",
      "Train epoch:11 iter: 671 begin\n",
      "Train epoch:11 iter: 671 end\n",
      "Train epoch:11 iter: 672 begin\n",
      "Train epoch:11 iter: 672 end\n",
      "Train epoch:11 iter: 673 begin\n",
      "Train epoch:11 iter: 673 end\n",
      "Train epoch:11 iter: 674 begin\n",
      "Train epoch:11 iter: 674 end\n",
      "Train epoch:11 iter: 675 begin\n",
      "Train epoch:11 iter: 675 end\n",
      "Train epoch:11 iter: 676 begin\n",
      "Train epoch:11 iter: 676 end\n",
      "Train epoch:11 iter: 677 begin\n",
      "Train epoch:11 iter: 677 end\n",
      "Train epoch:11 iter: 678 begin\n",
      "Train epoch:11 iter: 678 end\n",
      "Train epoch:11 iter: 679 begin\n",
      "Train epoch:11 iter: 679 end\n",
      "Train epoch:11 iter: 680 begin\n",
      "Train epoch:11 iter: 680 end\n",
      "Train epoch:11 iter: 681 begin\n",
      "Train epoch:11 iter: 681 end\n",
      "Train epoch:11 iter: 682 begin\n",
      "Train epoch:11 iter: 682 end\n",
      "Train epoch:11 iter: 683 begin\n",
      "Train epoch:11 iter: 683 end\n",
      "Train epoch:11 iter: 684 begin\n",
      "Train epoch:11 iter: 684 end\n",
      "Train epoch:11 iter: 685 begin\n",
      "Train epoch:11 iter: 685 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:11 iter: 686 begin\n",
      "Train epoch:11 iter: 686 end\n",
      "Train epoch:11 iter: 687 begin\n",
      "Train epoch:11 iter: 687 end\n",
      "Train epoch:11 iter: 688 begin\n",
      "Train epoch:11 iter: 688 end\n",
      "Train epoch:11 iter: 689 begin\n",
      "Train epoch:11 iter: 689 end\n",
      "Train epoch:11 iter: 690 begin\n",
      "Train epoch:11 iter: 690 end\n",
      "Train epoch:11 iter: 691 begin\n",
      "Train epoch:11 iter: 691 end\n",
      "Train epoch:11 iter: 692 begin\n",
      "Train epoch:11 iter: 692 end\n",
      "Train epoch:11 iter: 693 begin\n",
      "Train epoch:11 iter: 693 end\n",
      "Train epoch:11 iter: 694 begin\n",
      "Train epoch:11 iter: 694 end\n",
      "Train epoch:11 iter: 695 begin\n",
      "Train epoch:11 iter: 695 end\n",
      "Train epoch:11 iter: 696 begin\n",
      "Train epoch:11 iter: 696 end\n",
      "Train epoch:11 iter: 697 begin\n",
      "Train epoch:11 iter: 697 end\n",
      "Train epoch:11 iter: 698 begin\n",
      "Train epoch:11 iter: 698 end\n",
      "Train epoch:11 iter: 699 begin\n",
      "Train epoch:11 iter: 699 end\n",
      "Train epoch:11 iter: 700 begin\n",
      "Train epoch:11 iter: 700 end\n",
      "Train epoch:11 iter: 701 begin\n",
      "Train epoch:11 iter: 701 end\n",
      "Train epoch:11 iter: 702 begin\n",
      "Train epoch:11 iter: 702 end\n",
      "Train epoch:11 iter: 703 begin\n",
      "Train epoch:11 iter: 703 end\n",
      "Train epoch:11 iter: 704 begin\n",
      "Train epoch:11 iter: 704 end\n",
      "Train epoch:11 iter: 705 begin\n",
      "Train epoch:11 iter: 705 end\n",
      "Train epoch:11 iter: 706 begin\n",
      "Train epoch:11 iter: 706 end\n",
      "Train epoch:11 iter: 707 begin\n",
      "Train epoch:11 iter: 707 end\n",
      "Train epoch:11 iter: 708 begin\n",
      "Train epoch:11 iter: 708 end\n",
      "Train epoch:11 iter: 709 begin\n",
      "Train epoch:11 iter: 709 end\n",
      "Train epoch:11 iter: 710 begin\n",
      "Train epoch:11 iter: 710 end\n",
      "Train epoch:11 iter: 711 begin\n",
      "Train epoch:11 iter: 711 end\n",
      "Train epoch:11 iter: 712 begin\n",
      "Train epoch:11 iter: 712 end\n",
      "Train epoch:11 iter: 713 begin\n",
      "Train epoch:11 iter: 713 end\n",
      "Train epoch:11 iter: 714 begin\n",
      "Train epoch:11 iter: 714 end\n",
      "Train epoch:11 iter: 715 begin\n",
      "Train epoch:11 iter: 715 end\n",
      "Train epoch:11 iter: 716 begin\n",
      "Train epoch:11 iter: 716 end\n",
      "Train epoch:11 iter: 717 begin\n",
      "Train epoch:11 iter: 717 end\n",
      "Train epoch:11 iter: 718 begin\n",
      "Train epoch:11 iter: 718 end\n",
      "Train epoch:11 iter: 719 begin\n",
      "Train epoch:11 iter: 719 end\n",
      "Train epoch:11 iter: 720 begin\n",
      "Train epoch:11 iter: 720 end\n",
      "Train epoch:11 iter: 721 begin\n",
      "Train epoch:11 iter: 721 end\n",
      "Train epoch:11 iter: 722 begin\n",
      "Train epoch:11 iter: 722 end\n",
      "Train epoch:11 iter: 723 begin\n",
      "Train epoch:11 iter: 723 end\n",
      "Train epoch:11 iter: 724 begin\n",
      "Train epoch:11 iter: 724 end\n",
      "Train epoch:11 iter: 725 begin\n",
      "Train epoch:11 iter: 725 end\n",
      "Train epoch:11 iter: 726 begin\n",
      "Train epoch:11 iter: 726 end\n",
      "Train epoch:11 iter: 727 begin\n",
      "Train epoch:11 iter: 727 end\n",
      "Train epoch:11 iter: 728 begin\n",
      "Train epoch:11 iter: 728 end\n",
      "Train epoch:11 iter: 729 begin\n",
      "Train epoch:11 iter: 729 end\n",
      "Train epoch:11 iter: 730 begin\n",
      "Train epoch:11 iter: 730 end\n",
      "Train epoch:11 iter: 731 begin\n",
      "Train epoch:11 iter: 731 end\n",
      "Train epoch:11 iter: 732 begin\n",
      "Train epoch:11 iter: 732 end\n",
      "Train epoch:11 iter: 733 begin\n",
      "Train epoch:11 iter: 733 end\n",
      "Train epoch:11 iter: 734 begin\n",
      "Train epoch:11 iter: 734 end\n",
      "Train epoch:11 iter: 735 begin\n",
      "Train epoch:11 iter: 735 end\n",
      "Train epoch:11 iter: 736 begin\n",
      "Train epoch:11 iter: 736 end\n",
      "Train epoch:11 iter: 737 begin\n",
      "Train epoch:11 iter: 737 end\n",
      "Train epoch:11 iter: 738 begin\n",
      "Train epoch:11 iter: 738 end\n",
      "Train epoch:11 iter: 739 begin\n",
      "Train epoch:11 iter: 739 end\n",
      "Train epoch:11 iter: 740 begin\n",
      "Train epoch:11 iter: 740 end\n",
      "Train epoch:11 iter: 741 begin\n",
      "Train epoch:11 iter: 741 end\n",
      "Train epoch:11 iter: 742 begin\n",
      "Train epoch:11 iter: 742 end\n",
      "Train epoch:11 iter: 743 begin\n",
      "Train epoch:11 iter: 743 end\n",
      "Train epoch:11 iter: 744 begin\n",
      "Train epoch:11 iter: 744 end\n",
      "Train epoch:11 iter: 745 begin\n",
      "Train epoch:11 iter: 745 end\n",
      "Train epoch:11 iter: 746 begin\n",
      "Train epoch:11 iter: 746 end\n",
      "Train epoch:11 iter: 747 begin\n",
      "Train epoch:11 iter: 747 end\n",
      "Train epoch:11 iter: 748 begin\n",
      "Train epoch:11 iter: 748 end\n",
      "Train epoch:11 iter: 749 begin\n",
      "Train epoch:11 iter: 749 end\n",
      "Train epoch:11 iter: 750 begin\n",
      "Train epoch:11 iter: 750 end\n",
      "Train epoch:11 iter: 751 begin\n",
      "Train epoch:11 iter: 751 end\n",
      "Train epoch:11 iter: 752 begin\n",
      "Train epoch:11 iter: 752 end\n",
      "Train epoch:11 iter: 753 begin\n",
      "Train epoch:11 iter: 753 end\n",
      "Train epoch:11 iter: 754 begin\n",
      "Train epoch:11 iter: 754 end\n",
      "Train epoch:11 iter: 755 begin\n",
      "Train epoch:11 iter: 755 end\n",
      "Train epoch:11 iter: 756 begin\n",
      "Train epoch:11 iter: 756 end\n",
      "Train epoch:11 iter: 757 begin\n",
      "Train epoch:11 iter: 757 end\n",
      "Train epoch:11 iter: 758 begin\n",
      "Train epoch:11 iter: 758 end\n",
      "Train epoch:11 iter: 759 begin\n",
      "Train epoch:11 iter: 759 end\n",
      "Train epoch:11 iter: 760 begin\n",
      "Train epoch:11 iter: 760 end\n",
      "Train epoch:11 iter: 761 begin\n",
      "Train epoch:11 iter: 761 end\n",
      "Train epoch:11 iter: 762 begin\n",
      "Train epoch:11 iter: 762 end\n",
      "Train epoch:11 iter: 763 begin\n",
      "Train epoch:11 iter: 763 end\n",
      "Train epoch:11 iter: 764 begin\n",
      "Train epoch:11 iter: 764 end\n",
      "Train epoch:11 iter: 765 begin\n",
      "Train epoch:11 iter: 765 end\n",
      "Train epoch:11 iter: 766 begin\n",
      "Train epoch:11 iter: 766 end\n",
      "Train epoch:11 iter: 767 begin\n",
      "Train epoch:11 iter: 767 end\n",
      "Train epoch:11 iter: 768 begin\n",
      "Train epoch:11 iter: 768 end\n",
      "Train epoch:11 iter: 769 begin\n",
      "Train epoch:11 iter: 769 end\n",
      "Train epoch:11 iter: 770 begin\n",
      "Train epoch:11 iter: 770 end\n",
      "Train epoch:11 iter: 771 begin\n",
      "Train epoch:11 iter: 771 end\n",
      "Train epoch:11 iter: 772 begin\n",
      "Train epoch:11 iter: 772 end\n",
      "Train epoch:11 iter: 773 begin\n",
      "Train epoch:11 iter: 773 end\n",
      "Train epoch:11 iter: 774 begin\n",
      "Train epoch:11 iter: 774 end\n",
      "Train epoch:11 iter: 775 begin\n",
      "Train epoch:11 iter: 775 end\n",
      "Train epoch:11 iter: 776 begin\n",
      "Train epoch:11 iter: 776 end\n",
      "Train epoch:11 iter: 777 begin\n",
      "Train epoch:11 iter: 777 end\n",
      "Train epoch:11 iter: 778 begin\n",
      "Train epoch:11 iter: 778 end\n",
      "Train epoch:11 iter: 779 begin\n",
      "Train epoch:11 iter: 779 end\n",
      "Train epoch:11 iter: 780 begin\n",
      "Train epoch:11 iter: 780 end\n",
      "Train epoch:11 iter: 781 begin\n",
      "Train epoch:11 iter: 781 end\n",
      "Train epoch:11 iter: 782 begin\n",
      "Train epoch:11 iter: 782 end\n",
      "Train epoch:11 iter: 783 begin\n",
      "Train epoch:11 iter: 783 end\n",
      "Train epoch:11 iter: 784 begin\n",
      "Train epoch:11 iter: 784 end\n",
      "Train epoch:11 iter: 785 begin\n",
      "Train epoch:11 iter: 785 end\n",
      "Train epoch:11 iter: 786 begin\n",
      "Train epoch:11 iter: 786 end\n",
      "Train epoch:11 iter: 787 begin\n",
      "Train epoch:11 iter: 787 end\n",
      "Train epoch:11 iter: 788 begin\n",
      "Train epoch:11 iter: 788 end\n",
      "Train epoch:11 iter: 789 begin\n",
      "Train epoch:11 iter: 789 end\n",
      "Train epoch:11 iter: 790 begin\n",
      "Train epoch:11 iter: 790 end\n",
      "Train epoch:11 iter: 791 begin\n",
      "Train epoch:11 iter: 791 end\n",
      "Train epoch:11 iter: 792 begin\n",
      "Train epoch:11 iter: 792 end\n",
      "Train epoch:11 iter: 793 begin\n",
      "Train epoch:11 iter: 793 end\n",
      "Train epoch:11 iter: 794 begin\n",
      "Train epoch:11 iter: 794 end\n",
      "Train epoch:11 iter: 795 begin\n",
      "Train epoch:11 iter: 795 end\n",
      "Train epoch:11 iter: 796 begin\n",
      "Train epoch:11 iter: 796 end\n",
      "Train epoch:11 iter: 797 begin\n",
      "Train epoch:11 iter: 797 end\n",
      "Train epoch:11 iter: 798 begin\n",
      "Train epoch:11 iter: 798 end\n",
      "Train epoch:11 iter: 799 begin\n",
      "Train epoch:11 iter: 799 end\n",
      "Train epoch:11 iter: 800 begin\n",
      "Train epoch:11 iter: 800 end\n",
      "Train epoch:11 iter: 801 begin\n",
      "Train epoch:11 iter: 801 end\n",
      "Train epoch:11 iter: 802 begin\n",
      "Train epoch:11 iter: 802 end\n",
      "Train epoch:11 iter: 803 begin\n",
      "Train epoch:11 iter: 803 end\n",
      "Train epoch:11 iter: 804 begin\n",
      "Train epoch:11 iter: 804 end\n",
      "Train epoch:11 iter: 805 begin\n",
      "Train epoch:11 iter: 805 end\n",
      "Train epoch:11 iter: 806 begin\n",
      "Train epoch:11 iter: 806 end\n",
      "Train epoch:11 iter: 807 begin\n",
      "Train epoch:11 iter: 807 end\n",
      "Train epoch:11 iter: 808 begin\n",
      "Train epoch:11 iter: 808 end\n",
      "Train epoch:11 iter: 809 begin\n",
      "Train epoch:11 iter: 809 end\n",
      "Train epoch:11 iter: 810 begin\n",
      "Train epoch:11 iter: 810 end\n",
      "Train epoch:11 iter: 811 begin\n",
      "Train epoch:11 iter: 811 end\n",
      "Train epoch:11 iter: 812 begin\n",
      "Train epoch:11 iter: 812 end\n",
      "Train epoch:11 iter: 813 begin\n",
      "Train epoch:11 iter: 813 end\n",
      "Train epoch:11 iter: 814 begin\n",
      "Train epoch:11 iter: 814 end\n",
      "Train epoch:11 iter: 815 begin\n",
      "Train epoch:11 iter: 815 end\n",
      "Train epoch:11 iter: 816 begin\n",
      "Train epoch:11 iter: 816 end\n",
      "Train epoch:11 iter: 817 begin\n",
      "Train epoch:11 iter: 817 end\n",
      "Train epoch:11 iter: 818 begin\n",
      "Train epoch:11 iter: 818 end\n",
      "Train epoch:11 iter: 819 begin\n",
      "Train epoch:11 iter: 819 end\n",
      "Train epoch:11 iter: 820 begin\n",
      "Train epoch:11 iter: 820 end\n",
      "Train epoch:11 iter: 821 begin\n",
      "Train epoch:11 iter: 821 end\n",
      "Train epoch:11 iter: 822 begin\n",
      "Train epoch:11 iter: 822 end\n",
      "Train epoch:11 iter: 823 begin\n",
      "Train epoch:11 iter: 823 end\n",
      "Train epoch:11 iter: 824 begin\n",
      "Train epoch:11 iter: 824 end\n",
      "Train epoch:11 iter: 825 begin\n",
      "Train epoch:11 iter: 825 end\n",
      "Train epoch:11 iter: 826 begin\n",
      "Train epoch:11 iter: 826 end\n",
      "Train epoch:11 iter: 827 begin\n",
      "Train epoch:11 iter: 827 end\n",
      "Train epoch:11 iter: 828 begin\n",
      "Train epoch:11 iter: 828 end\n",
      "Train epoch:11 iter: 829 begin\n",
      "Train epoch:11 iter: 829 end\n",
      "Train epoch:11 iter: 830 begin\n",
      "Train epoch:11 iter: 830 end\n",
      "Train epoch:11 iter: 831 begin\n",
      "Train epoch:11 iter: 831 end\n",
      "Train epoch:11 iter: 832 begin\n",
      "Train epoch:11 iter: 832 end\n",
      "Train epoch:11 iter: 833 begin\n",
      "Train epoch:11 iter: 833 end\n",
      "Train epoch:11 iter: 834 begin\n",
      "Train epoch:11 iter: 834 end\n",
      "Train epoch:11 iter: 835 begin\n",
      "Train epoch:11 iter: 835 end\n",
      "Train epoch:11 iter: 836 begin\n",
      "Train epoch:11 iter: 836 end\n",
      "Train epoch:11 iter: 837 begin\n",
      "Train epoch:11 iter: 837 end\n",
      "Train epoch:11 iter: 838 begin\n",
      "Train epoch:11 iter: 838 end\n",
      "Train epoch:11 iter: 839 begin\n",
      "Train epoch:11 iter: 839 end\n",
      "Train epoch:11 iter: 840 begin\n",
      "Train epoch:11 iter: 840 end\n",
      "Train epoch:11 iter: 841 begin\n",
      "Train epoch:11 iter: 841 end\n",
      "Train epoch:11 iter: 842 begin\n",
      "Train epoch:11 iter: 842 end\n",
      "Train epoch:11 iter: 843 begin\n",
      "Train epoch:11 iter: 843 end\n",
      "Train epoch:11 iter: 844 begin\n",
      "Train epoch:11 iter: 844 end\n",
      "Train epoch:11 iter: 845 begin\n",
      "Train epoch:11 iter: 845 end\n",
      "Train epoch:11 iter: 846 begin\n",
      "Train epoch:11 iter: 846 end\n",
      "Train epoch:11 iter: 847 begin\n",
      "Train epoch:11 iter: 847 end\n",
      "Train epoch:11 iter: 848 begin\n",
      "Train epoch:11 iter: 848 end\n",
      "Train epoch:11 iter: 849 begin\n",
      "Train epoch:11 iter: 849 end\n",
      "Train epoch:11 iter: 850 begin\n",
      "Train epoch:11 iter: 850 end\n",
      "Train epoch:11 iter: 851 begin\n",
      "Train epoch:11 iter: 851 end\n",
      "Train epoch:11 iter: 852 begin\n",
      "Train epoch:11 iter: 852 end\n",
      "Train epoch:11 iter: 853 begin\n",
      "Train epoch:11 iter: 853 end\n",
      "Train epoch:11 iter: 854 begin\n",
      "Train epoch:11 iter: 854 end\n",
      "Train epoch:11 iter: 855 begin\n",
      "Train epoch:11 iter: 855 end\n",
      "Train epoch:11 iter: 856 begin\n",
      "Train epoch:11 iter: 856 end\n",
      "Train epoch:11 iter: 857 begin\n",
      "Train epoch:11 iter: 857 end\n",
      "Train epoch:11 iter: 858 begin\n",
      "Train epoch:11 iter: 858 end\n",
      "Train epoch:11 iter: 859 begin\n",
      "Train epoch:11 iter: 859 end\n",
      "Train epoch:11 iter: 860 begin\n",
      "Train epoch:11 iter: 860 end\n",
      "Train epoch:11 iter: 861 begin\n",
      "Train epoch:11 iter: 861 end\n",
      "Train epoch:11 iter: 862 begin\n",
      "Train epoch:11 iter: 862 end\n",
      "Train epoch:11 iter: 863 begin\n",
      "Train epoch:11 iter: 863 end\n",
      "Train epoch:11 iter: 864 begin\n",
      "Train epoch:11 iter: 864 end\n",
      "Train epoch:11 iter: 865 begin\n",
      "Train epoch:11 iter: 865 end\n",
      "Train epoch:11 iter: 866 begin\n",
      "Train epoch:11 iter: 866 end\n",
      "Train epoch:11 iter: 867 begin\n",
      "Train epoch:11 iter: 867 end\n",
      "Train epoch:11 iter: 868 begin\n",
      "Train epoch:11 iter: 868 end\n",
      "Train epoch:11 iter: 869 begin\n",
      "Train epoch:11 iter: 869 end\n",
      "Train epoch:11 iter: 870 begin\n",
      "Train epoch:11 iter: 870 end\n",
      "Train epoch:11 iter: 871 begin\n",
      "Train epoch:11 iter: 871 end\n",
      "Train epoch:11 iter: 872 begin\n",
      "Train epoch:11 iter: 872 end\n",
      "Train epoch:11 iter: 873 begin\n",
      "Train epoch:11 iter: 873 end\n",
      "Train epoch:11 iter: 874 begin\n",
      "Train epoch:11 iter: 874 end\n",
      "Train epoch:11 iter: 875 begin\n",
      "Train epoch:11 iter: 875 end\n",
      "Train epoch:11 iter: 876 begin\n",
      "Train epoch:11 iter: 876 end\n",
      "Train epoch:11 iter: 877 begin\n",
      "Train epoch:11 iter: 877 end\n",
      "Train epoch:11 iter: 878 begin\n",
      "Train epoch:11 iter: 878 end\n",
      "Train epoch:11 iter: 879 begin\n",
      "Train epoch:11 iter: 879 end\n",
      "Train epoch:11 iter: 880 begin\n",
      "Train epoch:11 iter: 880 end\n",
      "Train epoch:11 iter: 881 begin\n",
      "Train epoch:11 iter: 881 end\n",
      "Train epoch:11 iter: 882 begin\n",
      "Train epoch:11 iter: 882 end\n",
      "Train epoch:11 iter: 883 begin\n",
      "Train epoch:11 iter: 883 end\n",
      "Train epoch:11 iter: 884 begin\n",
      "Train epoch:11 iter: 884 end\n",
      "Train epoch:11 iter: 885 begin\n",
      "Train epoch:11 iter: 885 end\n",
      "Train epoch:11 iter: 886 begin\n",
      "Train epoch:11 iter: 886 end\n",
      "Train epoch:11 iter: 887 begin\n",
      "Train epoch:11 iter: 887 end\n",
      "Train epoch:11 iter: 888 begin\n",
      "Train epoch:11 iter: 888 end\n",
      "Train epoch:11 iter: 889 begin\n",
      "Train epoch:11 iter: 889 end\n",
      "Train epoch:11 iter: 890 begin\n",
      "Train epoch:11 iter: 890 end\n",
      "Train epoch:11 iter: 891 begin\n",
      "Train epoch:11 iter: 891 end\n",
      "Train epoch:11 iter: 892 begin\n",
      "Train epoch:11 iter: 892 end\n",
      "Train epoch:11 iter: 893 begin\n",
      "Train epoch:11 iter: 893 end\n",
      "Train epoch:11 iter: 894 begin\n",
      "Train epoch:11 iter: 894 end\n",
      "Train epoch:11 iter: 895 begin\n",
      "Train epoch:11 iter: 895 end\n",
      "Train epoch:11 iter: 896 begin\n",
      "Train epoch:11 iter: 896 end\n",
      "Train epoch:11 iter: 897 begin\n",
      "Train epoch:11 iter: 897 end\n",
      "Train epoch:11 iter: 898 begin\n",
      "Train epoch:11 iter: 898 end\n",
      "Train epoch:11 iter: 899 begin\n",
      "Train epoch:11 iter: 899 end\n",
      "Train epoch:11 iter: 900 begin\n",
      "Train epoch:11 iter: 900 end\n",
      "Train epoch:11 iter: 901 begin\n",
      "Train epoch:11 iter: 901 end\n",
      "Train epoch:11 iter: 902 begin\n",
      "Train epoch:11 iter: 902 end\n",
      "Train epoch:11 iter: 903 begin\n",
      "Train epoch:11 iter: 903 end\n",
      "Train epoch:11 iter: 904 begin\n",
      "Train epoch:11 iter: 904 end\n",
      "Train epoch:11 iter: 905 begin\n",
      "Train epoch:11 iter: 905 end\n",
      "Train epoch:11 iter: 906 begin\n",
      "Train epoch:11 iter: 906 end\n",
      "Train epoch:11 iter: 907 begin\n",
      "Train epoch:11 iter: 907 end\n",
      "Train epoch:11 iter: 908 begin\n",
      "Train epoch:11 iter: 908 end\n",
      "Train epoch:11 iter: 909 begin\n",
      "Train epoch:11 iter: 909 end\n",
      "Train epoch:11 iter: 910 begin\n",
      "Train epoch:11 iter: 910 end\n",
      "Train epoch:11 iter: 911 begin\n",
      "Train epoch:11 iter: 911 end\n",
      "Train epoch:11 iter: 912 begin\n",
      "Train epoch:11 iter: 912 end\n",
      "Train epoch:11 iter: 913 begin\n",
      "Train epoch:11 iter: 913 end\n",
      "Train epoch:11 iter: 914 begin\n",
      "Train epoch:11 iter: 914 end\n",
      "Train epoch:11 iter: 915 begin\n",
      "Train epoch:11 iter: 915 end\n",
      "Train epoch:11 iter: 916 begin\n",
      "Train epoch:11 iter: 916 end\n",
      "Train epoch:11 iter: 917 begin\n",
      "Train epoch:11 iter: 917 end\n",
      "Train epoch:11 iter: 918 begin\n",
      "Train epoch:11 iter: 918 end\n",
      "Train epoch:11 iter: 919 begin\n",
      "Train epoch:11 iter: 919 end\n",
      "Train epoch:11 iter: 920 begin\n",
      "Train epoch:11 iter: 920 end\n",
      "Train epoch:11 iter: 921 begin\n",
      "Train epoch:11 iter: 921 end\n",
      "Train epoch:11 iter: 922 begin\n",
      "Train epoch:11 iter: 922 end\n",
      "Train epoch:11 iter: 923 begin\n",
      "Train epoch:11 iter: 923 end\n",
      "Train epoch:11 iter: 924 begin\n",
      "Train epoch:11 iter: 924 end\n",
      "Train epoch:11 iter: 925 begin\n",
      "Train epoch:11 iter: 925 end\n",
      "Train epoch:11 iter: 926 begin\n",
      "Train epoch:11 iter: 926 end\n",
      "Train epoch:11 iter: 927 begin\n",
      "Train epoch:11 iter: 927 end\n",
      "Train epoch:11 iter: 928 begin\n",
      "Train epoch:11 iter: 928 end\n",
      "Train epoch:11 iter: 929 begin\n",
      "Train epoch:11 iter: 929 end\n",
      "Train epoch:11 iter: 930 begin\n",
      "Train epoch:11 iter: 930 end\n",
      "Train epoch:11 iter: 931 begin\n",
      "Train epoch:11 iter: 931 end\n",
      "Train epoch:11 iter: 932 begin\n",
      "Train epoch:11 iter: 932 end\n",
      "Train epoch:11 iter: 933 begin\n",
      "Train epoch:11 iter: 933 end\n",
      "Train epoch:11 iter: 934 begin\n",
      "Train epoch:11 iter: 934 end\n",
      "Train epoch:11 iter: 935 begin\n",
      "Train epoch:11 iter: 935 end\n",
      "Train epoch:11 iter: 936 begin\n",
      "Train epoch:11 iter: 936 end\n",
      "Train epoch:11 iter: 937 begin\n",
      "Train epoch:11 iter: 937 end\n",
      "Train epoch:11 iter: 938 begin\n",
      "Train epoch:11 iter: 938 end\n",
      "Train Loss: 0.001671, Acc: 0.960433\n",
      "save model for best accuate: 0.9604333333333334 begin\n",
      "save model for best accuate: 0.9604333333333334 end\n",
      "epoch 13\n",
      "Train epoch:12 iter: 1 begin\n",
      "Train epoch:12 iter: 1 end\n",
      "Train epoch:12 iter: 2 begin\n",
      "Train epoch:12 iter: 2 end\n",
      "Train epoch:12 iter: 3 begin\n",
      "Train epoch:12 iter: 3 end\n",
      "Train epoch:12 iter: 4 begin\n",
      "Train epoch:12 iter: 4 end\n",
      "Train epoch:12 iter: 5 begin\n",
      "Train epoch:12 iter: 5 end\n",
      "Train epoch:12 iter: 6 begin\n",
      "Train epoch:12 iter: 6 end\n",
      "Train epoch:12 iter: 7 begin\n",
      "Train epoch:12 iter: 7 end\n",
      "Train epoch:12 iter: 8 begin\n",
      "Train epoch:12 iter: 8 end\n",
      "Train epoch:12 iter: 9 begin\n",
      "Train epoch:12 iter: 9 end\n",
      "Train epoch:12 iter: 10 begin\n",
      "Train epoch:12 iter: 10 end\n",
      "Train epoch:12 iter: 11 begin\n",
      "Train epoch:12 iter: 11 end\n",
      "Train epoch:12 iter: 12 begin\n",
      "Train epoch:12 iter: 12 end\n",
      "Train epoch:12 iter: 13 begin\n",
      "Train epoch:12 iter: 13 end\n",
      "Train epoch:12 iter: 14 begin\n",
      "Train epoch:12 iter: 14 end\n",
      "Train epoch:12 iter: 15 begin\n",
      "Train epoch:12 iter: 15 end\n",
      "Train epoch:12 iter: 16 begin\n",
      "Train epoch:12 iter: 16 end\n",
      "Train epoch:12 iter: 17 begin\n",
      "Train epoch:12 iter: 17 end\n",
      "Train epoch:12 iter: 18 begin\n",
      "Train epoch:12 iter: 18 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:12 iter: 19 begin\n",
      "Train epoch:12 iter: 19 end\n",
      "Train epoch:12 iter: 20 begin\n",
      "Train epoch:12 iter: 20 end\n",
      "Train epoch:12 iter: 21 begin\n",
      "Train epoch:12 iter: 21 end\n",
      "Train epoch:12 iter: 22 begin\n",
      "Train epoch:12 iter: 22 end\n",
      "Train epoch:12 iter: 23 begin\n",
      "Train epoch:12 iter: 23 end\n",
      "Train epoch:12 iter: 24 begin\n",
      "Train epoch:12 iter: 24 end\n",
      "Train epoch:12 iter: 25 begin\n",
      "Train epoch:12 iter: 25 end\n",
      "Train epoch:12 iter: 26 begin\n",
      "Train epoch:12 iter: 26 end\n",
      "Train epoch:12 iter: 27 begin\n",
      "Train epoch:12 iter: 27 end\n",
      "Train epoch:12 iter: 28 begin\n",
      "Train epoch:12 iter: 28 end\n",
      "Train epoch:12 iter: 29 begin\n",
      "Train epoch:12 iter: 29 end\n",
      "Train epoch:12 iter: 30 begin\n",
      "Train epoch:12 iter: 30 end\n",
      "Train epoch:12 iter: 31 begin\n",
      "Train epoch:12 iter: 31 end\n",
      "Train epoch:12 iter: 32 begin\n",
      "Train epoch:12 iter: 32 end\n",
      "Train epoch:12 iter: 33 begin\n",
      "Train epoch:12 iter: 33 end\n",
      "Train epoch:12 iter: 34 begin\n",
      "Train epoch:12 iter: 34 end\n",
      "Train epoch:12 iter: 35 begin\n",
      "Train epoch:12 iter: 35 end\n",
      "Train epoch:12 iter: 36 begin\n",
      "Train epoch:12 iter: 36 end\n",
      "Train epoch:12 iter: 37 begin\n",
      "Train epoch:12 iter: 37 end\n",
      "Train epoch:12 iter: 38 begin\n",
      "Train epoch:12 iter: 38 end\n",
      "Train epoch:12 iter: 39 begin\n",
      "Train epoch:12 iter: 39 end\n",
      "Train epoch:12 iter: 40 begin\n",
      "Train epoch:12 iter: 40 end\n",
      "Train epoch:12 iter: 41 begin\n",
      "Train epoch:12 iter: 41 end\n",
      "Train epoch:12 iter: 42 begin\n",
      "Train epoch:12 iter: 42 end\n",
      "Train epoch:12 iter: 43 begin\n",
      "Train epoch:12 iter: 43 end\n",
      "Train epoch:12 iter: 44 begin\n",
      "Train epoch:12 iter: 44 end\n",
      "Train epoch:12 iter: 45 begin\n",
      "Train epoch:12 iter: 45 end\n",
      "Train epoch:12 iter: 46 begin\n",
      "Train epoch:12 iter: 46 end\n",
      "Train epoch:12 iter: 47 begin\n",
      "Train epoch:12 iter: 47 end\n",
      "Train epoch:12 iter: 48 begin\n",
      "Train epoch:12 iter: 48 end\n",
      "Train epoch:12 iter: 49 begin\n",
      "Train epoch:12 iter: 49 end\n",
      "Train epoch:12 iter: 50 begin\n",
      "Train epoch:12 iter: 50 end\n",
      "Train epoch:12 iter: 51 begin\n",
      "Train epoch:12 iter: 51 end\n",
      "Train epoch:12 iter: 52 begin\n",
      "Train epoch:12 iter: 52 end\n",
      "Train epoch:12 iter: 53 begin\n",
      "Train epoch:12 iter: 53 end\n",
      "Train epoch:12 iter: 54 begin\n",
      "Train epoch:12 iter: 54 end\n",
      "Train epoch:12 iter: 55 begin\n",
      "Train epoch:12 iter: 55 end\n",
      "Train epoch:12 iter: 56 begin\n",
      "Train epoch:12 iter: 56 end\n",
      "Train epoch:12 iter: 57 begin\n",
      "Train epoch:12 iter: 57 end\n",
      "Train epoch:12 iter: 58 begin\n",
      "Train epoch:12 iter: 58 end\n",
      "Train epoch:12 iter: 59 begin\n",
      "Train epoch:12 iter: 59 end\n",
      "Train epoch:12 iter: 60 begin\n",
      "Train epoch:12 iter: 60 end\n",
      "Train epoch:12 iter: 61 begin\n",
      "Train epoch:12 iter: 61 end\n",
      "Train epoch:12 iter: 62 begin\n",
      "Train epoch:12 iter: 62 end\n",
      "Train epoch:12 iter: 63 begin\n",
      "Train epoch:12 iter: 63 end\n",
      "Train epoch:12 iter: 64 begin\n",
      "Train epoch:12 iter: 64 end\n",
      "Train epoch:12 iter: 65 begin\n",
      "Train epoch:12 iter: 65 end\n",
      "Train epoch:12 iter: 66 begin\n",
      "Train epoch:12 iter: 66 end\n",
      "Train epoch:12 iter: 67 begin\n",
      "Train epoch:12 iter: 67 end\n",
      "Train epoch:12 iter: 68 begin\n",
      "Train epoch:12 iter: 68 end\n",
      "Train epoch:12 iter: 69 begin\n",
      "Train epoch:12 iter: 69 end\n",
      "Train epoch:12 iter: 70 begin\n",
      "Train epoch:12 iter: 70 end\n",
      "Train epoch:12 iter: 71 begin\n",
      "Train epoch:12 iter: 71 end\n",
      "Train epoch:12 iter: 72 begin\n",
      "Train epoch:12 iter: 72 end\n",
      "Train epoch:12 iter: 73 begin\n",
      "Train epoch:12 iter: 73 end\n",
      "Train epoch:12 iter: 74 begin\n",
      "Train epoch:12 iter: 74 end\n",
      "Train epoch:12 iter: 75 begin\n",
      "Train epoch:12 iter: 75 end\n",
      "Train epoch:12 iter: 76 begin\n",
      "Train epoch:12 iter: 76 end\n",
      "Train epoch:12 iter: 77 begin\n",
      "Train epoch:12 iter: 77 end\n",
      "Train epoch:12 iter: 78 begin\n",
      "Train epoch:12 iter: 78 end\n",
      "Train epoch:12 iter: 79 begin\n",
      "Train epoch:12 iter: 79 end\n",
      "Train epoch:12 iter: 80 begin\n",
      "Train epoch:12 iter: 80 end\n",
      "Train epoch:12 iter: 81 begin\n",
      "Train epoch:12 iter: 81 end\n",
      "Train epoch:12 iter: 82 begin\n",
      "Train epoch:12 iter: 82 end\n",
      "Train epoch:12 iter: 83 begin\n",
      "Train epoch:12 iter: 83 end\n",
      "Train epoch:12 iter: 84 begin\n",
      "Train epoch:12 iter: 84 end\n",
      "Train epoch:12 iter: 85 begin\n",
      "Train epoch:12 iter: 85 end\n",
      "Train epoch:12 iter: 86 begin\n",
      "Train epoch:12 iter: 86 end\n",
      "Train epoch:12 iter: 87 begin\n",
      "Train epoch:12 iter: 87 end\n",
      "Train epoch:12 iter: 88 begin\n",
      "Train epoch:12 iter: 88 end\n",
      "Train epoch:12 iter: 89 begin\n",
      "Train epoch:12 iter: 89 end\n",
      "Train epoch:12 iter: 90 begin\n",
      "Train epoch:12 iter: 90 end\n",
      "Train epoch:12 iter: 91 begin\n",
      "Train epoch:12 iter: 91 end\n",
      "Train epoch:12 iter: 92 begin\n",
      "Train epoch:12 iter: 92 end\n",
      "Train epoch:12 iter: 93 begin\n",
      "Train epoch:12 iter: 93 end\n",
      "Train epoch:12 iter: 94 begin\n",
      "Train epoch:12 iter: 94 end\n",
      "Train epoch:12 iter: 95 begin\n",
      "Train epoch:12 iter: 95 end\n",
      "Train epoch:12 iter: 96 begin\n",
      "Train epoch:12 iter: 96 end\n",
      "Train epoch:12 iter: 97 begin\n",
      "Train epoch:12 iter: 97 end\n",
      "Train epoch:12 iter: 98 begin\n",
      "Train epoch:12 iter: 98 end\n",
      "Train epoch:12 iter: 99 begin\n",
      "Train epoch:12 iter: 99 end\n",
      "Train epoch:12 iter: 100 begin\n",
      "Train epoch:12 iter: 100 end\n",
      "Train epoch:12 iter: 101 begin\n",
      "Train epoch:12 iter: 101 end\n",
      "Train epoch:12 iter: 102 begin\n",
      "Train epoch:12 iter: 102 end\n",
      "Train epoch:12 iter: 103 begin\n",
      "Train epoch:12 iter: 103 end\n",
      "Train epoch:12 iter: 104 begin\n",
      "Train epoch:12 iter: 104 end\n",
      "Train epoch:12 iter: 105 begin\n",
      "Train epoch:12 iter: 105 end\n",
      "Train epoch:12 iter: 106 begin\n",
      "Train epoch:12 iter: 106 end\n",
      "Train epoch:12 iter: 107 begin\n",
      "Train epoch:12 iter: 107 end\n",
      "Train epoch:12 iter: 108 begin\n",
      "Train epoch:12 iter: 108 end\n",
      "Train epoch:12 iter: 109 begin\n",
      "Train epoch:12 iter: 109 end\n",
      "Train epoch:12 iter: 110 begin\n",
      "Train epoch:12 iter: 110 end\n",
      "Train epoch:12 iter: 111 begin\n",
      "Train epoch:12 iter: 111 end\n",
      "Train epoch:12 iter: 112 begin\n",
      "Train epoch:12 iter: 112 end\n",
      "Train epoch:12 iter: 113 begin\n",
      "Train epoch:12 iter: 113 end\n",
      "Train epoch:12 iter: 114 begin\n",
      "Train epoch:12 iter: 114 end\n",
      "Train epoch:12 iter: 115 begin\n",
      "Train epoch:12 iter: 115 end\n",
      "Train epoch:12 iter: 116 begin\n",
      "Train epoch:12 iter: 116 end\n",
      "Train epoch:12 iter: 117 begin\n",
      "Train epoch:12 iter: 117 end\n",
      "Train epoch:12 iter: 118 begin\n",
      "Train epoch:12 iter: 118 end\n",
      "Train epoch:12 iter: 119 begin\n",
      "Train epoch:12 iter: 119 end\n",
      "Train epoch:12 iter: 120 begin\n",
      "Train epoch:12 iter: 120 end\n",
      "Train epoch:12 iter: 121 begin\n",
      "Train epoch:12 iter: 121 end\n",
      "Train epoch:12 iter: 122 begin\n",
      "Train epoch:12 iter: 122 end\n",
      "Train epoch:12 iter: 123 begin\n",
      "Train epoch:12 iter: 123 end\n",
      "Train epoch:12 iter: 124 begin\n",
      "Train epoch:12 iter: 124 end\n",
      "Train epoch:12 iter: 125 begin\n",
      "Train epoch:12 iter: 125 end\n",
      "Train epoch:12 iter: 126 begin\n",
      "Train epoch:12 iter: 126 end\n",
      "Train epoch:12 iter: 127 begin\n",
      "Train epoch:12 iter: 127 end\n",
      "Train epoch:12 iter: 128 begin\n",
      "Train epoch:12 iter: 128 end\n",
      "Train epoch:12 iter: 129 begin\n",
      "Train epoch:12 iter: 129 end\n",
      "Train epoch:12 iter: 130 begin\n",
      "Train epoch:12 iter: 130 end\n",
      "Train epoch:12 iter: 131 begin\n",
      "Train epoch:12 iter: 131 end\n",
      "Train epoch:12 iter: 132 begin\n",
      "Train epoch:12 iter: 132 end\n",
      "Train epoch:12 iter: 133 begin\n",
      "Train epoch:12 iter: 133 end\n",
      "Train epoch:12 iter: 134 begin\n",
      "Train epoch:12 iter: 134 end\n",
      "Train epoch:12 iter: 135 begin\n",
      "Train epoch:12 iter: 135 end\n",
      "Train epoch:12 iter: 136 begin\n",
      "Train epoch:12 iter: 136 end\n",
      "Train epoch:12 iter: 137 begin\n",
      "Train epoch:12 iter: 137 end\n",
      "Train epoch:12 iter: 138 begin\n",
      "Train epoch:12 iter: 138 end\n",
      "Train epoch:12 iter: 139 begin\n",
      "Train epoch:12 iter: 139 end\n",
      "Train epoch:12 iter: 140 begin\n",
      "Train epoch:12 iter: 140 end\n",
      "Train epoch:12 iter: 141 begin\n",
      "Train epoch:12 iter: 141 end\n",
      "Train epoch:12 iter: 142 begin\n",
      "Train epoch:12 iter: 142 end\n",
      "Train epoch:12 iter: 143 begin\n",
      "Train epoch:12 iter: 143 end\n",
      "Train epoch:12 iter: 144 begin\n",
      "Train epoch:12 iter: 144 end\n",
      "Train epoch:12 iter: 145 begin\n",
      "Train epoch:12 iter: 145 end\n",
      "Train epoch:12 iter: 146 begin\n",
      "Train epoch:12 iter: 146 end\n",
      "Train epoch:12 iter: 147 begin\n",
      "Train epoch:12 iter: 147 end\n",
      "Train epoch:12 iter: 148 begin\n",
      "Train epoch:12 iter: 148 end\n",
      "Train epoch:12 iter: 149 begin\n",
      "Train epoch:12 iter: 149 end\n",
      "Train epoch:12 iter: 150 begin\n",
      "Train epoch:12 iter: 150 end\n",
      "Train epoch:12 iter: 151 begin\n",
      "Train epoch:12 iter: 151 end\n",
      "Train epoch:12 iter: 152 begin\n",
      "Train epoch:12 iter: 152 end\n",
      "Train epoch:12 iter: 153 begin\n",
      "Train epoch:12 iter: 153 end\n",
      "Train epoch:12 iter: 154 begin\n",
      "Train epoch:12 iter: 154 end\n",
      "Train epoch:12 iter: 155 begin\n",
      "Train epoch:12 iter: 155 end\n",
      "Train epoch:12 iter: 156 begin\n",
      "Train epoch:12 iter: 156 end\n",
      "Train epoch:12 iter: 157 begin\n",
      "Train epoch:12 iter: 157 end\n",
      "Train epoch:12 iter: 158 begin\n",
      "Train epoch:12 iter: 158 end\n",
      "Train epoch:12 iter: 159 begin\n",
      "Train epoch:12 iter: 159 end\n",
      "Train epoch:12 iter: 160 begin\n",
      "Train epoch:12 iter: 160 end\n",
      "Train epoch:12 iter: 161 begin\n",
      "Train epoch:12 iter: 161 end\n",
      "Train epoch:12 iter: 162 begin\n",
      "Train epoch:12 iter: 162 end\n",
      "Train epoch:12 iter: 163 begin\n",
      "Train epoch:12 iter: 163 end\n",
      "Train epoch:12 iter: 164 begin\n",
      "Train epoch:12 iter: 164 end\n",
      "Train epoch:12 iter: 165 begin\n",
      "Train epoch:12 iter: 165 end\n",
      "Train epoch:12 iter: 166 begin\n",
      "Train epoch:12 iter: 166 end\n",
      "Train epoch:12 iter: 167 begin\n",
      "Train epoch:12 iter: 167 end\n",
      "Train epoch:12 iter: 168 begin\n",
      "Train epoch:12 iter: 168 end\n",
      "Train epoch:12 iter: 169 begin\n",
      "Train epoch:12 iter: 169 end\n",
      "Train epoch:12 iter: 170 begin\n",
      "Train epoch:12 iter: 170 end\n",
      "Train epoch:12 iter: 171 begin\n",
      "Train epoch:12 iter: 171 end\n",
      "Train epoch:12 iter: 172 begin\n",
      "Train epoch:12 iter: 172 end\n",
      "Train epoch:12 iter: 173 begin\n",
      "Train epoch:12 iter: 173 end\n",
      "Train epoch:12 iter: 174 begin\n",
      "Train epoch:12 iter: 174 end\n",
      "Train epoch:12 iter: 175 begin\n",
      "Train epoch:12 iter: 175 end\n",
      "Train epoch:12 iter: 176 begin\n",
      "Train epoch:12 iter: 176 end\n",
      "Train epoch:12 iter: 177 begin\n",
      "Train epoch:12 iter: 177 end\n",
      "Train epoch:12 iter: 178 begin\n",
      "Train epoch:12 iter: 178 end\n",
      "Train epoch:12 iter: 179 begin\n",
      "Train epoch:12 iter: 179 end\n",
      "Train epoch:12 iter: 180 begin\n",
      "Train epoch:12 iter: 180 end\n",
      "Train epoch:12 iter: 181 begin\n",
      "Train epoch:12 iter: 181 end\n",
      "Train epoch:12 iter: 182 begin\n",
      "Train epoch:12 iter: 182 end\n",
      "Train epoch:12 iter: 183 begin\n",
      "Train epoch:12 iter: 183 end\n",
      "Train epoch:12 iter: 184 begin\n",
      "Train epoch:12 iter: 184 end\n",
      "Train epoch:12 iter: 185 begin\n",
      "Train epoch:12 iter: 185 end\n",
      "Train epoch:12 iter: 186 begin\n",
      "Train epoch:12 iter: 186 end\n",
      "Train epoch:12 iter: 187 begin\n",
      "Train epoch:12 iter: 187 end\n",
      "Train epoch:12 iter: 188 begin\n",
      "Train epoch:12 iter: 188 end\n",
      "Train epoch:12 iter: 189 begin\n",
      "Train epoch:12 iter: 189 end\n",
      "Train epoch:12 iter: 190 begin\n",
      "Train epoch:12 iter: 190 end\n",
      "Train epoch:12 iter: 191 begin\n",
      "Train epoch:12 iter: 191 end\n",
      "Train epoch:12 iter: 192 begin\n",
      "Train epoch:12 iter: 192 end\n",
      "Train epoch:12 iter: 193 begin\n",
      "Train epoch:12 iter: 193 end\n",
      "Train epoch:12 iter: 194 begin\n",
      "Train epoch:12 iter: 194 end\n",
      "Train epoch:12 iter: 195 begin\n",
      "Train epoch:12 iter: 195 end\n",
      "Train epoch:12 iter: 196 begin\n",
      "Train epoch:12 iter: 196 end\n",
      "Train epoch:12 iter: 197 begin\n",
      "Train epoch:12 iter: 197 end\n",
      "Train epoch:12 iter: 198 begin\n",
      "Train epoch:12 iter: 198 end\n",
      "Train epoch:12 iter: 199 begin\n",
      "Train epoch:12 iter: 199 end\n",
      "Train epoch:12 iter: 200 begin\n",
      "Train epoch:12 iter: 200 end\n",
      "Train epoch:12 iter: 201 begin\n",
      "Train epoch:12 iter: 201 end\n",
      "Train epoch:12 iter: 202 begin\n",
      "Train epoch:12 iter: 202 end\n",
      "Train epoch:12 iter: 203 begin\n",
      "Train epoch:12 iter: 203 end\n",
      "Train epoch:12 iter: 204 begin\n",
      "Train epoch:12 iter: 204 end\n",
      "Train epoch:12 iter: 205 begin\n",
      "Train epoch:12 iter: 205 end\n",
      "Train epoch:12 iter: 206 begin\n",
      "Train epoch:12 iter: 206 end\n",
      "Train epoch:12 iter: 207 begin\n",
      "Train epoch:12 iter: 207 end\n",
      "Train epoch:12 iter: 208 begin\n",
      "Train epoch:12 iter: 208 end\n",
      "Train epoch:12 iter: 209 begin\n",
      "Train epoch:12 iter: 209 end\n",
      "Train epoch:12 iter: 210 begin\n",
      "Train epoch:12 iter: 210 end\n",
      "Train epoch:12 iter: 211 begin\n",
      "Train epoch:12 iter: 211 end\n",
      "Train epoch:12 iter: 212 begin\n",
      "Train epoch:12 iter: 212 end\n",
      "Train epoch:12 iter: 213 begin\n",
      "Train epoch:12 iter: 213 end\n",
      "Train epoch:12 iter: 214 begin\n",
      "Train epoch:12 iter: 214 end\n",
      "Train epoch:12 iter: 215 begin\n",
      "Train epoch:12 iter: 215 end\n",
      "Train epoch:12 iter: 216 begin\n",
      "Train epoch:12 iter: 216 end\n",
      "Train epoch:12 iter: 217 begin\n",
      "Train epoch:12 iter: 217 end\n",
      "Train epoch:12 iter: 218 begin\n",
      "Train epoch:12 iter: 218 end\n",
      "Train epoch:12 iter: 219 begin\n",
      "Train epoch:12 iter: 219 end\n",
      "Train epoch:12 iter: 220 begin\n",
      "Train epoch:12 iter: 220 end\n",
      "Train epoch:12 iter: 221 begin\n",
      "Train epoch:12 iter: 221 end\n",
      "Train epoch:12 iter: 222 begin\n",
      "Train epoch:12 iter: 222 end\n",
      "Train epoch:12 iter: 223 begin\n",
      "Train epoch:12 iter: 223 end\n",
      "Train epoch:12 iter: 224 begin\n",
      "Train epoch:12 iter: 224 end\n",
      "Train epoch:12 iter: 225 begin\n",
      "Train epoch:12 iter: 225 end\n",
      "Train epoch:12 iter: 226 begin\n",
      "Train epoch:12 iter: 226 end\n",
      "Train epoch:12 iter: 227 begin\n",
      "Train epoch:12 iter: 227 end\n",
      "Train epoch:12 iter: 228 begin\n",
      "Train epoch:12 iter: 228 end\n",
      "Train epoch:12 iter: 229 begin\n",
      "Train epoch:12 iter: 229 end\n",
      "Train epoch:12 iter: 230 begin\n",
      "Train epoch:12 iter: 230 end\n",
      "Train epoch:12 iter: 231 begin\n",
      "Train epoch:12 iter: 231 end\n",
      "Train epoch:12 iter: 232 begin\n",
      "Train epoch:12 iter: 232 end\n",
      "Train epoch:12 iter: 233 begin\n",
      "Train epoch:12 iter: 233 end\n",
      "Train epoch:12 iter: 234 begin\n",
      "Train epoch:12 iter: 234 end\n",
      "Train epoch:12 iter: 235 begin\n",
      "Train epoch:12 iter: 235 end\n",
      "Train epoch:12 iter: 236 begin\n",
      "Train epoch:12 iter: 236 end\n",
      "Train epoch:12 iter: 237 begin\n",
      "Train epoch:12 iter: 237 end\n",
      "Train epoch:12 iter: 238 begin\n",
      "Train epoch:12 iter: 238 end\n",
      "Train epoch:12 iter: 239 begin\n",
      "Train epoch:12 iter: 239 end\n",
      "Train epoch:12 iter: 240 begin\n",
      "Train epoch:12 iter: 240 end\n",
      "Train epoch:12 iter: 241 begin\n",
      "Train epoch:12 iter: 241 end\n",
      "Train epoch:12 iter: 242 begin\n",
      "Train epoch:12 iter: 242 end\n",
      "Train epoch:12 iter: 243 begin\n",
      "Train epoch:12 iter: 243 end\n",
      "Train epoch:12 iter: 244 begin\n",
      "Train epoch:12 iter: 244 end\n",
      "Train epoch:12 iter: 245 begin\n",
      "Train epoch:12 iter: 245 end\n",
      "Train epoch:12 iter: 246 begin\n",
      "Train epoch:12 iter: 246 end\n",
      "Train epoch:12 iter: 247 begin\n",
      "Train epoch:12 iter: 247 end\n",
      "Train epoch:12 iter: 248 begin\n",
      "Train epoch:12 iter: 248 end\n",
      "Train epoch:12 iter: 249 begin\n",
      "Train epoch:12 iter: 249 end\n",
      "Train epoch:12 iter: 250 begin\n",
      "Train epoch:12 iter: 250 end\n",
      "Train epoch:12 iter: 251 begin\n",
      "Train epoch:12 iter: 251 end\n",
      "Train epoch:12 iter: 252 begin\n",
      "Train epoch:12 iter: 252 end\n",
      "Train epoch:12 iter: 253 begin\n",
      "Train epoch:12 iter: 253 end\n",
      "Train epoch:12 iter: 254 begin\n",
      "Train epoch:12 iter: 254 end\n",
      "Train epoch:12 iter: 255 begin\n",
      "Train epoch:12 iter: 255 end\n",
      "Train epoch:12 iter: 256 begin\n",
      "Train epoch:12 iter: 256 end\n",
      "Train epoch:12 iter: 257 begin\n",
      "Train epoch:12 iter: 257 end\n",
      "Train epoch:12 iter: 258 begin\n",
      "Train epoch:12 iter: 258 end\n",
      "Train epoch:12 iter: 259 begin\n",
      "Train epoch:12 iter: 259 end\n",
      "Train epoch:12 iter: 260 begin\n",
      "Train epoch:12 iter: 260 end\n",
      "Train epoch:12 iter: 261 begin\n",
      "Train epoch:12 iter: 261 end\n",
      "Train epoch:12 iter: 262 begin\n",
      "Train epoch:12 iter: 262 end\n",
      "Train epoch:12 iter: 263 begin\n",
      "Train epoch:12 iter: 263 end\n",
      "Train epoch:12 iter: 264 begin\n",
      "Train epoch:12 iter: 264 end\n",
      "Train epoch:12 iter: 265 begin\n",
      "Train epoch:12 iter: 265 end\n",
      "Train epoch:12 iter: 266 begin\n",
      "Train epoch:12 iter: 266 end\n",
      "Train epoch:12 iter: 267 begin\n",
      "Train epoch:12 iter: 267 end\n",
      "Train epoch:12 iter: 268 begin\n",
      "Train epoch:12 iter: 268 end\n",
      "Train epoch:12 iter: 269 begin\n",
      "Train epoch:12 iter: 269 end\n",
      "Train epoch:12 iter: 270 begin\n",
      "Train epoch:12 iter: 270 end\n",
      "Train epoch:12 iter: 271 begin\n",
      "Train epoch:12 iter: 271 end\n",
      "Train epoch:12 iter: 272 begin\n",
      "Train epoch:12 iter: 272 end\n",
      "Train epoch:12 iter: 273 begin\n",
      "Train epoch:12 iter: 273 end\n",
      "Train epoch:12 iter: 274 begin\n",
      "Train epoch:12 iter: 274 end\n",
      "Train epoch:12 iter: 275 begin\n",
      "Train epoch:12 iter: 275 end\n",
      "Train epoch:12 iter: 276 begin\n",
      "Train epoch:12 iter: 276 end\n",
      "Train epoch:12 iter: 277 begin\n",
      "Train epoch:12 iter: 277 end\n",
      "Train epoch:12 iter: 278 begin\n",
      "Train epoch:12 iter: 278 end\n",
      "Train epoch:12 iter: 279 begin\n",
      "Train epoch:12 iter: 279 end\n",
      "Train epoch:12 iter: 280 begin\n",
      "Train epoch:12 iter: 280 end\n",
      "Train epoch:12 iter: 281 begin\n",
      "Train epoch:12 iter: 281 end\n",
      "Train epoch:12 iter: 282 begin\n",
      "Train epoch:12 iter: 282 end\n",
      "Train epoch:12 iter: 283 begin\n",
      "Train epoch:12 iter: 283 end\n",
      "Train epoch:12 iter: 284 begin\n",
      "Train epoch:12 iter: 284 end\n",
      "Train epoch:12 iter: 285 begin\n",
      "Train epoch:12 iter: 285 end\n",
      "Train epoch:12 iter: 286 begin\n",
      "Train epoch:12 iter: 286 end\n",
      "Train epoch:12 iter: 287 begin\n",
      "Train epoch:12 iter: 287 end\n",
      "Train epoch:12 iter: 288 begin\n",
      "Train epoch:12 iter: 288 end\n",
      "Train epoch:12 iter: 289 begin\n",
      "Train epoch:12 iter: 289 end\n",
      "Train epoch:12 iter: 290 begin\n",
      "Train epoch:12 iter: 290 end\n",
      "Train epoch:12 iter: 291 begin\n",
      "Train epoch:12 iter: 291 end\n",
      "Train epoch:12 iter: 292 begin\n",
      "Train epoch:12 iter: 292 end\n",
      "Train epoch:12 iter: 293 begin\n",
      "Train epoch:12 iter: 293 end\n",
      "Train epoch:12 iter: 294 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:12 iter: 294 end\n",
      "Train epoch:12 iter: 295 begin\n",
      "Train epoch:12 iter: 295 end\n",
      "Train epoch:12 iter: 296 begin\n",
      "Train epoch:12 iter: 296 end\n",
      "Train epoch:12 iter: 297 begin\n",
      "Train epoch:12 iter: 297 end\n",
      "Train epoch:12 iter: 298 begin\n",
      "Train epoch:12 iter: 298 end\n",
      "Train epoch:12 iter: 299 begin\n",
      "Train epoch:12 iter: 299 end\n",
      "Train epoch:12 iter: 300 begin\n",
      "Train epoch:12 iter: 300 end\n",
      "Train epoch:12 iter: 301 begin\n",
      "Train epoch:12 iter: 301 end\n",
      "Train epoch:12 iter: 302 begin\n",
      "Train epoch:12 iter: 302 end\n",
      "Train epoch:12 iter: 303 begin\n",
      "Train epoch:12 iter: 303 end\n",
      "Train epoch:12 iter: 304 begin\n",
      "Train epoch:12 iter: 304 end\n",
      "Train epoch:12 iter: 305 begin\n",
      "Train epoch:12 iter: 305 end\n",
      "Train epoch:12 iter: 306 begin\n",
      "Train epoch:12 iter: 306 end\n",
      "Train epoch:12 iter: 307 begin\n",
      "Train epoch:12 iter: 307 end\n",
      "Train epoch:12 iter: 308 begin\n",
      "Train epoch:12 iter: 308 end\n",
      "Train epoch:12 iter: 309 begin\n",
      "Train epoch:12 iter: 309 end\n",
      "Train epoch:12 iter: 310 begin\n",
      "Train epoch:12 iter: 310 end\n",
      "Train epoch:12 iter: 311 begin\n",
      "Train epoch:12 iter: 311 end\n",
      "Train epoch:12 iter: 312 begin\n",
      "Train epoch:12 iter: 312 end\n",
      "Train epoch:12 iter: 313 begin\n",
      "Train epoch:12 iter: 313 end\n",
      "Train epoch:12 iter: 314 begin\n",
      "Train epoch:12 iter: 314 end\n",
      "Train epoch:12 iter: 315 begin\n",
      "Train epoch:12 iter: 315 end\n",
      "Train epoch:12 iter: 316 begin\n",
      "Train epoch:12 iter: 316 end\n",
      "Train epoch:12 iter: 317 begin\n",
      "Train epoch:12 iter: 317 end\n",
      "Train epoch:12 iter: 318 begin\n",
      "Train epoch:12 iter: 318 end\n",
      "Train epoch:12 iter: 319 begin\n",
      "Train epoch:12 iter: 319 end\n",
      "Train epoch:12 iter: 320 begin\n",
      "Train epoch:12 iter: 320 end\n",
      "Train epoch:12 iter: 321 begin\n",
      "Train epoch:12 iter: 321 end\n",
      "Train epoch:12 iter: 322 begin\n",
      "Train epoch:12 iter: 322 end\n",
      "Train epoch:12 iter: 323 begin\n",
      "Train epoch:12 iter: 323 end\n",
      "Train epoch:12 iter: 324 begin\n",
      "Train epoch:12 iter: 324 end\n",
      "Train epoch:12 iter: 325 begin\n",
      "Train epoch:12 iter: 325 end\n",
      "Train epoch:12 iter: 326 begin\n",
      "Train epoch:12 iter: 326 end\n",
      "Train epoch:12 iter: 327 begin\n",
      "Train epoch:12 iter: 327 end\n",
      "Train epoch:12 iter: 328 begin\n",
      "Train epoch:12 iter: 328 end\n",
      "Train epoch:12 iter: 329 begin\n",
      "Train epoch:12 iter: 329 end\n",
      "Train epoch:12 iter: 330 begin\n",
      "Train epoch:12 iter: 330 end\n",
      "Train epoch:12 iter: 331 begin\n",
      "Train epoch:12 iter: 331 end\n",
      "Train epoch:12 iter: 332 begin\n",
      "Train epoch:12 iter: 332 end\n",
      "Train epoch:12 iter: 333 begin\n",
      "Train epoch:12 iter: 333 end\n",
      "Train epoch:12 iter: 334 begin\n",
      "Train epoch:12 iter: 334 end\n",
      "Train epoch:12 iter: 335 begin\n",
      "Train epoch:12 iter: 335 end\n",
      "Train epoch:12 iter: 336 begin\n",
      "Train epoch:12 iter: 336 end\n",
      "Train epoch:12 iter: 337 begin\n",
      "Train epoch:12 iter: 337 end\n",
      "Train epoch:12 iter: 338 begin\n",
      "Train epoch:12 iter: 338 end\n",
      "Train epoch:12 iter: 339 begin\n",
      "Train epoch:12 iter: 339 end\n",
      "Train epoch:12 iter: 340 begin\n",
      "Train epoch:12 iter: 340 end\n",
      "Train epoch:12 iter: 341 begin\n",
      "Train epoch:12 iter: 341 end\n",
      "Train epoch:12 iter: 342 begin\n",
      "Train epoch:12 iter: 342 end\n",
      "Train epoch:12 iter: 343 begin\n",
      "Train epoch:12 iter: 343 end\n",
      "Train epoch:12 iter: 344 begin\n",
      "Train epoch:12 iter: 344 end\n",
      "Train epoch:12 iter: 345 begin\n",
      "Train epoch:12 iter: 345 end\n",
      "Train epoch:12 iter: 346 begin\n",
      "Train epoch:12 iter: 346 end\n",
      "Train epoch:12 iter: 347 begin\n",
      "Train epoch:12 iter: 347 end\n",
      "Train epoch:12 iter: 348 begin\n",
      "Train epoch:12 iter: 348 end\n",
      "Train epoch:12 iter: 349 begin\n",
      "Train epoch:12 iter: 349 end\n",
      "Train epoch:12 iter: 350 begin\n",
      "Train epoch:12 iter: 350 end\n",
      "Train epoch:12 iter: 351 begin\n",
      "Train epoch:12 iter: 351 end\n",
      "Train epoch:12 iter: 352 begin\n",
      "Train epoch:12 iter: 352 end\n",
      "Train epoch:12 iter: 353 begin\n",
      "Train epoch:12 iter: 353 end\n",
      "Train epoch:12 iter: 354 begin\n",
      "Train epoch:12 iter: 354 end\n",
      "Train epoch:12 iter: 355 begin\n",
      "Train epoch:12 iter: 355 end\n",
      "Train epoch:12 iter: 356 begin\n",
      "Train epoch:12 iter: 356 end\n",
      "Train epoch:12 iter: 357 begin\n",
      "Train epoch:12 iter: 357 end\n",
      "Train epoch:12 iter: 358 begin\n",
      "Train epoch:12 iter: 358 end\n",
      "Train epoch:12 iter: 359 begin\n",
      "Train epoch:12 iter: 359 end\n",
      "Train epoch:12 iter: 360 begin\n",
      "Train epoch:12 iter: 360 end\n",
      "Train epoch:12 iter: 361 begin\n",
      "Train epoch:12 iter: 361 end\n",
      "Train epoch:12 iter: 362 begin\n",
      "Train epoch:12 iter: 362 end\n",
      "Train epoch:12 iter: 363 begin\n",
      "Train epoch:12 iter: 363 end\n",
      "Train epoch:12 iter: 364 begin\n",
      "Train epoch:12 iter: 364 end\n",
      "Train epoch:12 iter: 365 begin\n",
      "Train epoch:12 iter: 365 end\n",
      "Train epoch:12 iter: 366 begin\n",
      "Train epoch:12 iter: 366 end\n",
      "Train epoch:12 iter: 367 begin\n",
      "Train epoch:12 iter: 367 end\n",
      "Train epoch:12 iter: 368 begin\n",
      "Train epoch:12 iter: 368 end\n",
      "Train epoch:12 iter: 369 begin\n",
      "Train epoch:12 iter: 369 end\n",
      "Train epoch:12 iter: 370 begin\n",
      "Train epoch:12 iter: 370 end\n",
      "Train epoch:12 iter: 371 begin\n",
      "Train epoch:12 iter: 371 end\n",
      "Train epoch:12 iter: 372 begin\n",
      "Train epoch:12 iter: 372 end\n",
      "Train epoch:12 iter: 373 begin\n",
      "Train epoch:12 iter: 373 end\n",
      "Train epoch:12 iter: 374 begin\n",
      "Train epoch:12 iter: 374 end\n",
      "Train epoch:12 iter: 375 begin\n",
      "Train epoch:12 iter: 375 end\n",
      "Train epoch:12 iter: 376 begin\n",
      "Train epoch:12 iter: 376 end\n",
      "Train epoch:12 iter: 377 begin\n",
      "Train epoch:12 iter: 377 end\n",
      "Train epoch:12 iter: 378 begin\n",
      "Train epoch:12 iter: 378 end\n",
      "Train epoch:12 iter: 379 begin\n",
      "Train epoch:12 iter: 379 end\n",
      "Train epoch:12 iter: 380 begin\n",
      "Train epoch:12 iter: 380 end\n",
      "Train epoch:12 iter: 381 begin\n",
      "Train epoch:12 iter: 381 end\n",
      "Train epoch:12 iter: 382 begin\n",
      "Train epoch:12 iter: 382 end\n",
      "Train epoch:12 iter: 383 begin\n",
      "Train epoch:12 iter: 383 end\n",
      "Train epoch:12 iter: 384 begin\n",
      "Train epoch:12 iter: 384 end\n",
      "Train epoch:12 iter: 385 begin\n",
      "Train epoch:12 iter: 385 end\n",
      "Train epoch:12 iter: 386 begin\n",
      "Train epoch:12 iter: 386 end\n",
      "Train epoch:12 iter: 387 begin\n",
      "Train epoch:12 iter: 387 end\n",
      "Train epoch:12 iter: 388 begin\n",
      "Train epoch:12 iter: 388 end\n",
      "Train epoch:12 iter: 389 begin\n",
      "Train epoch:12 iter: 389 end\n",
      "Train epoch:12 iter: 390 begin\n",
      "Train epoch:12 iter: 390 end\n",
      "Train epoch:12 iter: 391 begin\n",
      "Train epoch:12 iter: 391 end\n",
      "Train epoch:12 iter: 392 begin\n",
      "Train epoch:12 iter: 392 end\n",
      "Train epoch:12 iter: 393 begin\n",
      "Train epoch:12 iter: 393 end\n",
      "Train epoch:12 iter: 394 begin\n",
      "Train epoch:12 iter: 394 end\n",
      "Train epoch:12 iter: 395 begin\n",
      "Train epoch:12 iter: 395 end\n",
      "Train epoch:12 iter: 396 begin\n",
      "Train epoch:12 iter: 396 end\n",
      "Train epoch:12 iter: 397 begin\n",
      "Train epoch:12 iter: 397 end\n",
      "Train epoch:12 iter: 398 begin\n",
      "Train epoch:12 iter: 398 end\n",
      "Train epoch:12 iter: 399 begin\n",
      "Train epoch:12 iter: 399 end\n",
      "Train epoch:12 iter: 400 begin\n",
      "Train epoch:12 iter: 400 end\n",
      "Train epoch:12 iter: 401 begin\n",
      "Train epoch:12 iter: 401 end\n",
      "Train epoch:12 iter: 402 begin\n",
      "Train epoch:12 iter: 402 end\n",
      "Train epoch:12 iter: 403 begin\n",
      "Train epoch:12 iter: 403 end\n",
      "Train epoch:12 iter: 404 begin\n",
      "Train epoch:12 iter: 404 end\n",
      "Train epoch:12 iter: 405 begin\n",
      "Train epoch:12 iter: 405 end\n",
      "Train epoch:12 iter: 406 begin\n",
      "Train epoch:12 iter: 406 end\n",
      "Train epoch:12 iter: 407 begin\n",
      "Train epoch:12 iter: 407 end\n",
      "Train epoch:12 iter: 408 begin\n",
      "Train epoch:12 iter: 408 end\n",
      "Train epoch:12 iter: 409 begin\n",
      "Train epoch:12 iter: 409 end\n",
      "Train epoch:12 iter: 410 begin\n",
      "Train epoch:12 iter: 410 end\n",
      "Train epoch:12 iter: 411 begin\n",
      "Train epoch:12 iter: 411 end\n",
      "Train epoch:12 iter: 412 begin\n",
      "Train epoch:12 iter: 412 end\n",
      "Train epoch:12 iter: 413 begin\n",
      "Train epoch:12 iter: 413 end\n",
      "Train epoch:12 iter: 414 begin\n",
      "Train epoch:12 iter: 414 end\n",
      "Train epoch:12 iter: 415 begin\n",
      "Train epoch:12 iter: 415 end\n",
      "Train epoch:12 iter: 416 begin\n",
      "Train epoch:12 iter: 416 end\n",
      "Train epoch:12 iter: 417 begin\n",
      "Train epoch:12 iter: 417 end\n",
      "Train epoch:12 iter: 418 begin\n",
      "Train epoch:12 iter: 418 end\n",
      "Train epoch:12 iter: 419 begin\n",
      "Train epoch:12 iter: 419 end\n",
      "Train epoch:12 iter: 420 begin\n",
      "Train epoch:12 iter: 420 end\n",
      "Train epoch:12 iter: 421 begin\n",
      "Train epoch:12 iter: 421 end\n",
      "Train epoch:12 iter: 422 begin\n",
      "Train epoch:12 iter: 422 end\n",
      "Train epoch:12 iter: 423 begin\n",
      "Train epoch:12 iter: 423 end\n",
      "Train epoch:12 iter: 424 begin\n",
      "Train epoch:12 iter: 424 end\n",
      "Train epoch:12 iter: 425 begin\n",
      "Train epoch:12 iter: 425 end\n",
      "Train epoch:12 iter: 426 begin\n",
      "Train epoch:12 iter: 426 end\n",
      "Train epoch:12 iter: 427 begin\n",
      "Train epoch:12 iter: 427 end\n",
      "Train epoch:12 iter: 428 begin\n",
      "Train epoch:12 iter: 428 end\n",
      "Train epoch:12 iter: 429 begin\n",
      "Train epoch:12 iter: 429 end\n",
      "Train epoch:12 iter: 430 begin\n",
      "Train epoch:12 iter: 430 end\n",
      "Train epoch:12 iter: 431 begin\n",
      "Train epoch:12 iter: 431 end\n",
      "Train epoch:12 iter: 432 begin\n",
      "Train epoch:12 iter: 432 end\n",
      "Train epoch:12 iter: 433 begin\n",
      "Train epoch:12 iter: 433 end\n",
      "Train epoch:12 iter: 434 begin\n",
      "Train epoch:12 iter: 434 end\n",
      "Train epoch:12 iter: 435 begin\n",
      "Train epoch:12 iter: 435 end\n",
      "Train epoch:12 iter: 436 begin\n",
      "Train epoch:12 iter: 436 end\n",
      "Train epoch:12 iter: 437 begin\n",
      "Train epoch:12 iter: 437 end\n",
      "Train epoch:12 iter: 438 begin\n",
      "Train epoch:12 iter: 438 end\n",
      "Train epoch:12 iter: 439 begin\n",
      "Train epoch:12 iter: 439 end\n",
      "Train epoch:12 iter: 440 begin\n",
      "Train epoch:12 iter: 440 end\n",
      "Train epoch:12 iter: 441 begin\n",
      "Train epoch:12 iter: 441 end\n",
      "Train epoch:12 iter: 442 begin\n",
      "Train epoch:12 iter: 442 end\n",
      "Train epoch:12 iter: 443 begin\n",
      "Train epoch:12 iter: 443 end\n",
      "Train epoch:12 iter: 444 begin\n",
      "Train epoch:12 iter: 444 end\n",
      "Train epoch:12 iter: 445 begin\n",
      "Train epoch:12 iter: 445 end\n",
      "Train epoch:12 iter: 446 begin\n",
      "Train epoch:12 iter: 446 end\n",
      "Train epoch:12 iter: 447 begin\n",
      "Train epoch:12 iter: 447 end\n",
      "Train epoch:12 iter: 448 begin\n",
      "Train epoch:12 iter: 448 end\n",
      "Train epoch:12 iter: 449 begin\n",
      "Train epoch:12 iter: 449 end\n",
      "Train epoch:12 iter: 450 begin\n",
      "Train epoch:12 iter: 450 end\n",
      "Train epoch:12 iter: 451 begin\n",
      "Train epoch:12 iter: 451 end\n",
      "Train epoch:12 iter: 452 begin\n",
      "Train epoch:12 iter: 452 end\n",
      "Train epoch:12 iter: 453 begin\n",
      "Train epoch:12 iter: 453 end\n",
      "Train epoch:12 iter: 454 begin\n",
      "Train epoch:12 iter: 454 end\n",
      "Train epoch:12 iter: 455 begin\n",
      "Train epoch:12 iter: 455 end\n",
      "Train epoch:12 iter: 456 begin\n",
      "Train epoch:12 iter: 456 end\n",
      "Train epoch:12 iter: 457 begin\n",
      "Train epoch:12 iter: 457 end\n",
      "Train epoch:12 iter: 458 begin\n",
      "Train epoch:12 iter: 458 end\n",
      "Train epoch:12 iter: 459 begin\n",
      "Train epoch:12 iter: 459 end\n",
      "Train epoch:12 iter: 460 begin\n",
      "Train epoch:12 iter: 460 end\n",
      "Train epoch:12 iter: 461 begin\n",
      "Train epoch:12 iter: 461 end\n",
      "Train epoch:12 iter: 462 begin\n",
      "Train epoch:12 iter: 462 end\n",
      "Train epoch:12 iter: 463 begin\n",
      "Train epoch:12 iter: 463 end\n",
      "Train epoch:12 iter: 464 begin\n",
      "Train epoch:12 iter: 464 end\n",
      "Train epoch:12 iter: 465 begin\n",
      "Train epoch:12 iter: 465 end\n",
      "Train epoch:12 iter: 466 begin\n",
      "Train epoch:12 iter: 466 end\n",
      "Train epoch:12 iter: 467 begin\n",
      "Train epoch:12 iter: 467 end\n",
      "Train epoch:12 iter: 468 begin\n",
      "Train epoch:12 iter: 468 end\n",
      "Train epoch:12 iter: 469 begin\n",
      "Train epoch:12 iter: 469 end\n",
      "Train epoch:12 iter: 470 begin\n",
      "Train epoch:12 iter: 470 end\n",
      "Train epoch:12 iter: 471 begin\n",
      "Train epoch:12 iter: 471 end\n",
      "Train epoch:12 iter: 472 begin\n",
      "Train epoch:12 iter: 472 end\n",
      "Train epoch:12 iter: 473 begin\n",
      "Train epoch:12 iter: 473 end\n",
      "Train epoch:12 iter: 474 begin\n",
      "Train epoch:12 iter: 474 end\n",
      "Train epoch:12 iter: 475 begin\n",
      "Train epoch:12 iter: 475 end\n",
      "Train epoch:12 iter: 476 begin\n",
      "Train epoch:12 iter: 476 end\n",
      "Train epoch:12 iter: 477 begin\n",
      "Train epoch:12 iter: 477 end\n",
      "Train epoch:12 iter: 478 begin\n",
      "Train epoch:12 iter: 478 end\n",
      "Train epoch:12 iter: 479 begin\n",
      "Train epoch:12 iter: 479 end\n",
      "Train epoch:12 iter: 480 begin\n",
      "Train epoch:12 iter: 480 end\n",
      "Train epoch:12 iter: 481 begin\n",
      "Train epoch:12 iter: 481 end\n",
      "Train epoch:12 iter: 482 begin\n",
      "Train epoch:12 iter: 482 end\n",
      "Train epoch:12 iter: 483 begin\n",
      "Train epoch:12 iter: 483 end\n",
      "Train epoch:12 iter: 484 begin\n",
      "Train epoch:12 iter: 484 end\n",
      "Train epoch:12 iter: 485 begin\n",
      "Train epoch:12 iter: 485 end\n",
      "Train epoch:12 iter: 486 begin\n",
      "Train epoch:12 iter: 486 end\n",
      "Train epoch:12 iter: 487 begin\n",
      "Train epoch:12 iter: 487 end\n",
      "Train epoch:12 iter: 488 begin\n",
      "Train epoch:12 iter: 488 end\n",
      "Train epoch:12 iter: 489 begin\n",
      "Train epoch:12 iter: 489 end\n",
      "Train epoch:12 iter: 490 begin\n",
      "Train epoch:12 iter: 490 end\n",
      "Train epoch:12 iter: 491 begin\n",
      "Train epoch:12 iter: 491 end\n",
      "Train epoch:12 iter: 492 begin\n",
      "Train epoch:12 iter: 492 end\n",
      "Train epoch:12 iter: 493 begin\n",
      "Train epoch:12 iter: 493 end\n",
      "Train epoch:12 iter: 494 begin\n",
      "Train epoch:12 iter: 494 end\n",
      "Train epoch:12 iter: 495 begin\n",
      "Train epoch:12 iter: 495 end\n",
      "Train epoch:12 iter: 496 begin\n",
      "Train epoch:12 iter: 496 end\n",
      "Train epoch:12 iter: 497 begin\n",
      "Train epoch:12 iter: 497 end\n",
      "Train epoch:12 iter: 498 begin\n",
      "Train epoch:12 iter: 498 end\n",
      "Train epoch:12 iter: 499 begin\n",
      "Train epoch:12 iter: 499 end\n",
      "Train epoch:12 iter: 500 begin\n",
      "Train epoch:12 iter: 500 end\n",
      "Train epoch:12 iter: 501 begin\n",
      "Train epoch:12 iter: 501 end\n",
      "Train epoch:12 iter: 502 begin\n",
      "Train epoch:12 iter: 502 end\n",
      "Train epoch:12 iter: 503 begin\n",
      "Train epoch:12 iter: 503 end\n",
      "Train epoch:12 iter: 504 begin\n",
      "Train epoch:12 iter: 504 end\n",
      "Train epoch:12 iter: 505 begin\n",
      "Train epoch:12 iter: 505 end\n",
      "Train epoch:12 iter: 506 begin\n",
      "Train epoch:12 iter: 506 end\n",
      "Train epoch:12 iter: 507 begin\n",
      "Train epoch:12 iter: 507 end\n",
      "Train epoch:12 iter: 508 begin\n",
      "Train epoch:12 iter: 508 end\n",
      "Train epoch:12 iter: 509 begin\n",
      "Train epoch:12 iter: 509 end\n",
      "Train epoch:12 iter: 510 begin\n",
      "Train epoch:12 iter: 510 end\n",
      "Train epoch:12 iter: 511 begin\n",
      "Train epoch:12 iter: 511 end\n",
      "Train epoch:12 iter: 512 begin\n",
      "Train epoch:12 iter: 512 end\n",
      "Train epoch:12 iter: 513 begin\n",
      "Train epoch:12 iter: 513 end\n",
      "Train epoch:12 iter: 514 begin\n",
      "Train epoch:12 iter: 514 end\n",
      "Train epoch:12 iter: 515 begin\n",
      "Train epoch:12 iter: 515 end\n",
      "Train epoch:12 iter: 516 begin\n",
      "Train epoch:12 iter: 516 end\n",
      "Train epoch:12 iter: 517 begin\n",
      "Train epoch:12 iter: 517 end\n",
      "Train epoch:12 iter: 518 begin\n",
      "Train epoch:12 iter: 518 end\n",
      "Train epoch:12 iter: 519 begin\n",
      "Train epoch:12 iter: 519 end\n",
      "Train epoch:12 iter: 520 begin\n",
      "Train epoch:12 iter: 520 end\n",
      "Train epoch:12 iter: 521 begin\n",
      "Train epoch:12 iter: 521 end\n",
      "Train epoch:12 iter: 522 begin\n",
      "Train epoch:12 iter: 522 end\n",
      "Train epoch:12 iter: 523 begin\n",
      "Train epoch:12 iter: 523 end\n",
      "Train epoch:12 iter: 524 begin\n",
      "Train epoch:12 iter: 524 end\n",
      "Train epoch:12 iter: 525 begin\n",
      "Train epoch:12 iter: 525 end\n",
      "Train epoch:12 iter: 526 begin\n",
      "Train epoch:12 iter: 526 end\n",
      "Train epoch:12 iter: 527 begin\n",
      "Train epoch:12 iter: 527 end\n",
      "Train epoch:12 iter: 528 begin\n",
      "Train epoch:12 iter: 528 end\n",
      "Train epoch:12 iter: 529 begin\n",
      "Train epoch:12 iter: 529 end\n",
      "Train epoch:12 iter: 530 begin\n",
      "Train epoch:12 iter: 530 end\n",
      "Train epoch:12 iter: 531 begin\n",
      "Train epoch:12 iter: 531 end\n",
      "Train epoch:12 iter: 532 begin\n",
      "Train epoch:12 iter: 532 end\n",
      "Train epoch:12 iter: 533 begin\n",
      "Train epoch:12 iter: 533 end\n",
      "Train epoch:12 iter: 534 begin\n",
      "Train epoch:12 iter: 534 end\n",
      "Train epoch:12 iter: 535 begin\n",
      "Train epoch:12 iter: 535 end\n",
      "Train epoch:12 iter: 536 begin\n",
      "Train epoch:12 iter: 536 end\n",
      "Train epoch:12 iter: 537 begin\n",
      "Train epoch:12 iter: 537 end\n",
      "Train epoch:12 iter: 538 begin\n",
      "Train epoch:12 iter: 538 end\n",
      "Train epoch:12 iter: 539 begin\n",
      "Train epoch:12 iter: 539 end\n",
      "Train epoch:12 iter: 540 begin\n",
      "Train epoch:12 iter: 540 end\n",
      "Train epoch:12 iter: 541 begin\n",
      "Train epoch:12 iter: 541 end\n",
      "Train epoch:12 iter: 542 begin\n",
      "Train epoch:12 iter: 542 end\n",
      "Train epoch:12 iter: 543 begin\n",
      "Train epoch:12 iter: 543 end\n",
      "Train epoch:12 iter: 544 begin\n",
      "Train epoch:12 iter: 544 end\n",
      "Train epoch:12 iter: 545 begin\n",
      "Train epoch:12 iter: 545 end\n",
      "Train epoch:12 iter: 546 begin\n",
      "Train epoch:12 iter: 546 end\n",
      "Train epoch:12 iter: 547 begin\n",
      "Train epoch:12 iter: 547 end\n",
      "Train epoch:12 iter: 548 begin\n",
      "Train epoch:12 iter: 548 end\n",
      "Train epoch:12 iter: 549 begin\n",
      "Train epoch:12 iter: 549 end\n",
      "Train epoch:12 iter: 550 begin\n",
      "Train epoch:12 iter: 550 end\n",
      "Train epoch:12 iter: 551 begin\n",
      "Train epoch:12 iter: 551 end\n",
      "Train epoch:12 iter: 552 begin\n",
      "Train epoch:12 iter: 552 end\n",
      "Train epoch:12 iter: 553 begin\n",
      "Train epoch:12 iter: 553 end\n",
      "Train epoch:12 iter: 554 begin\n",
      "Train epoch:12 iter: 554 end\n",
      "Train epoch:12 iter: 555 begin\n",
      "Train epoch:12 iter: 555 end\n",
      "Train epoch:12 iter: 556 begin\n",
      "Train epoch:12 iter: 556 end\n",
      "Train epoch:12 iter: 557 begin\n",
      "Train epoch:12 iter: 557 end\n",
      "Train epoch:12 iter: 558 begin\n",
      "Train epoch:12 iter: 558 end\n",
      "Train epoch:12 iter: 559 begin\n",
      "Train epoch:12 iter: 559 end\n",
      "Train epoch:12 iter: 560 begin\n",
      "Train epoch:12 iter: 560 end\n",
      "Train epoch:12 iter: 561 begin\n",
      "Train epoch:12 iter: 561 end\n",
      "Train epoch:12 iter: 562 begin\n",
      "Train epoch:12 iter: 562 end\n",
      "Train epoch:12 iter: 563 begin\n",
      "Train epoch:12 iter: 563 end\n",
      "Train epoch:12 iter: 564 begin\n",
      "Train epoch:12 iter: 564 end\n",
      "Train epoch:12 iter: 565 begin\n",
      "Train epoch:12 iter: 565 end\n",
      "Train epoch:12 iter: 566 begin\n",
      "Train epoch:12 iter: 566 end\n",
      "Train epoch:12 iter: 567 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:12 iter: 567 end\n",
      "Train epoch:12 iter: 568 begin\n",
      "Train epoch:12 iter: 568 end\n",
      "Train epoch:12 iter: 569 begin\n",
      "Train epoch:12 iter: 569 end\n",
      "Train epoch:12 iter: 570 begin\n",
      "Train epoch:12 iter: 570 end\n",
      "Train epoch:12 iter: 571 begin\n",
      "Train epoch:12 iter: 571 end\n",
      "Train epoch:12 iter: 572 begin\n",
      "Train epoch:12 iter: 572 end\n",
      "Train epoch:12 iter: 573 begin\n",
      "Train epoch:12 iter: 573 end\n",
      "Train epoch:12 iter: 574 begin\n",
      "Train epoch:12 iter: 574 end\n",
      "Train epoch:12 iter: 575 begin\n",
      "Train epoch:12 iter: 575 end\n",
      "Train epoch:12 iter: 576 begin\n",
      "Train epoch:12 iter: 576 end\n",
      "Train epoch:12 iter: 577 begin\n",
      "Train epoch:12 iter: 577 end\n",
      "Train epoch:12 iter: 578 begin\n",
      "Train epoch:12 iter: 578 end\n",
      "Train epoch:12 iter: 579 begin\n",
      "Train epoch:12 iter: 579 end\n",
      "Train epoch:12 iter: 580 begin\n",
      "Train epoch:12 iter: 580 end\n",
      "Train epoch:12 iter: 581 begin\n",
      "Train epoch:12 iter: 581 end\n",
      "Train epoch:12 iter: 582 begin\n",
      "Train epoch:12 iter: 582 end\n",
      "Train epoch:12 iter: 583 begin\n",
      "Train epoch:12 iter: 583 end\n",
      "Train epoch:12 iter: 584 begin\n",
      "Train epoch:12 iter: 584 end\n",
      "Train epoch:12 iter: 585 begin\n",
      "Train epoch:12 iter: 585 end\n",
      "Train epoch:12 iter: 586 begin\n",
      "Train epoch:12 iter: 586 end\n",
      "Train epoch:12 iter: 587 begin\n",
      "Train epoch:12 iter: 587 end\n",
      "Train epoch:12 iter: 588 begin\n",
      "Train epoch:12 iter: 588 end\n",
      "Train epoch:12 iter: 589 begin\n",
      "Train epoch:12 iter: 589 end\n",
      "Train epoch:12 iter: 590 begin\n",
      "Train epoch:12 iter: 590 end\n",
      "Train epoch:12 iter: 591 begin\n",
      "Train epoch:12 iter: 591 end\n",
      "Train epoch:12 iter: 592 begin\n",
      "Train epoch:12 iter: 592 end\n",
      "Train epoch:12 iter: 593 begin\n",
      "Train epoch:12 iter: 593 end\n",
      "Train epoch:12 iter: 594 begin\n",
      "Train epoch:12 iter: 594 end\n",
      "Train epoch:12 iter: 595 begin\n",
      "Train epoch:12 iter: 595 end\n",
      "Train epoch:12 iter: 596 begin\n",
      "Train epoch:12 iter: 596 end\n",
      "Train epoch:12 iter: 597 begin\n",
      "Train epoch:12 iter: 597 end\n",
      "Train epoch:12 iter: 598 begin\n",
      "Train epoch:12 iter: 598 end\n",
      "Train epoch:12 iter: 599 begin\n",
      "Train epoch:12 iter: 599 end\n",
      "Train epoch:12 iter: 600 begin\n",
      "Train epoch:12 iter: 600 end\n",
      "Train epoch:12 iter: 601 begin\n",
      "Train epoch:12 iter: 601 end\n",
      "Train epoch:12 iter: 602 begin\n",
      "Train epoch:12 iter: 602 end\n",
      "Train epoch:12 iter: 603 begin\n",
      "Train epoch:12 iter: 603 end\n",
      "Train epoch:12 iter: 604 begin\n",
      "Train epoch:12 iter: 604 end\n",
      "Train epoch:12 iter: 605 begin\n",
      "Train epoch:12 iter: 605 end\n",
      "Train epoch:12 iter: 606 begin\n",
      "Train epoch:12 iter: 606 end\n",
      "Train epoch:12 iter: 607 begin\n",
      "Train epoch:12 iter: 607 end\n",
      "Train epoch:12 iter: 608 begin\n",
      "Train epoch:12 iter: 608 end\n",
      "Train epoch:12 iter: 609 begin\n",
      "Train epoch:12 iter: 609 end\n",
      "Train epoch:12 iter: 610 begin\n",
      "Train epoch:12 iter: 610 end\n",
      "Train epoch:12 iter: 611 begin\n",
      "Train epoch:12 iter: 611 end\n",
      "Train epoch:12 iter: 612 begin\n",
      "Train epoch:12 iter: 612 end\n",
      "Train epoch:12 iter: 613 begin\n",
      "Train epoch:12 iter: 613 end\n",
      "Train epoch:12 iter: 614 begin\n",
      "Train epoch:12 iter: 614 end\n",
      "Train epoch:12 iter: 615 begin\n",
      "Train epoch:12 iter: 615 end\n",
      "Train epoch:12 iter: 616 begin\n",
      "Train epoch:12 iter: 616 end\n",
      "Train epoch:12 iter: 617 begin\n",
      "Train epoch:12 iter: 617 end\n",
      "Train epoch:12 iter: 618 begin\n",
      "Train epoch:12 iter: 618 end\n",
      "Train epoch:12 iter: 619 begin\n",
      "Train epoch:12 iter: 619 end\n",
      "Train epoch:12 iter: 620 begin\n",
      "Train epoch:12 iter: 620 end\n",
      "Train epoch:12 iter: 621 begin\n",
      "Train epoch:12 iter: 621 end\n",
      "Train epoch:12 iter: 622 begin\n",
      "Train epoch:12 iter: 622 end\n",
      "Train epoch:12 iter: 623 begin\n",
      "Train epoch:12 iter: 623 end\n",
      "Train epoch:12 iter: 624 begin\n",
      "Train epoch:12 iter: 624 end\n",
      "Train epoch:12 iter: 625 begin\n",
      "Train epoch:12 iter: 625 end\n",
      "Train epoch:12 iter: 626 begin\n",
      "Train epoch:12 iter: 626 end\n",
      "Train epoch:12 iter: 627 begin\n",
      "Train epoch:12 iter: 627 end\n",
      "Train epoch:12 iter: 628 begin\n",
      "Train epoch:12 iter: 628 end\n",
      "Train epoch:12 iter: 629 begin\n",
      "Train epoch:12 iter: 629 end\n",
      "Train epoch:12 iter: 630 begin\n",
      "Train epoch:12 iter: 630 end\n",
      "Train epoch:12 iter: 631 begin\n",
      "Train epoch:12 iter: 631 end\n",
      "Train epoch:12 iter: 632 begin\n",
      "Train epoch:12 iter: 632 end\n",
      "Train epoch:12 iter: 633 begin\n",
      "Train epoch:12 iter: 633 end\n",
      "Train epoch:12 iter: 634 begin\n",
      "Train epoch:12 iter: 634 end\n",
      "Train epoch:12 iter: 635 begin\n",
      "Train epoch:12 iter: 635 end\n",
      "Train epoch:12 iter: 636 begin\n",
      "Train epoch:12 iter: 636 end\n",
      "Train epoch:12 iter: 637 begin\n",
      "Train epoch:12 iter: 637 end\n",
      "Train epoch:12 iter: 638 begin\n",
      "Train epoch:12 iter: 638 end\n",
      "Train epoch:12 iter: 639 begin\n",
      "Train epoch:12 iter: 639 end\n",
      "Train epoch:12 iter: 640 begin\n",
      "Train epoch:12 iter: 640 end\n",
      "Train epoch:12 iter: 641 begin\n",
      "Train epoch:12 iter: 641 end\n",
      "Train epoch:12 iter: 642 begin\n",
      "Train epoch:12 iter: 642 end\n",
      "Train epoch:12 iter: 643 begin\n",
      "Train epoch:12 iter: 643 end\n",
      "Train epoch:12 iter: 644 begin\n",
      "Train epoch:12 iter: 644 end\n",
      "Train epoch:12 iter: 645 begin\n",
      "Train epoch:12 iter: 645 end\n",
      "Train epoch:12 iter: 646 begin\n",
      "Train epoch:12 iter: 646 end\n",
      "Train epoch:12 iter: 647 begin\n",
      "Train epoch:12 iter: 647 end\n",
      "Train epoch:12 iter: 648 begin\n",
      "Train epoch:12 iter: 648 end\n",
      "Train epoch:12 iter: 649 begin\n",
      "Train epoch:12 iter: 649 end\n",
      "Train epoch:12 iter: 650 begin\n",
      "Train epoch:12 iter: 650 end\n",
      "Train epoch:12 iter: 651 begin\n",
      "Train epoch:12 iter: 651 end\n",
      "Train epoch:12 iter: 652 begin\n",
      "Train epoch:12 iter: 652 end\n",
      "Train epoch:12 iter: 653 begin\n",
      "Train epoch:12 iter: 653 end\n",
      "Train epoch:12 iter: 654 begin\n",
      "Train epoch:12 iter: 654 end\n",
      "Train epoch:12 iter: 655 begin\n",
      "Train epoch:12 iter: 655 end\n",
      "Train epoch:12 iter: 656 begin\n",
      "Train epoch:12 iter: 656 end\n",
      "Train epoch:12 iter: 657 begin\n",
      "Train epoch:12 iter: 657 end\n",
      "Train epoch:12 iter: 658 begin\n",
      "Train epoch:12 iter: 658 end\n",
      "Train epoch:12 iter: 659 begin\n",
      "Train epoch:12 iter: 659 end\n",
      "Train epoch:12 iter: 660 begin\n",
      "Train epoch:12 iter: 660 end\n",
      "Train epoch:12 iter: 661 begin\n",
      "Train epoch:12 iter: 661 end\n",
      "Train epoch:12 iter: 662 begin\n",
      "Train epoch:12 iter: 662 end\n",
      "Train epoch:12 iter: 663 begin\n",
      "Train epoch:12 iter: 663 end\n",
      "Train epoch:12 iter: 664 begin\n",
      "Train epoch:12 iter: 664 end\n",
      "Train epoch:12 iter: 665 begin\n",
      "Train epoch:12 iter: 665 end\n",
      "Train epoch:12 iter: 666 begin\n",
      "Train epoch:12 iter: 666 end\n",
      "Train epoch:12 iter: 667 begin\n",
      "Train epoch:12 iter: 667 end\n",
      "Train epoch:12 iter: 668 begin\n",
      "Train epoch:12 iter: 668 end\n",
      "Train epoch:12 iter: 669 begin\n",
      "Train epoch:12 iter: 669 end\n",
      "Train epoch:12 iter: 670 begin\n",
      "Train epoch:12 iter: 670 end\n",
      "Train epoch:12 iter: 671 begin\n",
      "Train epoch:12 iter: 671 end\n",
      "Train epoch:12 iter: 672 begin\n",
      "Train epoch:12 iter: 672 end\n",
      "Train epoch:12 iter: 673 begin\n",
      "Train epoch:12 iter: 673 end\n",
      "Train epoch:12 iter: 674 begin\n",
      "Train epoch:12 iter: 674 end\n",
      "Train epoch:12 iter: 675 begin\n",
      "Train epoch:12 iter: 675 end\n",
      "Train epoch:12 iter: 676 begin\n",
      "Train epoch:12 iter: 676 end\n",
      "Train epoch:12 iter: 677 begin\n",
      "Train epoch:12 iter: 677 end\n",
      "Train epoch:12 iter: 678 begin\n",
      "Train epoch:12 iter: 678 end\n",
      "Train epoch:12 iter: 679 begin\n",
      "Train epoch:12 iter: 679 end\n",
      "Train epoch:12 iter: 680 begin\n",
      "Train epoch:12 iter: 680 end\n",
      "Train epoch:12 iter: 681 begin\n",
      "Train epoch:12 iter: 681 end\n",
      "Train epoch:12 iter: 682 begin\n",
      "Train epoch:12 iter: 682 end\n",
      "Train epoch:12 iter: 683 begin\n",
      "Train epoch:12 iter: 683 end\n",
      "Train epoch:12 iter: 684 begin\n",
      "Train epoch:12 iter: 684 end\n",
      "Train epoch:12 iter: 685 begin\n",
      "Train epoch:12 iter: 685 end\n",
      "Train epoch:12 iter: 686 begin\n",
      "Train epoch:12 iter: 686 end\n",
      "Train epoch:12 iter: 687 begin\n",
      "Train epoch:12 iter: 687 end\n",
      "Train epoch:12 iter: 688 begin\n",
      "Train epoch:12 iter: 688 end\n",
      "Train epoch:12 iter: 689 begin\n",
      "Train epoch:12 iter: 689 end\n",
      "Train epoch:12 iter: 690 begin\n",
      "Train epoch:12 iter: 690 end\n",
      "Train epoch:12 iter: 691 begin\n",
      "Train epoch:12 iter: 691 end\n",
      "Train epoch:12 iter: 692 begin\n",
      "Train epoch:12 iter: 692 end\n",
      "Train epoch:12 iter: 693 begin\n",
      "Train epoch:12 iter: 693 end\n",
      "Train epoch:12 iter: 694 begin\n",
      "Train epoch:12 iter: 694 end\n",
      "Train epoch:12 iter: 695 begin\n",
      "Train epoch:12 iter: 695 end\n",
      "Train epoch:12 iter: 696 begin\n",
      "Train epoch:12 iter: 696 end\n",
      "Train epoch:12 iter: 697 begin\n",
      "Train epoch:12 iter: 697 end\n",
      "Train epoch:12 iter: 698 begin\n",
      "Train epoch:12 iter: 698 end\n",
      "Train epoch:12 iter: 699 begin\n",
      "Train epoch:12 iter: 699 end\n",
      "Train epoch:12 iter: 700 begin\n",
      "Train epoch:12 iter: 700 end\n",
      "Train epoch:12 iter: 701 begin\n",
      "Train epoch:12 iter: 701 end\n",
      "Train epoch:12 iter: 702 begin\n",
      "Train epoch:12 iter: 702 end\n",
      "Train epoch:12 iter: 703 begin\n",
      "Train epoch:12 iter: 703 end\n",
      "Train epoch:12 iter: 704 begin\n",
      "Train epoch:12 iter: 704 end\n",
      "Train epoch:12 iter: 705 begin\n",
      "Train epoch:12 iter: 705 end\n",
      "Train epoch:12 iter: 706 begin\n",
      "Train epoch:12 iter: 706 end\n",
      "Train epoch:12 iter: 707 begin\n",
      "Train epoch:12 iter: 707 end\n",
      "Train epoch:12 iter: 708 begin\n",
      "Train epoch:12 iter: 708 end\n",
      "Train epoch:12 iter: 709 begin\n",
      "Train epoch:12 iter: 709 end\n",
      "Train epoch:12 iter: 710 begin\n",
      "Train epoch:12 iter: 710 end\n",
      "Train epoch:12 iter: 711 begin\n",
      "Train epoch:12 iter: 711 end\n",
      "Train epoch:12 iter: 712 begin\n",
      "Train epoch:12 iter: 712 end\n",
      "Train epoch:12 iter: 713 begin\n",
      "Train epoch:12 iter: 713 end\n",
      "Train epoch:12 iter: 714 begin\n",
      "Train epoch:12 iter: 714 end\n",
      "Train epoch:12 iter: 715 begin\n",
      "Train epoch:12 iter: 715 end\n",
      "Train epoch:12 iter: 716 begin\n",
      "Train epoch:12 iter: 716 end\n",
      "Train epoch:12 iter: 717 begin\n",
      "Train epoch:12 iter: 717 end\n",
      "Train epoch:12 iter: 718 begin\n",
      "Train epoch:12 iter: 718 end\n",
      "Train epoch:12 iter: 719 begin\n",
      "Train epoch:12 iter: 719 end\n",
      "Train epoch:12 iter: 720 begin\n",
      "Train epoch:12 iter: 720 end\n",
      "Train epoch:12 iter: 721 begin\n",
      "Train epoch:12 iter: 721 end\n",
      "Train epoch:12 iter: 722 begin\n",
      "Train epoch:12 iter: 722 end\n",
      "Train epoch:12 iter: 723 begin\n",
      "Train epoch:12 iter: 723 end\n",
      "Train epoch:12 iter: 724 begin\n",
      "Train epoch:12 iter: 724 end\n",
      "Train epoch:12 iter: 725 begin\n",
      "Train epoch:12 iter: 725 end\n",
      "Train epoch:12 iter: 726 begin\n",
      "Train epoch:12 iter: 726 end\n",
      "Train epoch:12 iter: 727 begin\n",
      "Train epoch:12 iter: 727 end\n",
      "Train epoch:12 iter: 728 begin\n",
      "Train epoch:12 iter: 728 end\n",
      "Train epoch:12 iter: 729 begin\n",
      "Train epoch:12 iter: 729 end\n",
      "Train epoch:12 iter: 730 begin\n",
      "Train epoch:12 iter: 730 end\n",
      "Train epoch:12 iter: 731 begin\n",
      "Train epoch:12 iter: 731 end\n",
      "Train epoch:12 iter: 732 begin\n",
      "Train epoch:12 iter: 732 end\n",
      "Train epoch:12 iter: 733 begin\n",
      "Train epoch:12 iter: 733 end\n",
      "Train epoch:12 iter: 734 begin\n",
      "Train epoch:12 iter: 734 end\n",
      "Train epoch:12 iter: 735 begin\n",
      "Train epoch:12 iter: 735 end\n",
      "Train epoch:12 iter: 736 begin\n",
      "Train epoch:12 iter: 736 end\n",
      "Train epoch:12 iter: 737 begin\n",
      "Train epoch:12 iter: 737 end\n",
      "Train epoch:12 iter: 738 begin\n",
      "Train epoch:12 iter: 738 end\n",
      "Train epoch:12 iter: 739 begin\n",
      "Train epoch:12 iter: 739 end\n",
      "Train epoch:12 iter: 740 begin\n",
      "Train epoch:12 iter: 740 end\n",
      "Train epoch:12 iter: 741 begin\n",
      "Train epoch:12 iter: 741 end\n",
      "Train epoch:12 iter: 742 begin\n",
      "Train epoch:12 iter: 742 end\n",
      "Train epoch:12 iter: 743 begin\n",
      "Train epoch:12 iter: 743 end\n",
      "Train epoch:12 iter: 744 begin\n",
      "Train epoch:12 iter: 744 end\n",
      "Train epoch:12 iter: 745 begin\n",
      "Train epoch:12 iter: 745 end\n",
      "Train epoch:12 iter: 746 begin\n",
      "Train epoch:12 iter: 746 end\n",
      "Train epoch:12 iter: 747 begin\n",
      "Train epoch:12 iter: 747 end\n",
      "Train epoch:12 iter: 748 begin\n",
      "Train epoch:12 iter: 748 end\n",
      "Train epoch:12 iter: 749 begin\n",
      "Train epoch:12 iter: 749 end\n",
      "Train epoch:12 iter: 750 begin\n",
      "Train epoch:12 iter: 750 end\n",
      "Train epoch:12 iter: 751 begin\n",
      "Train epoch:12 iter: 751 end\n",
      "Train epoch:12 iter: 752 begin\n",
      "Train epoch:12 iter: 752 end\n",
      "Train epoch:12 iter: 753 begin\n",
      "Train epoch:12 iter: 753 end\n",
      "Train epoch:12 iter: 754 begin\n",
      "Train epoch:12 iter: 754 end\n",
      "Train epoch:12 iter: 755 begin\n",
      "Train epoch:12 iter: 755 end\n",
      "Train epoch:12 iter: 756 begin\n",
      "Train epoch:12 iter: 756 end\n",
      "Train epoch:12 iter: 757 begin\n",
      "Train epoch:12 iter: 757 end\n",
      "Train epoch:12 iter: 758 begin\n",
      "Train epoch:12 iter: 758 end\n",
      "Train epoch:12 iter: 759 begin\n",
      "Train epoch:12 iter: 759 end\n",
      "Train epoch:12 iter: 760 begin\n",
      "Train epoch:12 iter: 760 end\n",
      "Train epoch:12 iter: 761 begin\n",
      "Train epoch:12 iter: 761 end\n",
      "Train epoch:12 iter: 762 begin\n",
      "Train epoch:12 iter: 762 end\n",
      "Train epoch:12 iter: 763 begin\n",
      "Train epoch:12 iter: 763 end\n",
      "Train epoch:12 iter: 764 begin\n",
      "Train epoch:12 iter: 764 end\n",
      "Train epoch:12 iter: 765 begin\n",
      "Train epoch:12 iter: 765 end\n",
      "Train epoch:12 iter: 766 begin\n",
      "Train epoch:12 iter: 766 end\n",
      "Train epoch:12 iter: 767 begin\n",
      "Train epoch:12 iter: 767 end\n",
      "Train epoch:12 iter: 768 begin\n",
      "Train epoch:12 iter: 768 end\n",
      "Train epoch:12 iter: 769 begin\n",
      "Train epoch:12 iter: 769 end\n",
      "Train epoch:12 iter: 770 begin\n",
      "Train epoch:12 iter: 770 end\n",
      "Train epoch:12 iter: 771 begin\n",
      "Train epoch:12 iter: 771 end\n",
      "Train epoch:12 iter: 772 begin\n",
      "Train epoch:12 iter: 772 end\n",
      "Train epoch:12 iter: 773 begin\n",
      "Train epoch:12 iter: 773 end\n",
      "Train epoch:12 iter: 774 begin\n",
      "Train epoch:12 iter: 774 end\n",
      "Train epoch:12 iter: 775 begin\n",
      "Train epoch:12 iter: 775 end\n",
      "Train epoch:12 iter: 776 begin\n",
      "Train epoch:12 iter: 776 end\n",
      "Train epoch:12 iter: 777 begin\n",
      "Train epoch:12 iter: 777 end\n",
      "Train epoch:12 iter: 778 begin\n",
      "Train epoch:12 iter: 778 end\n",
      "Train epoch:12 iter: 779 begin\n",
      "Train epoch:12 iter: 779 end\n",
      "Train epoch:12 iter: 780 begin\n",
      "Train epoch:12 iter: 780 end\n",
      "Train epoch:12 iter: 781 begin\n",
      "Train epoch:12 iter: 781 end\n",
      "Train epoch:12 iter: 782 begin\n",
      "Train epoch:12 iter: 782 end\n",
      "Train epoch:12 iter: 783 begin\n",
      "Train epoch:12 iter: 783 end\n",
      "Train epoch:12 iter: 784 begin\n",
      "Train epoch:12 iter: 784 end\n",
      "Train epoch:12 iter: 785 begin\n",
      "Train epoch:12 iter: 785 end\n",
      "Train epoch:12 iter: 786 begin\n",
      "Train epoch:12 iter: 786 end\n",
      "Train epoch:12 iter: 787 begin\n",
      "Train epoch:12 iter: 787 end\n",
      "Train epoch:12 iter: 788 begin\n",
      "Train epoch:12 iter: 788 end\n",
      "Train epoch:12 iter: 789 begin\n",
      "Train epoch:12 iter: 789 end\n",
      "Train epoch:12 iter: 790 begin\n",
      "Train epoch:12 iter: 790 end\n",
      "Train epoch:12 iter: 791 begin\n",
      "Train epoch:12 iter: 791 end\n",
      "Train epoch:12 iter: 792 begin\n",
      "Train epoch:12 iter: 792 end\n",
      "Train epoch:12 iter: 793 begin\n",
      "Train epoch:12 iter: 793 end\n",
      "Train epoch:12 iter: 794 begin\n",
      "Train epoch:12 iter: 794 end\n",
      "Train epoch:12 iter: 795 begin\n",
      "Train epoch:12 iter: 795 end\n",
      "Train epoch:12 iter: 796 begin\n",
      "Train epoch:12 iter: 796 end\n",
      "Train epoch:12 iter: 797 begin\n",
      "Train epoch:12 iter: 797 end\n",
      "Train epoch:12 iter: 798 begin\n",
      "Train epoch:12 iter: 798 end\n",
      "Train epoch:12 iter: 799 begin\n",
      "Train epoch:12 iter: 799 end\n",
      "Train epoch:12 iter: 800 begin\n",
      "Train epoch:12 iter: 800 end\n",
      "Train epoch:12 iter: 801 begin\n",
      "Train epoch:12 iter: 801 end\n",
      "Train epoch:12 iter: 802 begin\n",
      "Train epoch:12 iter: 802 end\n",
      "Train epoch:12 iter: 803 begin\n",
      "Train epoch:12 iter: 803 end\n",
      "Train epoch:12 iter: 804 begin\n",
      "Train epoch:12 iter: 804 end\n",
      "Train epoch:12 iter: 805 begin\n",
      "Train epoch:12 iter: 805 end\n",
      "Train epoch:12 iter: 806 begin\n",
      "Train epoch:12 iter: 806 end\n",
      "Train epoch:12 iter: 807 begin\n",
      "Train epoch:12 iter: 807 end\n",
      "Train epoch:12 iter: 808 begin\n",
      "Train epoch:12 iter: 808 end\n",
      "Train epoch:12 iter: 809 begin\n",
      "Train epoch:12 iter: 809 end\n",
      "Train epoch:12 iter: 810 begin\n",
      "Train epoch:12 iter: 810 end\n",
      "Train epoch:12 iter: 811 begin\n",
      "Train epoch:12 iter: 811 end\n",
      "Train epoch:12 iter: 812 begin\n",
      "Train epoch:12 iter: 812 end\n",
      "Train epoch:12 iter: 813 begin\n",
      "Train epoch:12 iter: 813 end\n",
      "Train epoch:12 iter: 814 begin\n",
      "Train epoch:12 iter: 814 end\n",
      "Train epoch:12 iter: 815 begin\n",
      "Train epoch:12 iter: 815 end\n",
      "Train epoch:12 iter: 816 begin\n",
      "Train epoch:12 iter: 816 end\n",
      "Train epoch:12 iter: 817 begin\n",
      "Train epoch:12 iter: 817 end\n",
      "Train epoch:12 iter: 818 begin\n",
      "Train epoch:12 iter: 818 end\n",
      "Train epoch:12 iter: 819 begin\n",
      "Train epoch:12 iter: 819 end\n",
      "Train epoch:12 iter: 820 begin\n",
      "Train epoch:12 iter: 820 end\n",
      "Train epoch:12 iter: 821 begin\n",
      "Train epoch:12 iter: 821 end\n",
      "Train epoch:12 iter: 822 begin\n",
      "Train epoch:12 iter: 822 end\n",
      "Train epoch:12 iter: 823 begin\n",
      "Train epoch:12 iter: 823 end\n",
      "Train epoch:12 iter: 824 begin\n",
      "Train epoch:12 iter: 824 end\n",
      "Train epoch:12 iter: 825 begin\n",
      "Train epoch:12 iter: 825 end\n",
      "Train epoch:12 iter: 826 begin\n",
      "Train epoch:12 iter: 826 end\n",
      "Train epoch:12 iter: 827 begin\n",
      "Train epoch:12 iter: 827 end\n",
      "Train epoch:12 iter: 828 begin\n",
      "Train epoch:12 iter: 828 end\n",
      "Train epoch:12 iter: 829 begin\n",
      "Train epoch:12 iter: 829 end\n",
      "Train epoch:12 iter: 830 begin\n",
      "Train epoch:12 iter: 830 end\n",
      "Train epoch:12 iter: 831 begin\n",
      "Train epoch:12 iter: 831 end\n",
      "Train epoch:12 iter: 832 begin\n",
      "Train epoch:12 iter: 832 end\n",
      "Train epoch:12 iter: 833 begin\n",
      "Train epoch:12 iter: 833 end\n",
      "Train epoch:12 iter: 834 begin\n",
      "Train epoch:12 iter: 834 end\n",
      "Train epoch:12 iter: 835 begin\n",
      "Train epoch:12 iter: 835 end\n",
      "Train epoch:12 iter: 836 begin\n",
      "Train epoch:12 iter: 836 end\n",
      "Train epoch:12 iter: 837 begin\n",
      "Train epoch:12 iter: 837 end\n",
      "Train epoch:12 iter: 838 begin\n",
      "Train epoch:12 iter: 838 end\n",
      "Train epoch:12 iter: 839 begin\n",
      "Train epoch:12 iter: 839 end\n",
      "Train epoch:12 iter: 840 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:12 iter: 840 end\n",
      "Train epoch:12 iter: 841 begin\n",
      "Train epoch:12 iter: 841 end\n",
      "Train epoch:12 iter: 842 begin\n",
      "Train epoch:12 iter: 842 end\n",
      "Train epoch:12 iter: 843 begin\n",
      "Train epoch:12 iter: 843 end\n",
      "Train epoch:12 iter: 844 begin\n",
      "Train epoch:12 iter: 844 end\n",
      "Train epoch:12 iter: 845 begin\n",
      "Train epoch:12 iter: 845 end\n",
      "Train epoch:12 iter: 846 begin\n",
      "Train epoch:12 iter: 846 end\n",
      "Train epoch:12 iter: 847 begin\n",
      "Train epoch:12 iter: 847 end\n",
      "Train epoch:12 iter: 848 begin\n",
      "Train epoch:12 iter: 848 end\n",
      "Train epoch:12 iter: 849 begin\n",
      "Train epoch:12 iter: 849 end\n",
      "Train epoch:12 iter: 850 begin\n",
      "Train epoch:12 iter: 850 end\n",
      "Train epoch:12 iter: 851 begin\n",
      "Train epoch:12 iter: 851 end\n",
      "Train epoch:12 iter: 852 begin\n",
      "Train epoch:12 iter: 852 end\n",
      "Train epoch:12 iter: 853 begin\n",
      "Train epoch:12 iter: 853 end\n",
      "Train epoch:12 iter: 854 begin\n",
      "Train epoch:12 iter: 854 end\n",
      "Train epoch:12 iter: 855 begin\n",
      "Train epoch:12 iter: 855 end\n",
      "Train epoch:12 iter: 856 begin\n",
      "Train epoch:12 iter: 856 end\n",
      "Train epoch:12 iter: 857 begin\n",
      "Train epoch:12 iter: 857 end\n",
      "Train epoch:12 iter: 858 begin\n",
      "Train epoch:12 iter: 858 end\n",
      "Train epoch:12 iter: 859 begin\n",
      "Train epoch:12 iter: 859 end\n",
      "Train epoch:12 iter: 860 begin\n",
      "Train epoch:12 iter: 860 end\n",
      "Train epoch:12 iter: 861 begin\n",
      "Train epoch:12 iter: 861 end\n",
      "Train epoch:12 iter: 862 begin\n",
      "Train epoch:12 iter: 862 end\n",
      "Train epoch:12 iter: 863 begin\n",
      "Train epoch:12 iter: 863 end\n",
      "Train epoch:12 iter: 864 begin\n",
      "Train epoch:12 iter: 864 end\n",
      "Train epoch:12 iter: 865 begin\n",
      "Train epoch:12 iter: 865 end\n",
      "Train epoch:12 iter: 866 begin\n",
      "Train epoch:12 iter: 866 end\n",
      "Train epoch:12 iter: 867 begin\n",
      "Train epoch:12 iter: 867 end\n",
      "Train epoch:12 iter: 868 begin\n",
      "Train epoch:12 iter: 868 end\n",
      "Train epoch:12 iter: 869 begin\n",
      "Train epoch:12 iter: 869 end\n",
      "Train epoch:12 iter: 870 begin\n",
      "Train epoch:12 iter: 870 end\n",
      "Train epoch:12 iter: 871 begin\n",
      "Train epoch:12 iter: 871 end\n",
      "Train epoch:12 iter: 872 begin\n",
      "Train epoch:12 iter: 872 end\n",
      "Train epoch:12 iter: 873 begin\n",
      "Train epoch:12 iter: 873 end\n",
      "Train epoch:12 iter: 874 begin\n",
      "Train epoch:12 iter: 874 end\n",
      "Train epoch:12 iter: 875 begin\n",
      "Train epoch:12 iter: 875 end\n",
      "Train epoch:12 iter: 876 begin\n",
      "Train epoch:12 iter: 876 end\n",
      "Train epoch:12 iter: 877 begin\n",
      "Train epoch:12 iter: 877 end\n",
      "Train epoch:12 iter: 878 begin\n",
      "Train epoch:12 iter: 878 end\n",
      "Train epoch:12 iter: 879 begin\n",
      "Train epoch:12 iter: 879 end\n",
      "Train epoch:12 iter: 880 begin\n",
      "Train epoch:12 iter: 880 end\n",
      "Train epoch:12 iter: 881 begin\n",
      "Train epoch:12 iter: 881 end\n",
      "Train epoch:12 iter: 882 begin\n",
      "Train epoch:12 iter: 882 end\n",
      "Train epoch:12 iter: 883 begin\n",
      "Train epoch:12 iter: 883 end\n",
      "Train epoch:12 iter: 884 begin\n",
      "Train epoch:12 iter: 884 end\n",
      "Train epoch:12 iter: 885 begin\n",
      "Train epoch:12 iter: 885 end\n",
      "Train epoch:12 iter: 886 begin\n",
      "Train epoch:12 iter: 886 end\n",
      "Train epoch:12 iter: 887 begin\n",
      "Train epoch:12 iter: 887 end\n",
      "Train epoch:12 iter: 888 begin\n",
      "Train epoch:12 iter: 888 end\n",
      "Train epoch:12 iter: 889 begin\n",
      "Train epoch:12 iter: 889 end\n",
      "Train epoch:12 iter: 890 begin\n",
      "Train epoch:12 iter: 890 end\n",
      "Train epoch:12 iter: 891 begin\n",
      "Train epoch:12 iter: 891 end\n",
      "Train epoch:12 iter: 892 begin\n",
      "Train epoch:12 iter: 892 end\n",
      "Train epoch:12 iter: 893 begin\n",
      "Train epoch:12 iter: 893 end\n",
      "Train epoch:12 iter: 894 begin\n",
      "Train epoch:12 iter: 894 end\n",
      "Train epoch:12 iter: 895 begin\n",
      "Train epoch:12 iter: 895 end\n",
      "Train epoch:12 iter: 896 begin\n",
      "Train epoch:12 iter: 896 end\n",
      "Train epoch:12 iter: 897 begin\n",
      "Train epoch:12 iter: 897 end\n",
      "Train epoch:12 iter: 898 begin\n",
      "Train epoch:12 iter: 898 end\n",
      "Train epoch:12 iter: 899 begin\n",
      "Train epoch:12 iter: 899 end\n",
      "Train epoch:12 iter: 900 begin\n",
      "Train epoch:12 iter: 900 end\n",
      "Train epoch:12 iter: 901 begin\n",
      "Train epoch:12 iter: 901 end\n",
      "Train epoch:12 iter: 902 begin\n",
      "Train epoch:12 iter: 902 end\n",
      "Train epoch:12 iter: 903 begin\n",
      "Train epoch:12 iter: 903 end\n",
      "Train epoch:12 iter: 904 begin\n",
      "Train epoch:12 iter: 904 end\n",
      "Train epoch:12 iter: 905 begin\n",
      "Train epoch:12 iter: 905 end\n",
      "Train epoch:12 iter: 906 begin\n",
      "Train epoch:12 iter: 906 end\n",
      "Train epoch:12 iter: 907 begin\n",
      "Train epoch:12 iter: 907 end\n",
      "Train epoch:12 iter: 908 begin\n",
      "Train epoch:12 iter: 908 end\n",
      "Train epoch:12 iter: 909 begin\n",
      "Train epoch:12 iter: 909 end\n",
      "Train epoch:12 iter: 910 begin\n",
      "Train epoch:12 iter: 910 end\n",
      "Train epoch:12 iter: 911 begin\n",
      "Train epoch:12 iter: 911 end\n",
      "Train epoch:12 iter: 912 begin\n",
      "Train epoch:12 iter: 912 end\n",
      "Train epoch:12 iter: 913 begin\n",
      "Train epoch:12 iter: 913 end\n",
      "Train epoch:12 iter: 914 begin\n",
      "Train epoch:12 iter: 914 end\n",
      "Train epoch:12 iter: 915 begin\n",
      "Train epoch:12 iter: 915 end\n",
      "Train epoch:12 iter: 916 begin\n",
      "Train epoch:12 iter: 916 end\n",
      "Train epoch:12 iter: 917 begin\n",
      "Train epoch:12 iter: 917 end\n",
      "Train epoch:12 iter: 918 begin\n",
      "Train epoch:12 iter: 918 end\n",
      "Train epoch:12 iter: 919 begin\n",
      "Train epoch:12 iter: 919 end\n",
      "Train epoch:12 iter: 920 begin\n",
      "Train epoch:12 iter: 920 end\n",
      "Train epoch:12 iter: 921 begin\n",
      "Train epoch:12 iter: 921 end\n",
      "Train epoch:12 iter: 922 begin\n",
      "Train epoch:12 iter: 922 end\n",
      "Train epoch:12 iter: 923 begin\n",
      "Train epoch:12 iter: 923 end\n",
      "Train epoch:12 iter: 924 begin\n",
      "Train epoch:12 iter: 924 end\n",
      "Train epoch:12 iter: 925 begin\n",
      "Train epoch:12 iter: 925 end\n",
      "Train epoch:12 iter: 926 begin\n",
      "Train epoch:12 iter: 926 end\n",
      "Train epoch:12 iter: 927 begin\n",
      "Train epoch:12 iter: 927 end\n",
      "Train epoch:12 iter: 928 begin\n",
      "Train epoch:12 iter: 928 end\n",
      "Train epoch:12 iter: 929 begin\n",
      "Train epoch:12 iter: 929 end\n",
      "Train epoch:12 iter: 930 begin\n",
      "Train epoch:12 iter: 930 end\n",
      "Train epoch:12 iter: 931 begin\n",
      "Train epoch:12 iter: 931 end\n",
      "Train epoch:12 iter: 932 begin\n",
      "Train epoch:12 iter: 932 end\n",
      "Train epoch:12 iter: 933 begin\n",
      "Train epoch:12 iter: 933 end\n",
      "Train epoch:12 iter: 934 begin\n",
      "Train epoch:12 iter: 934 end\n",
      "Train epoch:12 iter: 935 begin\n",
      "Train epoch:12 iter: 935 end\n",
      "Train epoch:12 iter: 936 begin\n",
      "Train epoch:12 iter: 936 end\n",
      "Train epoch:12 iter: 937 begin\n",
      "Train epoch:12 iter: 937 end\n",
      "Train epoch:12 iter: 938 begin\n",
      "Train epoch:12 iter: 938 end\n",
      "Train Loss: 0.001510, Acc: 0.963367\n",
      "save model for best accuate: 0.9633666666666667 begin\n",
      "save model for best accuate: 0.9633666666666667 end\n",
      "epoch 14\n",
      "Train epoch:13 iter: 1 begin\n",
      "Train epoch:13 iter: 1 end\n",
      "Train epoch:13 iter: 2 begin\n",
      "Train epoch:13 iter: 2 end\n",
      "Train epoch:13 iter: 3 begin\n",
      "Train epoch:13 iter: 3 end\n",
      "Train epoch:13 iter: 4 begin\n",
      "Train epoch:13 iter: 4 end\n",
      "Train epoch:13 iter: 5 begin\n",
      "Train epoch:13 iter: 5 end\n",
      "Train epoch:13 iter: 6 begin\n",
      "Train epoch:13 iter: 6 end\n",
      "Train epoch:13 iter: 7 begin\n",
      "Train epoch:13 iter: 7 end\n",
      "Train epoch:13 iter: 8 begin\n",
      "Train epoch:13 iter: 8 end\n",
      "Train epoch:13 iter: 9 begin\n",
      "Train epoch:13 iter: 9 end\n",
      "Train epoch:13 iter: 10 begin\n",
      "Train epoch:13 iter: 10 end\n",
      "Train epoch:13 iter: 11 begin\n",
      "Train epoch:13 iter: 11 end\n",
      "Train epoch:13 iter: 12 begin\n",
      "Train epoch:13 iter: 12 end\n",
      "Train epoch:13 iter: 13 begin\n",
      "Train epoch:13 iter: 13 end\n",
      "Train epoch:13 iter: 14 begin\n",
      "Train epoch:13 iter: 14 end\n",
      "Train epoch:13 iter: 15 begin\n",
      "Train epoch:13 iter: 15 end\n",
      "Train epoch:13 iter: 16 begin\n",
      "Train epoch:13 iter: 16 end\n",
      "Train epoch:13 iter: 17 begin\n",
      "Train epoch:13 iter: 17 end\n",
      "Train epoch:13 iter: 18 begin\n",
      "Train epoch:13 iter: 18 end\n",
      "Train epoch:13 iter: 19 begin\n",
      "Train epoch:13 iter: 19 end\n",
      "Train epoch:13 iter: 20 begin\n",
      "Train epoch:13 iter: 20 end\n",
      "Train epoch:13 iter: 21 begin\n",
      "Train epoch:13 iter: 21 end\n",
      "Train epoch:13 iter: 22 begin\n",
      "Train epoch:13 iter: 22 end\n",
      "Train epoch:13 iter: 23 begin\n",
      "Train epoch:13 iter: 23 end\n",
      "Train epoch:13 iter: 24 begin\n",
      "Train epoch:13 iter: 24 end\n",
      "Train epoch:13 iter: 25 begin\n",
      "Train epoch:13 iter: 25 end\n",
      "Train epoch:13 iter: 26 begin\n",
      "Train epoch:13 iter: 26 end\n",
      "Train epoch:13 iter: 27 begin\n",
      "Train epoch:13 iter: 27 end\n",
      "Train epoch:13 iter: 28 begin\n",
      "Train epoch:13 iter: 28 end\n",
      "Train epoch:13 iter: 29 begin\n",
      "Train epoch:13 iter: 29 end\n",
      "Train epoch:13 iter: 30 begin\n",
      "Train epoch:13 iter: 30 end\n",
      "Train epoch:13 iter: 31 begin\n",
      "Train epoch:13 iter: 31 end\n",
      "Train epoch:13 iter: 32 begin\n",
      "Train epoch:13 iter: 32 end\n",
      "Train epoch:13 iter: 33 begin\n",
      "Train epoch:13 iter: 33 end\n",
      "Train epoch:13 iter: 34 begin\n",
      "Train epoch:13 iter: 34 end\n",
      "Train epoch:13 iter: 35 begin\n",
      "Train epoch:13 iter: 35 end\n",
      "Train epoch:13 iter: 36 begin\n",
      "Train epoch:13 iter: 36 end\n",
      "Train epoch:13 iter: 37 begin\n",
      "Train epoch:13 iter: 37 end\n",
      "Train epoch:13 iter: 38 begin\n",
      "Train epoch:13 iter: 38 end\n",
      "Train epoch:13 iter: 39 begin\n",
      "Train epoch:13 iter: 39 end\n",
      "Train epoch:13 iter: 40 begin\n",
      "Train epoch:13 iter: 40 end\n",
      "Train epoch:13 iter: 41 begin\n",
      "Train epoch:13 iter: 41 end\n",
      "Train epoch:13 iter: 42 begin\n",
      "Train epoch:13 iter: 42 end\n",
      "Train epoch:13 iter: 43 begin\n",
      "Train epoch:13 iter: 43 end\n",
      "Train epoch:13 iter: 44 begin\n",
      "Train epoch:13 iter: 44 end\n",
      "Train epoch:13 iter: 45 begin\n",
      "Train epoch:13 iter: 45 end\n",
      "Train epoch:13 iter: 46 begin\n",
      "Train epoch:13 iter: 46 end\n",
      "Train epoch:13 iter: 47 begin\n",
      "Train epoch:13 iter: 47 end\n",
      "Train epoch:13 iter: 48 begin\n",
      "Train epoch:13 iter: 48 end\n",
      "Train epoch:13 iter: 49 begin\n",
      "Train epoch:13 iter: 49 end\n",
      "Train epoch:13 iter: 50 begin\n",
      "Train epoch:13 iter: 50 end\n",
      "Train epoch:13 iter: 51 begin\n",
      "Train epoch:13 iter: 51 end\n",
      "Train epoch:13 iter: 52 begin\n",
      "Train epoch:13 iter: 52 end\n",
      "Train epoch:13 iter: 53 begin\n",
      "Train epoch:13 iter: 53 end\n",
      "Train epoch:13 iter: 54 begin\n",
      "Train epoch:13 iter: 54 end\n",
      "Train epoch:13 iter: 55 begin\n",
      "Train epoch:13 iter: 55 end\n",
      "Train epoch:13 iter: 56 begin\n",
      "Train epoch:13 iter: 56 end\n",
      "Train epoch:13 iter: 57 begin\n",
      "Train epoch:13 iter: 57 end\n",
      "Train epoch:13 iter: 58 begin\n",
      "Train epoch:13 iter: 58 end\n",
      "Train epoch:13 iter: 59 begin\n",
      "Train epoch:13 iter: 59 end\n",
      "Train epoch:13 iter: 60 begin\n",
      "Train epoch:13 iter: 60 end\n",
      "Train epoch:13 iter: 61 begin\n",
      "Train epoch:13 iter: 61 end\n",
      "Train epoch:13 iter: 62 begin\n",
      "Train epoch:13 iter: 62 end\n",
      "Train epoch:13 iter: 63 begin\n",
      "Train epoch:13 iter: 63 end\n",
      "Train epoch:13 iter: 64 begin\n",
      "Train epoch:13 iter: 64 end\n",
      "Train epoch:13 iter: 65 begin\n",
      "Train epoch:13 iter: 65 end\n",
      "Train epoch:13 iter: 66 begin\n",
      "Train epoch:13 iter: 66 end\n",
      "Train epoch:13 iter: 67 begin\n",
      "Train epoch:13 iter: 67 end\n",
      "Train epoch:13 iter: 68 begin\n",
      "Train epoch:13 iter: 68 end\n",
      "Train epoch:13 iter: 69 begin\n",
      "Train epoch:13 iter: 69 end\n",
      "Train epoch:13 iter: 70 begin\n",
      "Train epoch:13 iter: 70 end\n",
      "Train epoch:13 iter: 71 begin\n",
      "Train epoch:13 iter: 71 end\n",
      "Train epoch:13 iter: 72 begin\n",
      "Train epoch:13 iter: 72 end\n",
      "Train epoch:13 iter: 73 begin\n",
      "Train epoch:13 iter: 73 end\n",
      "Train epoch:13 iter: 74 begin\n",
      "Train epoch:13 iter: 74 end\n",
      "Train epoch:13 iter: 75 begin\n",
      "Train epoch:13 iter: 75 end\n",
      "Train epoch:13 iter: 76 begin\n",
      "Train epoch:13 iter: 76 end\n",
      "Train epoch:13 iter: 77 begin\n",
      "Train epoch:13 iter: 77 end\n",
      "Train epoch:13 iter: 78 begin\n",
      "Train epoch:13 iter: 78 end\n",
      "Train epoch:13 iter: 79 begin\n",
      "Train epoch:13 iter: 79 end\n",
      "Train epoch:13 iter: 80 begin\n",
      "Train epoch:13 iter: 80 end\n",
      "Train epoch:13 iter: 81 begin\n",
      "Train epoch:13 iter: 81 end\n",
      "Train epoch:13 iter: 82 begin\n",
      "Train epoch:13 iter: 82 end\n",
      "Train epoch:13 iter: 83 begin\n",
      "Train epoch:13 iter: 83 end\n",
      "Train epoch:13 iter: 84 begin\n",
      "Train epoch:13 iter: 84 end\n",
      "Train epoch:13 iter: 85 begin\n",
      "Train epoch:13 iter: 85 end\n",
      "Train epoch:13 iter: 86 begin\n",
      "Train epoch:13 iter: 86 end\n",
      "Train epoch:13 iter: 87 begin\n",
      "Train epoch:13 iter: 87 end\n",
      "Train epoch:13 iter: 88 begin\n",
      "Train epoch:13 iter: 88 end\n",
      "Train epoch:13 iter: 89 begin\n",
      "Train epoch:13 iter: 89 end\n",
      "Train epoch:13 iter: 90 begin\n",
      "Train epoch:13 iter: 90 end\n",
      "Train epoch:13 iter: 91 begin\n",
      "Train epoch:13 iter: 91 end\n",
      "Train epoch:13 iter: 92 begin\n",
      "Train epoch:13 iter: 92 end\n",
      "Train epoch:13 iter: 93 begin\n",
      "Train epoch:13 iter: 93 end\n",
      "Train epoch:13 iter: 94 begin\n",
      "Train epoch:13 iter: 94 end\n",
      "Train epoch:13 iter: 95 begin\n",
      "Train epoch:13 iter: 95 end\n",
      "Train epoch:13 iter: 96 begin\n",
      "Train epoch:13 iter: 96 end\n",
      "Train epoch:13 iter: 97 begin\n",
      "Train epoch:13 iter: 97 end\n",
      "Train epoch:13 iter: 98 begin\n",
      "Train epoch:13 iter: 98 end\n",
      "Train epoch:13 iter: 99 begin\n",
      "Train epoch:13 iter: 99 end\n",
      "Train epoch:13 iter: 100 begin\n",
      "Train epoch:13 iter: 100 end\n",
      "Train epoch:13 iter: 101 begin\n",
      "Train epoch:13 iter: 101 end\n",
      "Train epoch:13 iter: 102 begin\n",
      "Train epoch:13 iter: 102 end\n",
      "Train epoch:13 iter: 103 begin\n",
      "Train epoch:13 iter: 103 end\n",
      "Train epoch:13 iter: 104 begin\n",
      "Train epoch:13 iter: 104 end\n",
      "Train epoch:13 iter: 105 begin\n",
      "Train epoch:13 iter: 105 end\n",
      "Train epoch:13 iter: 106 begin\n",
      "Train epoch:13 iter: 106 end\n",
      "Train epoch:13 iter: 107 begin\n",
      "Train epoch:13 iter: 107 end\n",
      "Train epoch:13 iter: 108 begin\n",
      "Train epoch:13 iter: 108 end\n",
      "Train epoch:13 iter: 109 begin\n",
      "Train epoch:13 iter: 109 end\n",
      "Train epoch:13 iter: 110 begin\n",
      "Train epoch:13 iter: 110 end\n",
      "Train epoch:13 iter: 111 begin\n",
      "Train epoch:13 iter: 111 end\n",
      "Train epoch:13 iter: 112 begin\n",
      "Train epoch:13 iter: 112 end\n",
      "Train epoch:13 iter: 113 begin\n",
      "Train epoch:13 iter: 113 end\n",
      "Train epoch:13 iter: 114 begin\n",
      "Train epoch:13 iter: 114 end\n",
      "Train epoch:13 iter: 115 begin\n",
      "Train epoch:13 iter: 115 end\n",
      "Train epoch:13 iter: 116 begin\n",
      "Train epoch:13 iter: 116 end\n",
      "Train epoch:13 iter: 117 begin\n",
      "Train epoch:13 iter: 117 end\n",
      "Train epoch:13 iter: 118 begin\n",
      "Train epoch:13 iter: 118 end\n",
      "Train epoch:13 iter: 119 begin\n",
      "Train epoch:13 iter: 119 end\n",
      "Train epoch:13 iter: 120 begin\n",
      "Train epoch:13 iter: 120 end\n",
      "Train epoch:13 iter: 121 begin\n",
      "Train epoch:13 iter: 121 end\n",
      "Train epoch:13 iter: 122 begin\n",
      "Train epoch:13 iter: 122 end\n",
      "Train epoch:13 iter: 123 begin\n",
      "Train epoch:13 iter: 123 end\n",
      "Train epoch:13 iter: 124 begin\n",
      "Train epoch:13 iter: 124 end\n",
      "Train epoch:13 iter: 125 begin\n",
      "Train epoch:13 iter: 125 end\n",
      "Train epoch:13 iter: 126 begin\n",
      "Train epoch:13 iter: 126 end\n",
      "Train epoch:13 iter: 127 begin\n",
      "Train epoch:13 iter: 127 end\n",
      "Train epoch:13 iter: 128 begin\n",
      "Train epoch:13 iter: 128 end\n",
      "Train epoch:13 iter: 129 begin\n",
      "Train epoch:13 iter: 129 end\n",
      "Train epoch:13 iter: 130 begin\n",
      "Train epoch:13 iter: 130 end\n",
      "Train epoch:13 iter: 131 begin\n",
      "Train epoch:13 iter: 131 end\n",
      "Train epoch:13 iter: 132 begin\n",
      "Train epoch:13 iter: 132 end\n",
      "Train epoch:13 iter: 133 begin\n",
      "Train epoch:13 iter: 133 end\n",
      "Train epoch:13 iter: 134 begin\n",
      "Train epoch:13 iter: 134 end\n",
      "Train epoch:13 iter: 135 begin\n",
      "Train epoch:13 iter: 135 end\n",
      "Train epoch:13 iter: 136 begin\n",
      "Train epoch:13 iter: 136 end\n",
      "Train epoch:13 iter: 137 begin\n",
      "Train epoch:13 iter: 137 end\n",
      "Train epoch:13 iter: 138 begin\n",
      "Train epoch:13 iter: 138 end\n",
      "Train epoch:13 iter: 139 begin\n",
      "Train epoch:13 iter: 139 end\n",
      "Train epoch:13 iter: 140 begin\n",
      "Train epoch:13 iter: 140 end\n",
      "Train epoch:13 iter: 141 begin\n",
      "Train epoch:13 iter: 141 end\n",
      "Train epoch:13 iter: 142 begin\n",
      "Train epoch:13 iter: 142 end\n",
      "Train epoch:13 iter: 143 begin\n",
      "Train epoch:13 iter: 143 end\n",
      "Train epoch:13 iter: 144 begin\n",
      "Train epoch:13 iter: 144 end\n",
      "Train epoch:13 iter: 145 begin\n",
      "Train epoch:13 iter: 145 end\n",
      "Train epoch:13 iter: 146 begin\n",
      "Train epoch:13 iter: 146 end\n",
      "Train epoch:13 iter: 147 begin\n",
      "Train epoch:13 iter: 147 end\n",
      "Train epoch:13 iter: 148 begin\n",
      "Train epoch:13 iter: 148 end\n",
      "Train epoch:13 iter: 149 begin\n",
      "Train epoch:13 iter: 149 end\n",
      "Train epoch:13 iter: 150 begin\n",
      "Train epoch:13 iter: 150 end\n",
      "Train epoch:13 iter: 151 begin\n",
      "Train epoch:13 iter: 151 end\n",
      "Train epoch:13 iter: 152 begin\n",
      "Train epoch:13 iter: 152 end\n",
      "Train epoch:13 iter: 153 begin\n",
      "Train epoch:13 iter: 153 end\n",
      "Train epoch:13 iter: 154 begin\n",
      "Train epoch:13 iter: 154 end\n",
      "Train epoch:13 iter: 155 begin\n",
      "Train epoch:13 iter: 155 end\n",
      "Train epoch:13 iter: 156 begin\n",
      "Train epoch:13 iter: 156 end\n",
      "Train epoch:13 iter: 157 begin\n",
      "Train epoch:13 iter: 157 end\n",
      "Train epoch:13 iter: 158 begin\n",
      "Train epoch:13 iter: 158 end\n",
      "Train epoch:13 iter: 159 begin\n",
      "Train epoch:13 iter: 159 end\n",
      "Train epoch:13 iter: 160 begin\n",
      "Train epoch:13 iter: 160 end\n",
      "Train epoch:13 iter: 161 begin\n",
      "Train epoch:13 iter: 161 end\n",
      "Train epoch:13 iter: 162 begin\n",
      "Train epoch:13 iter: 162 end\n",
      "Train epoch:13 iter: 163 begin\n",
      "Train epoch:13 iter: 163 end\n",
      "Train epoch:13 iter: 164 begin\n",
      "Train epoch:13 iter: 164 end\n",
      "Train epoch:13 iter: 165 begin\n",
      "Train epoch:13 iter: 165 end\n",
      "Train epoch:13 iter: 166 begin\n",
      "Train epoch:13 iter: 166 end\n",
      "Train epoch:13 iter: 167 begin\n",
      "Train epoch:13 iter: 167 end\n",
      "Train epoch:13 iter: 168 begin\n",
      "Train epoch:13 iter: 168 end\n",
      "Train epoch:13 iter: 169 begin\n",
      "Train epoch:13 iter: 169 end\n",
      "Train epoch:13 iter: 170 begin\n",
      "Train epoch:13 iter: 170 end\n",
      "Train epoch:13 iter: 171 begin\n",
      "Train epoch:13 iter: 171 end\n",
      "Train epoch:13 iter: 172 begin\n",
      "Train epoch:13 iter: 172 end\n",
      "Train epoch:13 iter: 173 begin\n",
      "Train epoch:13 iter: 173 end\n",
      "Train epoch:13 iter: 174 begin\n",
      "Train epoch:13 iter: 174 end\n",
      "Train epoch:13 iter: 175 begin\n",
      "Train epoch:13 iter: 175 end\n",
      "Train epoch:13 iter: 176 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:13 iter: 176 end\n",
      "Train epoch:13 iter: 177 begin\n",
      "Train epoch:13 iter: 177 end\n",
      "Train epoch:13 iter: 178 begin\n",
      "Train epoch:13 iter: 178 end\n",
      "Train epoch:13 iter: 179 begin\n",
      "Train epoch:13 iter: 179 end\n",
      "Train epoch:13 iter: 180 begin\n",
      "Train epoch:13 iter: 180 end\n",
      "Train epoch:13 iter: 181 begin\n",
      "Train epoch:13 iter: 181 end\n",
      "Train epoch:13 iter: 182 begin\n",
      "Train epoch:13 iter: 182 end\n",
      "Train epoch:13 iter: 183 begin\n",
      "Train epoch:13 iter: 183 end\n",
      "Train epoch:13 iter: 184 begin\n",
      "Train epoch:13 iter: 184 end\n",
      "Train epoch:13 iter: 185 begin\n",
      "Train epoch:13 iter: 185 end\n",
      "Train epoch:13 iter: 186 begin\n",
      "Train epoch:13 iter: 186 end\n",
      "Train epoch:13 iter: 187 begin\n",
      "Train epoch:13 iter: 187 end\n",
      "Train epoch:13 iter: 188 begin\n",
      "Train epoch:13 iter: 188 end\n",
      "Train epoch:13 iter: 189 begin\n",
      "Train epoch:13 iter: 189 end\n",
      "Train epoch:13 iter: 190 begin\n",
      "Train epoch:13 iter: 190 end\n",
      "Train epoch:13 iter: 191 begin\n",
      "Train epoch:13 iter: 191 end\n",
      "Train epoch:13 iter: 192 begin\n",
      "Train epoch:13 iter: 192 end\n",
      "Train epoch:13 iter: 193 begin\n",
      "Train epoch:13 iter: 193 end\n",
      "Train epoch:13 iter: 194 begin\n",
      "Train epoch:13 iter: 194 end\n",
      "Train epoch:13 iter: 195 begin\n",
      "Train epoch:13 iter: 195 end\n",
      "Train epoch:13 iter: 196 begin\n",
      "Train epoch:13 iter: 196 end\n",
      "Train epoch:13 iter: 197 begin\n",
      "Train epoch:13 iter: 197 end\n",
      "Train epoch:13 iter: 198 begin\n",
      "Train epoch:13 iter: 198 end\n",
      "Train epoch:13 iter: 199 begin\n",
      "Train epoch:13 iter: 199 end\n",
      "Train epoch:13 iter: 200 begin\n",
      "Train epoch:13 iter: 200 end\n",
      "Train epoch:13 iter: 201 begin\n",
      "Train epoch:13 iter: 201 end\n",
      "Train epoch:13 iter: 202 begin\n",
      "Train epoch:13 iter: 202 end\n",
      "Train epoch:13 iter: 203 begin\n",
      "Train epoch:13 iter: 203 end\n",
      "Train epoch:13 iter: 204 begin\n",
      "Train epoch:13 iter: 204 end\n",
      "Train epoch:13 iter: 205 begin\n",
      "Train epoch:13 iter: 205 end\n",
      "Train epoch:13 iter: 206 begin\n",
      "Train epoch:13 iter: 206 end\n",
      "Train epoch:13 iter: 207 begin\n",
      "Train epoch:13 iter: 207 end\n",
      "Train epoch:13 iter: 208 begin\n",
      "Train epoch:13 iter: 208 end\n",
      "Train epoch:13 iter: 209 begin\n",
      "Train epoch:13 iter: 209 end\n",
      "Train epoch:13 iter: 210 begin\n",
      "Train epoch:13 iter: 210 end\n",
      "Train epoch:13 iter: 211 begin\n",
      "Train epoch:13 iter: 211 end\n",
      "Train epoch:13 iter: 212 begin\n",
      "Train epoch:13 iter: 212 end\n",
      "Train epoch:13 iter: 213 begin\n",
      "Train epoch:13 iter: 213 end\n",
      "Train epoch:13 iter: 214 begin\n",
      "Train epoch:13 iter: 214 end\n",
      "Train epoch:13 iter: 215 begin\n",
      "Train epoch:13 iter: 215 end\n",
      "Train epoch:13 iter: 216 begin\n",
      "Train epoch:13 iter: 216 end\n",
      "Train epoch:13 iter: 217 begin\n",
      "Train epoch:13 iter: 217 end\n",
      "Train epoch:13 iter: 218 begin\n",
      "Train epoch:13 iter: 218 end\n",
      "Train epoch:13 iter: 219 begin\n",
      "Train epoch:13 iter: 219 end\n",
      "Train epoch:13 iter: 220 begin\n",
      "Train epoch:13 iter: 220 end\n",
      "Train epoch:13 iter: 221 begin\n",
      "Train epoch:13 iter: 221 end\n",
      "Train epoch:13 iter: 222 begin\n",
      "Train epoch:13 iter: 222 end\n",
      "Train epoch:13 iter: 223 begin\n",
      "Train epoch:13 iter: 223 end\n",
      "Train epoch:13 iter: 224 begin\n",
      "Train epoch:13 iter: 224 end\n",
      "Train epoch:13 iter: 225 begin\n",
      "Train epoch:13 iter: 225 end\n",
      "Train epoch:13 iter: 226 begin\n",
      "Train epoch:13 iter: 226 end\n",
      "Train epoch:13 iter: 227 begin\n",
      "Train epoch:13 iter: 227 end\n",
      "Train epoch:13 iter: 228 begin\n",
      "Train epoch:13 iter: 228 end\n",
      "Train epoch:13 iter: 229 begin\n",
      "Train epoch:13 iter: 229 end\n",
      "Train epoch:13 iter: 230 begin\n",
      "Train epoch:13 iter: 230 end\n",
      "Train epoch:13 iter: 231 begin\n",
      "Train epoch:13 iter: 231 end\n",
      "Train epoch:13 iter: 232 begin\n",
      "Train epoch:13 iter: 232 end\n",
      "Train epoch:13 iter: 233 begin\n",
      "Train epoch:13 iter: 233 end\n",
      "Train epoch:13 iter: 234 begin\n",
      "Train epoch:13 iter: 234 end\n",
      "Train epoch:13 iter: 235 begin\n",
      "Train epoch:13 iter: 235 end\n",
      "Train epoch:13 iter: 236 begin\n",
      "Train epoch:13 iter: 236 end\n",
      "Train epoch:13 iter: 237 begin\n",
      "Train epoch:13 iter: 237 end\n",
      "Train epoch:13 iter: 238 begin\n",
      "Train epoch:13 iter: 238 end\n",
      "Train epoch:13 iter: 239 begin\n",
      "Train epoch:13 iter: 239 end\n",
      "Train epoch:13 iter: 240 begin\n",
      "Train epoch:13 iter: 240 end\n",
      "Train epoch:13 iter: 241 begin\n",
      "Train epoch:13 iter: 241 end\n",
      "Train epoch:13 iter: 242 begin\n",
      "Train epoch:13 iter: 242 end\n",
      "Train epoch:13 iter: 243 begin\n",
      "Train epoch:13 iter: 243 end\n",
      "Train epoch:13 iter: 244 begin\n",
      "Train epoch:13 iter: 244 end\n",
      "Train epoch:13 iter: 245 begin\n",
      "Train epoch:13 iter: 245 end\n",
      "Train epoch:13 iter: 246 begin\n",
      "Train epoch:13 iter: 246 end\n",
      "Train epoch:13 iter: 247 begin\n",
      "Train epoch:13 iter: 247 end\n",
      "Train epoch:13 iter: 248 begin\n",
      "Train epoch:13 iter: 248 end\n",
      "Train epoch:13 iter: 249 begin\n",
      "Train epoch:13 iter: 249 end\n",
      "Train epoch:13 iter: 250 begin\n",
      "Train epoch:13 iter: 250 end\n",
      "Train epoch:13 iter: 251 begin\n",
      "Train epoch:13 iter: 251 end\n",
      "Train epoch:13 iter: 252 begin\n",
      "Train epoch:13 iter: 252 end\n",
      "Train epoch:13 iter: 253 begin\n",
      "Train epoch:13 iter: 253 end\n",
      "Train epoch:13 iter: 254 begin\n",
      "Train epoch:13 iter: 254 end\n",
      "Train epoch:13 iter: 255 begin\n",
      "Train epoch:13 iter: 255 end\n",
      "Train epoch:13 iter: 256 begin\n",
      "Train epoch:13 iter: 256 end\n",
      "Train epoch:13 iter: 257 begin\n",
      "Train epoch:13 iter: 257 end\n",
      "Train epoch:13 iter: 258 begin\n",
      "Train epoch:13 iter: 258 end\n",
      "Train epoch:13 iter: 259 begin\n",
      "Train epoch:13 iter: 259 end\n",
      "Train epoch:13 iter: 260 begin\n",
      "Train epoch:13 iter: 260 end\n",
      "Train epoch:13 iter: 261 begin\n",
      "Train epoch:13 iter: 261 end\n",
      "Train epoch:13 iter: 262 begin\n",
      "Train epoch:13 iter: 262 end\n",
      "Train epoch:13 iter: 263 begin\n",
      "Train epoch:13 iter: 263 end\n",
      "Train epoch:13 iter: 264 begin\n",
      "Train epoch:13 iter: 264 end\n",
      "Train epoch:13 iter: 265 begin\n",
      "Train epoch:13 iter: 265 end\n",
      "Train epoch:13 iter: 266 begin\n",
      "Train epoch:13 iter: 266 end\n",
      "Train epoch:13 iter: 267 begin\n",
      "Train epoch:13 iter: 267 end\n",
      "Train epoch:13 iter: 268 begin\n",
      "Train epoch:13 iter: 268 end\n",
      "Train epoch:13 iter: 269 begin\n",
      "Train epoch:13 iter: 269 end\n",
      "Train epoch:13 iter: 270 begin\n",
      "Train epoch:13 iter: 270 end\n",
      "Train epoch:13 iter: 271 begin\n",
      "Train epoch:13 iter: 271 end\n",
      "Train epoch:13 iter: 272 begin\n",
      "Train epoch:13 iter: 272 end\n",
      "Train epoch:13 iter: 273 begin\n",
      "Train epoch:13 iter: 273 end\n",
      "Train epoch:13 iter: 274 begin\n",
      "Train epoch:13 iter: 274 end\n",
      "Train epoch:13 iter: 275 begin\n",
      "Train epoch:13 iter: 275 end\n",
      "Train epoch:13 iter: 276 begin\n",
      "Train epoch:13 iter: 276 end\n",
      "Train epoch:13 iter: 277 begin\n",
      "Train epoch:13 iter: 277 end\n",
      "Train epoch:13 iter: 278 begin\n",
      "Train epoch:13 iter: 278 end\n",
      "Train epoch:13 iter: 279 begin\n",
      "Train epoch:13 iter: 279 end\n",
      "Train epoch:13 iter: 280 begin\n",
      "Train epoch:13 iter: 280 end\n",
      "Train epoch:13 iter: 281 begin\n",
      "Train epoch:13 iter: 281 end\n",
      "Train epoch:13 iter: 282 begin\n",
      "Train epoch:13 iter: 282 end\n",
      "Train epoch:13 iter: 283 begin\n",
      "Train epoch:13 iter: 283 end\n",
      "Train epoch:13 iter: 284 begin\n",
      "Train epoch:13 iter: 284 end\n",
      "Train epoch:13 iter: 285 begin\n",
      "Train epoch:13 iter: 285 end\n",
      "Train epoch:13 iter: 286 begin\n",
      "Train epoch:13 iter: 286 end\n",
      "Train epoch:13 iter: 287 begin\n",
      "Train epoch:13 iter: 287 end\n",
      "Train epoch:13 iter: 288 begin\n",
      "Train epoch:13 iter: 288 end\n",
      "Train epoch:13 iter: 289 begin\n",
      "Train epoch:13 iter: 289 end\n",
      "Train epoch:13 iter: 290 begin\n",
      "Train epoch:13 iter: 290 end\n",
      "Train epoch:13 iter: 291 begin\n",
      "Train epoch:13 iter: 291 end\n",
      "Train epoch:13 iter: 292 begin\n",
      "Train epoch:13 iter: 292 end\n",
      "Train epoch:13 iter: 293 begin\n",
      "Train epoch:13 iter: 293 end\n",
      "Train epoch:13 iter: 294 begin\n",
      "Train epoch:13 iter: 294 end\n",
      "Train epoch:13 iter: 295 begin\n",
      "Train epoch:13 iter: 295 end\n",
      "Train epoch:13 iter: 296 begin\n",
      "Train epoch:13 iter: 296 end\n",
      "Train epoch:13 iter: 297 begin\n",
      "Train epoch:13 iter: 297 end\n",
      "Train epoch:13 iter: 298 begin\n",
      "Train epoch:13 iter: 298 end\n",
      "Train epoch:13 iter: 299 begin\n",
      "Train epoch:13 iter: 299 end\n",
      "Train epoch:13 iter: 300 begin\n",
      "Train epoch:13 iter: 300 end\n",
      "Train epoch:13 iter: 301 begin\n",
      "Train epoch:13 iter: 301 end\n",
      "Train epoch:13 iter: 302 begin\n",
      "Train epoch:13 iter: 302 end\n",
      "Train epoch:13 iter: 303 begin\n",
      "Train epoch:13 iter: 303 end\n",
      "Train epoch:13 iter: 304 begin\n",
      "Train epoch:13 iter: 304 end\n",
      "Train epoch:13 iter: 305 begin\n",
      "Train epoch:13 iter: 305 end\n",
      "Train epoch:13 iter: 306 begin\n",
      "Train epoch:13 iter: 306 end\n",
      "Train epoch:13 iter: 307 begin\n",
      "Train epoch:13 iter: 307 end\n",
      "Train epoch:13 iter: 308 begin\n",
      "Train epoch:13 iter: 308 end\n",
      "Train epoch:13 iter: 309 begin\n",
      "Train epoch:13 iter: 309 end\n",
      "Train epoch:13 iter: 310 begin\n",
      "Train epoch:13 iter: 310 end\n",
      "Train epoch:13 iter: 311 begin\n",
      "Train epoch:13 iter: 311 end\n",
      "Train epoch:13 iter: 312 begin\n",
      "Train epoch:13 iter: 312 end\n",
      "Train epoch:13 iter: 313 begin\n",
      "Train epoch:13 iter: 313 end\n",
      "Train epoch:13 iter: 314 begin\n",
      "Train epoch:13 iter: 314 end\n",
      "Train epoch:13 iter: 315 begin\n",
      "Train epoch:13 iter: 315 end\n",
      "Train epoch:13 iter: 316 begin\n",
      "Train epoch:13 iter: 316 end\n",
      "Train epoch:13 iter: 317 begin\n",
      "Train epoch:13 iter: 317 end\n",
      "Train epoch:13 iter: 318 begin\n",
      "Train epoch:13 iter: 318 end\n",
      "Train epoch:13 iter: 319 begin\n",
      "Train epoch:13 iter: 319 end\n",
      "Train epoch:13 iter: 320 begin\n",
      "Train epoch:13 iter: 320 end\n",
      "Train epoch:13 iter: 321 begin\n",
      "Train epoch:13 iter: 321 end\n",
      "Train epoch:13 iter: 322 begin\n",
      "Train epoch:13 iter: 322 end\n",
      "Train epoch:13 iter: 323 begin\n",
      "Train epoch:13 iter: 323 end\n",
      "Train epoch:13 iter: 324 begin\n",
      "Train epoch:13 iter: 324 end\n",
      "Train epoch:13 iter: 325 begin\n",
      "Train epoch:13 iter: 325 end\n",
      "Train epoch:13 iter: 326 begin\n",
      "Train epoch:13 iter: 326 end\n",
      "Train epoch:13 iter: 327 begin\n",
      "Train epoch:13 iter: 327 end\n",
      "Train epoch:13 iter: 328 begin\n",
      "Train epoch:13 iter: 328 end\n",
      "Train epoch:13 iter: 329 begin\n",
      "Train epoch:13 iter: 329 end\n",
      "Train epoch:13 iter: 330 begin\n",
      "Train epoch:13 iter: 330 end\n",
      "Train epoch:13 iter: 331 begin\n",
      "Train epoch:13 iter: 331 end\n",
      "Train epoch:13 iter: 332 begin\n",
      "Train epoch:13 iter: 332 end\n",
      "Train epoch:13 iter: 333 begin\n",
      "Train epoch:13 iter: 333 end\n",
      "Train epoch:13 iter: 334 begin\n",
      "Train epoch:13 iter: 334 end\n",
      "Train epoch:13 iter: 335 begin\n",
      "Train epoch:13 iter: 335 end\n",
      "Train epoch:13 iter: 336 begin\n",
      "Train epoch:13 iter: 336 end\n",
      "Train epoch:13 iter: 337 begin\n",
      "Train epoch:13 iter: 337 end\n",
      "Train epoch:13 iter: 338 begin\n",
      "Train epoch:13 iter: 338 end\n",
      "Train epoch:13 iter: 339 begin\n",
      "Train epoch:13 iter: 339 end\n",
      "Train epoch:13 iter: 340 begin\n",
      "Train epoch:13 iter: 340 end\n",
      "Train epoch:13 iter: 341 begin\n",
      "Train epoch:13 iter: 341 end\n",
      "Train epoch:13 iter: 342 begin\n",
      "Train epoch:13 iter: 342 end\n",
      "Train epoch:13 iter: 343 begin\n",
      "Train epoch:13 iter: 343 end\n",
      "Train epoch:13 iter: 344 begin\n",
      "Train epoch:13 iter: 344 end\n",
      "Train epoch:13 iter: 345 begin\n",
      "Train epoch:13 iter: 345 end\n",
      "Train epoch:13 iter: 346 begin\n",
      "Train epoch:13 iter: 346 end\n",
      "Train epoch:13 iter: 347 begin\n",
      "Train epoch:13 iter: 347 end\n",
      "Train epoch:13 iter: 348 begin\n",
      "Train epoch:13 iter: 348 end\n",
      "Train epoch:13 iter: 349 begin\n",
      "Train epoch:13 iter: 349 end\n",
      "Train epoch:13 iter: 350 begin\n",
      "Train epoch:13 iter: 350 end\n",
      "Train epoch:13 iter: 351 begin\n",
      "Train epoch:13 iter: 351 end\n",
      "Train epoch:13 iter: 352 begin\n",
      "Train epoch:13 iter: 352 end\n",
      "Train epoch:13 iter: 353 begin\n",
      "Train epoch:13 iter: 353 end\n",
      "Train epoch:13 iter: 354 begin\n",
      "Train epoch:13 iter: 354 end\n",
      "Train epoch:13 iter: 355 begin\n",
      "Train epoch:13 iter: 355 end\n",
      "Train epoch:13 iter: 356 begin\n",
      "Train epoch:13 iter: 356 end\n",
      "Train epoch:13 iter: 357 begin\n",
      "Train epoch:13 iter: 357 end\n",
      "Train epoch:13 iter: 358 begin\n",
      "Train epoch:13 iter: 358 end\n",
      "Train epoch:13 iter: 359 begin\n",
      "Train epoch:13 iter: 359 end\n",
      "Train epoch:13 iter: 360 begin\n",
      "Train epoch:13 iter: 360 end\n",
      "Train epoch:13 iter: 361 begin\n",
      "Train epoch:13 iter: 361 end\n",
      "Train epoch:13 iter: 362 begin\n",
      "Train epoch:13 iter: 362 end\n",
      "Train epoch:13 iter: 363 begin\n",
      "Train epoch:13 iter: 363 end\n",
      "Train epoch:13 iter: 364 begin\n",
      "Train epoch:13 iter: 364 end\n",
      "Train epoch:13 iter: 365 begin\n",
      "Train epoch:13 iter: 365 end\n",
      "Train epoch:13 iter: 366 begin\n",
      "Train epoch:13 iter: 366 end\n",
      "Train epoch:13 iter: 367 begin\n",
      "Train epoch:13 iter: 367 end\n",
      "Train epoch:13 iter: 368 begin\n",
      "Train epoch:13 iter: 368 end\n",
      "Train epoch:13 iter: 369 begin\n",
      "Train epoch:13 iter: 369 end\n",
      "Train epoch:13 iter: 370 begin\n",
      "Train epoch:13 iter: 370 end\n",
      "Train epoch:13 iter: 371 begin\n",
      "Train epoch:13 iter: 371 end\n",
      "Train epoch:13 iter: 372 begin\n",
      "Train epoch:13 iter: 372 end\n",
      "Train epoch:13 iter: 373 begin\n",
      "Train epoch:13 iter: 373 end\n",
      "Train epoch:13 iter: 374 begin\n",
      "Train epoch:13 iter: 374 end\n",
      "Train epoch:13 iter: 375 begin\n",
      "Train epoch:13 iter: 375 end\n",
      "Train epoch:13 iter: 376 begin\n",
      "Train epoch:13 iter: 376 end\n",
      "Train epoch:13 iter: 377 begin\n",
      "Train epoch:13 iter: 377 end\n",
      "Train epoch:13 iter: 378 begin\n",
      "Train epoch:13 iter: 378 end\n",
      "Train epoch:13 iter: 379 begin\n",
      "Train epoch:13 iter: 379 end\n",
      "Train epoch:13 iter: 380 begin\n",
      "Train epoch:13 iter: 380 end\n",
      "Train epoch:13 iter: 381 begin\n",
      "Train epoch:13 iter: 381 end\n",
      "Train epoch:13 iter: 382 begin\n",
      "Train epoch:13 iter: 382 end\n",
      "Train epoch:13 iter: 383 begin\n",
      "Train epoch:13 iter: 383 end\n",
      "Train epoch:13 iter: 384 begin\n",
      "Train epoch:13 iter: 384 end\n",
      "Train epoch:13 iter: 385 begin\n",
      "Train epoch:13 iter: 385 end\n",
      "Train epoch:13 iter: 386 begin\n",
      "Train epoch:13 iter: 386 end\n",
      "Train epoch:13 iter: 387 begin\n",
      "Train epoch:13 iter: 387 end\n",
      "Train epoch:13 iter: 388 begin\n",
      "Train epoch:13 iter: 388 end\n",
      "Train epoch:13 iter: 389 begin\n",
      "Train epoch:13 iter: 389 end\n",
      "Train epoch:13 iter: 390 begin\n",
      "Train epoch:13 iter: 390 end\n",
      "Train epoch:13 iter: 391 begin\n",
      "Train epoch:13 iter: 391 end\n",
      "Train epoch:13 iter: 392 begin\n",
      "Train epoch:13 iter: 392 end\n",
      "Train epoch:13 iter: 393 begin\n",
      "Train epoch:13 iter: 393 end\n",
      "Train epoch:13 iter: 394 begin\n",
      "Train epoch:13 iter: 394 end\n",
      "Train epoch:13 iter: 395 begin\n",
      "Train epoch:13 iter: 395 end\n",
      "Train epoch:13 iter: 396 begin\n",
      "Train epoch:13 iter: 396 end\n",
      "Train epoch:13 iter: 397 begin\n",
      "Train epoch:13 iter: 397 end\n",
      "Train epoch:13 iter: 398 begin\n",
      "Train epoch:13 iter: 398 end\n",
      "Train epoch:13 iter: 399 begin\n",
      "Train epoch:13 iter: 399 end\n",
      "Train epoch:13 iter: 400 begin\n",
      "Train epoch:13 iter: 400 end\n",
      "Train epoch:13 iter: 401 begin\n",
      "Train epoch:13 iter: 401 end\n",
      "Train epoch:13 iter: 402 begin\n",
      "Train epoch:13 iter: 402 end\n",
      "Train epoch:13 iter: 403 begin\n",
      "Train epoch:13 iter: 403 end\n",
      "Train epoch:13 iter: 404 begin\n",
      "Train epoch:13 iter: 404 end\n",
      "Train epoch:13 iter: 405 begin\n",
      "Train epoch:13 iter: 405 end\n",
      "Train epoch:13 iter: 406 begin\n",
      "Train epoch:13 iter: 406 end\n",
      "Train epoch:13 iter: 407 begin\n",
      "Train epoch:13 iter: 407 end\n",
      "Train epoch:13 iter: 408 begin\n",
      "Train epoch:13 iter: 408 end\n",
      "Train epoch:13 iter: 409 begin\n",
      "Train epoch:13 iter: 409 end\n",
      "Train epoch:13 iter: 410 begin\n",
      "Train epoch:13 iter: 410 end\n",
      "Train epoch:13 iter: 411 begin\n",
      "Train epoch:13 iter: 411 end\n",
      "Train epoch:13 iter: 412 begin\n",
      "Train epoch:13 iter: 412 end\n",
      "Train epoch:13 iter: 413 begin\n",
      "Train epoch:13 iter: 413 end\n",
      "Train epoch:13 iter: 414 begin\n",
      "Train epoch:13 iter: 414 end\n",
      "Train epoch:13 iter: 415 begin\n",
      "Train epoch:13 iter: 415 end\n",
      "Train epoch:13 iter: 416 begin\n",
      "Train epoch:13 iter: 416 end\n",
      "Train epoch:13 iter: 417 begin\n",
      "Train epoch:13 iter: 417 end\n",
      "Train epoch:13 iter: 418 begin\n",
      "Train epoch:13 iter: 418 end\n",
      "Train epoch:13 iter: 419 begin\n",
      "Train epoch:13 iter: 419 end\n",
      "Train epoch:13 iter: 420 begin\n",
      "Train epoch:13 iter: 420 end\n",
      "Train epoch:13 iter: 421 begin\n",
      "Train epoch:13 iter: 421 end\n",
      "Train epoch:13 iter: 422 begin\n",
      "Train epoch:13 iter: 422 end\n",
      "Train epoch:13 iter: 423 begin\n",
      "Train epoch:13 iter: 423 end\n",
      "Train epoch:13 iter: 424 begin\n",
      "Train epoch:13 iter: 424 end\n",
      "Train epoch:13 iter: 425 begin\n",
      "Train epoch:13 iter: 425 end\n",
      "Train epoch:13 iter: 426 begin\n",
      "Train epoch:13 iter: 426 end\n",
      "Train epoch:13 iter: 427 begin\n",
      "Train epoch:13 iter: 427 end\n",
      "Train epoch:13 iter: 428 begin\n",
      "Train epoch:13 iter: 428 end\n",
      "Train epoch:13 iter: 429 begin\n",
      "Train epoch:13 iter: 429 end\n",
      "Train epoch:13 iter: 430 begin\n",
      "Train epoch:13 iter: 430 end\n",
      "Train epoch:13 iter: 431 begin\n",
      "Train epoch:13 iter: 431 end\n",
      "Train epoch:13 iter: 432 begin\n",
      "Train epoch:13 iter: 432 end\n",
      "Train epoch:13 iter: 433 begin\n",
      "Train epoch:13 iter: 433 end\n",
      "Train epoch:13 iter: 434 begin\n",
      "Train epoch:13 iter: 434 end\n",
      "Train epoch:13 iter: 435 begin\n",
      "Train epoch:13 iter: 435 end\n",
      "Train epoch:13 iter: 436 begin\n",
      "Train epoch:13 iter: 436 end\n",
      "Train epoch:13 iter: 437 begin\n",
      "Train epoch:13 iter: 437 end\n",
      "Train epoch:13 iter: 438 begin\n",
      "Train epoch:13 iter: 438 end\n",
      "Train epoch:13 iter: 439 begin\n",
      "Train epoch:13 iter: 439 end\n",
      "Train epoch:13 iter: 440 begin\n",
      "Train epoch:13 iter: 440 end\n",
      "Train epoch:13 iter: 441 begin\n",
      "Train epoch:13 iter: 441 end\n",
      "Train epoch:13 iter: 442 begin\n",
      "Train epoch:13 iter: 442 end\n",
      "Train epoch:13 iter: 443 begin\n",
      "Train epoch:13 iter: 443 end\n",
      "Train epoch:13 iter: 444 begin\n",
      "Train epoch:13 iter: 444 end\n",
      "Train epoch:13 iter: 445 begin\n",
      "Train epoch:13 iter: 445 end\n",
      "Train epoch:13 iter: 446 begin\n",
      "Train epoch:13 iter: 446 end\n",
      "Train epoch:13 iter: 447 begin\n",
      "Train epoch:13 iter: 447 end\n",
      "Train epoch:13 iter: 448 begin\n",
      "Train epoch:13 iter: 448 end\n",
      "Train epoch:13 iter: 449 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:13 iter: 449 end\n",
      "Train epoch:13 iter: 450 begin\n",
      "Train epoch:13 iter: 450 end\n",
      "Train epoch:13 iter: 451 begin\n",
      "Train epoch:13 iter: 451 end\n",
      "Train epoch:13 iter: 452 begin\n",
      "Train epoch:13 iter: 452 end\n",
      "Train epoch:13 iter: 453 begin\n",
      "Train epoch:13 iter: 453 end\n",
      "Train epoch:13 iter: 454 begin\n",
      "Train epoch:13 iter: 454 end\n",
      "Train epoch:13 iter: 455 begin\n",
      "Train epoch:13 iter: 455 end\n",
      "Train epoch:13 iter: 456 begin\n",
      "Train epoch:13 iter: 456 end\n",
      "Train epoch:13 iter: 457 begin\n",
      "Train epoch:13 iter: 457 end\n",
      "Train epoch:13 iter: 458 begin\n",
      "Train epoch:13 iter: 458 end\n",
      "Train epoch:13 iter: 459 begin\n",
      "Train epoch:13 iter: 459 end\n",
      "Train epoch:13 iter: 460 begin\n",
      "Train epoch:13 iter: 460 end\n",
      "Train epoch:13 iter: 461 begin\n",
      "Train epoch:13 iter: 461 end\n",
      "Train epoch:13 iter: 462 begin\n",
      "Train epoch:13 iter: 462 end\n",
      "Train epoch:13 iter: 463 begin\n",
      "Train epoch:13 iter: 463 end\n",
      "Train epoch:13 iter: 464 begin\n",
      "Train epoch:13 iter: 464 end\n",
      "Train epoch:13 iter: 465 begin\n",
      "Train epoch:13 iter: 465 end\n",
      "Train epoch:13 iter: 466 begin\n",
      "Train epoch:13 iter: 466 end\n",
      "Train epoch:13 iter: 467 begin\n",
      "Train epoch:13 iter: 467 end\n",
      "Train epoch:13 iter: 468 begin\n",
      "Train epoch:13 iter: 468 end\n",
      "Train epoch:13 iter: 469 begin\n",
      "Train epoch:13 iter: 469 end\n",
      "Train epoch:13 iter: 470 begin\n",
      "Train epoch:13 iter: 470 end\n",
      "Train epoch:13 iter: 471 begin\n",
      "Train epoch:13 iter: 471 end\n",
      "Train epoch:13 iter: 472 begin\n",
      "Train epoch:13 iter: 472 end\n",
      "Train epoch:13 iter: 473 begin\n",
      "Train epoch:13 iter: 473 end\n",
      "Train epoch:13 iter: 474 begin\n",
      "Train epoch:13 iter: 474 end\n",
      "Train epoch:13 iter: 475 begin\n",
      "Train epoch:13 iter: 475 end\n",
      "Train epoch:13 iter: 476 begin\n",
      "Train epoch:13 iter: 476 end\n",
      "Train epoch:13 iter: 477 begin\n",
      "Train epoch:13 iter: 477 end\n",
      "Train epoch:13 iter: 478 begin\n",
      "Train epoch:13 iter: 478 end\n",
      "Train epoch:13 iter: 479 begin\n",
      "Train epoch:13 iter: 479 end\n",
      "Train epoch:13 iter: 480 begin\n",
      "Train epoch:13 iter: 480 end\n",
      "Train epoch:13 iter: 481 begin\n",
      "Train epoch:13 iter: 481 end\n",
      "Train epoch:13 iter: 482 begin\n",
      "Train epoch:13 iter: 482 end\n",
      "Train epoch:13 iter: 483 begin\n",
      "Train epoch:13 iter: 483 end\n",
      "Train epoch:13 iter: 484 begin\n",
      "Train epoch:13 iter: 484 end\n",
      "Train epoch:13 iter: 485 begin\n",
      "Train epoch:13 iter: 485 end\n",
      "Train epoch:13 iter: 486 begin\n",
      "Train epoch:13 iter: 486 end\n",
      "Train epoch:13 iter: 487 begin\n",
      "Train epoch:13 iter: 487 end\n",
      "Train epoch:13 iter: 488 begin\n",
      "Train epoch:13 iter: 488 end\n",
      "Train epoch:13 iter: 489 begin\n",
      "Train epoch:13 iter: 489 end\n",
      "Train epoch:13 iter: 490 begin\n",
      "Train epoch:13 iter: 490 end\n",
      "Train epoch:13 iter: 491 begin\n",
      "Train epoch:13 iter: 491 end\n",
      "Train epoch:13 iter: 492 begin\n",
      "Train epoch:13 iter: 492 end\n",
      "Train epoch:13 iter: 493 begin\n",
      "Train epoch:13 iter: 493 end\n",
      "Train epoch:13 iter: 494 begin\n",
      "Train epoch:13 iter: 494 end\n",
      "Train epoch:13 iter: 495 begin\n",
      "Train epoch:13 iter: 495 end\n",
      "Train epoch:13 iter: 496 begin\n",
      "Train epoch:13 iter: 496 end\n",
      "Train epoch:13 iter: 497 begin\n",
      "Train epoch:13 iter: 497 end\n",
      "Train epoch:13 iter: 498 begin\n",
      "Train epoch:13 iter: 498 end\n",
      "Train epoch:13 iter: 499 begin\n",
      "Train epoch:13 iter: 499 end\n",
      "Train epoch:13 iter: 500 begin\n",
      "Train epoch:13 iter: 500 end\n",
      "Train epoch:13 iter: 501 begin\n",
      "Train epoch:13 iter: 501 end\n",
      "Train epoch:13 iter: 502 begin\n",
      "Train epoch:13 iter: 502 end\n",
      "Train epoch:13 iter: 503 begin\n",
      "Train epoch:13 iter: 503 end\n",
      "Train epoch:13 iter: 504 begin\n",
      "Train epoch:13 iter: 504 end\n",
      "Train epoch:13 iter: 505 begin\n",
      "Train epoch:13 iter: 505 end\n",
      "Train epoch:13 iter: 506 begin\n",
      "Train epoch:13 iter: 506 end\n",
      "Train epoch:13 iter: 507 begin\n",
      "Train epoch:13 iter: 507 end\n",
      "Train epoch:13 iter: 508 begin\n",
      "Train epoch:13 iter: 508 end\n",
      "Train epoch:13 iter: 509 begin\n",
      "Train epoch:13 iter: 509 end\n",
      "Train epoch:13 iter: 510 begin\n",
      "Train epoch:13 iter: 510 end\n",
      "Train epoch:13 iter: 511 begin\n",
      "Train epoch:13 iter: 511 end\n",
      "Train epoch:13 iter: 512 begin\n",
      "Train epoch:13 iter: 512 end\n",
      "Train epoch:13 iter: 513 begin\n",
      "Train epoch:13 iter: 513 end\n",
      "Train epoch:13 iter: 514 begin\n",
      "Train epoch:13 iter: 514 end\n",
      "Train epoch:13 iter: 515 begin\n",
      "Train epoch:13 iter: 515 end\n",
      "Train epoch:13 iter: 516 begin\n",
      "Train epoch:13 iter: 516 end\n",
      "Train epoch:13 iter: 517 begin\n",
      "Train epoch:13 iter: 517 end\n",
      "Train epoch:13 iter: 518 begin\n",
      "Train epoch:13 iter: 518 end\n",
      "Train epoch:13 iter: 519 begin\n",
      "Train epoch:13 iter: 519 end\n",
      "Train epoch:13 iter: 520 begin\n",
      "Train epoch:13 iter: 520 end\n",
      "Train epoch:13 iter: 521 begin\n",
      "Train epoch:13 iter: 521 end\n",
      "Train epoch:13 iter: 522 begin\n",
      "Train epoch:13 iter: 522 end\n",
      "Train epoch:13 iter: 523 begin\n",
      "Train epoch:13 iter: 523 end\n",
      "Train epoch:13 iter: 524 begin\n",
      "Train epoch:13 iter: 524 end\n",
      "Train epoch:13 iter: 525 begin\n",
      "Train epoch:13 iter: 525 end\n",
      "Train epoch:13 iter: 526 begin\n",
      "Train epoch:13 iter: 526 end\n",
      "Train epoch:13 iter: 527 begin\n",
      "Train epoch:13 iter: 527 end\n",
      "Train epoch:13 iter: 528 begin\n",
      "Train epoch:13 iter: 528 end\n",
      "Train epoch:13 iter: 529 begin\n",
      "Train epoch:13 iter: 529 end\n",
      "Train epoch:13 iter: 530 begin\n",
      "Train epoch:13 iter: 530 end\n",
      "Train epoch:13 iter: 531 begin\n",
      "Train epoch:13 iter: 531 end\n",
      "Train epoch:13 iter: 532 begin\n",
      "Train epoch:13 iter: 532 end\n",
      "Train epoch:13 iter: 533 begin\n",
      "Train epoch:13 iter: 533 end\n",
      "Train epoch:13 iter: 534 begin\n",
      "Train epoch:13 iter: 534 end\n",
      "Train epoch:13 iter: 535 begin\n",
      "Train epoch:13 iter: 535 end\n",
      "Train epoch:13 iter: 536 begin\n",
      "Train epoch:13 iter: 536 end\n",
      "Train epoch:13 iter: 537 begin\n",
      "Train epoch:13 iter: 537 end\n",
      "Train epoch:13 iter: 538 begin\n",
      "Train epoch:13 iter: 538 end\n",
      "Train epoch:13 iter: 539 begin\n",
      "Train epoch:13 iter: 539 end\n",
      "Train epoch:13 iter: 540 begin\n",
      "Train epoch:13 iter: 540 end\n",
      "Train epoch:13 iter: 541 begin\n",
      "Train epoch:13 iter: 541 end\n",
      "Train epoch:13 iter: 542 begin\n",
      "Train epoch:13 iter: 542 end\n",
      "Train epoch:13 iter: 543 begin\n",
      "Train epoch:13 iter: 543 end\n",
      "Train epoch:13 iter: 544 begin\n",
      "Train epoch:13 iter: 544 end\n",
      "Train epoch:13 iter: 545 begin\n",
      "Train epoch:13 iter: 545 end\n",
      "Train epoch:13 iter: 546 begin\n",
      "Train epoch:13 iter: 546 end\n",
      "Train epoch:13 iter: 547 begin\n",
      "Train epoch:13 iter: 547 end\n",
      "Train epoch:13 iter: 548 begin\n",
      "Train epoch:13 iter: 548 end\n",
      "Train epoch:13 iter: 549 begin\n",
      "Train epoch:13 iter: 549 end\n",
      "Train epoch:13 iter: 550 begin\n",
      "Train epoch:13 iter: 550 end\n",
      "Train epoch:13 iter: 551 begin\n",
      "Train epoch:13 iter: 551 end\n",
      "Train epoch:13 iter: 552 begin\n",
      "Train epoch:13 iter: 552 end\n",
      "Train epoch:13 iter: 553 begin\n",
      "Train epoch:13 iter: 553 end\n",
      "Train epoch:13 iter: 554 begin\n",
      "Train epoch:13 iter: 554 end\n",
      "Train epoch:13 iter: 555 begin\n",
      "Train epoch:13 iter: 555 end\n",
      "Train epoch:13 iter: 556 begin\n",
      "Train epoch:13 iter: 556 end\n",
      "Train epoch:13 iter: 557 begin\n",
      "Train epoch:13 iter: 557 end\n",
      "Train epoch:13 iter: 558 begin\n",
      "Train epoch:13 iter: 558 end\n",
      "Train epoch:13 iter: 559 begin\n",
      "Train epoch:13 iter: 559 end\n",
      "Train epoch:13 iter: 560 begin\n",
      "Train epoch:13 iter: 560 end\n",
      "Train epoch:13 iter: 561 begin\n",
      "Train epoch:13 iter: 561 end\n",
      "Train epoch:13 iter: 562 begin\n",
      "Train epoch:13 iter: 562 end\n",
      "Train epoch:13 iter: 563 begin\n",
      "Train epoch:13 iter: 563 end\n",
      "Train epoch:13 iter: 564 begin\n",
      "Train epoch:13 iter: 564 end\n",
      "Train epoch:13 iter: 565 begin\n",
      "Train epoch:13 iter: 565 end\n",
      "Train epoch:13 iter: 566 begin\n",
      "Train epoch:13 iter: 566 end\n",
      "Train epoch:13 iter: 567 begin\n",
      "Train epoch:13 iter: 567 end\n",
      "Train epoch:13 iter: 568 begin\n",
      "Train epoch:13 iter: 568 end\n",
      "Train epoch:13 iter: 569 begin\n",
      "Train epoch:13 iter: 569 end\n",
      "Train epoch:13 iter: 570 begin\n",
      "Train epoch:13 iter: 570 end\n",
      "Train epoch:13 iter: 571 begin\n",
      "Train epoch:13 iter: 571 end\n",
      "Train epoch:13 iter: 572 begin\n",
      "Train epoch:13 iter: 572 end\n",
      "Train epoch:13 iter: 573 begin\n",
      "Train epoch:13 iter: 573 end\n",
      "Train epoch:13 iter: 574 begin\n",
      "Train epoch:13 iter: 574 end\n",
      "Train epoch:13 iter: 575 begin\n",
      "Train epoch:13 iter: 575 end\n",
      "Train epoch:13 iter: 576 begin\n",
      "Train epoch:13 iter: 576 end\n",
      "Train epoch:13 iter: 577 begin\n",
      "Train epoch:13 iter: 577 end\n",
      "Train epoch:13 iter: 578 begin\n",
      "Train epoch:13 iter: 578 end\n",
      "Train epoch:13 iter: 579 begin\n",
      "Train epoch:13 iter: 579 end\n",
      "Train epoch:13 iter: 580 begin\n",
      "Train epoch:13 iter: 580 end\n",
      "Train epoch:13 iter: 581 begin\n",
      "Train epoch:13 iter: 581 end\n",
      "Train epoch:13 iter: 582 begin\n",
      "Train epoch:13 iter: 582 end\n",
      "Train epoch:13 iter: 583 begin\n",
      "Train epoch:13 iter: 583 end\n",
      "Train epoch:13 iter: 584 begin\n",
      "Train epoch:13 iter: 584 end\n",
      "Train epoch:13 iter: 585 begin\n",
      "Train epoch:13 iter: 585 end\n",
      "Train epoch:13 iter: 586 begin\n",
      "Train epoch:13 iter: 586 end\n",
      "Train epoch:13 iter: 587 begin\n",
      "Train epoch:13 iter: 587 end\n",
      "Train epoch:13 iter: 588 begin\n",
      "Train epoch:13 iter: 588 end\n",
      "Train epoch:13 iter: 589 begin\n",
      "Train epoch:13 iter: 589 end\n",
      "Train epoch:13 iter: 590 begin\n",
      "Train epoch:13 iter: 590 end\n",
      "Train epoch:13 iter: 591 begin\n",
      "Train epoch:13 iter: 591 end\n",
      "Train epoch:13 iter: 592 begin\n",
      "Train epoch:13 iter: 592 end\n",
      "Train epoch:13 iter: 593 begin\n",
      "Train epoch:13 iter: 593 end\n",
      "Train epoch:13 iter: 594 begin\n",
      "Train epoch:13 iter: 594 end\n",
      "Train epoch:13 iter: 595 begin\n",
      "Train epoch:13 iter: 595 end\n",
      "Train epoch:13 iter: 596 begin\n",
      "Train epoch:13 iter: 596 end\n",
      "Train epoch:13 iter: 597 begin\n",
      "Train epoch:13 iter: 597 end\n",
      "Train epoch:13 iter: 598 begin\n",
      "Train epoch:13 iter: 598 end\n",
      "Train epoch:13 iter: 599 begin\n",
      "Train epoch:13 iter: 599 end\n",
      "Train epoch:13 iter: 600 begin\n",
      "Train epoch:13 iter: 600 end\n",
      "Train epoch:13 iter: 601 begin\n",
      "Train epoch:13 iter: 601 end\n",
      "Train epoch:13 iter: 602 begin\n",
      "Train epoch:13 iter: 602 end\n",
      "Train epoch:13 iter: 603 begin\n",
      "Train epoch:13 iter: 603 end\n",
      "Train epoch:13 iter: 604 begin\n",
      "Train epoch:13 iter: 604 end\n",
      "Train epoch:13 iter: 605 begin\n",
      "Train epoch:13 iter: 605 end\n",
      "Train epoch:13 iter: 606 begin\n",
      "Train epoch:13 iter: 606 end\n",
      "Train epoch:13 iter: 607 begin\n",
      "Train epoch:13 iter: 607 end\n",
      "Train epoch:13 iter: 608 begin\n",
      "Train epoch:13 iter: 608 end\n",
      "Train epoch:13 iter: 609 begin\n",
      "Train epoch:13 iter: 609 end\n",
      "Train epoch:13 iter: 610 begin\n",
      "Train epoch:13 iter: 610 end\n",
      "Train epoch:13 iter: 611 begin\n",
      "Train epoch:13 iter: 611 end\n",
      "Train epoch:13 iter: 612 begin\n",
      "Train epoch:13 iter: 612 end\n",
      "Train epoch:13 iter: 613 begin\n",
      "Train epoch:13 iter: 613 end\n",
      "Train epoch:13 iter: 614 begin\n",
      "Train epoch:13 iter: 614 end\n",
      "Train epoch:13 iter: 615 begin\n",
      "Train epoch:13 iter: 615 end\n",
      "Train epoch:13 iter: 616 begin\n",
      "Train epoch:13 iter: 616 end\n",
      "Train epoch:13 iter: 617 begin\n",
      "Train epoch:13 iter: 617 end\n",
      "Train epoch:13 iter: 618 begin\n",
      "Train epoch:13 iter: 618 end\n",
      "Train epoch:13 iter: 619 begin\n",
      "Train epoch:13 iter: 619 end\n",
      "Train epoch:13 iter: 620 begin\n",
      "Train epoch:13 iter: 620 end\n",
      "Train epoch:13 iter: 621 begin\n",
      "Train epoch:13 iter: 621 end\n",
      "Train epoch:13 iter: 622 begin\n",
      "Train epoch:13 iter: 622 end\n",
      "Train epoch:13 iter: 623 begin\n",
      "Train epoch:13 iter: 623 end\n",
      "Train epoch:13 iter: 624 begin\n",
      "Train epoch:13 iter: 624 end\n",
      "Train epoch:13 iter: 625 begin\n",
      "Train epoch:13 iter: 625 end\n",
      "Train epoch:13 iter: 626 begin\n",
      "Train epoch:13 iter: 626 end\n",
      "Train epoch:13 iter: 627 begin\n",
      "Train epoch:13 iter: 627 end\n",
      "Train epoch:13 iter: 628 begin\n",
      "Train epoch:13 iter: 628 end\n",
      "Train epoch:13 iter: 629 begin\n",
      "Train epoch:13 iter: 629 end\n",
      "Train epoch:13 iter: 630 begin\n",
      "Train epoch:13 iter: 630 end\n",
      "Train epoch:13 iter: 631 begin\n",
      "Train epoch:13 iter: 631 end\n",
      "Train epoch:13 iter: 632 begin\n",
      "Train epoch:13 iter: 632 end\n",
      "Train epoch:13 iter: 633 begin\n",
      "Train epoch:13 iter: 633 end\n",
      "Train epoch:13 iter: 634 begin\n",
      "Train epoch:13 iter: 634 end\n",
      "Train epoch:13 iter: 635 begin\n",
      "Train epoch:13 iter: 635 end\n",
      "Train epoch:13 iter: 636 begin\n",
      "Train epoch:13 iter: 636 end\n",
      "Train epoch:13 iter: 637 begin\n",
      "Train epoch:13 iter: 637 end\n",
      "Train epoch:13 iter: 638 begin\n",
      "Train epoch:13 iter: 638 end\n",
      "Train epoch:13 iter: 639 begin\n",
      "Train epoch:13 iter: 639 end\n",
      "Train epoch:13 iter: 640 begin\n",
      "Train epoch:13 iter: 640 end\n",
      "Train epoch:13 iter: 641 begin\n",
      "Train epoch:13 iter: 641 end\n",
      "Train epoch:13 iter: 642 begin\n",
      "Train epoch:13 iter: 642 end\n",
      "Train epoch:13 iter: 643 begin\n",
      "Train epoch:13 iter: 643 end\n",
      "Train epoch:13 iter: 644 begin\n",
      "Train epoch:13 iter: 644 end\n",
      "Train epoch:13 iter: 645 begin\n",
      "Train epoch:13 iter: 645 end\n",
      "Train epoch:13 iter: 646 begin\n",
      "Train epoch:13 iter: 646 end\n",
      "Train epoch:13 iter: 647 begin\n",
      "Train epoch:13 iter: 647 end\n",
      "Train epoch:13 iter: 648 begin\n",
      "Train epoch:13 iter: 648 end\n",
      "Train epoch:13 iter: 649 begin\n",
      "Train epoch:13 iter: 649 end\n",
      "Train epoch:13 iter: 650 begin\n",
      "Train epoch:13 iter: 650 end\n",
      "Train epoch:13 iter: 651 begin\n",
      "Train epoch:13 iter: 651 end\n",
      "Train epoch:13 iter: 652 begin\n",
      "Train epoch:13 iter: 652 end\n",
      "Train epoch:13 iter: 653 begin\n",
      "Train epoch:13 iter: 653 end\n",
      "Train epoch:13 iter: 654 begin\n",
      "Train epoch:13 iter: 654 end\n",
      "Train epoch:13 iter: 655 begin\n",
      "Train epoch:13 iter: 655 end\n",
      "Train epoch:13 iter: 656 begin\n",
      "Train epoch:13 iter: 656 end\n",
      "Train epoch:13 iter: 657 begin\n",
      "Train epoch:13 iter: 657 end\n",
      "Train epoch:13 iter: 658 begin\n",
      "Train epoch:13 iter: 658 end\n",
      "Train epoch:13 iter: 659 begin\n",
      "Train epoch:13 iter: 659 end\n",
      "Train epoch:13 iter: 660 begin\n",
      "Train epoch:13 iter: 660 end\n",
      "Train epoch:13 iter: 661 begin\n",
      "Train epoch:13 iter: 661 end\n",
      "Train epoch:13 iter: 662 begin\n",
      "Train epoch:13 iter: 662 end\n",
      "Train epoch:13 iter: 663 begin\n",
      "Train epoch:13 iter: 663 end\n",
      "Train epoch:13 iter: 664 begin\n",
      "Train epoch:13 iter: 664 end\n",
      "Train epoch:13 iter: 665 begin\n",
      "Train epoch:13 iter: 665 end\n",
      "Train epoch:13 iter: 666 begin\n",
      "Train epoch:13 iter: 666 end\n",
      "Train epoch:13 iter: 667 begin\n",
      "Train epoch:13 iter: 667 end\n",
      "Train epoch:13 iter: 668 begin\n",
      "Train epoch:13 iter: 668 end\n",
      "Train epoch:13 iter: 669 begin\n",
      "Train epoch:13 iter: 669 end\n",
      "Train epoch:13 iter: 670 begin\n",
      "Train epoch:13 iter: 670 end\n",
      "Train epoch:13 iter: 671 begin\n",
      "Train epoch:13 iter: 671 end\n",
      "Train epoch:13 iter: 672 begin\n",
      "Train epoch:13 iter: 672 end\n",
      "Train epoch:13 iter: 673 begin\n",
      "Train epoch:13 iter: 673 end\n",
      "Train epoch:13 iter: 674 begin\n",
      "Train epoch:13 iter: 674 end\n",
      "Train epoch:13 iter: 675 begin\n",
      "Train epoch:13 iter: 675 end\n",
      "Train epoch:13 iter: 676 begin\n",
      "Train epoch:13 iter: 676 end\n",
      "Train epoch:13 iter: 677 begin\n",
      "Train epoch:13 iter: 677 end\n",
      "Train epoch:13 iter: 678 begin\n",
      "Train epoch:13 iter: 678 end\n",
      "Train epoch:13 iter: 679 begin\n",
      "Train epoch:13 iter: 679 end\n",
      "Train epoch:13 iter: 680 begin\n",
      "Train epoch:13 iter: 680 end\n",
      "Train epoch:13 iter: 681 begin\n",
      "Train epoch:13 iter: 681 end\n",
      "Train epoch:13 iter: 682 begin\n",
      "Train epoch:13 iter: 682 end\n",
      "Train epoch:13 iter: 683 begin\n",
      "Train epoch:13 iter: 683 end\n",
      "Train epoch:13 iter: 684 begin\n",
      "Train epoch:13 iter: 684 end\n",
      "Train epoch:13 iter: 685 begin\n",
      "Train epoch:13 iter: 685 end\n",
      "Train epoch:13 iter: 686 begin\n",
      "Train epoch:13 iter: 686 end\n",
      "Train epoch:13 iter: 687 begin\n",
      "Train epoch:13 iter: 687 end\n",
      "Train epoch:13 iter: 688 begin\n",
      "Train epoch:13 iter: 688 end\n",
      "Train epoch:13 iter: 689 begin\n",
      "Train epoch:13 iter: 689 end\n",
      "Train epoch:13 iter: 690 begin\n",
      "Train epoch:13 iter: 690 end\n",
      "Train epoch:13 iter: 691 begin\n",
      "Train epoch:13 iter: 691 end\n",
      "Train epoch:13 iter: 692 begin\n",
      "Train epoch:13 iter: 692 end\n",
      "Train epoch:13 iter: 693 begin\n",
      "Train epoch:13 iter: 693 end\n",
      "Train epoch:13 iter: 694 begin\n",
      "Train epoch:13 iter: 694 end\n",
      "Train epoch:13 iter: 695 begin\n",
      "Train epoch:13 iter: 695 end\n",
      "Train epoch:13 iter: 696 begin\n",
      "Train epoch:13 iter: 696 end\n",
      "Train epoch:13 iter: 697 begin\n",
      "Train epoch:13 iter: 697 end\n",
      "Train epoch:13 iter: 698 begin\n",
      "Train epoch:13 iter: 698 end\n",
      "Train epoch:13 iter: 699 begin\n",
      "Train epoch:13 iter: 699 end\n",
      "Train epoch:13 iter: 700 begin\n",
      "Train epoch:13 iter: 700 end\n",
      "Train epoch:13 iter: 701 begin\n",
      "Train epoch:13 iter: 701 end\n",
      "Train epoch:13 iter: 702 begin\n",
      "Train epoch:13 iter: 702 end\n",
      "Train epoch:13 iter: 703 begin\n",
      "Train epoch:13 iter: 703 end\n",
      "Train epoch:13 iter: 704 begin\n",
      "Train epoch:13 iter: 704 end\n",
      "Train epoch:13 iter: 705 begin\n",
      "Train epoch:13 iter: 705 end\n",
      "Train epoch:13 iter: 706 begin\n",
      "Train epoch:13 iter: 706 end\n",
      "Train epoch:13 iter: 707 begin\n",
      "Train epoch:13 iter: 707 end\n",
      "Train epoch:13 iter: 708 begin\n",
      "Train epoch:13 iter: 708 end\n",
      "Train epoch:13 iter: 709 begin\n",
      "Train epoch:13 iter: 709 end\n",
      "Train epoch:13 iter: 710 begin\n",
      "Train epoch:13 iter: 710 end\n",
      "Train epoch:13 iter: 711 begin\n",
      "Train epoch:13 iter: 711 end\n",
      "Train epoch:13 iter: 712 begin\n",
      "Train epoch:13 iter: 712 end\n",
      "Train epoch:13 iter: 713 begin\n",
      "Train epoch:13 iter: 713 end\n",
      "Train epoch:13 iter: 714 begin\n",
      "Train epoch:13 iter: 714 end\n",
      "Train epoch:13 iter: 715 begin\n",
      "Train epoch:13 iter: 715 end\n",
      "Train epoch:13 iter: 716 begin\n",
      "Train epoch:13 iter: 716 end\n",
      "Train epoch:13 iter: 717 begin\n",
      "Train epoch:13 iter: 717 end\n",
      "Train epoch:13 iter: 718 begin\n",
      "Train epoch:13 iter: 718 end\n",
      "Train epoch:13 iter: 719 begin\n",
      "Train epoch:13 iter: 719 end\n",
      "Train epoch:13 iter: 720 begin\n",
      "Train epoch:13 iter: 720 end\n",
      "Train epoch:13 iter: 721 begin\n",
      "Train epoch:13 iter: 721 end\n",
      "Train epoch:13 iter: 722 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:13 iter: 722 end\n",
      "Train epoch:13 iter: 723 begin\n",
      "Train epoch:13 iter: 723 end\n",
      "Train epoch:13 iter: 724 begin\n",
      "Train epoch:13 iter: 724 end\n",
      "Train epoch:13 iter: 725 begin\n",
      "Train epoch:13 iter: 725 end\n",
      "Train epoch:13 iter: 726 begin\n",
      "Train epoch:13 iter: 726 end\n",
      "Train epoch:13 iter: 727 begin\n",
      "Train epoch:13 iter: 727 end\n",
      "Train epoch:13 iter: 728 begin\n",
      "Train epoch:13 iter: 728 end\n",
      "Train epoch:13 iter: 729 begin\n",
      "Train epoch:13 iter: 729 end\n",
      "Train epoch:13 iter: 730 begin\n",
      "Train epoch:13 iter: 730 end\n",
      "Train epoch:13 iter: 731 begin\n",
      "Train epoch:13 iter: 731 end\n",
      "Train epoch:13 iter: 732 begin\n",
      "Train epoch:13 iter: 732 end\n",
      "Train epoch:13 iter: 733 begin\n",
      "Train epoch:13 iter: 733 end\n",
      "Train epoch:13 iter: 734 begin\n",
      "Train epoch:13 iter: 734 end\n",
      "Train epoch:13 iter: 735 begin\n",
      "Train epoch:13 iter: 735 end\n",
      "Train epoch:13 iter: 736 begin\n",
      "Train epoch:13 iter: 736 end\n",
      "Train epoch:13 iter: 737 begin\n",
      "Train epoch:13 iter: 737 end\n",
      "Train epoch:13 iter: 738 begin\n",
      "Train epoch:13 iter: 738 end\n",
      "Train epoch:13 iter: 739 begin\n",
      "Train epoch:13 iter: 739 end\n",
      "Train epoch:13 iter: 740 begin\n",
      "Train epoch:13 iter: 740 end\n",
      "Train epoch:13 iter: 741 begin\n",
      "Train epoch:13 iter: 741 end\n",
      "Train epoch:13 iter: 742 begin\n",
      "Train epoch:13 iter: 742 end\n",
      "Train epoch:13 iter: 743 begin\n",
      "Train epoch:13 iter: 743 end\n",
      "Train epoch:13 iter: 744 begin\n",
      "Train epoch:13 iter: 744 end\n",
      "Train epoch:13 iter: 745 begin\n",
      "Train epoch:13 iter: 745 end\n",
      "Train epoch:13 iter: 746 begin\n",
      "Train epoch:13 iter: 746 end\n",
      "Train epoch:13 iter: 747 begin\n",
      "Train epoch:13 iter: 747 end\n",
      "Train epoch:13 iter: 748 begin\n",
      "Train epoch:13 iter: 748 end\n",
      "Train epoch:13 iter: 749 begin\n",
      "Train epoch:13 iter: 749 end\n",
      "Train epoch:13 iter: 750 begin\n",
      "Train epoch:13 iter: 750 end\n",
      "Train epoch:13 iter: 751 begin\n",
      "Train epoch:13 iter: 751 end\n",
      "Train epoch:13 iter: 752 begin\n",
      "Train epoch:13 iter: 752 end\n",
      "Train epoch:13 iter: 753 begin\n",
      "Train epoch:13 iter: 753 end\n",
      "Train epoch:13 iter: 754 begin\n",
      "Train epoch:13 iter: 754 end\n",
      "Train epoch:13 iter: 755 begin\n",
      "Train epoch:13 iter: 755 end\n",
      "Train epoch:13 iter: 756 begin\n",
      "Train epoch:13 iter: 756 end\n",
      "Train epoch:13 iter: 757 begin\n",
      "Train epoch:13 iter: 757 end\n",
      "Train epoch:13 iter: 758 begin\n",
      "Train epoch:13 iter: 758 end\n",
      "Train epoch:13 iter: 759 begin\n",
      "Train epoch:13 iter: 759 end\n",
      "Train epoch:13 iter: 760 begin\n",
      "Train epoch:13 iter: 760 end\n",
      "Train epoch:13 iter: 761 begin\n",
      "Train epoch:13 iter: 761 end\n",
      "Train epoch:13 iter: 762 begin\n",
      "Train epoch:13 iter: 762 end\n",
      "Train epoch:13 iter: 763 begin\n",
      "Train epoch:13 iter: 763 end\n",
      "Train epoch:13 iter: 764 begin\n",
      "Train epoch:13 iter: 764 end\n",
      "Train epoch:13 iter: 765 begin\n",
      "Train epoch:13 iter: 765 end\n",
      "Train epoch:13 iter: 766 begin\n",
      "Train epoch:13 iter: 766 end\n",
      "Train epoch:13 iter: 767 begin\n",
      "Train epoch:13 iter: 767 end\n",
      "Train epoch:13 iter: 768 begin\n",
      "Train epoch:13 iter: 768 end\n",
      "Train epoch:13 iter: 769 begin\n",
      "Train epoch:13 iter: 769 end\n",
      "Train epoch:13 iter: 770 begin\n",
      "Train epoch:13 iter: 770 end\n",
      "Train epoch:13 iter: 771 begin\n",
      "Train epoch:13 iter: 771 end\n",
      "Train epoch:13 iter: 772 begin\n",
      "Train epoch:13 iter: 772 end\n",
      "Train epoch:13 iter: 773 begin\n",
      "Train epoch:13 iter: 773 end\n",
      "Train epoch:13 iter: 774 begin\n",
      "Train epoch:13 iter: 774 end\n",
      "Train epoch:13 iter: 775 begin\n",
      "Train epoch:13 iter: 775 end\n",
      "Train epoch:13 iter: 776 begin\n",
      "Train epoch:13 iter: 776 end\n",
      "Train epoch:13 iter: 777 begin\n",
      "Train epoch:13 iter: 777 end\n",
      "Train epoch:13 iter: 778 begin\n",
      "Train epoch:13 iter: 778 end\n",
      "Train epoch:13 iter: 779 begin\n",
      "Train epoch:13 iter: 779 end\n",
      "Train epoch:13 iter: 780 begin\n",
      "Train epoch:13 iter: 780 end\n",
      "Train epoch:13 iter: 781 begin\n",
      "Train epoch:13 iter: 781 end\n",
      "Train epoch:13 iter: 782 begin\n",
      "Train epoch:13 iter: 782 end\n",
      "Train epoch:13 iter: 783 begin\n",
      "Train epoch:13 iter: 783 end\n",
      "Train epoch:13 iter: 784 begin\n",
      "Train epoch:13 iter: 784 end\n",
      "Train epoch:13 iter: 785 begin\n",
      "Train epoch:13 iter: 785 end\n",
      "Train epoch:13 iter: 786 begin\n",
      "Train epoch:13 iter: 786 end\n",
      "Train epoch:13 iter: 787 begin\n",
      "Train epoch:13 iter: 787 end\n",
      "Train epoch:13 iter: 788 begin\n",
      "Train epoch:13 iter: 788 end\n",
      "Train epoch:13 iter: 789 begin\n",
      "Train epoch:13 iter: 789 end\n",
      "Train epoch:13 iter: 790 begin\n",
      "Train epoch:13 iter: 790 end\n",
      "Train epoch:13 iter: 791 begin\n",
      "Train epoch:13 iter: 791 end\n",
      "Train epoch:13 iter: 792 begin\n",
      "Train epoch:13 iter: 792 end\n",
      "Train epoch:13 iter: 793 begin\n",
      "Train epoch:13 iter: 793 end\n",
      "Train epoch:13 iter: 794 begin\n",
      "Train epoch:13 iter: 794 end\n",
      "Train epoch:13 iter: 795 begin\n",
      "Train epoch:13 iter: 795 end\n",
      "Train epoch:13 iter: 796 begin\n",
      "Train epoch:13 iter: 796 end\n",
      "Train epoch:13 iter: 797 begin\n",
      "Train epoch:13 iter: 797 end\n",
      "Train epoch:13 iter: 798 begin\n",
      "Train epoch:13 iter: 798 end\n",
      "Train epoch:13 iter: 799 begin\n",
      "Train epoch:13 iter: 799 end\n",
      "Train epoch:13 iter: 800 begin\n",
      "Train epoch:13 iter: 800 end\n",
      "Train epoch:13 iter: 801 begin\n",
      "Train epoch:13 iter: 801 end\n",
      "Train epoch:13 iter: 802 begin\n",
      "Train epoch:13 iter: 802 end\n",
      "Train epoch:13 iter: 803 begin\n",
      "Train epoch:13 iter: 803 end\n",
      "Train epoch:13 iter: 804 begin\n",
      "Train epoch:13 iter: 804 end\n",
      "Train epoch:13 iter: 805 begin\n",
      "Train epoch:13 iter: 805 end\n",
      "Train epoch:13 iter: 806 begin\n",
      "Train epoch:13 iter: 806 end\n",
      "Train epoch:13 iter: 807 begin\n",
      "Train epoch:13 iter: 807 end\n",
      "Train epoch:13 iter: 808 begin\n",
      "Train epoch:13 iter: 808 end\n",
      "Train epoch:13 iter: 809 begin\n",
      "Train epoch:13 iter: 809 end\n",
      "Train epoch:13 iter: 810 begin\n",
      "Train epoch:13 iter: 810 end\n",
      "Train epoch:13 iter: 811 begin\n",
      "Train epoch:13 iter: 811 end\n",
      "Train epoch:13 iter: 812 begin\n",
      "Train epoch:13 iter: 812 end\n",
      "Train epoch:13 iter: 813 begin\n",
      "Train epoch:13 iter: 813 end\n",
      "Train epoch:13 iter: 814 begin\n",
      "Train epoch:13 iter: 814 end\n",
      "Train epoch:13 iter: 815 begin\n",
      "Train epoch:13 iter: 815 end\n",
      "Train epoch:13 iter: 816 begin\n",
      "Train epoch:13 iter: 816 end\n",
      "Train epoch:13 iter: 817 begin\n",
      "Train epoch:13 iter: 817 end\n",
      "Train epoch:13 iter: 818 begin\n",
      "Train epoch:13 iter: 818 end\n",
      "Train epoch:13 iter: 819 begin\n",
      "Train epoch:13 iter: 819 end\n",
      "Train epoch:13 iter: 820 begin\n",
      "Train epoch:13 iter: 820 end\n",
      "Train epoch:13 iter: 821 begin\n",
      "Train epoch:13 iter: 821 end\n",
      "Train epoch:13 iter: 822 begin\n",
      "Train epoch:13 iter: 822 end\n",
      "Train epoch:13 iter: 823 begin\n",
      "Train epoch:13 iter: 823 end\n",
      "Train epoch:13 iter: 824 begin\n",
      "Train epoch:13 iter: 824 end\n",
      "Train epoch:13 iter: 825 begin\n",
      "Train epoch:13 iter: 825 end\n",
      "Train epoch:13 iter: 826 begin\n",
      "Train epoch:13 iter: 826 end\n",
      "Train epoch:13 iter: 827 begin\n",
      "Train epoch:13 iter: 827 end\n",
      "Train epoch:13 iter: 828 begin\n",
      "Train epoch:13 iter: 828 end\n",
      "Train epoch:13 iter: 829 begin\n",
      "Train epoch:13 iter: 829 end\n",
      "Train epoch:13 iter: 830 begin\n",
      "Train epoch:13 iter: 830 end\n",
      "Train epoch:13 iter: 831 begin\n",
      "Train epoch:13 iter: 831 end\n",
      "Train epoch:13 iter: 832 begin\n",
      "Train epoch:13 iter: 832 end\n",
      "Train epoch:13 iter: 833 begin\n",
      "Train epoch:13 iter: 833 end\n",
      "Train epoch:13 iter: 834 begin\n",
      "Train epoch:13 iter: 834 end\n",
      "Train epoch:13 iter: 835 begin\n",
      "Train epoch:13 iter: 835 end\n",
      "Train epoch:13 iter: 836 begin\n",
      "Train epoch:13 iter: 836 end\n",
      "Train epoch:13 iter: 837 begin\n",
      "Train epoch:13 iter: 837 end\n",
      "Train epoch:13 iter: 838 begin\n",
      "Train epoch:13 iter: 838 end\n",
      "Train epoch:13 iter: 839 begin\n",
      "Train epoch:13 iter: 839 end\n",
      "Train epoch:13 iter: 840 begin\n",
      "Train epoch:13 iter: 840 end\n",
      "Train epoch:13 iter: 841 begin\n",
      "Train epoch:13 iter: 841 end\n",
      "Train epoch:13 iter: 842 begin\n",
      "Train epoch:13 iter: 842 end\n",
      "Train epoch:13 iter: 843 begin\n",
      "Train epoch:13 iter: 843 end\n",
      "Train epoch:13 iter: 844 begin\n",
      "Train epoch:13 iter: 844 end\n",
      "Train epoch:13 iter: 845 begin\n",
      "Train epoch:13 iter: 845 end\n",
      "Train epoch:13 iter: 846 begin\n",
      "Train epoch:13 iter: 846 end\n",
      "Train epoch:13 iter: 847 begin\n",
      "Train epoch:13 iter: 847 end\n",
      "Train epoch:13 iter: 848 begin\n",
      "Train epoch:13 iter: 848 end\n",
      "Train epoch:13 iter: 849 begin\n",
      "Train epoch:13 iter: 849 end\n",
      "Train epoch:13 iter: 850 begin\n",
      "Train epoch:13 iter: 850 end\n",
      "Train epoch:13 iter: 851 begin\n",
      "Train epoch:13 iter: 851 end\n",
      "Train epoch:13 iter: 852 begin\n",
      "Train epoch:13 iter: 852 end\n",
      "Train epoch:13 iter: 853 begin\n",
      "Train epoch:13 iter: 853 end\n",
      "Train epoch:13 iter: 854 begin\n",
      "Train epoch:13 iter: 854 end\n",
      "Train epoch:13 iter: 855 begin\n",
      "Train epoch:13 iter: 855 end\n",
      "Train epoch:13 iter: 856 begin\n",
      "Train epoch:13 iter: 856 end\n",
      "Train epoch:13 iter: 857 begin\n",
      "Train epoch:13 iter: 857 end\n",
      "Train epoch:13 iter: 858 begin\n",
      "Train epoch:13 iter: 858 end\n",
      "Train epoch:13 iter: 859 begin\n",
      "Train epoch:13 iter: 859 end\n",
      "Train epoch:13 iter: 860 begin\n",
      "Train epoch:13 iter: 860 end\n",
      "Train epoch:13 iter: 861 begin\n",
      "Train epoch:13 iter: 861 end\n",
      "Train epoch:13 iter: 862 begin\n",
      "Train epoch:13 iter: 862 end\n",
      "Train epoch:13 iter: 863 begin\n",
      "Train epoch:13 iter: 863 end\n",
      "Train epoch:13 iter: 864 begin\n",
      "Train epoch:13 iter: 864 end\n",
      "Train epoch:13 iter: 865 begin\n",
      "Train epoch:13 iter: 865 end\n",
      "Train epoch:13 iter: 866 begin\n",
      "Train epoch:13 iter: 866 end\n",
      "Train epoch:13 iter: 867 begin\n",
      "Train epoch:13 iter: 867 end\n",
      "Train epoch:13 iter: 868 begin\n",
      "Train epoch:13 iter: 868 end\n",
      "Train epoch:13 iter: 869 begin\n",
      "Train epoch:13 iter: 869 end\n",
      "Train epoch:13 iter: 870 begin\n",
      "Train epoch:13 iter: 870 end\n",
      "Train epoch:13 iter: 871 begin\n",
      "Train epoch:13 iter: 871 end\n",
      "Train epoch:13 iter: 872 begin\n",
      "Train epoch:13 iter: 872 end\n",
      "Train epoch:13 iter: 873 begin\n",
      "Train epoch:13 iter: 873 end\n",
      "Train epoch:13 iter: 874 begin\n",
      "Train epoch:13 iter: 874 end\n",
      "Train epoch:13 iter: 875 begin\n",
      "Train epoch:13 iter: 875 end\n",
      "Train epoch:13 iter: 876 begin\n",
      "Train epoch:13 iter: 876 end\n",
      "Train epoch:13 iter: 877 begin\n",
      "Train epoch:13 iter: 877 end\n",
      "Train epoch:13 iter: 878 begin\n",
      "Train epoch:13 iter: 878 end\n",
      "Train epoch:13 iter: 879 begin\n",
      "Train epoch:13 iter: 879 end\n",
      "Train epoch:13 iter: 880 begin\n",
      "Train epoch:13 iter: 880 end\n",
      "Train epoch:13 iter: 881 begin\n",
      "Train epoch:13 iter: 881 end\n",
      "Train epoch:13 iter: 882 begin\n",
      "Train epoch:13 iter: 882 end\n",
      "Train epoch:13 iter: 883 begin\n",
      "Train epoch:13 iter: 883 end\n",
      "Train epoch:13 iter: 884 begin\n",
      "Train epoch:13 iter: 884 end\n",
      "Train epoch:13 iter: 885 begin\n",
      "Train epoch:13 iter: 885 end\n",
      "Train epoch:13 iter: 886 begin\n",
      "Train epoch:13 iter: 886 end\n",
      "Train epoch:13 iter: 887 begin\n",
      "Train epoch:13 iter: 887 end\n",
      "Train epoch:13 iter: 888 begin\n",
      "Train epoch:13 iter: 888 end\n",
      "Train epoch:13 iter: 889 begin\n",
      "Train epoch:13 iter: 889 end\n",
      "Train epoch:13 iter: 890 begin\n",
      "Train epoch:13 iter: 890 end\n",
      "Train epoch:13 iter: 891 begin\n",
      "Train epoch:13 iter: 891 end\n",
      "Train epoch:13 iter: 892 begin\n",
      "Train epoch:13 iter: 892 end\n",
      "Train epoch:13 iter: 893 begin\n",
      "Train epoch:13 iter: 893 end\n",
      "Train epoch:13 iter: 894 begin\n",
      "Train epoch:13 iter: 894 end\n",
      "Train epoch:13 iter: 895 begin\n",
      "Train epoch:13 iter: 895 end\n",
      "Train epoch:13 iter: 896 begin\n",
      "Train epoch:13 iter: 896 end\n",
      "Train epoch:13 iter: 897 begin\n",
      "Train epoch:13 iter: 897 end\n",
      "Train epoch:13 iter: 898 begin\n",
      "Train epoch:13 iter: 898 end\n",
      "Train epoch:13 iter: 899 begin\n",
      "Train epoch:13 iter: 899 end\n",
      "Train epoch:13 iter: 900 begin\n",
      "Train epoch:13 iter: 900 end\n",
      "Train epoch:13 iter: 901 begin\n",
      "Train epoch:13 iter: 901 end\n",
      "Train epoch:13 iter: 902 begin\n",
      "Train epoch:13 iter: 902 end\n",
      "Train epoch:13 iter: 903 begin\n",
      "Train epoch:13 iter: 903 end\n",
      "Train epoch:13 iter: 904 begin\n",
      "Train epoch:13 iter: 904 end\n",
      "Train epoch:13 iter: 905 begin\n",
      "Train epoch:13 iter: 905 end\n",
      "Train epoch:13 iter: 906 begin\n",
      "Train epoch:13 iter: 906 end\n",
      "Train epoch:13 iter: 907 begin\n",
      "Train epoch:13 iter: 907 end\n",
      "Train epoch:13 iter: 908 begin\n",
      "Train epoch:13 iter: 908 end\n",
      "Train epoch:13 iter: 909 begin\n",
      "Train epoch:13 iter: 909 end\n",
      "Train epoch:13 iter: 910 begin\n",
      "Train epoch:13 iter: 910 end\n",
      "Train epoch:13 iter: 911 begin\n",
      "Train epoch:13 iter: 911 end\n",
      "Train epoch:13 iter: 912 begin\n",
      "Train epoch:13 iter: 912 end\n",
      "Train epoch:13 iter: 913 begin\n",
      "Train epoch:13 iter: 913 end\n",
      "Train epoch:13 iter: 914 begin\n",
      "Train epoch:13 iter: 914 end\n",
      "Train epoch:13 iter: 915 begin\n",
      "Train epoch:13 iter: 915 end\n",
      "Train epoch:13 iter: 916 begin\n",
      "Train epoch:13 iter: 916 end\n",
      "Train epoch:13 iter: 917 begin\n",
      "Train epoch:13 iter: 917 end\n",
      "Train epoch:13 iter: 918 begin\n",
      "Train epoch:13 iter: 918 end\n",
      "Train epoch:13 iter: 919 begin\n",
      "Train epoch:13 iter: 919 end\n",
      "Train epoch:13 iter: 920 begin\n",
      "Train epoch:13 iter: 920 end\n",
      "Train epoch:13 iter: 921 begin\n",
      "Train epoch:13 iter: 921 end\n",
      "Train epoch:13 iter: 922 begin\n",
      "Train epoch:13 iter: 922 end\n",
      "Train epoch:13 iter: 923 begin\n",
      "Train epoch:13 iter: 923 end\n",
      "Train epoch:13 iter: 924 begin\n",
      "Train epoch:13 iter: 924 end\n",
      "Train epoch:13 iter: 925 begin\n",
      "Train epoch:13 iter: 925 end\n",
      "Train epoch:13 iter: 926 begin\n",
      "Train epoch:13 iter: 926 end\n",
      "Train epoch:13 iter: 927 begin\n",
      "Train epoch:13 iter: 927 end\n",
      "Train epoch:13 iter: 928 begin\n",
      "Train epoch:13 iter: 928 end\n",
      "Train epoch:13 iter: 929 begin\n",
      "Train epoch:13 iter: 929 end\n",
      "Train epoch:13 iter: 930 begin\n",
      "Train epoch:13 iter: 930 end\n",
      "Train epoch:13 iter: 931 begin\n",
      "Train epoch:13 iter: 931 end\n",
      "Train epoch:13 iter: 932 begin\n",
      "Train epoch:13 iter: 932 end\n",
      "Train epoch:13 iter: 933 begin\n",
      "Train epoch:13 iter: 933 end\n",
      "Train epoch:13 iter: 934 begin\n",
      "Train epoch:13 iter: 934 end\n",
      "Train epoch:13 iter: 935 begin\n",
      "Train epoch:13 iter: 935 end\n",
      "Train epoch:13 iter: 936 begin\n",
      "Train epoch:13 iter: 936 end\n",
      "Train epoch:13 iter: 937 begin\n",
      "Train epoch:13 iter: 937 end\n",
      "Train epoch:13 iter: 938 begin\n",
      "Train epoch:13 iter: 938 end\n",
      "Train Loss: 0.001405, Acc: 0.965767\n",
      "save model for best accuate: 0.9657666666666667 begin\n",
      "save model for best accuate: 0.9657666666666667 end\n",
      "epoch 15\n",
      "Train epoch:14 iter: 1 begin\n",
      "Train epoch:14 iter: 1 end\n",
      "Train epoch:14 iter: 2 begin\n",
      "Train epoch:14 iter: 2 end\n",
      "Train epoch:14 iter: 3 begin\n",
      "Train epoch:14 iter: 3 end\n",
      "Train epoch:14 iter: 4 begin\n",
      "Train epoch:14 iter: 4 end\n",
      "Train epoch:14 iter: 5 begin\n",
      "Train epoch:14 iter: 5 end\n",
      "Train epoch:14 iter: 6 begin\n",
      "Train epoch:14 iter: 6 end\n",
      "Train epoch:14 iter: 7 begin\n",
      "Train epoch:14 iter: 7 end\n",
      "Train epoch:14 iter: 8 begin\n",
      "Train epoch:14 iter: 8 end\n",
      "Train epoch:14 iter: 9 begin\n",
      "Train epoch:14 iter: 9 end\n",
      "Train epoch:14 iter: 10 begin\n",
      "Train epoch:14 iter: 10 end\n",
      "Train epoch:14 iter: 11 begin\n",
      "Train epoch:14 iter: 11 end\n",
      "Train epoch:14 iter: 12 begin\n",
      "Train epoch:14 iter: 12 end\n",
      "Train epoch:14 iter: 13 begin\n",
      "Train epoch:14 iter: 13 end\n",
      "Train epoch:14 iter: 14 begin\n",
      "Train epoch:14 iter: 14 end\n",
      "Train epoch:14 iter: 15 begin\n",
      "Train epoch:14 iter: 15 end\n",
      "Train epoch:14 iter: 16 begin\n",
      "Train epoch:14 iter: 16 end\n",
      "Train epoch:14 iter: 17 begin\n",
      "Train epoch:14 iter: 17 end\n",
      "Train epoch:14 iter: 18 begin\n",
      "Train epoch:14 iter: 18 end\n",
      "Train epoch:14 iter: 19 begin\n",
      "Train epoch:14 iter: 19 end\n",
      "Train epoch:14 iter: 20 begin\n",
      "Train epoch:14 iter: 20 end\n",
      "Train epoch:14 iter: 21 begin\n",
      "Train epoch:14 iter: 21 end\n",
      "Train epoch:14 iter: 22 begin\n",
      "Train epoch:14 iter: 22 end\n",
      "Train epoch:14 iter: 23 begin\n",
      "Train epoch:14 iter: 23 end\n",
      "Train epoch:14 iter: 24 begin\n",
      "Train epoch:14 iter: 24 end\n",
      "Train epoch:14 iter: 25 begin\n",
      "Train epoch:14 iter: 25 end\n",
      "Train epoch:14 iter: 26 begin\n",
      "Train epoch:14 iter: 26 end\n",
      "Train epoch:14 iter: 27 begin\n",
      "Train epoch:14 iter: 27 end\n",
      "Train epoch:14 iter: 28 begin\n",
      "Train epoch:14 iter: 28 end\n",
      "Train epoch:14 iter: 29 begin\n",
      "Train epoch:14 iter: 29 end\n",
      "Train epoch:14 iter: 30 begin\n",
      "Train epoch:14 iter: 30 end\n",
      "Train epoch:14 iter: 31 begin\n",
      "Train epoch:14 iter: 31 end\n",
      "Train epoch:14 iter: 32 begin\n",
      "Train epoch:14 iter: 32 end\n",
      "Train epoch:14 iter: 33 begin\n",
      "Train epoch:14 iter: 33 end\n",
      "Train epoch:14 iter: 34 begin\n",
      "Train epoch:14 iter: 34 end\n",
      "Train epoch:14 iter: 35 begin\n",
      "Train epoch:14 iter: 35 end\n",
      "Train epoch:14 iter: 36 begin\n",
      "Train epoch:14 iter: 36 end\n",
      "Train epoch:14 iter: 37 begin\n",
      "Train epoch:14 iter: 37 end\n",
      "Train epoch:14 iter: 38 begin\n",
      "Train epoch:14 iter: 38 end\n",
      "Train epoch:14 iter: 39 begin\n",
      "Train epoch:14 iter: 39 end\n",
      "Train epoch:14 iter: 40 begin\n",
      "Train epoch:14 iter: 40 end\n",
      "Train epoch:14 iter: 41 begin\n",
      "Train epoch:14 iter: 41 end\n",
      "Train epoch:14 iter: 42 begin\n",
      "Train epoch:14 iter: 42 end\n",
      "Train epoch:14 iter: 43 begin\n",
      "Train epoch:14 iter: 43 end\n",
      "Train epoch:14 iter: 44 begin\n",
      "Train epoch:14 iter: 44 end\n",
      "Train epoch:14 iter: 45 begin\n",
      "Train epoch:14 iter: 45 end\n",
      "Train epoch:14 iter: 46 begin\n",
      "Train epoch:14 iter: 46 end\n",
      "Train epoch:14 iter: 47 begin\n",
      "Train epoch:14 iter: 47 end\n",
      "Train epoch:14 iter: 48 begin\n",
      "Train epoch:14 iter: 48 end\n",
      "Train epoch:14 iter: 49 begin\n",
      "Train epoch:14 iter: 49 end\n",
      "Train epoch:14 iter: 50 begin\n",
      "Train epoch:14 iter: 50 end\n",
      "Train epoch:14 iter: 51 begin\n",
      "Train epoch:14 iter: 51 end\n",
      "Train epoch:14 iter: 52 begin\n",
      "Train epoch:14 iter: 52 end\n",
      "Train epoch:14 iter: 53 begin\n",
      "Train epoch:14 iter: 53 end\n",
      "Train epoch:14 iter: 54 begin\n",
      "Train epoch:14 iter: 54 end\n",
      "Train epoch:14 iter: 55 begin\n",
      "Train epoch:14 iter: 55 end\n",
      "Train epoch:14 iter: 56 begin\n",
      "Train epoch:14 iter: 56 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:14 iter: 57 begin\n",
      "Train epoch:14 iter: 57 end\n",
      "Train epoch:14 iter: 58 begin\n",
      "Train epoch:14 iter: 58 end\n",
      "Train epoch:14 iter: 59 begin\n",
      "Train epoch:14 iter: 59 end\n",
      "Train epoch:14 iter: 60 begin\n",
      "Train epoch:14 iter: 60 end\n",
      "Train epoch:14 iter: 61 begin\n",
      "Train epoch:14 iter: 61 end\n",
      "Train epoch:14 iter: 62 begin\n",
      "Train epoch:14 iter: 62 end\n",
      "Train epoch:14 iter: 63 begin\n",
      "Train epoch:14 iter: 63 end\n",
      "Train epoch:14 iter: 64 begin\n",
      "Train epoch:14 iter: 64 end\n",
      "Train epoch:14 iter: 65 begin\n",
      "Train epoch:14 iter: 65 end\n",
      "Train epoch:14 iter: 66 begin\n",
      "Train epoch:14 iter: 66 end\n",
      "Train epoch:14 iter: 67 begin\n",
      "Train epoch:14 iter: 67 end\n",
      "Train epoch:14 iter: 68 begin\n",
      "Train epoch:14 iter: 68 end\n",
      "Train epoch:14 iter: 69 begin\n",
      "Train epoch:14 iter: 69 end\n",
      "Train epoch:14 iter: 70 begin\n",
      "Train epoch:14 iter: 70 end\n",
      "Train epoch:14 iter: 71 begin\n",
      "Train epoch:14 iter: 71 end\n",
      "Train epoch:14 iter: 72 begin\n",
      "Train epoch:14 iter: 72 end\n",
      "Train epoch:14 iter: 73 begin\n",
      "Train epoch:14 iter: 73 end\n",
      "Train epoch:14 iter: 74 begin\n",
      "Train epoch:14 iter: 74 end\n",
      "Train epoch:14 iter: 75 begin\n",
      "Train epoch:14 iter: 75 end\n",
      "Train epoch:14 iter: 76 begin\n",
      "Train epoch:14 iter: 76 end\n",
      "Train epoch:14 iter: 77 begin\n",
      "Train epoch:14 iter: 77 end\n",
      "Train epoch:14 iter: 78 begin\n",
      "Train epoch:14 iter: 78 end\n",
      "Train epoch:14 iter: 79 begin\n",
      "Train epoch:14 iter: 79 end\n",
      "Train epoch:14 iter: 80 begin\n",
      "Train epoch:14 iter: 80 end\n",
      "Train epoch:14 iter: 81 begin\n",
      "Train epoch:14 iter: 81 end\n",
      "Train epoch:14 iter: 82 begin\n",
      "Train epoch:14 iter: 82 end\n",
      "Train epoch:14 iter: 83 begin\n",
      "Train epoch:14 iter: 83 end\n",
      "Train epoch:14 iter: 84 begin\n",
      "Train epoch:14 iter: 84 end\n",
      "Train epoch:14 iter: 85 begin\n",
      "Train epoch:14 iter: 85 end\n",
      "Train epoch:14 iter: 86 begin\n",
      "Train epoch:14 iter: 86 end\n",
      "Train epoch:14 iter: 87 begin\n",
      "Train epoch:14 iter: 87 end\n",
      "Train epoch:14 iter: 88 begin\n",
      "Train epoch:14 iter: 88 end\n",
      "Train epoch:14 iter: 89 begin\n",
      "Train epoch:14 iter: 89 end\n",
      "Train epoch:14 iter: 90 begin\n",
      "Train epoch:14 iter: 90 end\n",
      "Train epoch:14 iter: 91 begin\n",
      "Train epoch:14 iter: 91 end\n",
      "Train epoch:14 iter: 92 begin\n",
      "Train epoch:14 iter: 92 end\n",
      "Train epoch:14 iter: 93 begin\n",
      "Train epoch:14 iter: 93 end\n",
      "Train epoch:14 iter: 94 begin\n",
      "Train epoch:14 iter: 94 end\n",
      "Train epoch:14 iter: 95 begin\n",
      "Train epoch:14 iter: 95 end\n",
      "Train epoch:14 iter: 96 begin\n",
      "Train epoch:14 iter: 96 end\n",
      "Train epoch:14 iter: 97 begin\n",
      "Train epoch:14 iter: 97 end\n",
      "Train epoch:14 iter: 98 begin\n",
      "Train epoch:14 iter: 98 end\n",
      "Train epoch:14 iter: 99 begin\n",
      "Train epoch:14 iter: 99 end\n",
      "Train epoch:14 iter: 100 begin\n",
      "Train epoch:14 iter: 100 end\n",
      "Train epoch:14 iter: 101 begin\n",
      "Train epoch:14 iter: 101 end\n",
      "Train epoch:14 iter: 102 begin\n",
      "Train epoch:14 iter: 102 end\n",
      "Train epoch:14 iter: 103 begin\n",
      "Train epoch:14 iter: 103 end\n",
      "Train epoch:14 iter: 104 begin\n",
      "Train epoch:14 iter: 104 end\n",
      "Train epoch:14 iter: 105 begin\n",
      "Train epoch:14 iter: 105 end\n",
      "Train epoch:14 iter: 106 begin\n",
      "Train epoch:14 iter: 106 end\n",
      "Train epoch:14 iter: 107 begin\n",
      "Train epoch:14 iter: 107 end\n",
      "Train epoch:14 iter: 108 begin\n",
      "Train epoch:14 iter: 108 end\n",
      "Train epoch:14 iter: 109 begin\n",
      "Train epoch:14 iter: 109 end\n",
      "Train epoch:14 iter: 110 begin\n",
      "Train epoch:14 iter: 110 end\n",
      "Train epoch:14 iter: 111 begin\n",
      "Train epoch:14 iter: 111 end\n",
      "Train epoch:14 iter: 112 begin\n",
      "Train epoch:14 iter: 112 end\n",
      "Train epoch:14 iter: 113 begin\n",
      "Train epoch:14 iter: 113 end\n",
      "Train epoch:14 iter: 114 begin\n",
      "Train epoch:14 iter: 114 end\n",
      "Train epoch:14 iter: 115 begin\n",
      "Train epoch:14 iter: 115 end\n",
      "Train epoch:14 iter: 116 begin\n",
      "Train epoch:14 iter: 116 end\n",
      "Train epoch:14 iter: 117 begin\n",
      "Train epoch:14 iter: 117 end\n",
      "Train epoch:14 iter: 118 begin\n",
      "Train epoch:14 iter: 118 end\n",
      "Train epoch:14 iter: 119 begin\n",
      "Train epoch:14 iter: 119 end\n",
      "Train epoch:14 iter: 120 begin\n",
      "Train epoch:14 iter: 120 end\n",
      "Train epoch:14 iter: 121 begin\n",
      "Train epoch:14 iter: 121 end\n",
      "Train epoch:14 iter: 122 begin\n",
      "Train epoch:14 iter: 122 end\n",
      "Train epoch:14 iter: 123 begin\n",
      "Train epoch:14 iter: 123 end\n",
      "Train epoch:14 iter: 124 begin\n",
      "Train epoch:14 iter: 124 end\n",
      "Train epoch:14 iter: 125 begin\n",
      "Train epoch:14 iter: 125 end\n",
      "Train epoch:14 iter: 126 begin\n",
      "Train epoch:14 iter: 126 end\n",
      "Train epoch:14 iter: 127 begin\n",
      "Train epoch:14 iter: 127 end\n",
      "Train epoch:14 iter: 128 begin\n",
      "Train epoch:14 iter: 128 end\n",
      "Train epoch:14 iter: 129 begin\n",
      "Train epoch:14 iter: 129 end\n",
      "Train epoch:14 iter: 130 begin\n",
      "Train epoch:14 iter: 130 end\n",
      "Train epoch:14 iter: 131 begin\n",
      "Train epoch:14 iter: 131 end\n",
      "Train epoch:14 iter: 132 begin\n",
      "Train epoch:14 iter: 132 end\n",
      "Train epoch:14 iter: 133 begin\n",
      "Train epoch:14 iter: 133 end\n",
      "Train epoch:14 iter: 134 begin\n",
      "Train epoch:14 iter: 134 end\n",
      "Train epoch:14 iter: 135 begin\n",
      "Train epoch:14 iter: 135 end\n",
      "Train epoch:14 iter: 136 begin\n",
      "Train epoch:14 iter: 136 end\n",
      "Train epoch:14 iter: 137 begin\n",
      "Train epoch:14 iter: 137 end\n",
      "Train epoch:14 iter: 138 begin\n",
      "Train epoch:14 iter: 138 end\n",
      "Train epoch:14 iter: 139 begin\n",
      "Train epoch:14 iter: 139 end\n",
      "Train epoch:14 iter: 140 begin\n",
      "Train epoch:14 iter: 140 end\n",
      "Train epoch:14 iter: 141 begin\n",
      "Train epoch:14 iter: 141 end\n",
      "Train epoch:14 iter: 142 begin\n",
      "Train epoch:14 iter: 142 end\n",
      "Train epoch:14 iter: 143 begin\n",
      "Train epoch:14 iter: 143 end\n",
      "Train epoch:14 iter: 144 begin\n",
      "Train epoch:14 iter: 144 end\n",
      "Train epoch:14 iter: 145 begin\n",
      "Train epoch:14 iter: 145 end\n",
      "Train epoch:14 iter: 146 begin\n",
      "Train epoch:14 iter: 146 end\n",
      "Train epoch:14 iter: 147 begin\n",
      "Train epoch:14 iter: 147 end\n",
      "Train epoch:14 iter: 148 begin\n",
      "Train epoch:14 iter: 148 end\n",
      "Train epoch:14 iter: 149 begin\n",
      "Train epoch:14 iter: 149 end\n",
      "Train epoch:14 iter: 150 begin\n",
      "Train epoch:14 iter: 150 end\n",
      "Train epoch:14 iter: 151 begin\n",
      "Train epoch:14 iter: 151 end\n",
      "Train epoch:14 iter: 152 begin\n",
      "Train epoch:14 iter: 152 end\n",
      "Train epoch:14 iter: 153 begin\n",
      "Train epoch:14 iter: 153 end\n",
      "Train epoch:14 iter: 154 begin\n",
      "Train epoch:14 iter: 154 end\n",
      "Train epoch:14 iter: 155 begin\n",
      "Train epoch:14 iter: 155 end\n",
      "Train epoch:14 iter: 156 begin\n",
      "Train epoch:14 iter: 156 end\n",
      "Train epoch:14 iter: 157 begin\n",
      "Train epoch:14 iter: 157 end\n",
      "Train epoch:14 iter: 158 begin\n",
      "Train epoch:14 iter: 158 end\n",
      "Train epoch:14 iter: 159 begin\n",
      "Train epoch:14 iter: 159 end\n",
      "Train epoch:14 iter: 160 begin\n",
      "Train epoch:14 iter: 160 end\n",
      "Train epoch:14 iter: 161 begin\n",
      "Train epoch:14 iter: 161 end\n",
      "Train epoch:14 iter: 162 begin\n",
      "Train epoch:14 iter: 162 end\n",
      "Train epoch:14 iter: 163 begin\n",
      "Train epoch:14 iter: 163 end\n",
      "Train epoch:14 iter: 164 begin\n",
      "Train epoch:14 iter: 164 end\n",
      "Train epoch:14 iter: 165 begin\n",
      "Train epoch:14 iter: 165 end\n",
      "Train epoch:14 iter: 166 begin\n",
      "Train epoch:14 iter: 166 end\n",
      "Train epoch:14 iter: 167 begin\n",
      "Train epoch:14 iter: 167 end\n",
      "Train epoch:14 iter: 168 begin\n",
      "Train epoch:14 iter: 168 end\n",
      "Train epoch:14 iter: 169 begin\n",
      "Train epoch:14 iter: 169 end\n",
      "Train epoch:14 iter: 170 begin\n",
      "Train epoch:14 iter: 170 end\n",
      "Train epoch:14 iter: 171 begin\n",
      "Train epoch:14 iter: 171 end\n",
      "Train epoch:14 iter: 172 begin\n",
      "Train epoch:14 iter: 172 end\n",
      "Train epoch:14 iter: 173 begin\n",
      "Train epoch:14 iter: 173 end\n",
      "Train epoch:14 iter: 174 begin\n",
      "Train epoch:14 iter: 174 end\n",
      "Train epoch:14 iter: 175 begin\n",
      "Train epoch:14 iter: 175 end\n",
      "Train epoch:14 iter: 176 begin\n",
      "Train epoch:14 iter: 176 end\n",
      "Train epoch:14 iter: 177 begin\n",
      "Train epoch:14 iter: 177 end\n",
      "Train epoch:14 iter: 178 begin\n",
      "Train epoch:14 iter: 178 end\n",
      "Train epoch:14 iter: 179 begin\n",
      "Train epoch:14 iter: 179 end\n",
      "Train epoch:14 iter: 180 begin\n",
      "Train epoch:14 iter: 180 end\n",
      "Train epoch:14 iter: 181 begin\n",
      "Train epoch:14 iter: 181 end\n",
      "Train epoch:14 iter: 182 begin\n",
      "Train epoch:14 iter: 182 end\n",
      "Train epoch:14 iter: 183 begin\n",
      "Train epoch:14 iter: 183 end\n",
      "Train epoch:14 iter: 184 begin\n",
      "Train epoch:14 iter: 184 end\n",
      "Train epoch:14 iter: 185 begin\n",
      "Train epoch:14 iter: 185 end\n",
      "Train epoch:14 iter: 186 begin\n",
      "Train epoch:14 iter: 186 end\n",
      "Train epoch:14 iter: 187 begin\n",
      "Train epoch:14 iter: 187 end\n",
      "Train epoch:14 iter: 188 begin\n",
      "Train epoch:14 iter: 188 end\n",
      "Train epoch:14 iter: 189 begin\n",
      "Train epoch:14 iter: 189 end\n",
      "Train epoch:14 iter: 190 begin\n",
      "Train epoch:14 iter: 190 end\n",
      "Train epoch:14 iter: 191 begin\n",
      "Train epoch:14 iter: 191 end\n",
      "Train epoch:14 iter: 192 begin\n",
      "Train epoch:14 iter: 192 end\n",
      "Train epoch:14 iter: 193 begin\n",
      "Train epoch:14 iter: 193 end\n",
      "Train epoch:14 iter: 194 begin\n",
      "Train epoch:14 iter: 194 end\n",
      "Train epoch:14 iter: 195 begin\n",
      "Train epoch:14 iter: 195 end\n",
      "Train epoch:14 iter: 196 begin\n",
      "Train epoch:14 iter: 196 end\n",
      "Train epoch:14 iter: 197 begin\n",
      "Train epoch:14 iter: 197 end\n",
      "Train epoch:14 iter: 198 begin\n",
      "Train epoch:14 iter: 198 end\n",
      "Train epoch:14 iter: 199 begin\n",
      "Train epoch:14 iter: 199 end\n",
      "Train epoch:14 iter: 200 begin\n",
      "Train epoch:14 iter: 200 end\n",
      "Train epoch:14 iter: 201 begin\n",
      "Train epoch:14 iter: 201 end\n",
      "Train epoch:14 iter: 202 begin\n",
      "Train epoch:14 iter: 202 end\n",
      "Train epoch:14 iter: 203 begin\n",
      "Train epoch:14 iter: 203 end\n",
      "Train epoch:14 iter: 204 begin\n",
      "Train epoch:14 iter: 204 end\n",
      "Train epoch:14 iter: 205 begin\n",
      "Train epoch:14 iter: 205 end\n",
      "Train epoch:14 iter: 206 begin\n",
      "Train epoch:14 iter: 206 end\n",
      "Train epoch:14 iter: 207 begin\n",
      "Train epoch:14 iter: 207 end\n",
      "Train epoch:14 iter: 208 begin\n",
      "Train epoch:14 iter: 208 end\n",
      "Train epoch:14 iter: 209 begin\n",
      "Train epoch:14 iter: 209 end\n",
      "Train epoch:14 iter: 210 begin\n",
      "Train epoch:14 iter: 210 end\n",
      "Train epoch:14 iter: 211 begin\n",
      "Train epoch:14 iter: 211 end\n",
      "Train epoch:14 iter: 212 begin\n",
      "Train epoch:14 iter: 212 end\n",
      "Train epoch:14 iter: 213 begin\n",
      "Train epoch:14 iter: 213 end\n",
      "Train epoch:14 iter: 214 begin\n",
      "Train epoch:14 iter: 214 end\n",
      "Train epoch:14 iter: 215 begin\n",
      "Train epoch:14 iter: 215 end\n",
      "Train epoch:14 iter: 216 begin\n",
      "Train epoch:14 iter: 216 end\n",
      "Train epoch:14 iter: 217 begin\n",
      "Train epoch:14 iter: 217 end\n",
      "Train epoch:14 iter: 218 begin\n",
      "Train epoch:14 iter: 218 end\n",
      "Train epoch:14 iter: 219 begin\n",
      "Train epoch:14 iter: 219 end\n",
      "Train epoch:14 iter: 220 begin\n",
      "Train epoch:14 iter: 220 end\n",
      "Train epoch:14 iter: 221 begin\n",
      "Train epoch:14 iter: 221 end\n",
      "Train epoch:14 iter: 222 begin\n",
      "Train epoch:14 iter: 222 end\n",
      "Train epoch:14 iter: 223 begin\n",
      "Train epoch:14 iter: 223 end\n",
      "Train epoch:14 iter: 224 begin\n",
      "Train epoch:14 iter: 224 end\n",
      "Train epoch:14 iter: 225 begin\n",
      "Train epoch:14 iter: 225 end\n",
      "Train epoch:14 iter: 226 begin\n",
      "Train epoch:14 iter: 226 end\n",
      "Train epoch:14 iter: 227 begin\n",
      "Train epoch:14 iter: 227 end\n",
      "Train epoch:14 iter: 228 begin\n",
      "Train epoch:14 iter: 228 end\n",
      "Train epoch:14 iter: 229 begin\n",
      "Train epoch:14 iter: 229 end\n",
      "Train epoch:14 iter: 230 begin\n",
      "Train epoch:14 iter: 230 end\n",
      "Train epoch:14 iter: 231 begin\n",
      "Train epoch:14 iter: 231 end\n",
      "Train epoch:14 iter: 232 begin\n",
      "Train epoch:14 iter: 232 end\n",
      "Train epoch:14 iter: 233 begin\n",
      "Train epoch:14 iter: 233 end\n",
      "Train epoch:14 iter: 234 begin\n",
      "Train epoch:14 iter: 234 end\n",
      "Train epoch:14 iter: 235 begin\n",
      "Train epoch:14 iter: 235 end\n",
      "Train epoch:14 iter: 236 begin\n",
      "Train epoch:14 iter: 236 end\n",
      "Train epoch:14 iter: 237 begin\n",
      "Train epoch:14 iter: 237 end\n",
      "Train epoch:14 iter: 238 begin\n",
      "Train epoch:14 iter: 238 end\n",
      "Train epoch:14 iter: 239 begin\n",
      "Train epoch:14 iter: 239 end\n",
      "Train epoch:14 iter: 240 begin\n",
      "Train epoch:14 iter: 240 end\n",
      "Train epoch:14 iter: 241 begin\n",
      "Train epoch:14 iter: 241 end\n",
      "Train epoch:14 iter: 242 begin\n",
      "Train epoch:14 iter: 242 end\n",
      "Train epoch:14 iter: 243 begin\n",
      "Train epoch:14 iter: 243 end\n",
      "Train epoch:14 iter: 244 begin\n",
      "Train epoch:14 iter: 244 end\n",
      "Train epoch:14 iter: 245 begin\n",
      "Train epoch:14 iter: 245 end\n",
      "Train epoch:14 iter: 246 begin\n",
      "Train epoch:14 iter: 246 end\n",
      "Train epoch:14 iter: 247 begin\n",
      "Train epoch:14 iter: 247 end\n",
      "Train epoch:14 iter: 248 begin\n",
      "Train epoch:14 iter: 248 end\n",
      "Train epoch:14 iter: 249 begin\n",
      "Train epoch:14 iter: 249 end\n",
      "Train epoch:14 iter: 250 begin\n",
      "Train epoch:14 iter: 250 end\n",
      "Train epoch:14 iter: 251 begin\n",
      "Train epoch:14 iter: 251 end\n",
      "Train epoch:14 iter: 252 begin\n",
      "Train epoch:14 iter: 252 end\n",
      "Train epoch:14 iter: 253 begin\n",
      "Train epoch:14 iter: 253 end\n",
      "Train epoch:14 iter: 254 begin\n",
      "Train epoch:14 iter: 254 end\n",
      "Train epoch:14 iter: 255 begin\n",
      "Train epoch:14 iter: 255 end\n",
      "Train epoch:14 iter: 256 begin\n",
      "Train epoch:14 iter: 256 end\n",
      "Train epoch:14 iter: 257 begin\n",
      "Train epoch:14 iter: 257 end\n",
      "Train epoch:14 iter: 258 begin\n",
      "Train epoch:14 iter: 258 end\n",
      "Train epoch:14 iter: 259 begin\n",
      "Train epoch:14 iter: 259 end\n",
      "Train epoch:14 iter: 260 begin\n",
      "Train epoch:14 iter: 260 end\n",
      "Train epoch:14 iter: 261 begin\n",
      "Train epoch:14 iter: 261 end\n",
      "Train epoch:14 iter: 262 begin\n",
      "Train epoch:14 iter: 262 end\n",
      "Train epoch:14 iter: 263 begin\n",
      "Train epoch:14 iter: 263 end\n",
      "Train epoch:14 iter: 264 begin\n",
      "Train epoch:14 iter: 264 end\n",
      "Train epoch:14 iter: 265 begin\n",
      "Train epoch:14 iter: 265 end\n",
      "Train epoch:14 iter: 266 begin\n",
      "Train epoch:14 iter: 266 end\n",
      "Train epoch:14 iter: 267 begin\n",
      "Train epoch:14 iter: 267 end\n",
      "Train epoch:14 iter: 268 begin\n",
      "Train epoch:14 iter: 268 end\n",
      "Train epoch:14 iter: 269 begin\n",
      "Train epoch:14 iter: 269 end\n",
      "Train epoch:14 iter: 270 begin\n",
      "Train epoch:14 iter: 270 end\n",
      "Train epoch:14 iter: 271 begin\n",
      "Train epoch:14 iter: 271 end\n",
      "Train epoch:14 iter: 272 begin\n",
      "Train epoch:14 iter: 272 end\n",
      "Train epoch:14 iter: 273 begin\n",
      "Train epoch:14 iter: 273 end\n",
      "Train epoch:14 iter: 274 begin\n",
      "Train epoch:14 iter: 274 end\n",
      "Train epoch:14 iter: 275 begin\n",
      "Train epoch:14 iter: 275 end\n",
      "Train epoch:14 iter: 276 begin\n",
      "Train epoch:14 iter: 276 end\n",
      "Train epoch:14 iter: 277 begin\n",
      "Train epoch:14 iter: 277 end\n",
      "Train epoch:14 iter: 278 begin\n",
      "Train epoch:14 iter: 278 end\n",
      "Train epoch:14 iter: 279 begin\n",
      "Train epoch:14 iter: 279 end\n",
      "Train epoch:14 iter: 280 begin\n",
      "Train epoch:14 iter: 280 end\n",
      "Train epoch:14 iter: 281 begin\n",
      "Train epoch:14 iter: 281 end\n",
      "Train epoch:14 iter: 282 begin\n",
      "Train epoch:14 iter: 282 end\n",
      "Train epoch:14 iter: 283 begin\n",
      "Train epoch:14 iter: 283 end\n",
      "Train epoch:14 iter: 284 begin\n",
      "Train epoch:14 iter: 284 end\n",
      "Train epoch:14 iter: 285 begin\n",
      "Train epoch:14 iter: 285 end\n",
      "Train epoch:14 iter: 286 begin\n",
      "Train epoch:14 iter: 286 end\n",
      "Train epoch:14 iter: 287 begin\n",
      "Train epoch:14 iter: 287 end\n",
      "Train epoch:14 iter: 288 begin\n",
      "Train epoch:14 iter: 288 end\n",
      "Train epoch:14 iter: 289 begin\n",
      "Train epoch:14 iter: 289 end\n",
      "Train epoch:14 iter: 290 begin\n",
      "Train epoch:14 iter: 290 end\n",
      "Train epoch:14 iter: 291 begin\n",
      "Train epoch:14 iter: 291 end\n",
      "Train epoch:14 iter: 292 begin\n",
      "Train epoch:14 iter: 292 end\n",
      "Train epoch:14 iter: 293 begin\n",
      "Train epoch:14 iter: 293 end\n",
      "Train epoch:14 iter: 294 begin\n",
      "Train epoch:14 iter: 294 end\n",
      "Train epoch:14 iter: 295 begin\n",
      "Train epoch:14 iter: 295 end\n",
      "Train epoch:14 iter: 296 begin\n",
      "Train epoch:14 iter: 296 end\n",
      "Train epoch:14 iter: 297 begin\n",
      "Train epoch:14 iter: 297 end\n",
      "Train epoch:14 iter: 298 begin\n",
      "Train epoch:14 iter: 298 end\n",
      "Train epoch:14 iter: 299 begin\n",
      "Train epoch:14 iter: 299 end\n",
      "Train epoch:14 iter: 300 begin\n",
      "Train epoch:14 iter: 300 end\n",
      "Train epoch:14 iter: 301 begin\n",
      "Train epoch:14 iter: 301 end\n",
      "Train epoch:14 iter: 302 begin\n",
      "Train epoch:14 iter: 302 end\n",
      "Train epoch:14 iter: 303 begin\n",
      "Train epoch:14 iter: 303 end\n",
      "Train epoch:14 iter: 304 begin\n",
      "Train epoch:14 iter: 304 end\n",
      "Train epoch:14 iter: 305 begin\n",
      "Train epoch:14 iter: 305 end\n",
      "Train epoch:14 iter: 306 begin\n",
      "Train epoch:14 iter: 306 end\n",
      "Train epoch:14 iter: 307 begin\n",
      "Train epoch:14 iter: 307 end\n",
      "Train epoch:14 iter: 308 begin\n",
      "Train epoch:14 iter: 308 end\n",
      "Train epoch:14 iter: 309 begin\n",
      "Train epoch:14 iter: 309 end\n",
      "Train epoch:14 iter: 310 begin\n",
      "Train epoch:14 iter: 310 end\n",
      "Train epoch:14 iter: 311 begin\n",
      "Train epoch:14 iter: 311 end\n",
      "Train epoch:14 iter: 312 begin\n",
      "Train epoch:14 iter: 312 end\n",
      "Train epoch:14 iter: 313 begin\n",
      "Train epoch:14 iter: 313 end\n",
      "Train epoch:14 iter: 314 begin\n",
      "Train epoch:14 iter: 314 end\n",
      "Train epoch:14 iter: 315 begin\n",
      "Train epoch:14 iter: 315 end\n",
      "Train epoch:14 iter: 316 begin\n",
      "Train epoch:14 iter: 316 end\n",
      "Train epoch:14 iter: 317 begin\n",
      "Train epoch:14 iter: 317 end\n",
      "Train epoch:14 iter: 318 begin\n",
      "Train epoch:14 iter: 318 end\n",
      "Train epoch:14 iter: 319 begin\n",
      "Train epoch:14 iter: 319 end\n",
      "Train epoch:14 iter: 320 begin\n",
      "Train epoch:14 iter: 320 end\n",
      "Train epoch:14 iter: 321 begin\n",
      "Train epoch:14 iter: 321 end\n",
      "Train epoch:14 iter: 322 begin\n",
      "Train epoch:14 iter: 322 end\n",
      "Train epoch:14 iter: 323 begin\n",
      "Train epoch:14 iter: 323 end\n",
      "Train epoch:14 iter: 324 begin\n",
      "Train epoch:14 iter: 324 end\n",
      "Train epoch:14 iter: 325 begin\n",
      "Train epoch:14 iter: 325 end\n",
      "Train epoch:14 iter: 326 begin\n",
      "Train epoch:14 iter: 326 end\n",
      "Train epoch:14 iter: 327 begin\n",
      "Train epoch:14 iter: 327 end\n",
      "Train epoch:14 iter: 328 begin\n",
      "Train epoch:14 iter: 328 end\n",
      "Train epoch:14 iter: 329 begin\n",
      "Train epoch:14 iter: 329 end\n",
      "Train epoch:14 iter: 330 begin\n",
      "Train epoch:14 iter: 330 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:14 iter: 331 begin\n",
      "Train epoch:14 iter: 331 end\n",
      "Train epoch:14 iter: 332 begin\n",
      "Train epoch:14 iter: 332 end\n",
      "Train epoch:14 iter: 333 begin\n",
      "Train epoch:14 iter: 333 end\n",
      "Train epoch:14 iter: 334 begin\n",
      "Train epoch:14 iter: 334 end\n",
      "Train epoch:14 iter: 335 begin\n",
      "Train epoch:14 iter: 335 end\n",
      "Train epoch:14 iter: 336 begin\n",
      "Train epoch:14 iter: 336 end\n",
      "Train epoch:14 iter: 337 begin\n",
      "Train epoch:14 iter: 337 end\n",
      "Train epoch:14 iter: 338 begin\n",
      "Train epoch:14 iter: 338 end\n",
      "Train epoch:14 iter: 339 begin\n",
      "Train epoch:14 iter: 339 end\n",
      "Train epoch:14 iter: 340 begin\n",
      "Train epoch:14 iter: 340 end\n",
      "Train epoch:14 iter: 341 begin\n",
      "Train epoch:14 iter: 341 end\n",
      "Train epoch:14 iter: 342 begin\n",
      "Train epoch:14 iter: 342 end\n",
      "Train epoch:14 iter: 343 begin\n",
      "Train epoch:14 iter: 343 end\n",
      "Train epoch:14 iter: 344 begin\n",
      "Train epoch:14 iter: 344 end\n",
      "Train epoch:14 iter: 345 begin\n",
      "Train epoch:14 iter: 345 end\n",
      "Train epoch:14 iter: 346 begin\n",
      "Train epoch:14 iter: 346 end\n",
      "Train epoch:14 iter: 347 begin\n",
      "Train epoch:14 iter: 347 end\n",
      "Train epoch:14 iter: 348 begin\n",
      "Train epoch:14 iter: 348 end\n",
      "Train epoch:14 iter: 349 begin\n",
      "Train epoch:14 iter: 349 end\n",
      "Train epoch:14 iter: 350 begin\n",
      "Train epoch:14 iter: 350 end\n",
      "Train epoch:14 iter: 351 begin\n",
      "Train epoch:14 iter: 351 end\n",
      "Train epoch:14 iter: 352 begin\n",
      "Train epoch:14 iter: 352 end\n",
      "Train epoch:14 iter: 353 begin\n",
      "Train epoch:14 iter: 353 end\n",
      "Train epoch:14 iter: 354 begin\n",
      "Train epoch:14 iter: 354 end\n",
      "Train epoch:14 iter: 355 begin\n",
      "Train epoch:14 iter: 355 end\n",
      "Train epoch:14 iter: 356 begin\n",
      "Train epoch:14 iter: 356 end\n",
      "Train epoch:14 iter: 357 begin\n",
      "Train epoch:14 iter: 357 end\n",
      "Train epoch:14 iter: 358 begin\n",
      "Train epoch:14 iter: 358 end\n",
      "Train epoch:14 iter: 359 begin\n",
      "Train epoch:14 iter: 359 end\n",
      "Train epoch:14 iter: 360 begin\n",
      "Train epoch:14 iter: 360 end\n",
      "Train epoch:14 iter: 361 begin\n",
      "Train epoch:14 iter: 361 end\n",
      "Train epoch:14 iter: 362 begin\n",
      "Train epoch:14 iter: 362 end\n",
      "Train epoch:14 iter: 363 begin\n",
      "Train epoch:14 iter: 363 end\n",
      "Train epoch:14 iter: 364 begin\n",
      "Train epoch:14 iter: 364 end\n",
      "Train epoch:14 iter: 365 begin\n",
      "Train epoch:14 iter: 365 end\n",
      "Train epoch:14 iter: 366 begin\n",
      "Train epoch:14 iter: 366 end\n",
      "Train epoch:14 iter: 367 begin\n",
      "Train epoch:14 iter: 367 end\n",
      "Train epoch:14 iter: 368 begin\n",
      "Train epoch:14 iter: 368 end\n",
      "Train epoch:14 iter: 369 begin\n",
      "Train epoch:14 iter: 369 end\n",
      "Train epoch:14 iter: 370 begin\n",
      "Train epoch:14 iter: 370 end\n",
      "Train epoch:14 iter: 371 begin\n",
      "Train epoch:14 iter: 371 end\n",
      "Train epoch:14 iter: 372 begin\n",
      "Train epoch:14 iter: 372 end\n",
      "Train epoch:14 iter: 373 begin\n",
      "Train epoch:14 iter: 373 end\n",
      "Train epoch:14 iter: 374 begin\n",
      "Train epoch:14 iter: 374 end\n",
      "Train epoch:14 iter: 375 begin\n",
      "Train epoch:14 iter: 375 end\n",
      "Train epoch:14 iter: 376 begin\n",
      "Train epoch:14 iter: 376 end\n",
      "Train epoch:14 iter: 377 begin\n",
      "Train epoch:14 iter: 377 end\n",
      "Train epoch:14 iter: 378 begin\n",
      "Train epoch:14 iter: 378 end\n",
      "Train epoch:14 iter: 379 begin\n",
      "Train epoch:14 iter: 379 end\n",
      "Train epoch:14 iter: 380 begin\n",
      "Train epoch:14 iter: 380 end\n",
      "Train epoch:14 iter: 381 begin\n",
      "Train epoch:14 iter: 381 end\n",
      "Train epoch:14 iter: 382 begin\n",
      "Train epoch:14 iter: 382 end\n",
      "Train epoch:14 iter: 383 begin\n",
      "Train epoch:14 iter: 383 end\n",
      "Train epoch:14 iter: 384 begin\n",
      "Train epoch:14 iter: 384 end\n",
      "Train epoch:14 iter: 385 begin\n",
      "Train epoch:14 iter: 385 end\n",
      "Train epoch:14 iter: 386 begin\n",
      "Train epoch:14 iter: 386 end\n",
      "Train epoch:14 iter: 387 begin\n",
      "Train epoch:14 iter: 387 end\n",
      "Train epoch:14 iter: 388 begin\n",
      "Train epoch:14 iter: 388 end\n",
      "Train epoch:14 iter: 389 begin\n",
      "Train epoch:14 iter: 389 end\n",
      "Train epoch:14 iter: 390 begin\n",
      "Train epoch:14 iter: 390 end\n",
      "Train epoch:14 iter: 391 begin\n",
      "Train epoch:14 iter: 391 end\n",
      "Train epoch:14 iter: 392 begin\n",
      "Train epoch:14 iter: 392 end\n",
      "Train epoch:14 iter: 393 begin\n",
      "Train epoch:14 iter: 393 end\n",
      "Train epoch:14 iter: 394 begin\n",
      "Train epoch:14 iter: 394 end\n",
      "Train epoch:14 iter: 395 begin\n",
      "Train epoch:14 iter: 395 end\n",
      "Train epoch:14 iter: 396 begin\n",
      "Train epoch:14 iter: 396 end\n",
      "Train epoch:14 iter: 397 begin\n",
      "Train epoch:14 iter: 397 end\n",
      "Train epoch:14 iter: 398 begin\n",
      "Train epoch:14 iter: 398 end\n",
      "Train epoch:14 iter: 399 begin\n",
      "Train epoch:14 iter: 399 end\n",
      "Train epoch:14 iter: 400 begin\n",
      "Train epoch:14 iter: 400 end\n",
      "Train epoch:14 iter: 401 begin\n",
      "Train epoch:14 iter: 401 end\n",
      "Train epoch:14 iter: 402 begin\n",
      "Train epoch:14 iter: 402 end\n",
      "Train epoch:14 iter: 403 begin\n",
      "Train epoch:14 iter: 403 end\n",
      "Train epoch:14 iter: 404 begin\n",
      "Train epoch:14 iter: 404 end\n",
      "Train epoch:14 iter: 405 begin\n",
      "Train epoch:14 iter: 405 end\n",
      "Train epoch:14 iter: 406 begin\n",
      "Train epoch:14 iter: 406 end\n",
      "Train epoch:14 iter: 407 begin\n",
      "Train epoch:14 iter: 407 end\n",
      "Train epoch:14 iter: 408 begin\n",
      "Train epoch:14 iter: 408 end\n",
      "Train epoch:14 iter: 409 begin\n",
      "Train epoch:14 iter: 409 end\n",
      "Train epoch:14 iter: 410 begin\n",
      "Train epoch:14 iter: 410 end\n",
      "Train epoch:14 iter: 411 begin\n",
      "Train epoch:14 iter: 411 end\n",
      "Train epoch:14 iter: 412 begin\n",
      "Train epoch:14 iter: 412 end\n",
      "Train epoch:14 iter: 413 begin\n",
      "Train epoch:14 iter: 413 end\n",
      "Train epoch:14 iter: 414 begin\n",
      "Train epoch:14 iter: 414 end\n",
      "Train epoch:14 iter: 415 begin\n",
      "Train epoch:14 iter: 415 end\n",
      "Train epoch:14 iter: 416 begin\n",
      "Train epoch:14 iter: 416 end\n",
      "Train epoch:14 iter: 417 begin\n",
      "Train epoch:14 iter: 417 end\n",
      "Train epoch:14 iter: 418 begin\n",
      "Train epoch:14 iter: 418 end\n",
      "Train epoch:14 iter: 419 begin\n",
      "Train epoch:14 iter: 419 end\n",
      "Train epoch:14 iter: 420 begin\n",
      "Train epoch:14 iter: 420 end\n",
      "Train epoch:14 iter: 421 begin\n",
      "Train epoch:14 iter: 421 end\n",
      "Train epoch:14 iter: 422 begin\n",
      "Train epoch:14 iter: 422 end\n",
      "Train epoch:14 iter: 423 begin\n",
      "Train epoch:14 iter: 423 end\n",
      "Train epoch:14 iter: 424 begin\n",
      "Train epoch:14 iter: 424 end\n",
      "Train epoch:14 iter: 425 begin\n",
      "Train epoch:14 iter: 425 end\n",
      "Train epoch:14 iter: 426 begin\n",
      "Train epoch:14 iter: 426 end\n",
      "Train epoch:14 iter: 427 begin\n",
      "Train epoch:14 iter: 427 end\n",
      "Train epoch:14 iter: 428 begin\n",
      "Train epoch:14 iter: 428 end\n",
      "Train epoch:14 iter: 429 begin\n",
      "Train epoch:14 iter: 429 end\n",
      "Train epoch:14 iter: 430 begin\n",
      "Train epoch:14 iter: 430 end\n",
      "Train epoch:14 iter: 431 begin\n",
      "Train epoch:14 iter: 431 end\n",
      "Train epoch:14 iter: 432 begin\n",
      "Train epoch:14 iter: 432 end\n",
      "Train epoch:14 iter: 433 begin\n",
      "Train epoch:14 iter: 433 end\n",
      "Train epoch:14 iter: 434 begin\n",
      "Train epoch:14 iter: 434 end\n",
      "Train epoch:14 iter: 435 begin\n",
      "Train epoch:14 iter: 435 end\n",
      "Train epoch:14 iter: 436 begin\n",
      "Train epoch:14 iter: 436 end\n",
      "Train epoch:14 iter: 437 begin\n",
      "Train epoch:14 iter: 437 end\n",
      "Train epoch:14 iter: 438 begin\n",
      "Train epoch:14 iter: 438 end\n",
      "Train epoch:14 iter: 439 begin\n",
      "Train epoch:14 iter: 439 end\n",
      "Train epoch:14 iter: 440 begin\n",
      "Train epoch:14 iter: 440 end\n",
      "Train epoch:14 iter: 441 begin\n",
      "Train epoch:14 iter: 441 end\n",
      "Train epoch:14 iter: 442 begin\n",
      "Train epoch:14 iter: 442 end\n",
      "Train epoch:14 iter: 443 begin\n",
      "Train epoch:14 iter: 443 end\n",
      "Train epoch:14 iter: 444 begin\n",
      "Train epoch:14 iter: 444 end\n",
      "Train epoch:14 iter: 445 begin\n",
      "Train epoch:14 iter: 445 end\n",
      "Train epoch:14 iter: 446 begin\n",
      "Train epoch:14 iter: 446 end\n",
      "Train epoch:14 iter: 447 begin\n",
      "Train epoch:14 iter: 447 end\n",
      "Train epoch:14 iter: 448 begin\n",
      "Train epoch:14 iter: 448 end\n",
      "Train epoch:14 iter: 449 begin\n",
      "Train epoch:14 iter: 449 end\n",
      "Train epoch:14 iter: 450 begin\n",
      "Train epoch:14 iter: 450 end\n",
      "Train epoch:14 iter: 451 begin\n",
      "Train epoch:14 iter: 451 end\n",
      "Train epoch:14 iter: 452 begin\n",
      "Train epoch:14 iter: 452 end\n",
      "Train epoch:14 iter: 453 begin\n",
      "Train epoch:14 iter: 453 end\n",
      "Train epoch:14 iter: 454 begin\n",
      "Train epoch:14 iter: 454 end\n",
      "Train epoch:14 iter: 455 begin\n",
      "Train epoch:14 iter: 455 end\n",
      "Train epoch:14 iter: 456 begin\n",
      "Train epoch:14 iter: 456 end\n",
      "Train epoch:14 iter: 457 begin\n",
      "Train epoch:14 iter: 457 end\n",
      "Train epoch:14 iter: 458 begin\n",
      "Train epoch:14 iter: 458 end\n",
      "Train epoch:14 iter: 459 begin\n",
      "Train epoch:14 iter: 459 end\n",
      "Train epoch:14 iter: 460 begin\n",
      "Train epoch:14 iter: 460 end\n",
      "Train epoch:14 iter: 461 begin\n",
      "Train epoch:14 iter: 461 end\n",
      "Train epoch:14 iter: 462 begin\n",
      "Train epoch:14 iter: 462 end\n",
      "Train epoch:14 iter: 463 begin\n",
      "Train epoch:14 iter: 463 end\n",
      "Train epoch:14 iter: 464 begin\n",
      "Train epoch:14 iter: 464 end\n",
      "Train epoch:14 iter: 465 begin\n",
      "Train epoch:14 iter: 465 end\n",
      "Train epoch:14 iter: 466 begin\n",
      "Train epoch:14 iter: 466 end\n",
      "Train epoch:14 iter: 467 begin\n",
      "Train epoch:14 iter: 467 end\n",
      "Train epoch:14 iter: 468 begin\n",
      "Train epoch:14 iter: 468 end\n",
      "Train epoch:14 iter: 469 begin\n",
      "Train epoch:14 iter: 469 end\n",
      "Train epoch:14 iter: 470 begin\n",
      "Train epoch:14 iter: 470 end\n",
      "Train epoch:14 iter: 471 begin\n",
      "Train epoch:14 iter: 471 end\n",
      "Train epoch:14 iter: 472 begin\n",
      "Train epoch:14 iter: 472 end\n",
      "Train epoch:14 iter: 473 begin\n",
      "Train epoch:14 iter: 473 end\n",
      "Train epoch:14 iter: 474 begin\n",
      "Train epoch:14 iter: 474 end\n",
      "Train epoch:14 iter: 475 begin\n",
      "Train epoch:14 iter: 475 end\n",
      "Train epoch:14 iter: 476 begin\n",
      "Train epoch:14 iter: 476 end\n",
      "Train epoch:14 iter: 477 begin\n",
      "Train epoch:14 iter: 477 end\n",
      "Train epoch:14 iter: 478 begin\n",
      "Train epoch:14 iter: 478 end\n",
      "Train epoch:14 iter: 479 begin\n",
      "Train epoch:14 iter: 479 end\n",
      "Train epoch:14 iter: 480 begin\n",
      "Train epoch:14 iter: 480 end\n",
      "Train epoch:14 iter: 481 begin\n",
      "Train epoch:14 iter: 481 end\n",
      "Train epoch:14 iter: 482 begin\n",
      "Train epoch:14 iter: 482 end\n",
      "Train epoch:14 iter: 483 begin\n",
      "Train epoch:14 iter: 483 end\n",
      "Train epoch:14 iter: 484 begin\n",
      "Train epoch:14 iter: 484 end\n",
      "Train epoch:14 iter: 485 begin\n",
      "Train epoch:14 iter: 485 end\n",
      "Train epoch:14 iter: 486 begin\n",
      "Train epoch:14 iter: 486 end\n",
      "Train epoch:14 iter: 487 begin\n",
      "Train epoch:14 iter: 487 end\n",
      "Train epoch:14 iter: 488 begin\n",
      "Train epoch:14 iter: 488 end\n",
      "Train epoch:14 iter: 489 begin\n",
      "Train epoch:14 iter: 489 end\n",
      "Train epoch:14 iter: 490 begin\n",
      "Train epoch:14 iter: 490 end\n",
      "Train epoch:14 iter: 491 begin\n",
      "Train epoch:14 iter: 491 end\n",
      "Train epoch:14 iter: 492 begin\n",
      "Train epoch:14 iter: 492 end\n",
      "Train epoch:14 iter: 493 begin\n",
      "Train epoch:14 iter: 493 end\n",
      "Train epoch:14 iter: 494 begin\n",
      "Train epoch:14 iter: 494 end\n",
      "Train epoch:14 iter: 495 begin\n",
      "Train epoch:14 iter: 495 end\n",
      "Train epoch:14 iter: 496 begin\n",
      "Train epoch:14 iter: 496 end\n",
      "Train epoch:14 iter: 497 begin\n",
      "Train epoch:14 iter: 497 end\n",
      "Train epoch:14 iter: 498 begin\n",
      "Train epoch:14 iter: 498 end\n",
      "Train epoch:14 iter: 499 begin\n",
      "Train epoch:14 iter: 499 end\n",
      "Train epoch:14 iter: 500 begin\n",
      "Train epoch:14 iter: 500 end\n",
      "Train epoch:14 iter: 501 begin\n",
      "Train epoch:14 iter: 501 end\n",
      "Train epoch:14 iter: 502 begin\n",
      "Train epoch:14 iter: 502 end\n",
      "Train epoch:14 iter: 503 begin\n",
      "Train epoch:14 iter: 503 end\n",
      "Train epoch:14 iter: 504 begin\n",
      "Train epoch:14 iter: 504 end\n",
      "Train epoch:14 iter: 505 begin\n",
      "Train epoch:14 iter: 505 end\n",
      "Train epoch:14 iter: 506 begin\n",
      "Train epoch:14 iter: 506 end\n",
      "Train epoch:14 iter: 507 begin\n",
      "Train epoch:14 iter: 507 end\n",
      "Train epoch:14 iter: 508 begin\n",
      "Train epoch:14 iter: 508 end\n",
      "Train epoch:14 iter: 509 begin\n",
      "Train epoch:14 iter: 509 end\n",
      "Train epoch:14 iter: 510 begin\n",
      "Train epoch:14 iter: 510 end\n",
      "Train epoch:14 iter: 511 begin\n",
      "Train epoch:14 iter: 511 end\n",
      "Train epoch:14 iter: 512 begin\n",
      "Train epoch:14 iter: 512 end\n",
      "Train epoch:14 iter: 513 begin\n",
      "Train epoch:14 iter: 513 end\n",
      "Train epoch:14 iter: 514 begin\n",
      "Train epoch:14 iter: 514 end\n",
      "Train epoch:14 iter: 515 begin\n",
      "Train epoch:14 iter: 515 end\n",
      "Train epoch:14 iter: 516 begin\n",
      "Train epoch:14 iter: 516 end\n",
      "Train epoch:14 iter: 517 begin\n",
      "Train epoch:14 iter: 517 end\n",
      "Train epoch:14 iter: 518 begin\n",
      "Train epoch:14 iter: 518 end\n",
      "Train epoch:14 iter: 519 begin\n",
      "Train epoch:14 iter: 519 end\n",
      "Train epoch:14 iter: 520 begin\n",
      "Train epoch:14 iter: 520 end\n",
      "Train epoch:14 iter: 521 begin\n",
      "Train epoch:14 iter: 521 end\n",
      "Train epoch:14 iter: 522 begin\n",
      "Train epoch:14 iter: 522 end\n",
      "Train epoch:14 iter: 523 begin\n",
      "Train epoch:14 iter: 523 end\n",
      "Train epoch:14 iter: 524 begin\n",
      "Train epoch:14 iter: 524 end\n",
      "Train epoch:14 iter: 525 begin\n",
      "Train epoch:14 iter: 525 end\n",
      "Train epoch:14 iter: 526 begin\n",
      "Train epoch:14 iter: 526 end\n",
      "Train epoch:14 iter: 527 begin\n",
      "Train epoch:14 iter: 527 end\n",
      "Train epoch:14 iter: 528 begin\n",
      "Train epoch:14 iter: 528 end\n",
      "Train epoch:14 iter: 529 begin\n",
      "Train epoch:14 iter: 529 end\n",
      "Train epoch:14 iter: 530 begin\n",
      "Train epoch:14 iter: 530 end\n",
      "Train epoch:14 iter: 531 begin\n",
      "Train epoch:14 iter: 531 end\n",
      "Train epoch:14 iter: 532 begin\n",
      "Train epoch:14 iter: 532 end\n",
      "Train epoch:14 iter: 533 begin\n",
      "Train epoch:14 iter: 533 end\n",
      "Train epoch:14 iter: 534 begin\n",
      "Train epoch:14 iter: 534 end\n",
      "Train epoch:14 iter: 535 begin\n",
      "Train epoch:14 iter: 535 end\n",
      "Train epoch:14 iter: 536 begin\n",
      "Train epoch:14 iter: 536 end\n",
      "Train epoch:14 iter: 537 begin\n",
      "Train epoch:14 iter: 537 end\n",
      "Train epoch:14 iter: 538 begin\n",
      "Train epoch:14 iter: 538 end\n",
      "Train epoch:14 iter: 539 begin\n",
      "Train epoch:14 iter: 539 end\n",
      "Train epoch:14 iter: 540 begin\n",
      "Train epoch:14 iter: 540 end\n",
      "Train epoch:14 iter: 541 begin\n",
      "Train epoch:14 iter: 541 end\n",
      "Train epoch:14 iter: 542 begin\n",
      "Train epoch:14 iter: 542 end\n",
      "Train epoch:14 iter: 543 begin\n",
      "Train epoch:14 iter: 543 end\n",
      "Train epoch:14 iter: 544 begin\n",
      "Train epoch:14 iter: 544 end\n",
      "Train epoch:14 iter: 545 begin\n",
      "Train epoch:14 iter: 545 end\n",
      "Train epoch:14 iter: 546 begin\n",
      "Train epoch:14 iter: 546 end\n",
      "Train epoch:14 iter: 547 begin\n",
      "Train epoch:14 iter: 547 end\n",
      "Train epoch:14 iter: 548 begin\n",
      "Train epoch:14 iter: 548 end\n",
      "Train epoch:14 iter: 549 begin\n",
      "Train epoch:14 iter: 549 end\n",
      "Train epoch:14 iter: 550 begin\n",
      "Train epoch:14 iter: 550 end\n",
      "Train epoch:14 iter: 551 begin\n",
      "Train epoch:14 iter: 551 end\n",
      "Train epoch:14 iter: 552 begin\n",
      "Train epoch:14 iter: 552 end\n",
      "Train epoch:14 iter: 553 begin\n",
      "Train epoch:14 iter: 553 end\n",
      "Train epoch:14 iter: 554 begin\n",
      "Train epoch:14 iter: 554 end\n",
      "Train epoch:14 iter: 555 begin\n",
      "Train epoch:14 iter: 555 end\n",
      "Train epoch:14 iter: 556 begin\n",
      "Train epoch:14 iter: 556 end\n",
      "Train epoch:14 iter: 557 begin\n",
      "Train epoch:14 iter: 557 end\n",
      "Train epoch:14 iter: 558 begin\n",
      "Train epoch:14 iter: 558 end\n",
      "Train epoch:14 iter: 559 begin\n",
      "Train epoch:14 iter: 559 end\n",
      "Train epoch:14 iter: 560 begin\n",
      "Train epoch:14 iter: 560 end\n",
      "Train epoch:14 iter: 561 begin\n",
      "Train epoch:14 iter: 561 end\n",
      "Train epoch:14 iter: 562 begin\n",
      "Train epoch:14 iter: 562 end\n",
      "Train epoch:14 iter: 563 begin\n",
      "Train epoch:14 iter: 563 end\n",
      "Train epoch:14 iter: 564 begin\n",
      "Train epoch:14 iter: 564 end\n",
      "Train epoch:14 iter: 565 begin\n",
      "Train epoch:14 iter: 565 end\n",
      "Train epoch:14 iter: 566 begin\n",
      "Train epoch:14 iter: 566 end\n",
      "Train epoch:14 iter: 567 begin\n",
      "Train epoch:14 iter: 567 end\n",
      "Train epoch:14 iter: 568 begin\n",
      "Train epoch:14 iter: 568 end\n",
      "Train epoch:14 iter: 569 begin\n",
      "Train epoch:14 iter: 569 end\n",
      "Train epoch:14 iter: 570 begin\n",
      "Train epoch:14 iter: 570 end\n",
      "Train epoch:14 iter: 571 begin\n",
      "Train epoch:14 iter: 571 end\n",
      "Train epoch:14 iter: 572 begin\n",
      "Train epoch:14 iter: 572 end\n",
      "Train epoch:14 iter: 573 begin\n",
      "Train epoch:14 iter: 573 end\n",
      "Train epoch:14 iter: 574 begin\n",
      "Train epoch:14 iter: 574 end\n",
      "Train epoch:14 iter: 575 begin\n",
      "Train epoch:14 iter: 575 end\n",
      "Train epoch:14 iter: 576 begin\n",
      "Train epoch:14 iter: 576 end\n",
      "Train epoch:14 iter: 577 begin\n",
      "Train epoch:14 iter: 577 end\n",
      "Train epoch:14 iter: 578 begin\n",
      "Train epoch:14 iter: 578 end\n",
      "Train epoch:14 iter: 579 begin\n",
      "Train epoch:14 iter: 579 end\n",
      "Train epoch:14 iter: 580 begin\n",
      "Train epoch:14 iter: 580 end\n",
      "Train epoch:14 iter: 581 begin\n",
      "Train epoch:14 iter: 581 end\n",
      "Train epoch:14 iter: 582 begin\n",
      "Train epoch:14 iter: 582 end\n",
      "Train epoch:14 iter: 583 begin\n",
      "Train epoch:14 iter: 583 end\n",
      "Train epoch:14 iter: 584 begin\n",
      "Train epoch:14 iter: 584 end\n",
      "Train epoch:14 iter: 585 begin\n",
      "Train epoch:14 iter: 585 end\n",
      "Train epoch:14 iter: 586 begin\n",
      "Train epoch:14 iter: 586 end\n",
      "Train epoch:14 iter: 587 begin\n",
      "Train epoch:14 iter: 587 end\n",
      "Train epoch:14 iter: 588 begin\n",
      "Train epoch:14 iter: 588 end\n",
      "Train epoch:14 iter: 589 begin\n",
      "Train epoch:14 iter: 589 end\n",
      "Train epoch:14 iter: 590 begin\n",
      "Train epoch:14 iter: 590 end\n",
      "Train epoch:14 iter: 591 begin\n",
      "Train epoch:14 iter: 591 end\n",
      "Train epoch:14 iter: 592 begin\n",
      "Train epoch:14 iter: 592 end\n",
      "Train epoch:14 iter: 593 begin\n",
      "Train epoch:14 iter: 593 end\n",
      "Train epoch:14 iter: 594 begin\n",
      "Train epoch:14 iter: 594 end\n",
      "Train epoch:14 iter: 595 begin\n",
      "Train epoch:14 iter: 595 end\n",
      "Train epoch:14 iter: 596 begin\n",
      "Train epoch:14 iter: 596 end\n",
      "Train epoch:14 iter: 597 begin\n",
      "Train epoch:14 iter: 597 end\n",
      "Train epoch:14 iter: 598 begin\n",
      "Train epoch:14 iter: 598 end\n",
      "Train epoch:14 iter: 599 begin\n",
      "Train epoch:14 iter: 599 end\n",
      "Train epoch:14 iter: 600 begin\n",
      "Train epoch:14 iter: 600 end\n",
      "Train epoch:14 iter: 601 begin\n",
      "Train epoch:14 iter: 601 end\n",
      "Train epoch:14 iter: 602 begin\n",
      "Train epoch:14 iter: 602 end\n",
      "Train epoch:14 iter: 603 begin\n",
      "Train epoch:14 iter: 603 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:14 iter: 604 begin\n",
      "Train epoch:14 iter: 604 end\n",
      "Train epoch:14 iter: 605 begin\n",
      "Train epoch:14 iter: 605 end\n",
      "Train epoch:14 iter: 606 begin\n",
      "Train epoch:14 iter: 606 end\n",
      "Train epoch:14 iter: 607 begin\n",
      "Train epoch:14 iter: 607 end\n",
      "Train epoch:14 iter: 608 begin\n",
      "Train epoch:14 iter: 608 end\n",
      "Train epoch:14 iter: 609 begin\n",
      "Train epoch:14 iter: 609 end\n",
      "Train epoch:14 iter: 610 begin\n",
      "Train epoch:14 iter: 610 end\n",
      "Train epoch:14 iter: 611 begin\n",
      "Train epoch:14 iter: 611 end\n",
      "Train epoch:14 iter: 612 begin\n",
      "Train epoch:14 iter: 612 end\n",
      "Train epoch:14 iter: 613 begin\n",
      "Train epoch:14 iter: 613 end\n",
      "Train epoch:14 iter: 614 begin\n",
      "Train epoch:14 iter: 614 end\n",
      "Train epoch:14 iter: 615 begin\n",
      "Train epoch:14 iter: 615 end\n",
      "Train epoch:14 iter: 616 begin\n",
      "Train epoch:14 iter: 616 end\n",
      "Train epoch:14 iter: 617 begin\n",
      "Train epoch:14 iter: 617 end\n",
      "Train epoch:14 iter: 618 begin\n",
      "Train epoch:14 iter: 618 end\n",
      "Train epoch:14 iter: 619 begin\n",
      "Train epoch:14 iter: 619 end\n",
      "Train epoch:14 iter: 620 begin\n",
      "Train epoch:14 iter: 620 end\n",
      "Train epoch:14 iter: 621 begin\n",
      "Train epoch:14 iter: 621 end\n",
      "Train epoch:14 iter: 622 begin\n",
      "Train epoch:14 iter: 622 end\n",
      "Train epoch:14 iter: 623 begin\n",
      "Train epoch:14 iter: 623 end\n",
      "Train epoch:14 iter: 624 begin\n",
      "Train epoch:14 iter: 624 end\n",
      "Train epoch:14 iter: 625 begin\n",
      "Train epoch:14 iter: 625 end\n",
      "Train epoch:14 iter: 626 begin\n",
      "Train epoch:14 iter: 626 end\n",
      "Train epoch:14 iter: 627 begin\n",
      "Train epoch:14 iter: 627 end\n",
      "Train epoch:14 iter: 628 begin\n",
      "Train epoch:14 iter: 628 end\n",
      "Train epoch:14 iter: 629 begin\n",
      "Train epoch:14 iter: 629 end\n",
      "Train epoch:14 iter: 630 begin\n",
      "Train epoch:14 iter: 630 end\n",
      "Train epoch:14 iter: 631 begin\n",
      "Train epoch:14 iter: 631 end\n",
      "Train epoch:14 iter: 632 begin\n",
      "Train epoch:14 iter: 632 end\n",
      "Train epoch:14 iter: 633 begin\n",
      "Train epoch:14 iter: 633 end\n",
      "Train epoch:14 iter: 634 begin\n",
      "Train epoch:14 iter: 634 end\n",
      "Train epoch:14 iter: 635 begin\n",
      "Train epoch:14 iter: 635 end\n",
      "Train epoch:14 iter: 636 begin\n",
      "Train epoch:14 iter: 636 end\n",
      "Train epoch:14 iter: 637 begin\n",
      "Train epoch:14 iter: 637 end\n",
      "Train epoch:14 iter: 638 begin\n",
      "Train epoch:14 iter: 638 end\n",
      "Train epoch:14 iter: 639 begin\n",
      "Train epoch:14 iter: 639 end\n",
      "Train epoch:14 iter: 640 begin\n",
      "Train epoch:14 iter: 640 end\n",
      "Train epoch:14 iter: 641 begin\n",
      "Train epoch:14 iter: 641 end\n",
      "Train epoch:14 iter: 642 begin\n",
      "Train epoch:14 iter: 642 end\n",
      "Train epoch:14 iter: 643 begin\n",
      "Train epoch:14 iter: 643 end\n",
      "Train epoch:14 iter: 644 begin\n",
      "Train epoch:14 iter: 644 end\n",
      "Train epoch:14 iter: 645 begin\n",
      "Train epoch:14 iter: 645 end\n",
      "Train epoch:14 iter: 646 begin\n",
      "Train epoch:14 iter: 646 end\n",
      "Train epoch:14 iter: 647 begin\n",
      "Train epoch:14 iter: 647 end\n",
      "Train epoch:14 iter: 648 begin\n",
      "Train epoch:14 iter: 648 end\n",
      "Train epoch:14 iter: 649 begin\n",
      "Train epoch:14 iter: 649 end\n",
      "Train epoch:14 iter: 650 begin\n",
      "Train epoch:14 iter: 650 end\n",
      "Train epoch:14 iter: 651 begin\n",
      "Train epoch:14 iter: 651 end\n",
      "Train epoch:14 iter: 652 begin\n",
      "Train epoch:14 iter: 652 end\n",
      "Train epoch:14 iter: 653 begin\n",
      "Train epoch:14 iter: 653 end\n",
      "Train epoch:14 iter: 654 begin\n",
      "Train epoch:14 iter: 654 end\n",
      "Train epoch:14 iter: 655 begin\n",
      "Train epoch:14 iter: 655 end\n",
      "Train epoch:14 iter: 656 begin\n",
      "Train epoch:14 iter: 656 end\n",
      "Train epoch:14 iter: 657 begin\n",
      "Train epoch:14 iter: 657 end\n",
      "Train epoch:14 iter: 658 begin\n",
      "Train epoch:14 iter: 658 end\n",
      "Train epoch:14 iter: 659 begin\n",
      "Train epoch:14 iter: 659 end\n",
      "Train epoch:14 iter: 660 begin\n",
      "Train epoch:14 iter: 660 end\n",
      "Train epoch:14 iter: 661 begin\n",
      "Train epoch:14 iter: 661 end\n",
      "Train epoch:14 iter: 662 begin\n",
      "Train epoch:14 iter: 662 end\n",
      "Train epoch:14 iter: 663 begin\n",
      "Train epoch:14 iter: 663 end\n",
      "Train epoch:14 iter: 664 begin\n",
      "Train epoch:14 iter: 664 end\n",
      "Train epoch:14 iter: 665 begin\n",
      "Train epoch:14 iter: 665 end\n",
      "Train epoch:14 iter: 666 begin\n",
      "Train epoch:14 iter: 666 end\n",
      "Train epoch:14 iter: 667 begin\n",
      "Train epoch:14 iter: 667 end\n",
      "Train epoch:14 iter: 668 begin\n",
      "Train epoch:14 iter: 668 end\n",
      "Train epoch:14 iter: 669 begin\n",
      "Train epoch:14 iter: 669 end\n",
      "Train epoch:14 iter: 670 begin\n",
      "Train epoch:14 iter: 670 end\n",
      "Train epoch:14 iter: 671 begin\n",
      "Train epoch:14 iter: 671 end\n",
      "Train epoch:14 iter: 672 begin\n",
      "Train epoch:14 iter: 672 end\n",
      "Train epoch:14 iter: 673 begin\n",
      "Train epoch:14 iter: 673 end\n",
      "Train epoch:14 iter: 674 begin\n",
      "Train epoch:14 iter: 674 end\n",
      "Train epoch:14 iter: 675 begin\n",
      "Train epoch:14 iter: 675 end\n",
      "Train epoch:14 iter: 676 begin\n",
      "Train epoch:14 iter: 676 end\n",
      "Train epoch:14 iter: 677 begin\n",
      "Train epoch:14 iter: 677 end\n",
      "Train epoch:14 iter: 678 begin\n",
      "Train epoch:14 iter: 678 end\n",
      "Train epoch:14 iter: 679 begin\n",
      "Train epoch:14 iter: 679 end\n",
      "Train epoch:14 iter: 680 begin\n",
      "Train epoch:14 iter: 680 end\n",
      "Train epoch:14 iter: 681 begin\n",
      "Train epoch:14 iter: 681 end\n",
      "Train epoch:14 iter: 682 begin\n",
      "Train epoch:14 iter: 682 end\n",
      "Train epoch:14 iter: 683 begin\n",
      "Train epoch:14 iter: 683 end\n",
      "Train epoch:14 iter: 684 begin\n",
      "Train epoch:14 iter: 684 end\n",
      "Train epoch:14 iter: 685 begin\n",
      "Train epoch:14 iter: 685 end\n",
      "Train epoch:14 iter: 686 begin\n",
      "Train epoch:14 iter: 686 end\n",
      "Train epoch:14 iter: 687 begin\n",
      "Train epoch:14 iter: 687 end\n",
      "Train epoch:14 iter: 688 begin\n",
      "Train epoch:14 iter: 688 end\n",
      "Train epoch:14 iter: 689 begin\n",
      "Train epoch:14 iter: 689 end\n",
      "Train epoch:14 iter: 690 begin\n",
      "Train epoch:14 iter: 690 end\n",
      "Train epoch:14 iter: 691 begin\n",
      "Train epoch:14 iter: 691 end\n",
      "Train epoch:14 iter: 692 begin\n",
      "Train epoch:14 iter: 692 end\n",
      "Train epoch:14 iter: 693 begin\n",
      "Train epoch:14 iter: 693 end\n",
      "Train epoch:14 iter: 694 begin\n",
      "Train epoch:14 iter: 694 end\n",
      "Train epoch:14 iter: 695 begin\n",
      "Train epoch:14 iter: 695 end\n",
      "Train epoch:14 iter: 696 begin\n",
      "Train epoch:14 iter: 696 end\n",
      "Train epoch:14 iter: 697 begin\n",
      "Train epoch:14 iter: 697 end\n",
      "Train epoch:14 iter: 698 begin\n",
      "Train epoch:14 iter: 698 end\n",
      "Train epoch:14 iter: 699 begin\n",
      "Train epoch:14 iter: 699 end\n",
      "Train epoch:14 iter: 700 begin\n",
      "Train epoch:14 iter: 700 end\n",
      "Train epoch:14 iter: 701 begin\n",
      "Train epoch:14 iter: 701 end\n",
      "Train epoch:14 iter: 702 begin\n",
      "Train epoch:14 iter: 702 end\n",
      "Train epoch:14 iter: 703 begin\n",
      "Train epoch:14 iter: 703 end\n",
      "Train epoch:14 iter: 704 begin\n",
      "Train epoch:14 iter: 704 end\n",
      "Train epoch:14 iter: 705 begin\n",
      "Train epoch:14 iter: 705 end\n",
      "Train epoch:14 iter: 706 begin\n",
      "Train epoch:14 iter: 706 end\n",
      "Train epoch:14 iter: 707 begin\n",
      "Train epoch:14 iter: 707 end\n",
      "Train epoch:14 iter: 708 begin\n",
      "Train epoch:14 iter: 708 end\n",
      "Train epoch:14 iter: 709 begin\n",
      "Train epoch:14 iter: 709 end\n",
      "Train epoch:14 iter: 710 begin\n",
      "Train epoch:14 iter: 710 end\n",
      "Train epoch:14 iter: 711 begin\n",
      "Train epoch:14 iter: 711 end\n",
      "Train epoch:14 iter: 712 begin\n",
      "Train epoch:14 iter: 712 end\n",
      "Train epoch:14 iter: 713 begin\n",
      "Train epoch:14 iter: 713 end\n",
      "Train epoch:14 iter: 714 begin\n",
      "Train epoch:14 iter: 714 end\n",
      "Train epoch:14 iter: 715 begin\n",
      "Train epoch:14 iter: 715 end\n",
      "Train epoch:14 iter: 716 begin\n",
      "Train epoch:14 iter: 716 end\n",
      "Train epoch:14 iter: 717 begin\n",
      "Train epoch:14 iter: 717 end\n",
      "Train epoch:14 iter: 718 begin\n",
      "Train epoch:14 iter: 718 end\n",
      "Train epoch:14 iter: 719 begin\n",
      "Train epoch:14 iter: 719 end\n",
      "Train epoch:14 iter: 720 begin\n",
      "Train epoch:14 iter: 720 end\n",
      "Train epoch:14 iter: 721 begin\n",
      "Train epoch:14 iter: 721 end\n",
      "Train epoch:14 iter: 722 begin\n",
      "Train epoch:14 iter: 722 end\n",
      "Train epoch:14 iter: 723 begin\n",
      "Train epoch:14 iter: 723 end\n",
      "Train epoch:14 iter: 724 begin\n",
      "Train epoch:14 iter: 724 end\n",
      "Train epoch:14 iter: 725 begin\n",
      "Train epoch:14 iter: 725 end\n",
      "Train epoch:14 iter: 726 begin\n",
      "Train epoch:14 iter: 726 end\n",
      "Train epoch:14 iter: 727 begin\n",
      "Train epoch:14 iter: 727 end\n",
      "Train epoch:14 iter: 728 begin\n",
      "Train epoch:14 iter: 728 end\n",
      "Train epoch:14 iter: 729 begin\n",
      "Train epoch:14 iter: 729 end\n",
      "Train epoch:14 iter: 730 begin\n",
      "Train epoch:14 iter: 730 end\n",
      "Train epoch:14 iter: 731 begin\n",
      "Train epoch:14 iter: 731 end\n",
      "Train epoch:14 iter: 732 begin\n",
      "Train epoch:14 iter: 732 end\n",
      "Train epoch:14 iter: 733 begin\n",
      "Train epoch:14 iter: 733 end\n",
      "Train epoch:14 iter: 734 begin\n",
      "Train epoch:14 iter: 734 end\n",
      "Train epoch:14 iter: 735 begin\n",
      "Train epoch:14 iter: 735 end\n",
      "Train epoch:14 iter: 736 begin\n",
      "Train epoch:14 iter: 736 end\n",
      "Train epoch:14 iter: 737 begin\n",
      "Train epoch:14 iter: 737 end\n",
      "Train epoch:14 iter: 738 begin\n",
      "Train epoch:14 iter: 738 end\n",
      "Train epoch:14 iter: 739 begin\n",
      "Train epoch:14 iter: 739 end\n",
      "Train epoch:14 iter: 740 begin\n",
      "Train epoch:14 iter: 740 end\n",
      "Train epoch:14 iter: 741 begin\n",
      "Train epoch:14 iter: 741 end\n",
      "Train epoch:14 iter: 742 begin\n",
      "Train epoch:14 iter: 742 end\n",
      "Train epoch:14 iter: 743 begin\n",
      "Train epoch:14 iter: 743 end\n",
      "Train epoch:14 iter: 744 begin\n",
      "Train epoch:14 iter: 744 end\n",
      "Train epoch:14 iter: 745 begin\n",
      "Train epoch:14 iter: 745 end\n",
      "Train epoch:14 iter: 746 begin\n",
      "Train epoch:14 iter: 746 end\n",
      "Train epoch:14 iter: 747 begin\n",
      "Train epoch:14 iter: 747 end\n",
      "Train epoch:14 iter: 748 begin\n",
      "Train epoch:14 iter: 748 end\n",
      "Train epoch:14 iter: 749 begin\n",
      "Train epoch:14 iter: 749 end\n",
      "Train epoch:14 iter: 750 begin\n",
      "Train epoch:14 iter: 750 end\n",
      "Train epoch:14 iter: 751 begin\n",
      "Train epoch:14 iter: 751 end\n",
      "Train epoch:14 iter: 752 begin\n",
      "Train epoch:14 iter: 752 end\n",
      "Train epoch:14 iter: 753 begin\n",
      "Train epoch:14 iter: 753 end\n",
      "Train epoch:14 iter: 754 begin\n",
      "Train epoch:14 iter: 754 end\n",
      "Train epoch:14 iter: 755 begin\n",
      "Train epoch:14 iter: 755 end\n",
      "Train epoch:14 iter: 756 begin\n",
      "Train epoch:14 iter: 756 end\n",
      "Train epoch:14 iter: 757 begin\n",
      "Train epoch:14 iter: 757 end\n",
      "Train epoch:14 iter: 758 begin\n",
      "Train epoch:14 iter: 758 end\n",
      "Train epoch:14 iter: 759 begin\n",
      "Train epoch:14 iter: 759 end\n",
      "Train epoch:14 iter: 760 begin\n",
      "Train epoch:14 iter: 760 end\n",
      "Train epoch:14 iter: 761 begin\n",
      "Train epoch:14 iter: 761 end\n",
      "Train epoch:14 iter: 762 begin\n",
      "Train epoch:14 iter: 762 end\n",
      "Train epoch:14 iter: 763 begin\n",
      "Train epoch:14 iter: 763 end\n",
      "Train epoch:14 iter: 764 begin\n",
      "Train epoch:14 iter: 764 end\n",
      "Train epoch:14 iter: 765 begin\n",
      "Train epoch:14 iter: 765 end\n",
      "Train epoch:14 iter: 766 begin\n",
      "Train epoch:14 iter: 766 end\n",
      "Train epoch:14 iter: 767 begin\n",
      "Train epoch:14 iter: 767 end\n",
      "Train epoch:14 iter: 768 begin\n",
      "Train epoch:14 iter: 768 end\n",
      "Train epoch:14 iter: 769 begin\n",
      "Train epoch:14 iter: 769 end\n",
      "Train epoch:14 iter: 770 begin\n",
      "Train epoch:14 iter: 770 end\n",
      "Train epoch:14 iter: 771 begin\n",
      "Train epoch:14 iter: 771 end\n",
      "Train epoch:14 iter: 772 begin\n",
      "Train epoch:14 iter: 772 end\n",
      "Train epoch:14 iter: 773 begin\n",
      "Train epoch:14 iter: 773 end\n",
      "Train epoch:14 iter: 774 begin\n",
      "Train epoch:14 iter: 774 end\n",
      "Train epoch:14 iter: 775 begin\n",
      "Train epoch:14 iter: 775 end\n",
      "Train epoch:14 iter: 776 begin\n",
      "Train epoch:14 iter: 776 end\n",
      "Train epoch:14 iter: 777 begin\n",
      "Train epoch:14 iter: 777 end\n",
      "Train epoch:14 iter: 778 begin\n",
      "Train epoch:14 iter: 778 end\n",
      "Train epoch:14 iter: 779 begin\n",
      "Train epoch:14 iter: 779 end\n",
      "Train epoch:14 iter: 780 begin\n",
      "Train epoch:14 iter: 780 end\n",
      "Train epoch:14 iter: 781 begin\n",
      "Train epoch:14 iter: 781 end\n",
      "Train epoch:14 iter: 782 begin\n",
      "Train epoch:14 iter: 782 end\n",
      "Train epoch:14 iter: 783 begin\n",
      "Train epoch:14 iter: 783 end\n",
      "Train epoch:14 iter: 784 begin\n",
      "Train epoch:14 iter: 784 end\n",
      "Train epoch:14 iter: 785 begin\n",
      "Train epoch:14 iter: 785 end\n",
      "Train epoch:14 iter: 786 begin\n",
      "Train epoch:14 iter: 786 end\n",
      "Train epoch:14 iter: 787 begin\n",
      "Train epoch:14 iter: 787 end\n",
      "Train epoch:14 iter: 788 begin\n",
      "Train epoch:14 iter: 788 end\n",
      "Train epoch:14 iter: 789 begin\n",
      "Train epoch:14 iter: 789 end\n",
      "Train epoch:14 iter: 790 begin\n",
      "Train epoch:14 iter: 790 end\n",
      "Train epoch:14 iter: 791 begin\n",
      "Train epoch:14 iter: 791 end\n",
      "Train epoch:14 iter: 792 begin\n",
      "Train epoch:14 iter: 792 end\n",
      "Train epoch:14 iter: 793 begin\n",
      "Train epoch:14 iter: 793 end\n",
      "Train epoch:14 iter: 794 begin\n",
      "Train epoch:14 iter: 794 end\n",
      "Train epoch:14 iter: 795 begin\n",
      "Train epoch:14 iter: 795 end\n",
      "Train epoch:14 iter: 796 begin\n",
      "Train epoch:14 iter: 796 end\n",
      "Train epoch:14 iter: 797 begin\n",
      "Train epoch:14 iter: 797 end\n",
      "Train epoch:14 iter: 798 begin\n",
      "Train epoch:14 iter: 798 end\n",
      "Train epoch:14 iter: 799 begin\n",
      "Train epoch:14 iter: 799 end\n",
      "Train epoch:14 iter: 800 begin\n",
      "Train epoch:14 iter: 800 end\n",
      "Train epoch:14 iter: 801 begin\n",
      "Train epoch:14 iter: 801 end\n",
      "Train epoch:14 iter: 802 begin\n",
      "Train epoch:14 iter: 802 end\n",
      "Train epoch:14 iter: 803 begin\n",
      "Train epoch:14 iter: 803 end\n",
      "Train epoch:14 iter: 804 begin\n",
      "Train epoch:14 iter: 804 end\n",
      "Train epoch:14 iter: 805 begin\n",
      "Train epoch:14 iter: 805 end\n",
      "Train epoch:14 iter: 806 begin\n",
      "Train epoch:14 iter: 806 end\n",
      "Train epoch:14 iter: 807 begin\n",
      "Train epoch:14 iter: 807 end\n",
      "Train epoch:14 iter: 808 begin\n",
      "Train epoch:14 iter: 808 end\n",
      "Train epoch:14 iter: 809 begin\n",
      "Train epoch:14 iter: 809 end\n",
      "Train epoch:14 iter: 810 begin\n",
      "Train epoch:14 iter: 810 end\n",
      "Train epoch:14 iter: 811 begin\n",
      "Train epoch:14 iter: 811 end\n",
      "Train epoch:14 iter: 812 begin\n",
      "Train epoch:14 iter: 812 end\n",
      "Train epoch:14 iter: 813 begin\n",
      "Train epoch:14 iter: 813 end\n",
      "Train epoch:14 iter: 814 begin\n",
      "Train epoch:14 iter: 814 end\n",
      "Train epoch:14 iter: 815 begin\n",
      "Train epoch:14 iter: 815 end\n",
      "Train epoch:14 iter: 816 begin\n",
      "Train epoch:14 iter: 816 end\n",
      "Train epoch:14 iter: 817 begin\n",
      "Train epoch:14 iter: 817 end\n",
      "Train epoch:14 iter: 818 begin\n",
      "Train epoch:14 iter: 818 end\n",
      "Train epoch:14 iter: 819 begin\n",
      "Train epoch:14 iter: 819 end\n",
      "Train epoch:14 iter: 820 begin\n",
      "Train epoch:14 iter: 820 end\n",
      "Train epoch:14 iter: 821 begin\n",
      "Train epoch:14 iter: 821 end\n",
      "Train epoch:14 iter: 822 begin\n",
      "Train epoch:14 iter: 822 end\n",
      "Train epoch:14 iter: 823 begin\n",
      "Train epoch:14 iter: 823 end\n",
      "Train epoch:14 iter: 824 begin\n",
      "Train epoch:14 iter: 824 end\n",
      "Train epoch:14 iter: 825 begin\n",
      "Train epoch:14 iter: 825 end\n",
      "Train epoch:14 iter: 826 begin\n",
      "Train epoch:14 iter: 826 end\n",
      "Train epoch:14 iter: 827 begin\n",
      "Train epoch:14 iter: 827 end\n",
      "Train epoch:14 iter: 828 begin\n",
      "Train epoch:14 iter: 828 end\n",
      "Train epoch:14 iter: 829 begin\n",
      "Train epoch:14 iter: 829 end\n",
      "Train epoch:14 iter: 830 begin\n",
      "Train epoch:14 iter: 830 end\n",
      "Train epoch:14 iter: 831 begin\n",
      "Train epoch:14 iter: 831 end\n",
      "Train epoch:14 iter: 832 begin\n",
      "Train epoch:14 iter: 832 end\n",
      "Train epoch:14 iter: 833 begin\n",
      "Train epoch:14 iter: 833 end\n",
      "Train epoch:14 iter: 834 begin\n",
      "Train epoch:14 iter: 834 end\n",
      "Train epoch:14 iter: 835 begin\n",
      "Train epoch:14 iter: 835 end\n",
      "Train epoch:14 iter: 836 begin\n",
      "Train epoch:14 iter: 836 end\n",
      "Train epoch:14 iter: 837 begin\n",
      "Train epoch:14 iter: 837 end\n",
      "Train epoch:14 iter: 838 begin\n",
      "Train epoch:14 iter: 838 end\n",
      "Train epoch:14 iter: 839 begin\n",
      "Train epoch:14 iter: 839 end\n",
      "Train epoch:14 iter: 840 begin\n",
      "Train epoch:14 iter: 840 end\n",
      "Train epoch:14 iter: 841 begin\n",
      "Train epoch:14 iter: 841 end\n",
      "Train epoch:14 iter: 842 begin\n",
      "Train epoch:14 iter: 842 end\n",
      "Train epoch:14 iter: 843 begin\n",
      "Train epoch:14 iter: 843 end\n",
      "Train epoch:14 iter: 844 begin\n",
      "Train epoch:14 iter: 844 end\n",
      "Train epoch:14 iter: 845 begin\n",
      "Train epoch:14 iter: 845 end\n",
      "Train epoch:14 iter: 846 begin\n",
      "Train epoch:14 iter: 846 end\n",
      "Train epoch:14 iter: 847 begin\n",
      "Train epoch:14 iter: 847 end\n",
      "Train epoch:14 iter: 848 begin\n",
      "Train epoch:14 iter: 848 end\n",
      "Train epoch:14 iter: 849 begin\n",
      "Train epoch:14 iter: 849 end\n",
      "Train epoch:14 iter: 850 begin\n",
      "Train epoch:14 iter: 850 end\n",
      "Train epoch:14 iter: 851 begin\n",
      "Train epoch:14 iter: 851 end\n",
      "Train epoch:14 iter: 852 begin\n",
      "Train epoch:14 iter: 852 end\n",
      "Train epoch:14 iter: 853 begin\n",
      "Train epoch:14 iter: 853 end\n",
      "Train epoch:14 iter: 854 begin\n",
      "Train epoch:14 iter: 854 end\n",
      "Train epoch:14 iter: 855 begin\n",
      "Train epoch:14 iter: 855 end\n",
      "Train epoch:14 iter: 856 begin\n",
      "Train epoch:14 iter: 856 end\n",
      "Train epoch:14 iter: 857 begin\n",
      "Train epoch:14 iter: 857 end\n",
      "Train epoch:14 iter: 858 begin\n",
      "Train epoch:14 iter: 858 end\n",
      "Train epoch:14 iter: 859 begin\n",
      "Train epoch:14 iter: 859 end\n",
      "Train epoch:14 iter: 860 begin\n",
      "Train epoch:14 iter: 860 end\n",
      "Train epoch:14 iter: 861 begin\n",
      "Train epoch:14 iter: 861 end\n",
      "Train epoch:14 iter: 862 begin\n",
      "Train epoch:14 iter: 862 end\n",
      "Train epoch:14 iter: 863 begin\n",
      "Train epoch:14 iter: 863 end\n",
      "Train epoch:14 iter: 864 begin\n",
      "Train epoch:14 iter: 864 end\n",
      "Train epoch:14 iter: 865 begin\n",
      "Train epoch:14 iter: 865 end\n",
      "Train epoch:14 iter: 866 begin\n",
      "Train epoch:14 iter: 866 end\n",
      "Train epoch:14 iter: 867 begin\n",
      "Train epoch:14 iter: 867 end\n",
      "Train epoch:14 iter: 868 begin\n",
      "Train epoch:14 iter: 868 end\n",
      "Train epoch:14 iter: 869 begin\n",
      "Train epoch:14 iter: 869 end\n",
      "Train epoch:14 iter: 870 begin\n",
      "Train epoch:14 iter: 870 end\n",
      "Train epoch:14 iter: 871 begin\n",
      "Train epoch:14 iter: 871 end\n",
      "Train epoch:14 iter: 872 begin\n",
      "Train epoch:14 iter: 872 end\n",
      "Train epoch:14 iter: 873 begin\n",
      "Train epoch:14 iter: 873 end\n",
      "Train epoch:14 iter: 874 begin\n",
      "Train epoch:14 iter: 874 end\n",
      "Train epoch:14 iter: 875 begin\n",
      "Train epoch:14 iter: 875 end\n",
      "Train epoch:14 iter: 876 begin\n",
      "Train epoch:14 iter: 876 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:14 iter: 877 begin\n",
      "Train epoch:14 iter: 877 end\n",
      "Train epoch:14 iter: 878 begin\n",
      "Train epoch:14 iter: 878 end\n",
      "Train epoch:14 iter: 879 begin\n",
      "Train epoch:14 iter: 879 end\n",
      "Train epoch:14 iter: 880 begin\n",
      "Train epoch:14 iter: 880 end\n",
      "Train epoch:14 iter: 881 begin\n",
      "Train epoch:14 iter: 881 end\n",
      "Train epoch:14 iter: 882 begin\n",
      "Train epoch:14 iter: 882 end\n",
      "Train epoch:14 iter: 883 begin\n",
      "Train epoch:14 iter: 883 end\n",
      "Train epoch:14 iter: 884 begin\n",
      "Train epoch:14 iter: 884 end\n",
      "Train epoch:14 iter: 885 begin\n",
      "Train epoch:14 iter: 885 end\n",
      "Train epoch:14 iter: 886 begin\n",
      "Train epoch:14 iter: 886 end\n",
      "Train epoch:14 iter: 887 begin\n",
      "Train epoch:14 iter: 887 end\n",
      "Train epoch:14 iter: 888 begin\n",
      "Train epoch:14 iter: 888 end\n",
      "Train epoch:14 iter: 889 begin\n",
      "Train epoch:14 iter: 889 end\n",
      "Train epoch:14 iter: 890 begin\n",
      "Train epoch:14 iter: 890 end\n",
      "Train epoch:14 iter: 891 begin\n",
      "Train epoch:14 iter: 891 end\n",
      "Train epoch:14 iter: 892 begin\n",
      "Train epoch:14 iter: 892 end\n",
      "Train epoch:14 iter: 893 begin\n",
      "Train epoch:14 iter: 893 end\n",
      "Train epoch:14 iter: 894 begin\n",
      "Train epoch:14 iter: 894 end\n",
      "Train epoch:14 iter: 895 begin\n",
      "Train epoch:14 iter: 895 end\n",
      "Train epoch:14 iter: 896 begin\n",
      "Train epoch:14 iter: 896 end\n",
      "Train epoch:14 iter: 897 begin\n",
      "Train epoch:14 iter: 897 end\n",
      "Train epoch:14 iter: 898 begin\n",
      "Train epoch:14 iter: 898 end\n",
      "Train epoch:14 iter: 899 begin\n",
      "Train epoch:14 iter: 899 end\n",
      "Train epoch:14 iter: 900 begin\n",
      "Train epoch:14 iter: 900 end\n",
      "Train epoch:14 iter: 901 begin\n",
      "Train epoch:14 iter: 901 end\n",
      "Train epoch:14 iter: 902 begin\n",
      "Train epoch:14 iter: 902 end\n",
      "Train epoch:14 iter: 903 begin\n",
      "Train epoch:14 iter: 903 end\n",
      "Train epoch:14 iter: 904 begin\n",
      "Train epoch:14 iter: 904 end\n",
      "Train epoch:14 iter: 905 begin\n",
      "Train epoch:14 iter: 905 end\n",
      "Train epoch:14 iter: 906 begin\n",
      "Train epoch:14 iter: 906 end\n",
      "Train epoch:14 iter: 907 begin\n",
      "Train epoch:14 iter: 907 end\n",
      "Train epoch:14 iter: 908 begin\n",
      "Train epoch:14 iter: 908 end\n",
      "Train epoch:14 iter: 909 begin\n",
      "Train epoch:14 iter: 909 end\n",
      "Train epoch:14 iter: 910 begin\n",
      "Train epoch:14 iter: 910 end\n",
      "Train epoch:14 iter: 911 begin\n",
      "Train epoch:14 iter: 911 end\n",
      "Train epoch:14 iter: 912 begin\n",
      "Train epoch:14 iter: 912 end\n",
      "Train epoch:14 iter: 913 begin\n",
      "Train epoch:14 iter: 913 end\n",
      "Train epoch:14 iter: 914 begin\n",
      "Train epoch:14 iter: 914 end\n",
      "Train epoch:14 iter: 915 begin\n",
      "Train epoch:14 iter: 915 end\n",
      "Train epoch:14 iter: 916 begin\n",
      "Train epoch:14 iter: 916 end\n",
      "Train epoch:14 iter: 917 begin\n",
      "Train epoch:14 iter: 917 end\n",
      "Train epoch:14 iter: 918 begin\n",
      "Train epoch:14 iter: 918 end\n",
      "Train epoch:14 iter: 919 begin\n",
      "Train epoch:14 iter: 919 end\n",
      "Train epoch:14 iter: 920 begin\n",
      "Train epoch:14 iter: 920 end\n",
      "Train epoch:14 iter: 921 begin\n",
      "Train epoch:14 iter: 921 end\n",
      "Train epoch:14 iter: 922 begin\n",
      "Train epoch:14 iter: 922 end\n",
      "Train epoch:14 iter: 923 begin\n",
      "Train epoch:14 iter: 923 end\n",
      "Train epoch:14 iter: 924 begin\n",
      "Train epoch:14 iter: 924 end\n",
      "Train epoch:14 iter: 925 begin\n",
      "Train epoch:14 iter: 925 end\n",
      "Train epoch:14 iter: 926 begin\n",
      "Train epoch:14 iter: 926 end\n",
      "Train epoch:14 iter: 927 begin\n",
      "Train epoch:14 iter: 927 end\n",
      "Train epoch:14 iter: 928 begin\n",
      "Train epoch:14 iter: 928 end\n",
      "Train epoch:14 iter: 929 begin\n",
      "Train epoch:14 iter: 929 end\n",
      "Train epoch:14 iter: 930 begin\n",
      "Train epoch:14 iter: 930 end\n",
      "Train epoch:14 iter: 931 begin\n",
      "Train epoch:14 iter: 931 end\n",
      "Train epoch:14 iter: 932 begin\n",
      "Train epoch:14 iter: 932 end\n",
      "Train epoch:14 iter: 933 begin\n",
      "Train epoch:14 iter: 933 end\n",
      "Train epoch:14 iter: 934 begin\n",
      "Train epoch:14 iter: 934 end\n",
      "Train epoch:14 iter: 935 begin\n",
      "Train epoch:14 iter: 935 end\n",
      "Train epoch:14 iter: 936 begin\n",
      "Train epoch:14 iter: 936 end\n",
      "Train epoch:14 iter: 937 begin\n",
      "Train epoch:14 iter: 937 end\n",
      "Train epoch:14 iter: 938 begin\n",
      "Train epoch:14 iter: 938 end\n",
      "Train Loss: 0.001259, Acc: 0.968767\n",
      "save model for best accuate: 0.9687666666666667 begin\n",
      "save model for best accuate: 0.9687666666666667 end\n",
      "epoch 16\n",
      "Train epoch:15 iter: 1 begin\n",
      "Train epoch:15 iter: 1 end\n",
      "Train epoch:15 iter: 2 begin\n",
      "Train epoch:15 iter: 2 end\n",
      "Train epoch:15 iter: 3 begin\n",
      "Train epoch:15 iter: 3 end\n",
      "Train epoch:15 iter: 4 begin\n",
      "Train epoch:15 iter: 4 end\n",
      "Train epoch:15 iter: 5 begin\n",
      "Train epoch:15 iter: 5 end\n",
      "Train epoch:15 iter: 6 begin\n",
      "Train epoch:15 iter: 6 end\n",
      "Train epoch:15 iter: 7 begin\n",
      "Train epoch:15 iter: 7 end\n",
      "Train epoch:15 iter: 8 begin\n",
      "Train epoch:15 iter: 8 end\n",
      "Train epoch:15 iter: 9 begin\n",
      "Train epoch:15 iter: 9 end\n",
      "Train epoch:15 iter: 10 begin\n",
      "Train epoch:15 iter: 10 end\n",
      "Train epoch:15 iter: 11 begin\n",
      "Train epoch:15 iter: 11 end\n",
      "Train epoch:15 iter: 12 begin\n",
      "Train epoch:15 iter: 12 end\n",
      "Train epoch:15 iter: 13 begin\n",
      "Train epoch:15 iter: 13 end\n",
      "Train epoch:15 iter: 14 begin\n",
      "Train epoch:15 iter: 14 end\n",
      "Train epoch:15 iter: 15 begin\n",
      "Train epoch:15 iter: 15 end\n",
      "Train epoch:15 iter: 16 begin\n",
      "Train epoch:15 iter: 16 end\n",
      "Train epoch:15 iter: 17 begin\n",
      "Train epoch:15 iter: 17 end\n",
      "Train epoch:15 iter: 18 begin\n",
      "Train epoch:15 iter: 18 end\n",
      "Train epoch:15 iter: 19 begin\n",
      "Train epoch:15 iter: 19 end\n",
      "Train epoch:15 iter: 20 begin\n",
      "Train epoch:15 iter: 20 end\n",
      "Train epoch:15 iter: 21 begin\n",
      "Train epoch:15 iter: 21 end\n",
      "Train epoch:15 iter: 22 begin\n",
      "Train epoch:15 iter: 22 end\n",
      "Train epoch:15 iter: 23 begin\n",
      "Train epoch:15 iter: 23 end\n",
      "Train epoch:15 iter: 24 begin\n",
      "Train epoch:15 iter: 24 end\n",
      "Train epoch:15 iter: 25 begin\n",
      "Train epoch:15 iter: 25 end\n",
      "Train epoch:15 iter: 26 begin\n",
      "Train epoch:15 iter: 26 end\n",
      "Train epoch:15 iter: 27 begin\n",
      "Train epoch:15 iter: 27 end\n",
      "Train epoch:15 iter: 28 begin\n",
      "Train epoch:15 iter: 28 end\n",
      "Train epoch:15 iter: 29 begin\n",
      "Train epoch:15 iter: 29 end\n",
      "Train epoch:15 iter: 30 begin\n",
      "Train epoch:15 iter: 30 end\n",
      "Train epoch:15 iter: 31 begin\n",
      "Train epoch:15 iter: 31 end\n",
      "Train epoch:15 iter: 32 begin\n",
      "Train epoch:15 iter: 32 end\n",
      "Train epoch:15 iter: 33 begin\n",
      "Train epoch:15 iter: 33 end\n",
      "Train epoch:15 iter: 34 begin\n",
      "Train epoch:15 iter: 34 end\n",
      "Train epoch:15 iter: 35 begin\n",
      "Train epoch:15 iter: 35 end\n",
      "Train epoch:15 iter: 36 begin\n",
      "Train epoch:15 iter: 36 end\n",
      "Train epoch:15 iter: 37 begin\n",
      "Train epoch:15 iter: 37 end\n",
      "Train epoch:15 iter: 38 begin\n",
      "Train epoch:15 iter: 38 end\n",
      "Train epoch:15 iter: 39 begin\n",
      "Train epoch:15 iter: 39 end\n",
      "Train epoch:15 iter: 40 begin\n",
      "Train epoch:15 iter: 40 end\n",
      "Train epoch:15 iter: 41 begin\n",
      "Train epoch:15 iter: 41 end\n",
      "Train epoch:15 iter: 42 begin\n",
      "Train epoch:15 iter: 42 end\n",
      "Train epoch:15 iter: 43 begin\n",
      "Train epoch:15 iter: 43 end\n",
      "Train epoch:15 iter: 44 begin\n",
      "Train epoch:15 iter: 44 end\n",
      "Train epoch:15 iter: 45 begin\n",
      "Train epoch:15 iter: 45 end\n",
      "Train epoch:15 iter: 46 begin\n",
      "Train epoch:15 iter: 46 end\n",
      "Train epoch:15 iter: 47 begin\n",
      "Train epoch:15 iter: 47 end\n",
      "Train epoch:15 iter: 48 begin\n",
      "Train epoch:15 iter: 48 end\n",
      "Train epoch:15 iter: 49 begin\n",
      "Train epoch:15 iter: 49 end\n",
      "Train epoch:15 iter: 50 begin\n",
      "Train epoch:15 iter: 50 end\n",
      "Train epoch:15 iter: 51 begin\n",
      "Train epoch:15 iter: 51 end\n",
      "Train epoch:15 iter: 52 begin\n",
      "Train epoch:15 iter: 52 end\n",
      "Train epoch:15 iter: 53 begin\n",
      "Train epoch:15 iter: 53 end\n",
      "Train epoch:15 iter: 54 begin\n",
      "Train epoch:15 iter: 54 end\n",
      "Train epoch:15 iter: 55 begin\n",
      "Train epoch:15 iter: 55 end\n",
      "Train epoch:15 iter: 56 begin\n",
      "Train epoch:15 iter: 56 end\n",
      "Train epoch:15 iter: 57 begin\n",
      "Train epoch:15 iter: 57 end\n",
      "Train epoch:15 iter: 58 begin\n",
      "Train epoch:15 iter: 58 end\n",
      "Train epoch:15 iter: 59 begin\n",
      "Train epoch:15 iter: 59 end\n",
      "Train epoch:15 iter: 60 begin\n",
      "Train epoch:15 iter: 60 end\n",
      "Train epoch:15 iter: 61 begin\n",
      "Train epoch:15 iter: 61 end\n",
      "Train epoch:15 iter: 62 begin\n",
      "Train epoch:15 iter: 62 end\n",
      "Train epoch:15 iter: 63 begin\n",
      "Train epoch:15 iter: 63 end\n",
      "Train epoch:15 iter: 64 begin\n",
      "Train epoch:15 iter: 64 end\n",
      "Train epoch:15 iter: 65 begin\n",
      "Train epoch:15 iter: 65 end\n",
      "Train epoch:15 iter: 66 begin\n",
      "Train epoch:15 iter: 66 end\n",
      "Train epoch:15 iter: 67 begin\n",
      "Train epoch:15 iter: 67 end\n",
      "Train epoch:15 iter: 68 begin\n",
      "Train epoch:15 iter: 68 end\n",
      "Train epoch:15 iter: 69 begin\n",
      "Train epoch:15 iter: 69 end\n",
      "Train epoch:15 iter: 70 begin\n",
      "Train epoch:15 iter: 70 end\n",
      "Train epoch:15 iter: 71 begin\n",
      "Train epoch:15 iter: 71 end\n",
      "Train epoch:15 iter: 72 begin\n",
      "Train epoch:15 iter: 72 end\n",
      "Train epoch:15 iter: 73 begin\n",
      "Train epoch:15 iter: 73 end\n",
      "Train epoch:15 iter: 74 begin\n",
      "Train epoch:15 iter: 74 end\n",
      "Train epoch:15 iter: 75 begin\n",
      "Train epoch:15 iter: 75 end\n",
      "Train epoch:15 iter: 76 begin\n",
      "Train epoch:15 iter: 76 end\n",
      "Train epoch:15 iter: 77 begin\n",
      "Train epoch:15 iter: 77 end\n",
      "Train epoch:15 iter: 78 begin\n",
      "Train epoch:15 iter: 78 end\n",
      "Train epoch:15 iter: 79 begin\n",
      "Train epoch:15 iter: 79 end\n",
      "Train epoch:15 iter: 80 begin\n",
      "Train epoch:15 iter: 80 end\n",
      "Train epoch:15 iter: 81 begin\n",
      "Train epoch:15 iter: 81 end\n",
      "Train epoch:15 iter: 82 begin\n",
      "Train epoch:15 iter: 82 end\n",
      "Train epoch:15 iter: 83 begin\n",
      "Train epoch:15 iter: 83 end\n",
      "Train epoch:15 iter: 84 begin\n",
      "Train epoch:15 iter: 84 end\n",
      "Train epoch:15 iter: 85 begin\n",
      "Train epoch:15 iter: 85 end\n",
      "Train epoch:15 iter: 86 begin\n",
      "Train epoch:15 iter: 86 end\n",
      "Train epoch:15 iter: 87 begin\n",
      "Train epoch:15 iter: 87 end\n",
      "Train epoch:15 iter: 88 begin\n",
      "Train epoch:15 iter: 88 end\n",
      "Train epoch:15 iter: 89 begin\n",
      "Train epoch:15 iter: 89 end\n",
      "Train epoch:15 iter: 90 begin\n",
      "Train epoch:15 iter: 90 end\n",
      "Train epoch:15 iter: 91 begin\n",
      "Train epoch:15 iter: 91 end\n",
      "Train epoch:15 iter: 92 begin\n",
      "Train epoch:15 iter: 92 end\n",
      "Train epoch:15 iter: 93 begin\n",
      "Train epoch:15 iter: 93 end\n",
      "Train epoch:15 iter: 94 begin\n",
      "Train epoch:15 iter: 94 end\n",
      "Train epoch:15 iter: 95 begin\n",
      "Train epoch:15 iter: 95 end\n",
      "Train epoch:15 iter: 96 begin\n",
      "Train epoch:15 iter: 96 end\n",
      "Train epoch:15 iter: 97 begin\n",
      "Train epoch:15 iter: 97 end\n",
      "Train epoch:15 iter: 98 begin\n",
      "Train epoch:15 iter: 98 end\n",
      "Train epoch:15 iter: 99 begin\n",
      "Train epoch:15 iter: 99 end\n",
      "Train epoch:15 iter: 100 begin\n",
      "Train epoch:15 iter: 100 end\n",
      "Train epoch:15 iter: 101 begin\n",
      "Train epoch:15 iter: 101 end\n",
      "Train epoch:15 iter: 102 begin\n",
      "Train epoch:15 iter: 102 end\n",
      "Train epoch:15 iter: 103 begin\n",
      "Train epoch:15 iter: 103 end\n",
      "Train epoch:15 iter: 104 begin\n",
      "Train epoch:15 iter: 104 end\n",
      "Train epoch:15 iter: 105 begin\n",
      "Train epoch:15 iter: 105 end\n",
      "Train epoch:15 iter: 106 begin\n",
      "Train epoch:15 iter: 106 end\n",
      "Train epoch:15 iter: 107 begin\n",
      "Train epoch:15 iter: 107 end\n",
      "Train epoch:15 iter: 108 begin\n",
      "Train epoch:15 iter: 108 end\n",
      "Train epoch:15 iter: 109 begin\n",
      "Train epoch:15 iter: 109 end\n",
      "Train epoch:15 iter: 110 begin\n",
      "Train epoch:15 iter: 110 end\n",
      "Train epoch:15 iter: 111 begin\n",
      "Train epoch:15 iter: 111 end\n",
      "Train epoch:15 iter: 112 begin\n",
      "Train epoch:15 iter: 112 end\n",
      "Train epoch:15 iter: 113 begin\n",
      "Train epoch:15 iter: 113 end\n",
      "Train epoch:15 iter: 114 begin\n",
      "Train epoch:15 iter: 114 end\n",
      "Train epoch:15 iter: 115 begin\n",
      "Train epoch:15 iter: 115 end\n",
      "Train epoch:15 iter: 116 begin\n",
      "Train epoch:15 iter: 116 end\n",
      "Train epoch:15 iter: 117 begin\n",
      "Train epoch:15 iter: 117 end\n",
      "Train epoch:15 iter: 118 begin\n",
      "Train epoch:15 iter: 118 end\n",
      "Train epoch:15 iter: 119 begin\n",
      "Train epoch:15 iter: 119 end\n",
      "Train epoch:15 iter: 120 begin\n",
      "Train epoch:15 iter: 120 end\n",
      "Train epoch:15 iter: 121 begin\n",
      "Train epoch:15 iter: 121 end\n",
      "Train epoch:15 iter: 122 begin\n",
      "Train epoch:15 iter: 122 end\n",
      "Train epoch:15 iter: 123 begin\n",
      "Train epoch:15 iter: 123 end\n",
      "Train epoch:15 iter: 124 begin\n",
      "Train epoch:15 iter: 124 end\n",
      "Train epoch:15 iter: 125 begin\n",
      "Train epoch:15 iter: 125 end\n",
      "Train epoch:15 iter: 126 begin\n",
      "Train epoch:15 iter: 126 end\n",
      "Train epoch:15 iter: 127 begin\n",
      "Train epoch:15 iter: 127 end\n",
      "Train epoch:15 iter: 128 begin\n",
      "Train epoch:15 iter: 128 end\n",
      "Train epoch:15 iter: 129 begin\n",
      "Train epoch:15 iter: 129 end\n",
      "Train epoch:15 iter: 130 begin\n",
      "Train epoch:15 iter: 130 end\n",
      "Train epoch:15 iter: 131 begin\n",
      "Train epoch:15 iter: 131 end\n",
      "Train epoch:15 iter: 132 begin\n",
      "Train epoch:15 iter: 132 end\n",
      "Train epoch:15 iter: 133 begin\n",
      "Train epoch:15 iter: 133 end\n",
      "Train epoch:15 iter: 134 begin\n",
      "Train epoch:15 iter: 134 end\n",
      "Train epoch:15 iter: 135 begin\n",
      "Train epoch:15 iter: 135 end\n",
      "Train epoch:15 iter: 136 begin\n",
      "Train epoch:15 iter: 136 end\n",
      "Train epoch:15 iter: 137 begin\n",
      "Train epoch:15 iter: 137 end\n",
      "Train epoch:15 iter: 138 begin\n",
      "Train epoch:15 iter: 138 end\n",
      "Train epoch:15 iter: 139 begin\n",
      "Train epoch:15 iter: 139 end\n",
      "Train epoch:15 iter: 140 begin\n",
      "Train epoch:15 iter: 140 end\n",
      "Train epoch:15 iter: 141 begin\n",
      "Train epoch:15 iter: 141 end\n",
      "Train epoch:15 iter: 142 begin\n",
      "Train epoch:15 iter: 142 end\n",
      "Train epoch:15 iter: 143 begin\n",
      "Train epoch:15 iter: 143 end\n",
      "Train epoch:15 iter: 144 begin\n",
      "Train epoch:15 iter: 144 end\n",
      "Train epoch:15 iter: 145 begin\n",
      "Train epoch:15 iter: 145 end\n",
      "Train epoch:15 iter: 146 begin\n",
      "Train epoch:15 iter: 146 end\n",
      "Train epoch:15 iter: 147 begin\n",
      "Train epoch:15 iter: 147 end\n",
      "Train epoch:15 iter: 148 begin\n",
      "Train epoch:15 iter: 148 end\n",
      "Train epoch:15 iter: 149 begin\n",
      "Train epoch:15 iter: 149 end\n",
      "Train epoch:15 iter: 150 begin\n",
      "Train epoch:15 iter: 150 end\n",
      "Train epoch:15 iter: 151 begin\n",
      "Train epoch:15 iter: 151 end\n",
      "Train epoch:15 iter: 152 begin\n",
      "Train epoch:15 iter: 152 end\n",
      "Train epoch:15 iter: 153 begin\n",
      "Train epoch:15 iter: 153 end\n",
      "Train epoch:15 iter: 154 begin\n",
      "Train epoch:15 iter: 154 end\n",
      "Train epoch:15 iter: 155 begin\n",
      "Train epoch:15 iter: 155 end\n",
      "Train epoch:15 iter: 156 begin\n",
      "Train epoch:15 iter: 156 end\n",
      "Train epoch:15 iter: 157 begin\n",
      "Train epoch:15 iter: 157 end\n",
      "Train epoch:15 iter: 158 begin\n",
      "Train epoch:15 iter: 158 end\n",
      "Train epoch:15 iter: 159 begin\n",
      "Train epoch:15 iter: 159 end\n",
      "Train epoch:15 iter: 160 begin\n",
      "Train epoch:15 iter: 160 end\n",
      "Train epoch:15 iter: 161 begin\n",
      "Train epoch:15 iter: 161 end\n",
      "Train epoch:15 iter: 162 begin\n",
      "Train epoch:15 iter: 162 end\n",
      "Train epoch:15 iter: 163 begin\n",
      "Train epoch:15 iter: 163 end\n",
      "Train epoch:15 iter: 164 begin\n",
      "Train epoch:15 iter: 164 end\n",
      "Train epoch:15 iter: 165 begin\n",
      "Train epoch:15 iter: 165 end\n",
      "Train epoch:15 iter: 166 begin\n",
      "Train epoch:15 iter: 166 end\n",
      "Train epoch:15 iter: 167 begin\n",
      "Train epoch:15 iter: 167 end\n",
      "Train epoch:15 iter: 168 begin\n",
      "Train epoch:15 iter: 168 end\n",
      "Train epoch:15 iter: 169 begin\n",
      "Train epoch:15 iter: 169 end\n",
      "Train epoch:15 iter: 170 begin\n",
      "Train epoch:15 iter: 170 end\n",
      "Train epoch:15 iter: 171 begin\n",
      "Train epoch:15 iter: 171 end\n",
      "Train epoch:15 iter: 172 begin\n",
      "Train epoch:15 iter: 172 end\n",
      "Train epoch:15 iter: 173 begin\n",
      "Train epoch:15 iter: 173 end\n",
      "Train epoch:15 iter: 174 begin\n",
      "Train epoch:15 iter: 174 end\n",
      "Train epoch:15 iter: 175 begin\n",
      "Train epoch:15 iter: 175 end\n",
      "Train epoch:15 iter: 176 begin\n",
      "Train epoch:15 iter: 176 end\n",
      "Train epoch:15 iter: 177 begin\n",
      "Train epoch:15 iter: 177 end\n",
      "Train epoch:15 iter: 178 begin\n",
      "Train epoch:15 iter: 178 end\n",
      "Train epoch:15 iter: 179 begin\n",
      "Train epoch:15 iter: 179 end\n",
      "Train epoch:15 iter: 180 begin\n",
      "Train epoch:15 iter: 180 end\n",
      "Train epoch:15 iter: 181 begin\n",
      "Train epoch:15 iter: 181 end\n",
      "Train epoch:15 iter: 182 begin\n",
      "Train epoch:15 iter: 182 end\n",
      "Train epoch:15 iter: 183 begin\n",
      "Train epoch:15 iter: 183 end\n",
      "Train epoch:15 iter: 184 begin\n",
      "Train epoch:15 iter: 184 end\n",
      "Train epoch:15 iter: 185 begin\n",
      "Train epoch:15 iter: 185 end\n",
      "Train epoch:15 iter: 186 begin\n",
      "Train epoch:15 iter: 186 end\n",
      "Train epoch:15 iter: 187 begin\n",
      "Train epoch:15 iter: 187 end\n",
      "Train epoch:15 iter: 188 begin\n",
      "Train epoch:15 iter: 188 end\n",
      "Train epoch:15 iter: 189 begin\n",
      "Train epoch:15 iter: 189 end\n",
      "Train epoch:15 iter: 190 begin\n",
      "Train epoch:15 iter: 190 end\n",
      "Train epoch:15 iter: 191 begin\n",
      "Train epoch:15 iter: 191 end\n",
      "Train epoch:15 iter: 192 begin\n",
      "Train epoch:15 iter: 192 end\n",
      "Train epoch:15 iter: 193 begin\n",
      "Train epoch:15 iter: 193 end\n",
      "Train epoch:15 iter: 194 begin\n",
      "Train epoch:15 iter: 194 end\n",
      "Train epoch:15 iter: 195 begin\n",
      "Train epoch:15 iter: 195 end\n",
      "Train epoch:15 iter: 196 begin\n",
      "Train epoch:15 iter: 196 end\n",
      "Train epoch:15 iter: 197 begin\n",
      "Train epoch:15 iter: 197 end\n",
      "Train epoch:15 iter: 198 begin\n",
      "Train epoch:15 iter: 198 end\n",
      "Train epoch:15 iter: 199 begin\n",
      "Train epoch:15 iter: 199 end\n",
      "Train epoch:15 iter: 200 begin\n",
      "Train epoch:15 iter: 200 end\n",
      "Train epoch:15 iter: 201 begin\n",
      "Train epoch:15 iter: 201 end\n",
      "Train epoch:15 iter: 202 begin\n",
      "Train epoch:15 iter: 202 end\n",
      "Train epoch:15 iter: 203 begin\n",
      "Train epoch:15 iter: 203 end\n",
      "Train epoch:15 iter: 204 begin\n",
      "Train epoch:15 iter: 204 end\n",
      "Train epoch:15 iter: 205 begin\n",
      "Train epoch:15 iter: 205 end\n",
      "Train epoch:15 iter: 206 begin\n",
      "Train epoch:15 iter: 206 end\n",
      "Train epoch:15 iter: 207 begin\n",
      "Train epoch:15 iter: 207 end\n",
      "Train epoch:15 iter: 208 begin\n",
      "Train epoch:15 iter: 208 end\n",
      "Train epoch:15 iter: 209 begin\n",
      "Train epoch:15 iter: 209 end\n",
      "Train epoch:15 iter: 210 begin\n",
      "Train epoch:15 iter: 210 end\n",
      "Train epoch:15 iter: 211 begin\n",
      "Train epoch:15 iter: 211 end\n",
      "Train epoch:15 iter: 212 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:15 iter: 212 end\n",
      "Train epoch:15 iter: 213 begin\n",
      "Train epoch:15 iter: 213 end\n",
      "Train epoch:15 iter: 214 begin\n",
      "Train epoch:15 iter: 214 end\n",
      "Train epoch:15 iter: 215 begin\n",
      "Train epoch:15 iter: 215 end\n",
      "Train epoch:15 iter: 216 begin\n",
      "Train epoch:15 iter: 216 end\n",
      "Train epoch:15 iter: 217 begin\n",
      "Train epoch:15 iter: 217 end\n",
      "Train epoch:15 iter: 218 begin\n",
      "Train epoch:15 iter: 218 end\n",
      "Train epoch:15 iter: 219 begin\n",
      "Train epoch:15 iter: 219 end\n",
      "Train epoch:15 iter: 220 begin\n",
      "Train epoch:15 iter: 220 end\n",
      "Train epoch:15 iter: 221 begin\n",
      "Train epoch:15 iter: 221 end\n",
      "Train epoch:15 iter: 222 begin\n",
      "Train epoch:15 iter: 222 end\n",
      "Train epoch:15 iter: 223 begin\n",
      "Train epoch:15 iter: 223 end\n",
      "Train epoch:15 iter: 224 begin\n",
      "Train epoch:15 iter: 224 end\n",
      "Train epoch:15 iter: 225 begin\n",
      "Train epoch:15 iter: 225 end\n",
      "Train epoch:15 iter: 226 begin\n",
      "Train epoch:15 iter: 226 end\n",
      "Train epoch:15 iter: 227 begin\n",
      "Train epoch:15 iter: 227 end\n",
      "Train epoch:15 iter: 228 begin\n",
      "Train epoch:15 iter: 228 end\n",
      "Train epoch:15 iter: 229 begin\n",
      "Train epoch:15 iter: 229 end\n",
      "Train epoch:15 iter: 230 begin\n",
      "Train epoch:15 iter: 230 end\n",
      "Train epoch:15 iter: 231 begin\n",
      "Train epoch:15 iter: 231 end\n",
      "Train epoch:15 iter: 232 begin\n",
      "Train epoch:15 iter: 232 end\n",
      "Train epoch:15 iter: 233 begin\n",
      "Train epoch:15 iter: 233 end\n",
      "Train epoch:15 iter: 234 begin\n",
      "Train epoch:15 iter: 234 end\n",
      "Train epoch:15 iter: 235 begin\n",
      "Train epoch:15 iter: 235 end\n",
      "Train epoch:15 iter: 236 begin\n",
      "Train epoch:15 iter: 236 end\n",
      "Train epoch:15 iter: 237 begin\n",
      "Train epoch:15 iter: 237 end\n",
      "Train epoch:15 iter: 238 begin\n",
      "Train epoch:15 iter: 238 end\n",
      "Train epoch:15 iter: 239 begin\n",
      "Train epoch:15 iter: 239 end\n",
      "Train epoch:15 iter: 240 begin\n",
      "Train epoch:15 iter: 240 end\n",
      "Train epoch:15 iter: 241 begin\n",
      "Train epoch:15 iter: 241 end\n",
      "Train epoch:15 iter: 242 begin\n",
      "Train epoch:15 iter: 242 end\n",
      "Train epoch:15 iter: 243 begin\n",
      "Train epoch:15 iter: 243 end\n",
      "Train epoch:15 iter: 244 begin\n",
      "Train epoch:15 iter: 244 end\n",
      "Train epoch:15 iter: 245 begin\n",
      "Train epoch:15 iter: 245 end\n",
      "Train epoch:15 iter: 246 begin\n",
      "Train epoch:15 iter: 246 end\n",
      "Train epoch:15 iter: 247 begin\n",
      "Train epoch:15 iter: 247 end\n",
      "Train epoch:15 iter: 248 begin\n",
      "Train epoch:15 iter: 248 end\n",
      "Train epoch:15 iter: 249 begin\n",
      "Train epoch:15 iter: 249 end\n",
      "Train epoch:15 iter: 250 begin\n",
      "Train epoch:15 iter: 250 end\n",
      "Train epoch:15 iter: 251 begin\n",
      "Train epoch:15 iter: 251 end\n",
      "Train epoch:15 iter: 252 begin\n",
      "Train epoch:15 iter: 252 end\n",
      "Train epoch:15 iter: 253 begin\n",
      "Train epoch:15 iter: 253 end\n",
      "Train epoch:15 iter: 254 begin\n",
      "Train epoch:15 iter: 254 end\n",
      "Train epoch:15 iter: 255 begin\n",
      "Train epoch:15 iter: 255 end\n",
      "Train epoch:15 iter: 256 begin\n",
      "Train epoch:15 iter: 256 end\n",
      "Train epoch:15 iter: 257 begin\n",
      "Train epoch:15 iter: 257 end\n",
      "Train epoch:15 iter: 258 begin\n",
      "Train epoch:15 iter: 258 end\n",
      "Train epoch:15 iter: 259 begin\n",
      "Train epoch:15 iter: 259 end\n",
      "Train epoch:15 iter: 260 begin\n",
      "Train epoch:15 iter: 260 end\n",
      "Train epoch:15 iter: 261 begin\n",
      "Train epoch:15 iter: 261 end\n",
      "Train epoch:15 iter: 262 begin\n",
      "Train epoch:15 iter: 262 end\n",
      "Train epoch:15 iter: 263 begin\n",
      "Train epoch:15 iter: 263 end\n",
      "Train epoch:15 iter: 264 begin\n",
      "Train epoch:15 iter: 264 end\n",
      "Train epoch:15 iter: 265 begin\n",
      "Train epoch:15 iter: 265 end\n",
      "Train epoch:15 iter: 266 begin\n",
      "Train epoch:15 iter: 266 end\n",
      "Train epoch:15 iter: 267 begin\n",
      "Train epoch:15 iter: 267 end\n",
      "Train epoch:15 iter: 268 begin\n",
      "Train epoch:15 iter: 268 end\n",
      "Train epoch:15 iter: 269 begin\n",
      "Train epoch:15 iter: 269 end\n",
      "Train epoch:15 iter: 270 begin\n",
      "Train epoch:15 iter: 270 end\n",
      "Train epoch:15 iter: 271 begin\n",
      "Train epoch:15 iter: 271 end\n",
      "Train epoch:15 iter: 272 begin\n",
      "Train epoch:15 iter: 272 end\n",
      "Train epoch:15 iter: 273 begin\n",
      "Train epoch:15 iter: 273 end\n",
      "Train epoch:15 iter: 274 begin\n",
      "Train epoch:15 iter: 274 end\n",
      "Train epoch:15 iter: 275 begin\n",
      "Train epoch:15 iter: 275 end\n",
      "Train epoch:15 iter: 276 begin\n",
      "Train epoch:15 iter: 276 end\n",
      "Train epoch:15 iter: 277 begin\n",
      "Train epoch:15 iter: 277 end\n",
      "Train epoch:15 iter: 278 begin\n",
      "Train epoch:15 iter: 278 end\n",
      "Train epoch:15 iter: 279 begin\n",
      "Train epoch:15 iter: 279 end\n",
      "Train epoch:15 iter: 280 begin\n",
      "Train epoch:15 iter: 280 end\n",
      "Train epoch:15 iter: 281 begin\n",
      "Train epoch:15 iter: 281 end\n",
      "Train epoch:15 iter: 282 begin\n",
      "Train epoch:15 iter: 282 end\n",
      "Train epoch:15 iter: 283 begin\n",
      "Train epoch:15 iter: 283 end\n",
      "Train epoch:15 iter: 284 begin\n",
      "Train epoch:15 iter: 284 end\n",
      "Train epoch:15 iter: 285 begin\n",
      "Train epoch:15 iter: 285 end\n",
      "Train epoch:15 iter: 286 begin\n",
      "Train epoch:15 iter: 286 end\n",
      "Train epoch:15 iter: 287 begin\n",
      "Train epoch:15 iter: 287 end\n",
      "Train epoch:15 iter: 288 begin\n",
      "Train epoch:15 iter: 288 end\n",
      "Train epoch:15 iter: 289 begin\n",
      "Train epoch:15 iter: 289 end\n",
      "Train epoch:15 iter: 290 begin\n",
      "Train epoch:15 iter: 290 end\n",
      "Train epoch:15 iter: 291 begin\n",
      "Train epoch:15 iter: 291 end\n",
      "Train epoch:15 iter: 292 begin\n",
      "Train epoch:15 iter: 292 end\n",
      "Train epoch:15 iter: 293 begin\n",
      "Train epoch:15 iter: 293 end\n",
      "Train epoch:15 iter: 294 begin\n",
      "Train epoch:15 iter: 294 end\n",
      "Train epoch:15 iter: 295 begin\n",
      "Train epoch:15 iter: 295 end\n",
      "Train epoch:15 iter: 296 begin\n",
      "Train epoch:15 iter: 296 end\n",
      "Train epoch:15 iter: 297 begin\n",
      "Train epoch:15 iter: 297 end\n",
      "Train epoch:15 iter: 298 begin\n",
      "Train epoch:15 iter: 298 end\n",
      "Train epoch:15 iter: 299 begin\n",
      "Train epoch:15 iter: 299 end\n",
      "Train epoch:15 iter: 300 begin\n",
      "Train epoch:15 iter: 300 end\n",
      "Train epoch:15 iter: 301 begin\n",
      "Train epoch:15 iter: 301 end\n",
      "Train epoch:15 iter: 302 begin\n",
      "Train epoch:15 iter: 302 end\n",
      "Train epoch:15 iter: 303 begin\n",
      "Train epoch:15 iter: 303 end\n",
      "Train epoch:15 iter: 304 begin\n",
      "Train epoch:15 iter: 304 end\n",
      "Train epoch:15 iter: 305 begin\n",
      "Train epoch:15 iter: 305 end\n",
      "Train epoch:15 iter: 306 begin\n",
      "Train epoch:15 iter: 306 end\n",
      "Train epoch:15 iter: 307 begin\n",
      "Train epoch:15 iter: 307 end\n",
      "Train epoch:15 iter: 308 begin\n",
      "Train epoch:15 iter: 308 end\n",
      "Train epoch:15 iter: 309 begin\n",
      "Train epoch:15 iter: 309 end\n",
      "Train epoch:15 iter: 310 begin\n",
      "Train epoch:15 iter: 310 end\n",
      "Train epoch:15 iter: 311 begin\n",
      "Train epoch:15 iter: 311 end\n",
      "Train epoch:15 iter: 312 begin\n",
      "Train epoch:15 iter: 312 end\n",
      "Train epoch:15 iter: 313 begin\n",
      "Train epoch:15 iter: 313 end\n",
      "Train epoch:15 iter: 314 begin\n",
      "Train epoch:15 iter: 314 end\n",
      "Train epoch:15 iter: 315 begin\n",
      "Train epoch:15 iter: 315 end\n",
      "Train epoch:15 iter: 316 begin\n",
      "Train epoch:15 iter: 316 end\n",
      "Train epoch:15 iter: 317 begin\n",
      "Train epoch:15 iter: 317 end\n",
      "Train epoch:15 iter: 318 begin\n",
      "Train epoch:15 iter: 318 end\n",
      "Train epoch:15 iter: 319 begin\n",
      "Train epoch:15 iter: 319 end\n",
      "Train epoch:15 iter: 320 begin\n",
      "Train epoch:15 iter: 320 end\n",
      "Train epoch:15 iter: 321 begin\n",
      "Train epoch:15 iter: 321 end\n",
      "Train epoch:15 iter: 322 begin\n",
      "Train epoch:15 iter: 322 end\n",
      "Train epoch:15 iter: 323 begin\n",
      "Train epoch:15 iter: 323 end\n",
      "Train epoch:15 iter: 324 begin\n",
      "Train epoch:15 iter: 324 end\n",
      "Train epoch:15 iter: 325 begin\n",
      "Train epoch:15 iter: 325 end\n",
      "Train epoch:15 iter: 326 begin\n",
      "Train epoch:15 iter: 326 end\n",
      "Train epoch:15 iter: 327 begin\n",
      "Train epoch:15 iter: 327 end\n",
      "Train epoch:15 iter: 328 begin\n",
      "Train epoch:15 iter: 328 end\n",
      "Train epoch:15 iter: 329 begin\n",
      "Train epoch:15 iter: 329 end\n",
      "Train epoch:15 iter: 330 begin\n",
      "Train epoch:15 iter: 330 end\n",
      "Train epoch:15 iter: 331 begin\n",
      "Train epoch:15 iter: 331 end\n",
      "Train epoch:15 iter: 332 begin\n",
      "Train epoch:15 iter: 332 end\n",
      "Train epoch:15 iter: 333 begin\n",
      "Train epoch:15 iter: 333 end\n",
      "Train epoch:15 iter: 334 begin\n",
      "Train epoch:15 iter: 334 end\n",
      "Train epoch:15 iter: 335 begin\n",
      "Train epoch:15 iter: 335 end\n",
      "Train epoch:15 iter: 336 begin\n",
      "Train epoch:15 iter: 336 end\n",
      "Train epoch:15 iter: 337 begin\n",
      "Train epoch:15 iter: 337 end\n",
      "Train epoch:15 iter: 338 begin\n",
      "Train epoch:15 iter: 338 end\n",
      "Train epoch:15 iter: 339 begin\n",
      "Train epoch:15 iter: 339 end\n",
      "Train epoch:15 iter: 340 begin\n",
      "Train epoch:15 iter: 340 end\n",
      "Train epoch:15 iter: 341 begin\n",
      "Train epoch:15 iter: 341 end\n",
      "Train epoch:15 iter: 342 begin\n",
      "Train epoch:15 iter: 342 end\n",
      "Train epoch:15 iter: 343 begin\n",
      "Train epoch:15 iter: 343 end\n",
      "Train epoch:15 iter: 344 begin\n",
      "Train epoch:15 iter: 344 end\n",
      "Train epoch:15 iter: 345 begin\n",
      "Train epoch:15 iter: 345 end\n",
      "Train epoch:15 iter: 346 begin\n",
      "Train epoch:15 iter: 346 end\n",
      "Train epoch:15 iter: 347 begin\n",
      "Train epoch:15 iter: 347 end\n",
      "Train epoch:15 iter: 348 begin\n",
      "Train epoch:15 iter: 348 end\n",
      "Train epoch:15 iter: 349 begin\n",
      "Train epoch:15 iter: 349 end\n",
      "Train epoch:15 iter: 350 begin\n",
      "Train epoch:15 iter: 350 end\n",
      "Train epoch:15 iter: 351 begin\n",
      "Train epoch:15 iter: 351 end\n",
      "Train epoch:15 iter: 352 begin\n",
      "Train epoch:15 iter: 352 end\n",
      "Train epoch:15 iter: 353 begin\n",
      "Train epoch:15 iter: 353 end\n",
      "Train epoch:15 iter: 354 begin\n",
      "Train epoch:15 iter: 354 end\n",
      "Train epoch:15 iter: 355 begin\n",
      "Train epoch:15 iter: 355 end\n",
      "Train epoch:15 iter: 356 begin\n",
      "Train epoch:15 iter: 356 end\n",
      "Train epoch:15 iter: 357 begin\n",
      "Train epoch:15 iter: 357 end\n",
      "Train epoch:15 iter: 358 begin\n",
      "Train epoch:15 iter: 358 end\n",
      "Train epoch:15 iter: 359 begin\n",
      "Train epoch:15 iter: 359 end\n",
      "Train epoch:15 iter: 360 begin\n",
      "Train epoch:15 iter: 360 end\n",
      "Train epoch:15 iter: 361 begin\n",
      "Train epoch:15 iter: 361 end\n",
      "Train epoch:15 iter: 362 begin\n",
      "Train epoch:15 iter: 362 end\n",
      "Train epoch:15 iter: 363 begin\n",
      "Train epoch:15 iter: 363 end\n",
      "Train epoch:15 iter: 364 begin\n",
      "Train epoch:15 iter: 364 end\n",
      "Train epoch:15 iter: 365 begin\n",
      "Train epoch:15 iter: 365 end\n",
      "Train epoch:15 iter: 366 begin\n",
      "Train epoch:15 iter: 366 end\n",
      "Train epoch:15 iter: 367 begin\n",
      "Train epoch:15 iter: 367 end\n",
      "Train epoch:15 iter: 368 begin\n",
      "Train epoch:15 iter: 368 end\n",
      "Train epoch:15 iter: 369 begin\n",
      "Train epoch:15 iter: 369 end\n",
      "Train epoch:15 iter: 370 begin\n",
      "Train epoch:15 iter: 370 end\n",
      "Train epoch:15 iter: 371 begin\n",
      "Train epoch:15 iter: 371 end\n",
      "Train epoch:15 iter: 372 begin\n",
      "Train epoch:15 iter: 372 end\n",
      "Train epoch:15 iter: 373 begin\n",
      "Train epoch:15 iter: 373 end\n",
      "Train epoch:15 iter: 374 begin\n",
      "Train epoch:15 iter: 374 end\n",
      "Train epoch:15 iter: 375 begin\n",
      "Train epoch:15 iter: 375 end\n",
      "Train epoch:15 iter: 376 begin\n",
      "Train epoch:15 iter: 376 end\n",
      "Train epoch:15 iter: 377 begin\n",
      "Train epoch:15 iter: 377 end\n",
      "Train epoch:15 iter: 378 begin\n",
      "Train epoch:15 iter: 378 end\n",
      "Train epoch:15 iter: 379 begin\n",
      "Train epoch:15 iter: 379 end\n",
      "Train epoch:15 iter: 380 begin\n",
      "Train epoch:15 iter: 380 end\n",
      "Train epoch:15 iter: 381 begin\n",
      "Train epoch:15 iter: 381 end\n",
      "Train epoch:15 iter: 382 begin\n",
      "Train epoch:15 iter: 382 end\n",
      "Train epoch:15 iter: 383 begin\n",
      "Train epoch:15 iter: 383 end\n",
      "Train epoch:15 iter: 384 begin\n",
      "Train epoch:15 iter: 384 end\n",
      "Train epoch:15 iter: 385 begin\n",
      "Train epoch:15 iter: 385 end\n",
      "Train epoch:15 iter: 386 begin\n",
      "Train epoch:15 iter: 386 end\n",
      "Train epoch:15 iter: 387 begin\n",
      "Train epoch:15 iter: 387 end\n",
      "Train epoch:15 iter: 388 begin\n",
      "Train epoch:15 iter: 388 end\n",
      "Train epoch:15 iter: 389 begin\n",
      "Train epoch:15 iter: 389 end\n",
      "Train epoch:15 iter: 390 begin\n",
      "Train epoch:15 iter: 390 end\n",
      "Train epoch:15 iter: 391 begin\n",
      "Train epoch:15 iter: 391 end\n",
      "Train epoch:15 iter: 392 begin\n",
      "Train epoch:15 iter: 392 end\n",
      "Train epoch:15 iter: 393 begin\n",
      "Train epoch:15 iter: 393 end\n",
      "Train epoch:15 iter: 394 begin\n",
      "Train epoch:15 iter: 394 end\n",
      "Train epoch:15 iter: 395 begin\n",
      "Train epoch:15 iter: 395 end\n",
      "Train epoch:15 iter: 396 begin\n",
      "Train epoch:15 iter: 396 end\n",
      "Train epoch:15 iter: 397 begin\n",
      "Train epoch:15 iter: 397 end\n",
      "Train epoch:15 iter: 398 begin\n",
      "Train epoch:15 iter: 398 end\n",
      "Train epoch:15 iter: 399 begin\n",
      "Train epoch:15 iter: 399 end\n",
      "Train epoch:15 iter: 400 begin\n",
      "Train epoch:15 iter: 400 end\n",
      "Train epoch:15 iter: 401 begin\n",
      "Train epoch:15 iter: 401 end\n",
      "Train epoch:15 iter: 402 begin\n",
      "Train epoch:15 iter: 402 end\n",
      "Train epoch:15 iter: 403 begin\n",
      "Train epoch:15 iter: 403 end\n",
      "Train epoch:15 iter: 404 begin\n",
      "Train epoch:15 iter: 404 end\n",
      "Train epoch:15 iter: 405 begin\n",
      "Train epoch:15 iter: 405 end\n",
      "Train epoch:15 iter: 406 begin\n",
      "Train epoch:15 iter: 406 end\n",
      "Train epoch:15 iter: 407 begin\n",
      "Train epoch:15 iter: 407 end\n",
      "Train epoch:15 iter: 408 begin\n",
      "Train epoch:15 iter: 408 end\n",
      "Train epoch:15 iter: 409 begin\n",
      "Train epoch:15 iter: 409 end\n",
      "Train epoch:15 iter: 410 begin\n",
      "Train epoch:15 iter: 410 end\n",
      "Train epoch:15 iter: 411 begin\n",
      "Train epoch:15 iter: 411 end\n",
      "Train epoch:15 iter: 412 begin\n",
      "Train epoch:15 iter: 412 end\n",
      "Train epoch:15 iter: 413 begin\n",
      "Train epoch:15 iter: 413 end\n",
      "Train epoch:15 iter: 414 begin\n",
      "Train epoch:15 iter: 414 end\n",
      "Train epoch:15 iter: 415 begin\n",
      "Train epoch:15 iter: 415 end\n",
      "Train epoch:15 iter: 416 begin\n",
      "Train epoch:15 iter: 416 end\n",
      "Train epoch:15 iter: 417 begin\n",
      "Train epoch:15 iter: 417 end\n",
      "Train epoch:15 iter: 418 begin\n",
      "Train epoch:15 iter: 418 end\n",
      "Train epoch:15 iter: 419 begin\n",
      "Train epoch:15 iter: 419 end\n",
      "Train epoch:15 iter: 420 begin\n",
      "Train epoch:15 iter: 420 end\n",
      "Train epoch:15 iter: 421 begin\n",
      "Train epoch:15 iter: 421 end\n",
      "Train epoch:15 iter: 422 begin\n",
      "Train epoch:15 iter: 422 end\n",
      "Train epoch:15 iter: 423 begin\n",
      "Train epoch:15 iter: 423 end\n",
      "Train epoch:15 iter: 424 begin\n",
      "Train epoch:15 iter: 424 end\n",
      "Train epoch:15 iter: 425 begin\n",
      "Train epoch:15 iter: 425 end\n",
      "Train epoch:15 iter: 426 begin\n",
      "Train epoch:15 iter: 426 end\n",
      "Train epoch:15 iter: 427 begin\n",
      "Train epoch:15 iter: 427 end\n",
      "Train epoch:15 iter: 428 begin\n",
      "Train epoch:15 iter: 428 end\n",
      "Train epoch:15 iter: 429 begin\n",
      "Train epoch:15 iter: 429 end\n",
      "Train epoch:15 iter: 430 begin\n",
      "Train epoch:15 iter: 430 end\n",
      "Train epoch:15 iter: 431 begin\n",
      "Train epoch:15 iter: 431 end\n",
      "Train epoch:15 iter: 432 begin\n",
      "Train epoch:15 iter: 432 end\n",
      "Train epoch:15 iter: 433 begin\n",
      "Train epoch:15 iter: 433 end\n",
      "Train epoch:15 iter: 434 begin\n",
      "Train epoch:15 iter: 434 end\n",
      "Train epoch:15 iter: 435 begin\n",
      "Train epoch:15 iter: 435 end\n",
      "Train epoch:15 iter: 436 begin\n",
      "Train epoch:15 iter: 436 end\n",
      "Train epoch:15 iter: 437 begin\n",
      "Train epoch:15 iter: 437 end\n",
      "Train epoch:15 iter: 438 begin\n",
      "Train epoch:15 iter: 438 end\n",
      "Train epoch:15 iter: 439 begin\n",
      "Train epoch:15 iter: 439 end\n",
      "Train epoch:15 iter: 440 begin\n",
      "Train epoch:15 iter: 440 end\n",
      "Train epoch:15 iter: 441 begin\n",
      "Train epoch:15 iter: 441 end\n",
      "Train epoch:15 iter: 442 begin\n",
      "Train epoch:15 iter: 442 end\n",
      "Train epoch:15 iter: 443 begin\n",
      "Train epoch:15 iter: 443 end\n",
      "Train epoch:15 iter: 444 begin\n",
      "Train epoch:15 iter: 444 end\n",
      "Train epoch:15 iter: 445 begin\n",
      "Train epoch:15 iter: 445 end\n",
      "Train epoch:15 iter: 446 begin\n",
      "Train epoch:15 iter: 446 end\n",
      "Train epoch:15 iter: 447 begin\n",
      "Train epoch:15 iter: 447 end\n",
      "Train epoch:15 iter: 448 begin\n",
      "Train epoch:15 iter: 448 end\n",
      "Train epoch:15 iter: 449 begin\n",
      "Train epoch:15 iter: 449 end\n",
      "Train epoch:15 iter: 450 begin\n",
      "Train epoch:15 iter: 450 end\n",
      "Train epoch:15 iter: 451 begin\n",
      "Train epoch:15 iter: 451 end\n",
      "Train epoch:15 iter: 452 begin\n",
      "Train epoch:15 iter: 452 end\n",
      "Train epoch:15 iter: 453 begin\n",
      "Train epoch:15 iter: 453 end\n",
      "Train epoch:15 iter: 454 begin\n",
      "Train epoch:15 iter: 454 end\n",
      "Train epoch:15 iter: 455 begin\n",
      "Train epoch:15 iter: 455 end\n",
      "Train epoch:15 iter: 456 begin\n",
      "Train epoch:15 iter: 456 end\n",
      "Train epoch:15 iter: 457 begin\n",
      "Train epoch:15 iter: 457 end\n",
      "Train epoch:15 iter: 458 begin\n",
      "Train epoch:15 iter: 458 end\n",
      "Train epoch:15 iter: 459 begin\n",
      "Train epoch:15 iter: 459 end\n",
      "Train epoch:15 iter: 460 begin\n",
      "Train epoch:15 iter: 460 end\n",
      "Train epoch:15 iter: 461 begin\n",
      "Train epoch:15 iter: 461 end\n",
      "Train epoch:15 iter: 462 begin\n",
      "Train epoch:15 iter: 462 end\n",
      "Train epoch:15 iter: 463 begin\n",
      "Train epoch:15 iter: 463 end\n",
      "Train epoch:15 iter: 464 begin\n",
      "Train epoch:15 iter: 464 end\n",
      "Train epoch:15 iter: 465 begin\n",
      "Train epoch:15 iter: 465 end\n",
      "Train epoch:15 iter: 466 begin\n",
      "Train epoch:15 iter: 466 end\n",
      "Train epoch:15 iter: 467 begin\n",
      "Train epoch:15 iter: 467 end\n",
      "Train epoch:15 iter: 468 begin\n",
      "Train epoch:15 iter: 468 end\n",
      "Train epoch:15 iter: 469 begin\n",
      "Train epoch:15 iter: 469 end\n",
      "Train epoch:15 iter: 470 begin\n",
      "Train epoch:15 iter: 470 end\n",
      "Train epoch:15 iter: 471 begin\n",
      "Train epoch:15 iter: 471 end\n",
      "Train epoch:15 iter: 472 begin\n",
      "Train epoch:15 iter: 472 end\n",
      "Train epoch:15 iter: 473 begin\n",
      "Train epoch:15 iter: 473 end\n",
      "Train epoch:15 iter: 474 begin\n",
      "Train epoch:15 iter: 474 end\n",
      "Train epoch:15 iter: 475 begin\n",
      "Train epoch:15 iter: 475 end\n",
      "Train epoch:15 iter: 476 begin\n",
      "Train epoch:15 iter: 476 end\n",
      "Train epoch:15 iter: 477 begin\n",
      "Train epoch:15 iter: 477 end\n",
      "Train epoch:15 iter: 478 begin\n",
      "Train epoch:15 iter: 478 end\n",
      "Train epoch:15 iter: 479 begin\n",
      "Train epoch:15 iter: 479 end\n",
      "Train epoch:15 iter: 480 begin\n",
      "Train epoch:15 iter: 480 end\n",
      "Train epoch:15 iter: 481 begin\n",
      "Train epoch:15 iter: 481 end\n",
      "Train epoch:15 iter: 482 begin\n",
      "Train epoch:15 iter: 482 end\n",
      "Train epoch:15 iter: 483 begin\n",
      "Train epoch:15 iter: 483 end\n",
      "Train epoch:15 iter: 484 begin\n",
      "Train epoch:15 iter: 484 end\n",
      "Train epoch:15 iter: 485 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:15 iter: 485 end\n",
      "Train epoch:15 iter: 486 begin\n",
      "Train epoch:15 iter: 486 end\n",
      "Train epoch:15 iter: 487 begin\n",
      "Train epoch:15 iter: 487 end\n",
      "Train epoch:15 iter: 488 begin\n",
      "Train epoch:15 iter: 488 end\n",
      "Train epoch:15 iter: 489 begin\n",
      "Train epoch:15 iter: 489 end\n",
      "Train epoch:15 iter: 490 begin\n",
      "Train epoch:15 iter: 490 end\n",
      "Train epoch:15 iter: 491 begin\n",
      "Train epoch:15 iter: 491 end\n",
      "Train epoch:15 iter: 492 begin\n",
      "Train epoch:15 iter: 492 end\n",
      "Train epoch:15 iter: 493 begin\n",
      "Train epoch:15 iter: 493 end\n",
      "Train epoch:15 iter: 494 begin\n",
      "Train epoch:15 iter: 494 end\n",
      "Train epoch:15 iter: 495 begin\n",
      "Train epoch:15 iter: 495 end\n",
      "Train epoch:15 iter: 496 begin\n",
      "Train epoch:15 iter: 496 end\n",
      "Train epoch:15 iter: 497 begin\n",
      "Train epoch:15 iter: 497 end\n",
      "Train epoch:15 iter: 498 begin\n",
      "Train epoch:15 iter: 498 end\n",
      "Train epoch:15 iter: 499 begin\n",
      "Train epoch:15 iter: 499 end\n",
      "Train epoch:15 iter: 500 begin\n",
      "Train epoch:15 iter: 500 end\n",
      "Train epoch:15 iter: 501 begin\n",
      "Train epoch:15 iter: 501 end\n",
      "Train epoch:15 iter: 502 begin\n",
      "Train epoch:15 iter: 502 end\n",
      "Train epoch:15 iter: 503 begin\n",
      "Train epoch:15 iter: 503 end\n",
      "Train epoch:15 iter: 504 begin\n",
      "Train epoch:15 iter: 504 end\n",
      "Train epoch:15 iter: 505 begin\n",
      "Train epoch:15 iter: 505 end\n",
      "Train epoch:15 iter: 506 begin\n",
      "Train epoch:15 iter: 506 end\n",
      "Train epoch:15 iter: 507 begin\n",
      "Train epoch:15 iter: 507 end\n",
      "Train epoch:15 iter: 508 begin\n",
      "Train epoch:15 iter: 508 end\n",
      "Train epoch:15 iter: 509 begin\n",
      "Train epoch:15 iter: 509 end\n",
      "Train epoch:15 iter: 510 begin\n",
      "Train epoch:15 iter: 510 end\n",
      "Train epoch:15 iter: 511 begin\n",
      "Train epoch:15 iter: 511 end\n",
      "Train epoch:15 iter: 512 begin\n",
      "Train epoch:15 iter: 512 end\n",
      "Train epoch:15 iter: 513 begin\n",
      "Train epoch:15 iter: 513 end\n",
      "Train epoch:15 iter: 514 begin\n",
      "Train epoch:15 iter: 514 end\n",
      "Train epoch:15 iter: 515 begin\n",
      "Train epoch:15 iter: 515 end\n",
      "Train epoch:15 iter: 516 begin\n",
      "Train epoch:15 iter: 516 end\n",
      "Train epoch:15 iter: 517 begin\n",
      "Train epoch:15 iter: 517 end\n",
      "Train epoch:15 iter: 518 begin\n",
      "Train epoch:15 iter: 518 end\n",
      "Train epoch:15 iter: 519 begin\n",
      "Train epoch:15 iter: 519 end\n",
      "Train epoch:15 iter: 520 begin\n",
      "Train epoch:15 iter: 520 end\n",
      "Train epoch:15 iter: 521 begin\n",
      "Train epoch:15 iter: 521 end\n",
      "Train epoch:15 iter: 522 begin\n",
      "Train epoch:15 iter: 522 end\n",
      "Train epoch:15 iter: 523 begin\n",
      "Train epoch:15 iter: 523 end\n",
      "Train epoch:15 iter: 524 begin\n",
      "Train epoch:15 iter: 524 end\n",
      "Train epoch:15 iter: 525 begin\n",
      "Train epoch:15 iter: 525 end\n",
      "Train epoch:15 iter: 526 begin\n",
      "Train epoch:15 iter: 526 end\n",
      "Train epoch:15 iter: 527 begin\n",
      "Train epoch:15 iter: 527 end\n",
      "Train epoch:15 iter: 528 begin\n",
      "Train epoch:15 iter: 528 end\n",
      "Train epoch:15 iter: 529 begin\n",
      "Train epoch:15 iter: 529 end\n",
      "Train epoch:15 iter: 530 begin\n",
      "Train epoch:15 iter: 530 end\n",
      "Train epoch:15 iter: 531 begin\n",
      "Train epoch:15 iter: 531 end\n",
      "Train epoch:15 iter: 532 begin\n",
      "Train epoch:15 iter: 532 end\n",
      "Train epoch:15 iter: 533 begin\n",
      "Train epoch:15 iter: 533 end\n",
      "Train epoch:15 iter: 534 begin\n",
      "Train epoch:15 iter: 534 end\n",
      "Train epoch:15 iter: 535 begin\n",
      "Train epoch:15 iter: 535 end\n",
      "Train epoch:15 iter: 536 begin\n",
      "Train epoch:15 iter: 536 end\n",
      "Train epoch:15 iter: 537 begin\n",
      "Train epoch:15 iter: 537 end\n",
      "Train epoch:15 iter: 538 begin\n",
      "Train epoch:15 iter: 538 end\n",
      "Train epoch:15 iter: 539 begin\n",
      "Train epoch:15 iter: 539 end\n",
      "Train epoch:15 iter: 540 begin\n",
      "Train epoch:15 iter: 540 end\n",
      "Train epoch:15 iter: 541 begin\n",
      "Train epoch:15 iter: 541 end\n",
      "Train epoch:15 iter: 542 begin\n",
      "Train epoch:15 iter: 542 end\n",
      "Train epoch:15 iter: 543 begin\n",
      "Train epoch:15 iter: 543 end\n",
      "Train epoch:15 iter: 544 begin\n",
      "Train epoch:15 iter: 544 end\n",
      "Train epoch:15 iter: 545 begin\n",
      "Train epoch:15 iter: 545 end\n",
      "Train epoch:15 iter: 546 begin\n",
      "Train epoch:15 iter: 546 end\n",
      "Train epoch:15 iter: 547 begin\n",
      "Train epoch:15 iter: 547 end\n",
      "Train epoch:15 iter: 548 begin\n",
      "Train epoch:15 iter: 548 end\n",
      "Train epoch:15 iter: 549 begin\n",
      "Train epoch:15 iter: 549 end\n",
      "Train epoch:15 iter: 550 begin\n",
      "Train epoch:15 iter: 550 end\n",
      "Train epoch:15 iter: 551 begin\n",
      "Train epoch:15 iter: 551 end\n",
      "Train epoch:15 iter: 552 begin\n",
      "Train epoch:15 iter: 552 end\n",
      "Train epoch:15 iter: 553 begin\n",
      "Train epoch:15 iter: 553 end\n",
      "Train epoch:15 iter: 554 begin\n",
      "Train epoch:15 iter: 554 end\n",
      "Train epoch:15 iter: 555 begin\n",
      "Train epoch:15 iter: 555 end\n",
      "Train epoch:15 iter: 556 begin\n",
      "Train epoch:15 iter: 556 end\n",
      "Train epoch:15 iter: 557 begin\n",
      "Train epoch:15 iter: 557 end\n",
      "Train epoch:15 iter: 558 begin\n",
      "Train epoch:15 iter: 558 end\n",
      "Train epoch:15 iter: 559 begin\n",
      "Train epoch:15 iter: 559 end\n",
      "Train epoch:15 iter: 560 begin\n",
      "Train epoch:15 iter: 560 end\n",
      "Train epoch:15 iter: 561 begin\n",
      "Train epoch:15 iter: 561 end\n",
      "Train epoch:15 iter: 562 begin\n",
      "Train epoch:15 iter: 562 end\n",
      "Train epoch:15 iter: 563 begin\n",
      "Train epoch:15 iter: 563 end\n",
      "Train epoch:15 iter: 564 begin\n",
      "Train epoch:15 iter: 564 end\n",
      "Train epoch:15 iter: 565 begin\n",
      "Train epoch:15 iter: 565 end\n",
      "Train epoch:15 iter: 566 begin\n",
      "Train epoch:15 iter: 566 end\n",
      "Train epoch:15 iter: 567 begin\n",
      "Train epoch:15 iter: 567 end\n",
      "Train epoch:15 iter: 568 begin\n",
      "Train epoch:15 iter: 568 end\n",
      "Train epoch:15 iter: 569 begin\n",
      "Train epoch:15 iter: 569 end\n",
      "Train epoch:15 iter: 570 begin\n",
      "Train epoch:15 iter: 570 end\n",
      "Train epoch:15 iter: 571 begin\n",
      "Train epoch:15 iter: 571 end\n",
      "Train epoch:15 iter: 572 begin\n",
      "Train epoch:15 iter: 572 end\n",
      "Train epoch:15 iter: 573 begin\n",
      "Train epoch:15 iter: 573 end\n",
      "Train epoch:15 iter: 574 begin\n",
      "Train epoch:15 iter: 574 end\n",
      "Train epoch:15 iter: 575 begin\n",
      "Train epoch:15 iter: 575 end\n",
      "Train epoch:15 iter: 576 begin\n",
      "Train epoch:15 iter: 576 end\n",
      "Train epoch:15 iter: 577 begin\n",
      "Train epoch:15 iter: 577 end\n",
      "Train epoch:15 iter: 578 begin\n",
      "Train epoch:15 iter: 578 end\n",
      "Train epoch:15 iter: 579 begin\n",
      "Train epoch:15 iter: 579 end\n",
      "Train epoch:15 iter: 580 begin\n",
      "Train epoch:15 iter: 580 end\n",
      "Train epoch:15 iter: 581 begin\n",
      "Train epoch:15 iter: 581 end\n",
      "Train epoch:15 iter: 582 begin\n",
      "Train epoch:15 iter: 582 end\n",
      "Train epoch:15 iter: 583 begin\n",
      "Train epoch:15 iter: 583 end\n",
      "Train epoch:15 iter: 584 begin\n",
      "Train epoch:15 iter: 584 end\n",
      "Train epoch:15 iter: 585 begin\n",
      "Train epoch:15 iter: 585 end\n",
      "Train epoch:15 iter: 586 begin\n",
      "Train epoch:15 iter: 586 end\n",
      "Train epoch:15 iter: 587 begin\n",
      "Train epoch:15 iter: 587 end\n",
      "Train epoch:15 iter: 588 begin\n",
      "Train epoch:15 iter: 588 end\n",
      "Train epoch:15 iter: 589 begin\n",
      "Train epoch:15 iter: 589 end\n",
      "Train epoch:15 iter: 590 begin\n",
      "Train epoch:15 iter: 590 end\n",
      "Train epoch:15 iter: 591 begin\n",
      "Train epoch:15 iter: 591 end\n",
      "Train epoch:15 iter: 592 begin\n",
      "Train epoch:15 iter: 592 end\n",
      "Train epoch:15 iter: 593 begin\n",
      "Train epoch:15 iter: 593 end\n",
      "Train epoch:15 iter: 594 begin\n",
      "Train epoch:15 iter: 594 end\n",
      "Train epoch:15 iter: 595 begin\n",
      "Train epoch:15 iter: 595 end\n",
      "Train epoch:15 iter: 596 begin\n",
      "Train epoch:15 iter: 596 end\n",
      "Train epoch:15 iter: 597 begin\n",
      "Train epoch:15 iter: 597 end\n",
      "Train epoch:15 iter: 598 begin\n",
      "Train epoch:15 iter: 598 end\n",
      "Train epoch:15 iter: 599 begin\n",
      "Train epoch:15 iter: 599 end\n",
      "Train epoch:15 iter: 600 begin\n",
      "Train epoch:15 iter: 600 end\n",
      "Train epoch:15 iter: 601 begin\n",
      "Train epoch:15 iter: 601 end\n",
      "Train epoch:15 iter: 602 begin\n",
      "Train epoch:15 iter: 602 end\n",
      "Train epoch:15 iter: 603 begin\n",
      "Train epoch:15 iter: 603 end\n",
      "Train epoch:15 iter: 604 begin\n",
      "Train epoch:15 iter: 604 end\n",
      "Train epoch:15 iter: 605 begin\n",
      "Train epoch:15 iter: 605 end\n",
      "Train epoch:15 iter: 606 begin\n",
      "Train epoch:15 iter: 606 end\n",
      "Train epoch:15 iter: 607 begin\n",
      "Train epoch:15 iter: 607 end\n",
      "Train epoch:15 iter: 608 begin\n",
      "Train epoch:15 iter: 608 end\n",
      "Train epoch:15 iter: 609 begin\n",
      "Train epoch:15 iter: 609 end\n",
      "Train epoch:15 iter: 610 begin\n",
      "Train epoch:15 iter: 610 end\n",
      "Train epoch:15 iter: 611 begin\n",
      "Train epoch:15 iter: 611 end\n",
      "Train epoch:15 iter: 612 begin\n",
      "Train epoch:15 iter: 612 end\n",
      "Train epoch:15 iter: 613 begin\n",
      "Train epoch:15 iter: 613 end\n",
      "Train epoch:15 iter: 614 begin\n",
      "Train epoch:15 iter: 614 end\n",
      "Train epoch:15 iter: 615 begin\n",
      "Train epoch:15 iter: 615 end\n",
      "Train epoch:15 iter: 616 begin\n",
      "Train epoch:15 iter: 616 end\n",
      "Train epoch:15 iter: 617 begin\n",
      "Train epoch:15 iter: 617 end\n",
      "Train epoch:15 iter: 618 begin\n",
      "Train epoch:15 iter: 618 end\n",
      "Train epoch:15 iter: 619 begin\n",
      "Train epoch:15 iter: 619 end\n",
      "Train epoch:15 iter: 620 begin\n",
      "Train epoch:15 iter: 620 end\n",
      "Train epoch:15 iter: 621 begin\n",
      "Train epoch:15 iter: 621 end\n",
      "Train epoch:15 iter: 622 begin\n",
      "Train epoch:15 iter: 622 end\n",
      "Train epoch:15 iter: 623 begin\n",
      "Train epoch:15 iter: 623 end\n",
      "Train epoch:15 iter: 624 begin\n",
      "Train epoch:15 iter: 624 end\n",
      "Train epoch:15 iter: 625 begin\n",
      "Train epoch:15 iter: 625 end\n",
      "Train epoch:15 iter: 626 begin\n",
      "Train epoch:15 iter: 626 end\n",
      "Train epoch:15 iter: 627 begin\n",
      "Train epoch:15 iter: 627 end\n",
      "Train epoch:15 iter: 628 begin\n",
      "Train epoch:15 iter: 628 end\n",
      "Train epoch:15 iter: 629 begin\n",
      "Train epoch:15 iter: 629 end\n",
      "Train epoch:15 iter: 630 begin\n",
      "Train epoch:15 iter: 630 end\n",
      "Train epoch:15 iter: 631 begin\n",
      "Train epoch:15 iter: 631 end\n",
      "Train epoch:15 iter: 632 begin\n",
      "Train epoch:15 iter: 632 end\n",
      "Train epoch:15 iter: 633 begin\n",
      "Train epoch:15 iter: 633 end\n",
      "Train epoch:15 iter: 634 begin\n",
      "Train epoch:15 iter: 634 end\n",
      "Train epoch:15 iter: 635 begin\n",
      "Train epoch:15 iter: 635 end\n",
      "Train epoch:15 iter: 636 begin\n",
      "Train epoch:15 iter: 636 end\n",
      "Train epoch:15 iter: 637 begin\n",
      "Train epoch:15 iter: 637 end\n",
      "Train epoch:15 iter: 638 begin\n",
      "Train epoch:15 iter: 638 end\n",
      "Train epoch:15 iter: 639 begin\n",
      "Train epoch:15 iter: 639 end\n",
      "Train epoch:15 iter: 640 begin\n",
      "Train epoch:15 iter: 640 end\n",
      "Train epoch:15 iter: 641 begin\n",
      "Train epoch:15 iter: 641 end\n",
      "Train epoch:15 iter: 642 begin\n",
      "Train epoch:15 iter: 642 end\n",
      "Train epoch:15 iter: 643 begin\n",
      "Train epoch:15 iter: 643 end\n",
      "Train epoch:15 iter: 644 begin\n",
      "Train epoch:15 iter: 644 end\n",
      "Train epoch:15 iter: 645 begin\n",
      "Train epoch:15 iter: 645 end\n",
      "Train epoch:15 iter: 646 begin\n",
      "Train epoch:15 iter: 646 end\n",
      "Train epoch:15 iter: 647 begin\n",
      "Train epoch:15 iter: 647 end\n",
      "Train epoch:15 iter: 648 begin\n",
      "Train epoch:15 iter: 648 end\n",
      "Train epoch:15 iter: 649 begin\n",
      "Train epoch:15 iter: 649 end\n",
      "Train epoch:15 iter: 650 begin\n",
      "Train epoch:15 iter: 650 end\n",
      "Train epoch:15 iter: 651 begin\n",
      "Train epoch:15 iter: 651 end\n",
      "Train epoch:15 iter: 652 begin\n",
      "Train epoch:15 iter: 652 end\n",
      "Train epoch:15 iter: 653 begin\n",
      "Train epoch:15 iter: 653 end\n",
      "Train epoch:15 iter: 654 begin\n",
      "Train epoch:15 iter: 654 end\n",
      "Train epoch:15 iter: 655 begin\n",
      "Train epoch:15 iter: 655 end\n",
      "Train epoch:15 iter: 656 begin\n",
      "Train epoch:15 iter: 656 end\n",
      "Train epoch:15 iter: 657 begin\n",
      "Train epoch:15 iter: 657 end\n",
      "Train epoch:15 iter: 658 begin\n",
      "Train epoch:15 iter: 658 end\n",
      "Train epoch:15 iter: 659 begin\n",
      "Train epoch:15 iter: 659 end\n",
      "Train epoch:15 iter: 660 begin\n",
      "Train epoch:15 iter: 660 end\n",
      "Train epoch:15 iter: 661 begin\n",
      "Train epoch:15 iter: 661 end\n",
      "Train epoch:15 iter: 662 begin\n",
      "Train epoch:15 iter: 662 end\n",
      "Train epoch:15 iter: 663 begin\n",
      "Train epoch:15 iter: 663 end\n",
      "Train epoch:15 iter: 664 begin\n",
      "Train epoch:15 iter: 664 end\n",
      "Train epoch:15 iter: 665 begin\n",
      "Train epoch:15 iter: 665 end\n",
      "Train epoch:15 iter: 666 begin\n",
      "Train epoch:15 iter: 666 end\n",
      "Train epoch:15 iter: 667 begin\n",
      "Train epoch:15 iter: 667 end\n",
      "Train epoch:15 iter: 668 begin\n",
      "Train epoch:15 iter: 668 end\n",
      "Train epoch:15 iter: 669 begin\n",
      "Train epoch:15 iter: 669 end\n",
      "Train epoch:15 iter: 670 begin\n",
      "Train epoch:15 iter: 670 end\n",
      "Train epoch:15 iter: 671 begin\n",
      "Train epoch:15 iter: 671 end\n",
      "Train epoch:15 iter: 672 begin\n",
      "Train epoch:15 iter: 672 end\n",
      "Train epoch:15 iter: 673 begin\n",
      "Train epoch:15 iter: 673 end\n",
      "Train epoch:15 iter: 674 begin\n",
      "Train epoch:15 iter: 674 end\n",
      "Train epoch:15 iter: 675 begin\n",
      "Train epoch:15 iter: 675 end\n",
      "Train epoch:15 iter: 676 begin\n",
      "Train epoch:15 iter: 676 end\n",
      "Train epoch:15 iter: 677 begin\n",
      "Train epoch:15 iter: 677 end\n",
      "Train epoch:15 iter: 678 begin\n",
      "Train epoch:15 iter: 678 end\n",
      "Train epoch:15 iter: 679 begin\n",
      "Train epoch:15 iter: 679 end\n",
      "Train epoch:15 iter: 680 begin\n",
      "Train epoch:15 iter: 680 end\n",
      "Train epoch:15 iter: 681 begin\n",
      "Train epoch:15 iter: 681 end\n",
      "Train epoch:15 iter: 682 begin\n",
      "Train epoch:15 iter: 682 end\n",
      "Train epoch:15 iter: 683 begin\n",
      "Train epoch:15 iter: 683 end\n",
      "Train epoch:15 iter: 684 begin\n",
      "Train epoch:15 iter: 684 end\n",
      "Train epoch:15 iter: 685 begin\n",
      "Train epoch:15 iter: 685 end\n",
      "Train epoch:15 iter: 686 begin\n",
      "Train epoch:15 iter: 686 end\n",
      "Train epoch:15 iter: 687 begin\n",
      "Train epoch:15 iter: 687 end\n",
      "Train epoch:15 iter: 688 begin\n",
      "Train epoch:15 iter: 688 end\n",
      "Train epoch:15 iter: 689 begin\n",
      "Train epoch:15 iter: 689 end\n",
      "Train epoch:15 iter: 690 begin\n",
      "Train epoch:15 iter: 690 end\n",
      "Train epoch:15 iter: 691 begin\n",
      "Train epoch:15 iter: 691 end\n",
      "Train epoch:15 iter: 692 begin\n",
      "Train epoch:15 iter: 692 end\n",
      "Train epoch:15 iter: 693 begin\n",
      "Train epoch:15 iter: 693 end\n",
      "Train epoch:15 iter: 694 begin\n",
      "Train epoch:15 iter: 694 end\n",
      "Train epoch:15 iter: 695 begin\n",
      "Train epoch:15 iter: 695 end\n",
      "Train epoch:15 iter: 696 begin\n",
      "Train epoch:15 iter: 696 end\n",
      "Train epoch:15 iter: 697 begin\n",
      "Train epoch:15 iter: 697 end\n",
      "Train epoch:15 iter: 698 begin\n",
      "Train epoch:15 iter: 698 end\n",
      "Train epoch:15 iter: 699 begin\n",
      "Train epoch:15 iter: 699 end\n",
      "Train epoch:15 iter: 700 begin\n",
      "Train epoch:15 iter: 700 end\n",
      "Train epoch:15 iter: 701 begin\n",
      "Train epoch:15 iter: 701 end\n",
      "Train epoch:15 iter: 702 begin\n",
      "Train epoch:15 iter: 702 end\n",
      "Train epoch:15 iter: 703 begin\n",
      "Train epoch:15 iter: 703 end\n",
      "Train epoch:15 iter: 704 begin\n",
      "Train epoch:15 iter: 704 end\n",
      "Train epoch:15 iter: 705 begin\n",
      "Train epoch:15 iter: 705 end\n",
      "Train epoch:15 iter: 706 begin\n",
      "Train epoch:15 iter: 706 end\n",
      "Train epoch:15 iter: 707 begin\n",
      "Train epoch:15 iter: 707 end\n",
      "Train epoch:15 iter: 708 begin\n",
      "Train epoch:15 iter: 708 end\n",
      "Train epoch:15 iter: 709 begin\n",
      "Train epoch:15 iter: 709 end\n",
      "Train epoch:15 iter: 710 begin\n",
      "Train epoch:15 iter: 710 end\n",
      "Train epoch:15 iter: 711 begin\n",
      "Train epoch:15 iter: 711 end\n",
      "Train epoch:15 iter: 712 begin\n",
      "Train epoch:15 iter: 712 end\n",
      "Train epoch:15 iter: 713 begin\n",
      "Train epoch:15 iter: 713 end\n",
      "Train epoch:15 iter: 714 begin\n",
      "Train epoch:15 iter: 714 end\n",
      "Train epoch:15 iter: 715 begin\n",
      "Train epoch:15 iter: 715 end\n",
      "Train epoch:15 iter: 716 begin\n",
      "Train epoch:15 iter: 716 end\n",
      "Train epoch:15 iter: 717 begin\n",
      "Train epoch:15 iter: 717 end\n",
      "Train epoch:15 iter: 718 begin\n",
      "Train epoch:15 iter: 718 end\n",
      "Train epoch:15 iter: 719 begin\n",
      "Train epoch:15 iter: 719 end\n",
      "Train epoch:15 iter: 720 begin\n",
      "Train epoch:15 iter: 720 end\n",
      "Train epoch:15 iter: 721 begin\n",
      "Train epoch:15 iter: 721 end\n",
      "Train epoch:15 iter: 722 begin\n",
      "Train epoch:15 iter: 722 end\n",
      "Train epoch:15 iter: 723 begin\n",
      "Train epoch:15 iter: 723 end\n",
      "Train epoch:15 iter: 724 begin\n",
      "Train epoch:15 iter: 724 end\n",
      "Train epoch:15 iter: 725 begin\n",
      "Train epoch:15 iter: 725 end\n",
      "Train epoch:15 iter: 726 begin\n",
      "Train epoch:15 iter: 726 end\n",
      "Train epoch:15 iter: 727 begin\n",
      "Train epoch:15 iter: 727 end\n",
      "Train epoch:15 iter: 728 begin\n",
      "Train epoch:15 iter: 728 end\n",
      "Train epoch:15 iter: 729 begin\n",
      "Train epoch:15 iter: 729 end\n",
      "Train epoch:15 iter: 730 begin\n",
      "Train epoch:15 iter: 730 end\n",
      "Train epoch:15 iter: 731 begin\n",
      "Train epoch:15 iter: 731 end\n",
      "Train epoch:15 iter: 732 begin\n",
      "Train epoch:15 iter: 732 end\n",
      "Train epoch:15 iter: 733 begin\n",
      "Train epoch:15 iter: 733 end\n",
      "Train epoch:15 iter: 734 begin\n",
      "Train epoch:15 iter: 734 end\n",
      "Train epoch:15 iter: 735 begin\n",
      "Train epoch:15 iter: 735 end\n",
      "Train epoch:15 iter: 736 begin\n",
      "Train epoch:15 iter: 736 end\n",
      "Train epoch:15 iter: 737 begin\n",
      "Train epoch:15 iter: 737 end\n",
      "Train epoch:15 iter: 738 begin\n",
      "Train epoch:15 iter: 738 end\n",
      "Train epoch:15 iter: 739 begin\n",
      "Train epoch:15 iter: 739 end\n",
      "Train epoch:15 iter: 740 begin\n",
      "Train epoch:15 iter: 740 end\n",
      "Train epoch:15 iter: 741 begin\n",
      "Train epoch:15 iter: 741 end\n",
      "Train epoch:15 iter: 742 begin\n",
      "Train epoch:15 iter: 742 end\n",
      "Train epoch:15 iter: 743 begin\n",
      "Train epoch:15 iter: 743 end\n",
      "Train epoch:15 iter: 744 begin\n",
      "Train epoch:15 iter: 744 end\n",
      "Train epoch:15 iter: 745 begin\n",
      "Train epoch:15 iter: 745 end\n",
      "Train epoch:15 iter: 746 begin\n",
      "Train epoch:15 iter: 746 end\n",
      "Train epoch:15 iter: 747 begin\n",
      "Train epoch:15 iter: 747 end\n",
      "Train epoch:15 iter: 748 begin\n",
      "Train epoch:15 iter: 748 end\n",
      "Train epoch:15 iter: 749 begin\n",
      "Train epoch:15 iter: 749 end\n",
      "Train epoch:15 iter: 750 begin\n",
      "Train epoch:15 iter: 750 end\n",
      "Train epoch:15 iter: 751 begin\n",
      "Train epoch:15 iter: 751 end\n",
      "Train epoch:15 iter: 752 begin\n",
      "Train epoch:15 iter: 752 end\n",
      "Train epoch:15 iter: 753 begin\n",
      "Train epoch:15 iter: 753 end\n",
      "Train epoch:15 iter: 754 begin\n",
      "Train epoch:15 iter: 754 end\n",
      "Train epoch:15 iter: 755 begin\n",
      "Train epoch:15 iter: 755 end\n",
      "Train epoch:15 iter: 756 begin\n",
      "Train epoch:15 iter: 756 end\n",
      "Train epoch:15 iter: 757 begin\n",
      "Train epoch:15 iter: 757 end\n",
      "Train epoch:15 iter: 758 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:15 iter: 758 end\n",
      "Train epoch:15 iter: 759 begin\n",
      "Train epoch:15 iter: 759 end\n",
      "Train epoch:15 iter: 760 begin\n",
      "Train epoch:15 iter: 760 end\n",
      "Train epoch:15 iter: 761 begin\n",
      "Train epoch:15 iter: 761 end\n",
      "Train epoch:15 iter: 762 begin\n",
      "Train epoch:15 iter: 762 end\n",
      "Train epoch:15 iter: 763 begin\n",
      "Train epoch:15 iter: 763 end\n",
      "Train epoch:15 iter: 764 begin\n",
      "Train epoch:15 iter: 764 end\n",
      "Train epoch:15 iter: 765 begin\n",
      "Train epoch:15 iter: 765 end\n",
      "Train epoch:15 iter: 766 begin\n",
      "Train epoch:15 iter: 766 end\n",
      "Train epoch:15 iter: 767 begin\n",
      "Train epoch:15 iter: 767 end\n",
      "Train epoch:15 iter: 768 begin\n",
      "Train epoch:15 iter: 768 end\n",
      "Train epoch:15 iter: 769 begin\n",
      "Train epoch:15 iter: 769 end\n",
      "Train epoch:15 iter: 770 begin\n",
      "Train epoch:15 iter: 770 end\n",
      "Train epoch:15 iter: 771 begin\n",
      "Train epoch:15 iter: 771 end\n",
      "Train epoch:15 iter: 772 begin\n",
      "Train epoch:15 iter: 772 end\n",
      "Train epoch:15 iter: 773 begin\n",
      "Train epoch:15 iter: 773 end\n",
      "Train epoch:15 iter: 774 begin\n",
      "Train epoch:15 iter: 774 end\n",
      "Train epoch:15 iter: 775 begin\n",
      "Train epoch:15 iter: 775 end\n",
      "Train epoch:15 iter: 776 begin\n",
      "Train epoch:15 iter: 776 end\n",
      "Train epoch:15 iter: 777 begin\n",
      "Train epoch:15 iter: 777 end\n",
      "Train epoch:15 iter: 778 begin\n",
      "Train epoch:15 iter: 778 end\n",
      "Train epoch:15 iter: 779 begin\n",
      "Train epoch:15 iter: 779 end\n",
      "Train epoch:15 iter: 780 begin\n",
      "Train epoch:15 iter: 780 end\n",
      "Train epoch:15 iter: 781 begin\n",
      "Train epoch:15 iter: 781 end\n",
      "Train epoch:15 iter: 782 begin\n",
      "Train epoch:15 iter: 782 end\n",
      "Train epoch:15 iter: 783 begin\n",
      "Train epoch:15 iter: 783 end\n",
      "Train epoch:15 iter: 784 begin\n",
      "Train epoch:15 iter: 784 end\n",
      "Train epoch:15 iter: 785 begin\n",
      "Train epoch:15 iter: 785 end\n",
      "Train epoch:15 iter: 786 begin\n",
      "Train epoch:15 iter: 786 end\n",
      "Train epoch:15 iter: 787 begin\n",
      "Train epoch:15 iter: 787 end\n",
      "Train epoch:15 iter: 788 begin\n",
      "Train epoch:15 iter: 788 end\n",
      "Train epoch:15 iter: 789 begin\n",
      "Train epoch:15 iter: 789 end\n",
      "Train epoch:15 iter: 790 begin\n",
      "Train epoch:15 iter: 790 end\n",
      "Train epoch:15 iter: 791 begin\n",
      "Train epoch:15 iter: 791 end\n",
      "Train epoch:15 iter: 792 begin\n",
      "Train epoch:15 iter: 792 end\n",
      "Train epoch:15 iter: 793 begin\n",
      "Train epoch:15 iter: 793 end\n",
      "Train epoch:15 iter: 794 begin\n",
      "Train epoch:15 iter: 794 end\n",
      "Train epoch:15 iter: 795 begin\n",
      "Train epoch:15 iter: 795 end\n",
      "Train epoch:15 iter: 796 begin\n",
      "Train epoch:15 iter: 796 end\n",
      "Train epoch:15 iter: 797 begin\n",
      "Train epoch:15 iter: 797 end\n",
      "Train epoch:15 iter: 798 begin\n",
      "Train epoch:15 iter: 798 end\n",
      "Train epoch:15 iter: 799 begin\n",
      "Train epoch:15 iter: 799 end\n",
      "Train epoch:15 iter: 800 begin\n",
      "Train epoch:15 iter: 800 end\n",
      "Train epoch:15 iter: 801 begin\n",
      "Train epoch:15 iter: 801 end\n",
      "Train epoch:15 iter: 802 begin\n",
      "Train epoch:15 iter: 802 end\n",
      "Train epoch:15 iter: 803 begin\n",
      "Train epoch:15 iter: 803 end\n",
      "Train epoch:15 iter: 804 begin\n",
      "Train epoch:15 iter: 804 end\n",
      "Train epoch:15 iter: 805 begin\n",
      "Train epoch:15 iter: 805 end\n",
      "Train epoch:15 iter: 806 begin\n",
      "Train epoch:15 iter: 806 end\n",
      "Train epoch:15 iter: 807 begin\n",
      "Train epoch:15 iter: 807 end\n",
      "Train epoch:15 iter: 808 begin\n",
      "Train epoch:15 iter: 808 end\n",
      "Train epoch:15 iter: 809 begin\n",
      "Train epoch:15 iter: 809 end\n",
      "Train epoch:15 iter: 810 begin\n",
      "Train epoch:15 iter: 810 end\n",
      "Train epoch:15 iter: 811 begin\n",
      "Train epoch:15 iter: 811 end\n",
      "Train epoch:15 iter: 812 begin\n",
      "Train epoch:15 iter: 812 end\n",
      "Train epoch:15 iter: 813 begin\n",
      "Train epoch:15 iter: 813 end\n",
      "Train epoch:15 iter: 814 begin\n",
      "Train epoch:15 iter: 814 end\n",
      "Train epoch:15 iter: 815 begin\n",
      "Train epoch:15 iter: 815 end\n",
      "Train epoch:15 iter: 816 begin\n",
      "Train epoch:15 iter: 816 end\n",
      "Train epoch:15 iter: 817 begin\n",
      "Train epoch:15 iter: 817 end\n",
      "Train epoch:15 iter: 818 begin\n",
      "Train epoch:15 iter: 818 end\n",
      "Train epoch:15 iter: 819 begin\n",
      "Train epoch:15 iter: 819 end\n",
      "Train epoch:15 iter: 820 begin\n",
      "Train epoch:15 iter: 820 end\n",
      "Train epoch:15 iter: 821 begin\n",
      "Train epoch:15 iter: 821 end\n",
      "Train epoch:15 iter: 822 begin\n",
      "Train epoch:15 iter: 822 end\n",
      "Train epoch:15 iter: 823 begin\n",
      "Train epoch:15 iter: 823 end\n",
      "Train epoch:15 iter: 824 begin\n",
      "Train epoch:15 iter: 824 end\n",
      "Train epoch:15 iter: 825 begin\n",
      "Train epoch:15 iter: 825 end\n",
      "Train epoch:15 iter: 826 begin\n",
      "Train epoch:15 iter: 826 end\n",
      "Train epoch:15 iter: 827 begin\n",
      "Train epoch:15 iter: 827 end\n",
      "Train epoch:15 iter: 828 begin\n",
      "Train epoch:15 iter: 828 end\n",
      "Train epoch:15 iter: 829 begin\n",
      "Train epoch:15 iter: 829 end\n",
      "Train epoch:15 iter: 830 begin\n",
      "Train epoch:15 iter: 830 end\n",
      "Train epoch:15 iter: 831 begin\n",
      "Train epoch:15 iter: 831 end\n",
      "Train epoch:15 iter: 832 begin\n",
      "Train epoch:15 iter: 832 end\n",
      "Train epoch:15 iter: 833 begin\n",
      "Train epoch:15 iter: 833 end\n",
      "Train epoch:15 iter: 834 begin\n",
      "Train epoch:15 iter: 834 end\n",
      "Train epoch:15 iter: 835 begin\n",
      "Train epoch:15 iter: 835 end\n",
      "Train epoch:15 iter: 836 begin\n",
      "Train epoch:15 iter: 836 end\n",
      "Train epoch:15 iter: 837 begin\n",
      "Train epoch:15 iter: 837 end\n",
      "Train epoch:15 iter: 838 begin\n",
      "Train epoch:15 iter: 838 end\n",
      "Train epoch:15 iter: 839 begin\n",
      "Train epoch:15 iter: 839 end\n",
      "Train epoch:15 iter: 840 begin\n",
      "Train epoch:15 iter: 840 end\n",
      "Train epoch:15 iter: 841 begin\n",
      "Train epoch:15 iter: 841 end\n",
      "Train epoch:15 iter: 842 begin\n",
      "Train epoch:15 iter: 842 end\n",
      "Train epoch:15 iter: 843 begin\n",
      "Train epoch:15 iter: 843 end\n",
      "Train epoch:15 iter: 844 begin\n",
      "Train epoch:15 iter: 844 end\n",
      "Train epoch:15 iter: 845 begin\n",
      "Train epoch:15 iter: 845 end\n",
      "Train epoch:15 iter: 846 begin\n",
      "Train epoch:15 iter: 846 end\n",
      "Train epoch:15 iter: 847 begin\n",
      "Train epoch:15 iter: 847 end\n",
      "Train epoch:15 iter: 848 begin\n",
      "Train epoch:15 iter: 848 end\n",
      "Train epoch:15 iter: 849 begin\n",
      "Train epoch:15 iter: 849 end\n",
      "Train epoch:15 iter: 850 begin\n",
      "Train epoch:15 iter: 850 end\n",
      "Train epoch:15 iter: 851 begin\n",
      "Train epoch:15 iter: 851 end\n",
      "Train epoch:15 iter: 852 begin\n",
      "Train epoch:15 iter: 852 end\n",
      "Train epoch:15 iter: 853 begin\n",
      "Train epoch:15 iter: 853 end\n",
      "Train epoch:15 iter: 854 begin\n",
      "Train epoch:15 iter: 854 end\n",
      "Train epoch:15 iter: 855 begin\n",
      "Train epoch:15 iter: 855 end\n",
      "Train epoch:15 iter: 856 begin\n",
      "Train epoch:15 iter: 856 end\n",
      "Train epoch:15 iter: 857 begin\n",
      "Train epoch:15 iter: 857 end\n",
      "Train epoch:15 iter: 858 begin\n",
      "Train epoch:15 iter: 858 end\n",
      "Train epoch:15 iter: 859 begin\n",
      "Train epoch:15 iter: 859 end\n",
      "Train epoch:15 iter: 860 begin\n",
      "Train epoch:15 iter: 860 end\n",
      "Train epoch:15 iter: 861 begin\n",
      "Train epoch:15 iter: 861 end\n",
      "Train epoch:15 iter: 862 begin\n",
      "Train epoch:15 iter: 862 end\n",
      "Train epoch:15 iter: 863 begin\n",
      "Train epoch:15 iter: 863 end\n",
      "Train epoch:15 iter: 864 begin\n",
      "Train epoch:15 iter: 864 end\n",
      "Train epoch:15 iter: 865 begin\n",
      "Train epoch:15 iter: 865 end\n",
      "Train epoch:15 iter: 866 begin\n",
      "Train epoch:15 iter: 866 end\n",
      "Train epoch:15 iter: 867 begin\n",
      "Train epoch:15 iter: 867 end\n",
      "Train epoch:15 iter: 868 begin\n",
      "Train epoch:15 iter: 868 end\n",
      "Train epoch:15 iter: 869 begin\n",
      "Train epoch:15 iter: 869 end\n",
      "Train epoch:15 iter: 870 begin\n",
      "Train epoch:15 iter: 870 end\n",
      "Train epoch:15 iter: 871 begin\n",
      "Train epoch:15 iter: 871 end\n",
      "Train epoch:15 iter: 872 begin\n",
      "Train epoch:15 iter: 872 end\n",
      "Train epoch:15 iter: 873 begin\n",
      "Train epoch:15 iter: 873 end\n",
      "Train epoch:15 iter: 874 begin\n",
      "Train epoch:15 iter: 874 end\n",
      "Train epoch:15 iter: 875 begin\n",
      "Train epoch:15 iter: 875 end\n",
      "Train epoch:15 iter: 876 begin\n",
      "Train epoch:15 iter: 876 end\n",
      "Train epoch:15 iter: 877 begin\n",
      "Train epoch:15 iter: 877 end\n",
      "Train epoch:15 iter: 878 begin\n",
      "Train epoch:15 iter: 878 end\n",
      "Train epoch:15 iter: 879 begin\n",
      "Train epoch:15 iter: 879 end\n",
      "Train epoch:15 iter: 880 begin\n",
      "Train epoch:15 iter: 880 end\n",
      "Train epoch:15 iter: 881 begin\n",
      "Train epoch:15 iter: 881 end\n",
      "Train epoch:15 iter: 882 begin\n",
      "Train epoch:15 iter: 882 end\n",
      "Train epoch:15 iter: 883 begin\n",
      "Train epoch:15 iter: 883 end\n",
      "Train epoch:15 iter: 884 begin\n",
      "Train epoch:15 iter: 884 end\n",
      "Train epoch:15 iter: 885 begin\n",
      "Train epoch:15 iter: 885 end\n",
      "Train epoch:15 iter: 886 begin\n",
      "Train epoch:15 iter: 886 end\n",
      "Train epoch:15 iter: 887 begin\n",
      "Train epoch:15 iter: 887 end\n",
      "Train epoch:15 iter: 888 begin\n",
      "Train epoch:15 iter: 888 end\n",
      "Train epoch:15 iter: 889 begin\n",
      "Train epoch:15 iter: 889 end\n",
      "Train epoch:15 iter: 890 begin\n",
      "Train epoch:15 iter: 890 end\n",
      "Train epoch:15 iter: 891 begin\n",
      "Train epoch:15 iter: 891 end\n",
      "Train epoch:15 iter: 892 begin\n",
      "Train epoch:15 iter: 892 end\n",
      "Train epoch:15 iter: 893 begin\n",
      "Train epoch:15 iter: 893 end\n",
      "Train epoch:15 iter: 894 begin\n",
      "Train epoch:15 iter: 894 end\n",
      "Train epoch:15 iter: 895 begin\n",
      "Train epoch:15 iter: 895 end\n",
      "Train epoch:15 iter: 896 begin\n",
      "Train epoch:15 iter: 896 end\n",
      "Train epoch:15 iter: 897 begin\n",
      "Train epoch:15 iter: 897 end\n",
      "Train epoch:15 iter: 898 begin\n",
      "Train epoch:15 iter: 898 end\n",
      "Train epoch:15 iter: 899 begin\n",
      "Train epoch:15 iter: 899 end\n",
      "Train epoch:15 iter: 900 begin\n",
      "Train epoch:15 iter: 900 end\n",
      "Train epoch:15 iter: 901 begin\n",
      "Train epoch:15 iter: 901 end\n",
      "Train epoch:15 iter: 902 begin\n",
      "Train epoch:15 iter: 902 end\n",
      "Train epoch:15 iter: 903 begin\n",
      "Train epoch:15 iter: 903 end\n",
      "Train epoch:15 iter: 904 begin\n",
      "Train epoch:15 iter: 904 end\n",
      "Train epoch:15 iter: 905 begin\n",
      "Train epoch:15 iter: 905 end\n",
      "Train epoch:15 iter: 906 begin\n",
      "Train epoch:15 iter: 906 end\n",
      "Train epoch:15 iter: 907 begin\n",
      "Train epoch:15 iter: 907 end\n",
      "Train epoch:15 iter: 908 begin\n",
      "Train epoch:15 iter: 908 end\n",
      "Train epoch:15 iter: 909 begin\n",
      "Train epoch:15 iter: 909 end\n",
      "Train epoch:15 iter: 910 begin\n",
      "Train epoch:15 iter: 910 end\n",
      "Train epoch:15 iter: 911 begin\n",
      "Train epoch:15 iter: 911 end\n",
      "Train epoch:15 iter: 912 begin\n",
      "Train epoch:15 iter: 912 end\n",
      "Train epoch:15 iter: 913 begin\n",
      "Train epoch:15 iter: 913 end\n",
      "Train epoch:15 iter: 914 begin\n",
      "Train epoch:15 iter: 914 end\n",
      "Train epoch:15 iter: 915 begin\n",
      "Train epoch:15 iter: 915 end\n",
      "Train epoch:15 iter: 916 begin\n",
      "Train epoch:15 iter: 916 end\n",
      "Train epoch:15 iter: 917 begin\n",
      "Train epoch:15 iter: 917 end\n",
      "Train epoch:15 iter: 918 begin\n",
      "Train epoch:15 iter: 918 end\n",
      "Train epoch:15 iter: 919 begin\n",
      "Train epoch:15 iter: 919 end\n",
      "Train epoch:15 iter: 920 begin\n",
      "Train epoch:15 iter: 920 end\n",
      "Train epoch:15 iter: 921 begin\n",
      "Train epoch:15 iter: 921 end\n",
      "Train epoch:15 iter: 922 begin\n",
      "Train epoch:15 iter: 922 end\n",
      "Train epoch:15 iter: 923 begin\n",
      "Train epoch:15 iter: 923 end\n",
      "Train epoch:15 iter: 924 begin\n",
      "Train epoch:15 iter: 924 end\n",
      "Train epoch:15 iter: 925 begin\n",
      "Train epoch:15 iter: 925 end\n",
      "Train epoch:15 iter: 926 begin\n",
      "Train epoch:15 iter: 926 end\n",
      "Train epoch:15 iter: 927 begin\n",
      "Train epoch:15 iter: 927 end\n",
      "Train epoch:15 iter: 928 begin\n",
      "Train epoch:15 iter: 928 end\n",
      "Train epoch:15 iter: 929 begin\n",
      "Train epoch:15 iter: 929 end\n",
      "Train epoch:15 iter: 930 begin\n",
      "Train epoch:15 iter: 930 end\n",
      "Train epoch:15 iter: 931 begin\n",
      "Train epoch:15 iter: 931 end\n",
      "Train epoch:15 iter: 932 begin\n",
      "Train epoch:15 iter: 932 end\n",
      "Train epoch:15 iter: 933 begin\n",
      "Train epoch:15 iter: 933 end\n",
      "Train epoch:15 iter: 934 begin\n",
      "Train epoch:15 iter: 934 end\n",
      "Train epoch:15 iter: 935 begin\n",
      "Train epoch:15 iter: 935 end\n",
      "Train epoch:15 iter: 936 begin\n",
      "Train epoch:15 iter: 936 end\n",
      "Train epoch:15 iter: 937 begin\n",
      "Train epoch:15 iter: 937 end\n",
      "Train epoch:15 iter: 938 begin\n",
      "Train epoch:15 iter: 938 end\n",
      "Train Loss: 0.001138, Acc: 0.972133\n",
      "save model for best accuate: 0.9721333333333333 begin\n",
      "save model for best accuate: 0.9721333333333333 end\n",
      "epoch 17\n",
      "Train epoch:16 iter: 1 begin\n",
      "Train epoch:16 iter: 1 end\n",
      "Train epoch:16 iter: 2 begin\n",
      "Train epoch:16 iter: 2 end\n",
      "Train epoch:16 iter: 3 begin\n",
      "Train epoch:16 iter: 3 end\n",
      "Train epoch:16 iter: 4 begin\n",
      "Train epoch:16 iter: 4 end\n",
      "Train epoch:16 iter: 5 begin\n",
      "Train epoch:16 iter: 5 end\n",
      "Train epoch:16 iter: 6 begin\n",
      "Train epoch:16 iter: 6 end\n",
      "Train epoch:16 iter: 7 begin\n",
      "Train epoch:16 iter: 7 end\n",
      "Train epoch:16 iter: 8 begin\n",
      "Train epoch:16 iter: 8 end\n",
      "Train epoch:16 iter: 9 begin\n",
      "Train epoch:16 iter: 9 end\n",
      "Train epoch:16 iter: 10 begin\n",
      "Train epoch:16 iter: 10 end\n",
      "Train epoch:16 iter: 11 begin\n",
      "Train epoch:16 iter: 11 end\n",
      "Train epoch:16 iter: 12 begin\n",
      "Train epoch:16 iter: 12 end\n",
      "Train epoch:16 iter: 13 begin\n",
      "Train epoch:16 iter: 13 end\n",
      "Train epoch:16 iter: 14 begin\n",
      "Train epoch:16 iter: 14 end\n",
      "Train epoch:16 iter: 15 begin\n",
      "Train epoch:16 iter: 15 end\n",
      "Train epoch:16 iter: 16 begin\n",
      "Train epoch:16 iter: 16 end\n",
      "Train epoch:16 iter: 17 begin\n",
      "Train epoch:16 iter: 17 end\n",
      "Train epoch:16 iter: 18 begin\n",
      "Train epoch:16 iter: 18 end\n",
      "Train epoch:16 iter: 19 begin\n",
      "Train epoch:16 iter: 19 end\n",
      "Train epoch:16 iter: 20 begin\n",
      "Train epoch:16 iter: 20 end\n",
      "Train epoch:16 iter: 21 begin\n",
      "Train epoch:16 iter: 21 end\n",
      "Train epoch:16 iter: 22 begin\n",
      "Train epoch:16 iter: 22 end\n",
      "Train epoch:16 iter: 23 begin\n",
      "Train epoch:16 iter: 23 end\n",
      "Train epoch:16 iter: 24 begin\n",
      "Train epoch:16 iter: 24 end\n",
      "Train epoch:16 iter: 25 begin\n",
      "Train epoch:16 iter: 25 end\n",
      "Train epoch:16 iter: 26 begin\n",
      "Train epoch:16 iter: 26 end\n",
      "Train epoch:16 iter: 27 begin\n",
      "Train epoch:16 iter: 27 end\n",
      "Train epoch:16 iter: 28 begin\n",
      "Train epoch:16 iter: 28 end\n",
      "Train epoch:16 iter: 29 begin\n",
      "Train epoch:16 iter: 29 end\n",
      "Train epoch:16 iter: 30 begin\n",
      "Train epoch:16 iter: 30 end\n",
      "Train epoch:16 iter: 31 begin\n",
      "Train epoch:16 iter: 31 end\n",
      "Train epoch:16 iter: 32 begin\n",
      "Train epoch:16 iter: 32 end\n",
      "Train epoch:16 iter: 33 begin\n",
      "Train epoch:16 iter: 33 end\n",
      "Train epoch:16 iter: 34 begin\n",
      "Train epoch:16 iter: 34 end\n",
      "Train epoch:16 iter: 35 begin\n",
      "Train epoch:16 iter: 35 end\n",
      "Train epoch:16 iter: 36 begin\n",
      "Train epoch:16 iter: 36 end\n",
      "Train epoch:16 iter: 37 begin\n",
      "Train epoch:16 iter: 37 end\n",
      "Train epoch:16 iter: 38 begin\n",
      "Train epoch:16 iter: 38 end\n",
      "Train epoch:16 iter: 39 begin\n",
      "Train epoch:16 iter: 39 end\n",
      "Train epoch:16 iter: 40 begin\n",
      "Train epoch:16 iter: 40 end\n",
      "Train epoch:16 iter: 41 begin\n",
      "Train epoch:16 iter: 41 end\n",
      "Train epoch:16 iter: 42 begin\n",
      "Train epoch:16 iter: 42 end\n",
      "Train epoch:16 iter: 43 begin\n",
      "Train epoch:16 iter: 43 end\n",
      "Train epoch:16 iter: 44 begin\n",
      "Train epoch:16 iter: 44 end\n",
      "Train epoch:16 iter: 45 begin\n",
      "Train epoch:16 iter: 45 end\n",
      "Train epoch:16 iter: 46 begin\n",
      "Train epoch:16 iter: 46 end\n",
      "Train epoch:16 iter: 47 begin\n",
      "Train epoch:16 iter: 47 end\n",
      "Train epoch:16 iter: 48 begin\n",
      "Train epoch:16 iter: 48 end\n",
      "Train epoch:16 iter: 49 begin\n",
      "Train epoch:16 iter: 49 end\n",
      "Train epoch:16 iter: 50 begin\n",
      "Train epoch:16 iter: 50 end\n",
      "Train epoch:16 iter: 51 begin\n",
      "Train epoch:16 iter: 51 end\n",
      "Train epoch:16 iter: 52 begin\n",
      "Train epoch:16 iter: 52 end\n",
      "Train epoch:16 iter: 53 begin\n",
      "Train epoch:16 iter: 53 end\n",
      "Train epoch:16 iter: 54 begin\n",
      "Train epoch:16 iter: 54 end\n",
      "Train epoch:16 iter: 55 begin\n",
      "Train epoch:16 iter: 55 end\n",
      "Train epoch:16 iter: 56 begin\n",
      "Train epoch:16 iter: 56 end\n",
      "Train epoch:16 iter: 57 begin\n",
      "Train epoch:16 iter: 57 end\n",
      "Train epoch:16 iter: 58 begin\n",
      "Train epoch:16 iter: 58 end\n",
      "Train epoch:16 iter: 59 begin\n",
      "Train epoch:16 iter: 59 end\n",
      "Train epoch:16 iter: 60 begin\n",
      "Train epoch:16 iter: 60 end\n",
      "Train epoch:16 iter: 61 begin\n",
      "Train epoch:16 iter: 61 end\n",
      "Train epoch:16 iter: 62 begin\n",
      "Train epoch:16 iter: 62 end\n",
      "Train epoch:16 iter: 63 begin\n",
      "Train epoch:16 iter: 63 end\n",
      "Train epoch:16 iter: 64 begin\n",
      "Train epoch:16 iter: 64 end\n",
      "Train epoch:16 iter: 65 begin\n",
      "Train epoch:16 iter: 65 end\n",
      "Train epoch:16 iter: 66 begin\n",
      "Train epoch:16 iter: 66 end\n",
      "Train epoch:16 iter: 67 begin\n",
      "Train epoch:16 iter: 67 end\n",
      "Train epoch:16 iter: 68 begin\n",
      "Train epoch:16 iter: 68 end\n",
      "Train epoch:16 iter: 69 begin\n",
      "Train epoch:16 iter: 69 end\n",
      "Train epoch:16 iter: 70 begin\n",
      "Train epoch:16 iter: 70 end\n",
      "Train epoch:16 iter: 71 begin\n",
      "Train epoch:16 iter: 71 end\n",
      "Train epoch:16 iter: 72 begin\n",
      "Train epoch:16 iter: 72 end\n",
      "Train epoch:16 iter: 73 begin\n",
      "Train epoch:16 iter: 73 end\n",
      "Train epoch:16 iter: 74 begin\n",
      "Train epoch:16 iter: 74 end\n",
      "Train epoch:16 iter: 75 begin\n",
      "Train epoch:16 iter: 75 end\n",
      "Train epoch:16 iter: 76 begin\n",
      "Train epoch:16 iter: 76 end\n",
      "Train epoch:16 iter: 77 begin\n",
      "Train epoch:16 iter: 77 end\n",
      "Train epoch:16 iter: 78 begin\n",
      "Train epoch:16 iter: 78 end\n",
      "Train epoch:16 iter: 79 begin\n",
      "Train epoch:16 iter: 79 end\n",
      "Train epoch:16 iter: 80 begin\n",
      "Train epoch:16 iter: 80 end\n",
      "Train epoch:16 iter: 81 begin\n",
      "Train epoch:16 iter: 81 end\n",
      "Train epoch:16 iter: 82 begin\n",
      "Train epoch:16 iter: 82 end\n",
      "Train epoch:16 iter: 83 begin\n",
      "Train epoch:16 iter: 83 end\n",
      "Train epoch:16 iter: 84 begin\n",
      "Train epoch:16 iter: 84 end\n",
      "Train epoch:16 iter: 85 begin\n",
      "Train epoch:16 iter: 85 end\n",
      "Train epoch:16 iter: 86 begin\n",
      "Train epoch:16 iter: 86 end\n",
      "Train epoch:16 iter: 87 begin\n",
      "Train epoch:16 iter: 87 end\n",
      "Train epoch:16 iter: 88 begin\n",
      "Train epoch:16 iter: 88 end\n",
      "Train epoch:16 iter: 89 begin\n",
      "Train epoch:16 iter: 89 end\n",
      "Train epoch:16 iter: 90 begin\n",
      "Train epoch:16 iter: 90 end\n",
      "Train epoch:16 iter: 91 begin\n",
      "Train epoch:16 iter: 91 end\n",
      "Train epoch:16 iter: 92 begin\n",
      "Train epoch:16 iter: 92 end\n",
      "Train epoch:16 iter: 93 begin\n",
      "Train epoch:16 iter: 93 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:16 iter: 94 begin\n",
      "Train epoch:16 iter: 94 end\n",
      "Train epoch:16 iter: 95 begin\n",
      "Train epoch:16 iter: 95 end\n",
      "Train epoch:16 iter: 96 begin\n",
      "Train epoch:16 iter: 96 end\n",
      "Train epoch:16 iter: 97 begin\n",
      "Train epoch:16 iter: 97 end\n",
      "Train epoch:16 iter: 98 begin\n",
      "Train epoch:16 iter: 98 end\n",
      "Train epoch:16 iter: 99 begin\n",
      "Train epoch:16 iter: 99 end\n",
      "Train epoch:16 iter: 100 begin\n",
      "Train epoch:16 iter: 100 end\n",
      "Train epoch:16 iter: 101 begin\n",
      "Train epoch:16 iter: 101 end\n",
      "Train epoch:16 iter: 102 begin\n",
      "Train epoch:16 iter: 102 end\n",
      "Train epoch:16 iter: 103 begin\n",
      "Train epoch:16 iter: 103 end\n",
      "Train epoch:16 iter: 104 begin\n",
      "Train epoch:16 iter: 104 end\n",
      "Train epoch:16 iter: 105 begin\n",
      "Train epoch:16 iter: 105 end\n",
      "Train epoch:16 iter: 106 begin\n",
      "Train epoch:16 iter: 106 end\n",
      "Train epoch:16 iter: 107 begin\n",
      "Train epoch:16 iter: 107 end\n",
      "Train epoch:16 iter: 108 begin\n",
      "Train epoch:16 iter: 108 end\n",
      "Train epoch:16 iter: 109 begin\n",
      "Train epoch:16 iter: 109 end\n",
      "Train epoch:16 iter: 110 begin\n",
      "Train epoch:16 iter: 110 end\n",
      "Train epoch:16 iter: 111 begin\n",
      "Train epoch:16 iter: 111 end\n",
      "Train epoch:16 iter: 112 begin\n",
      "Train epoch:16 iter: 112 end\n",
      "Train epoch:16 iter: 113 begin\n",
      "Train epoch:16 iter: 113 end\n",
      "Train epoch:16 iter: 114 begin\n",
      "Train epoch:16 iter: 114 end\n",
      "Train epoch:16 iter: 115 begin\n",
      "Train epoch:16 iter: 115 end\n",
      "Train epoch:16 iter: 116 begin\n",
      "Train epoch:16 iter: 116 end\n",
      "Train epoch:16 iter: 117 begin\n",
      "Train epoch:16 iter: 117 end\n",
      "Train epoch:16 iter: 118 begin\n",
      "Train epoch:16 iter: 118 end\n",
      "Train epoch:16 iter: 119 begin\n",
      "Train epoch:16 iter: 119 end\n",
      "Train epoch:16 iter: 120 begin\n",
      "Train epoch:16 iter: 120 end\n",
      "Train epoch:16 iter: 121 begin\n",
      "Train epoch:16 iter: 121 end\n",
      "Train epoch:16 iter: 122 begin\n",
      "Train epoch:16 iter: 122 end\n",
      "Train epoch:16 iter: 123 begin\n",
      "Train epoch:16 iter: 123 end\n",
      "Train epoch:16 iter: 124 begin\n",
      "Train epoch:16 iter: 124 end\n",
      "Train epoch:16 iter: 125 begin\n",
      "Train epoch:16 iter: 125 end\n",
      "Train epoch:16 iter: 126 begin\n",
      "Train epoch:16 iter: 126 end\n",
      "Train epoch:16 iter: 127 begin\n",
      "Train epoch:16 iter: 127 end\n",
      "Train epoch:16 iter: 128 begin\n",
      "Train epoch:16 iter: 128 end\n",
      "Train epoch:16 iter: 129 begin\n",
      "Train epoch:16 iter: 129 end\n",
      "Train epoch:16 iter: 130 begin\n",
      "Train epoch:16 iter: 130 end\n",
      "Train epoch:16 iter: 131 begin\n",
      "Train epoch:16 iter: 131 end\n",
      "Train epoch:16 iter: 132 begin\n",
      "Train epoch:16 iter: 132 end\n",
      "Train epoch:16 iter: 133 begin\n",
      "Train epoch:16 iter: 133 end\n",
      "Train epoch:16 iter: 134 begin\n",
      "Train epoch:16 iter: 134 end\n",
      "Train epoch:16 iter: 135 begin\n",
      "Train epoch:16 iter: 135 end\n",
      "Train epoch:16 iter: 136 begin\n",
      "Train epoch:16 iter: 136 end\n",
      "Train epoch:16 iter: 137 begin\n",
      "Train epoch:16 iter: 137 end\n",
      "Train epoch:16 iter: 138 begin\n",
      "Train epoch:16 iter: 138 end\n",
      "Train epoch:16 iter: 139 begin\n",
      "Train epoch:16 iter: 139 end\n",
      "Train epoch:16 iter: 140 begin\n",
      "Train epoch:16 iter: 140 end\n",
      "Train epoch:16 iter: 141 begin\n",
      "Train epoch:16 iter: 141 end\n",
      "Train epoch:16 iter: 142 begin\n",
      "Train epoch:16 iter: 142 end\n",
      "Train epoch:16 iter: 143 begin\n",
      "Train epoch:16 iter: 143 end\n",
      "Train epoch:16 iter: 144 begin\n",
      "Train epoch:16 iter: 144 end\n",
      "Train epoch:16 iter: 145 begin\n",
      "Train epoch:16 iter: 145 end\n",
      "Train epoch:16 iter: 146 begin\n",
      "Train epoch:16 iter: 146 end\n",
      "Train epoch:16 iter: 147 begin\n",
      "Train epoch:16 iter: 147 end\n",
      "Train epoch:16 iter: 148 begin\n",
      "Train epoch:16 iter: 148 end\n",
      "Train epoch:16 iter: 149 begin\n",
      "Train epoch:16 iter: 149 end\n",
      "Train epoch:16 iter: 150 begin\n",
      "Train epoch:16 iter: 150 end\n",
      "Train epoch:16 iter: 151 begin\n",
      "Train epoch:16 iter: 151 end\n",
      "Train epoch:16 iter: 152 begin\n",
      "Train epoch:16 iter: 152 end\n",
      "Train epoch:16 iter: 153 begin\n",
      "Train epoch:16 iter: 153 end\n",
      "Train epoch:16 iter: 154 begin\n",
      "Train epoch:16 iter: 154 end\n",
      "Train epoch:16 iter: 155 begin\n",
      "Train epoch:16 iter: 155 end\n",
      "Train epoch:16 iter: 156 begin\n",
      "Train epoch:16 iter: 156 end\n",
      "Train epoch:16 iter: 157 begin\n",
      "Train epoch:16 iter: 157 end\n",
      "Train epoch:16 iter: 158 begin\n",
      "Train epoch:16 iter: 158 end\n",
      "Train epoch:16 iter: 159 begin\n",
      "Train epoch:16 iter: 159 end\n",
      "Train epoch:16 iter: 160 begin\n",
      "Train epoch:16 iter: 160 end\n",
      "Train epoch:16 iter: 161 begin\n",
      "Train epoch:16 iter: 161 end\n",
      "Train epoch:16 iter: 162 begin\n",
      "Train epoch:16 iter: 162 end\n",
      "Train epoch:16 iter: 163 begin\n",
      "Train epoch:16 iter: 163 end\n",
      "Train epoch:16 iter: 164 begin\n",
      "Train epoch:16 iter: 164 end\n",
      "Train epoch:16 iter: 165 begin\n",
      "Train epoch:16 iter: 165 end\n",
      "Train epoch:16 iter: 166 begin\n",
      "Train epoch:16 iter: 166 end\n",
      "Train epoch:16 iter: 167 begin\n",
      "Train epoch:16 iter: 167 end\n",
      "Train epoch:16 iter: 168 begin\n",
      "Train epoch:16 iter: 168 end\n",
      "Train epoch:16 iter: 169 begin\n",
      "Train epoch:16 iter: 169 end\n",
      "Train epoch:16 iter: 170 begin\n",
      "Train epoch:16 iter: 170 end\n",
      "Train epoch:16 iter: 171 begin\n",
      "Train epoch:16 iter: 171 end\n",
      "Train epoch:16 iter: 172 begin\n",
      "Train epoch:16 iter: 172 end\n",
      "Train epoch:16 iter: 173 begin\n",
      "Train epoch:16 iter: 173 end\n",
      "Train epoch:16 iter: 174 begin\n",
      "Train epoch:16 iter: 174 end\n",
      "Train epoch:16 iter: 175 begin\n",
      "Train epoch:16 iter: 175 end\n",
      "Train epoch:16 iter: 176 begin\n",
      "Train epoch:16 iter: 176 end\n",
      "Train epoch:16 iter: 177 begin\n",
      "Train epoch:16 iter: 177 end\n",
      "Train epoch:16 iter: 178 begin\n",
      "Train epoch:16 iter: 178 end\n",
      "Train epoch:16 iter: 179 begin\n",
      "Train epoch:16 iter: 179 end\n",
      "Train epoch:16 iter: 180 begin\n",
      "Train epoch:16 iter: 180 end\n",
      "Train epoch:16 iter: 181 begin\n",
      "Train epoch:16 iter: 181 end\n",
      "Train epoch:16 iter: 182 begin\n",
      "Train epoch:16 iter: 182 end\n",
      "Train epoch:16 iter: 183 begin\n",
      "Train epoch:16 iter: 183 end\n",
      "Train epoch:16 iter: 184 begin\n",
      "Train epoch:16 iter: 184 end\n",
      "Train epoch:16 iter: 185 begin\n",
      "Train epoch:16 iter: 185 end\n",
      "Train epoch:16 iter: 186 begin\n",
      "Train epoch:16 iter: 186 end\n",
      "Train epoch:16 iter: 187 begin\n",
      "Train epoch:16 iter: 187 end\n",
      "Train epoch:16 iter: 188 begin\n",
      "Train epoch:16 iter: 188 end\n",
      "Train epoch:16 iter: 189 begin\n",
      "Train epoch:16 iter: 189 end\n",
      "Train epoch:16 iter: 190 begin\n",
      "Train epoch:16 iter: 190 end\n",
      "Train epoch:16 iter: 191 begin\n",
      "Train epoch:16 iter: 191 end\n",
      "Train epoch:16 iter: 192 begin\n",
      "Train epoch:16 iter: 192 end\n",
      "Train epoch:16 iter: 193 begin\n",
      "Train epoch:16 iter: 193 end\n",
      "Train epoch:16 iter: 194 begin\n",
      "Train epoch:16 iter: 194 end\n",
      "Train epoch:16 iter: 195 begin\n",
      "Train epoch:16 iter: 195 end\n",
      "Train epoch:16 iter: 196 begin\n",
      "Train epoch:16 iter: 196 end\n",
      "Train epoch:16 iter: 197 begin\n",
      "Train epoch:16 iter: 197 end\n",
      "Train epoch:16 iter: 198 begin\n",
      "Train epoch:16 iter: 198 end\n",
      "Train epoch:16 iter: 199 begin\n",
      "Train epoch:16 iter: 199 end\n",
      "Train epoch:16 iter: 200 begin\n",
      "Train epoch:16 iter: 200 end\n",
      "Train epoch:16 iter: 201 begin\n",
      "Train epoch:16 iter: 201 end\n",
      "Train epoch:16 iter: 202 begin\n",
      "Train epoch:16 iter: 202 end\n",
      "Train epoch:16 iter: 203 begin\n",
      "Train epoch:16 iter: 203 end\n",
      "Train epoch:16 iter: 204 begin\n",
      "Train epoch:16 iter: 204 end\n",
      "Train epoch:16 iter: 205 begin\n",
      "Train epoch:16 iter: 205 end\n",
      "Train epoch:16 iter: 206 begin\n",
      "Train epoch:16 iter: 206 end\n",
      "Train epoch:16 iter: 207 begin\n",
      "Train epoch:16 iter: 207 end\n",
      "Train epoch:16 iter: 208 begin\n",
      "Train epoch:16 iter: 208 end\n",
      "Train epoch:16 iter: 209 begin\n",
      "Train epoch:16 iter: 209 end\n",
      "Train epoch:16 iter: 210 begin\n",
      "Train epoch:16 iter: 210 end\n",
      "Train epoch:16 iter: 211 begin\n",
      "Train epoch:16 iter: 211 end\n",
      "Train epoch:16 iter: 212 begin\n",
      "Train epoch:16 iter: 212 end\n",
      "Train epoch:16 iter: 213 begin\n",
      "Train epoch:16 iter: 213 end\n",
      "Train epoch:16 iter: 214 begin\n",
      "Train epoch:16 iter: 214 end\n",
      "Train epoch:16 iter: 215 begin\n",
      "Train epoch:16 iter: 215 end\n",
      "Train epoch:16 iter: 216 begin\n",
      "Train epoch:16 iter: 216 end\n",
      "Train epoch:16 iter: 217 begin\n",
      "Train epoch:16 iter: 217 end\n",
      "Train epoch:16 iter: 218 begin\n",
      "Train epoch:16 iter: 218 end\n",
      "Train epoch:16 iter: 219 begin\n",
      "Train epoch:16 iter: 219 end\n",
      "Train epoch:16 iter: 220 begin\n",
      "Train epoch:16 iter: 220 end\n",
      "Train epoch:16 iter: 221 begin\n",
      "Train epoch:16 iter: 221 end\n",
      "Train epoch:16 iter: 222 begin\n",
      "Train epoch:16 iter: 222 end\n",
      "Train epoch:16 iter: 223 begin\n",
      "Train epoch:16 iter: 223 end\n",
      "Train epoch:16 iter: 224 begin\n",
      "Train epoch:16 iter: 224 end\n",
      "Train epoch:16 iter: 225 begin\n",
      "Train epoch:16 iter: 225 end\n",
      "Train epoch:16 iter: 226 begin\n",
      "Train epoch:16 iter: 226 end\n",
      "Train epoch:16 iter: 227 begin\n",
      "Train epoch:16 iter: 227 end\n",
      "Train epoch:16 iter: 228 begin\n",
      "Train epoch:16 iter: 228 end\n",
      "Train epoch:16 iter: 229 begin\n",
      "Train epoch:16 iter: 229 end\n",
      "Train epoch:16 iter: 230 begin\n",
      "Train epoch:16 iter: 230 end\n",
      "Train epoch:16 iter: 231 begin\n",
      "Train epoch:16 iter: 231 end\n",
      "Train epoch:16 iter: 232 begin\n",
      "Train epoch:16 iter: 232 end\n",
      "Train epoch:16 iter: 233 begin\n",
      "Train epoch:16 iter: 233 end\n",
      "Train epoch:16 iter: 234 begin\n",
      "Train epoch:16 iter: 234 end\n",
      "Train epoch:16 iter: 235 begin\n",
      "Train epoch:16 iter: 235 end\n",
      "Train epoch:16 iter: 236 begin\n",
      "Train epoch:16 iter: 236 end\n",
      "Train epoch:16 iter: 237 begin\n",
      "Train epoch:16 iter: 237 end\n",
      "Train epoch:16 iter: 238 begin\n",
      "Train epoch:16 iter: 238 end\n",
      "Train epoch:16 iter: 239 begin\n",
      "Train epoch:16 iter: 239 end\n",
      "Train epoch:16 iter: 240 begin\n",
      "Train epoch:16 iter: 240 end\n",
      "Train epoch:16 iter: 241 begin\n",
      "Train epoch:16 iter: 241 end\n",
      "Train epoch:16 iter: 242 begin\n",
      "Train epoch:16 iter: 242 end\n",
      "Train epoch:16 iter: 243 begin\n",
      "Train epoch:16 iter: 243 end\n",
      "Train epoch:16 iter: 244 begin\n",
      "Train epoch:16 iter: 244 end\n",
      "Train epoch:16 iter: 245 begin\n",
      "Train epoch:16 iter: 245 end\n",
      "Train epoch:16 iter: 246 begin\n",
      "Train epoch:16 iter: 246 end\n",
      "Train epoch:16 iter: 247 begin\n",
      "Train epoch:16 iter: 247 end\n",
      "Train epoch:16 iter: 248 begin\n",
      "Train epoch:16 iter: 248 end\n",
      "Train epoch:16 iter: 249 begin\n",
      "Train epoch:16 iter: 249 end\n",
      "Train epoch:16 iter: 250 begin\n",
      "Train epoch:16 iter: 250 end\n",
      "Train epoch:16 iter: 251 begin\n",
      "Train epoch:16 iter: 251 end\n",
      "Train epoch:16 iter: 252 begin\n",
      "Train epoch:16 iter: 252 end\n",
      "Train epoch:16 iter: 253 begin\n",
      "Train epoch:16 iter: 253 end\n",
      "Train epoch:16 iter: 254 begin\n",
      "Train epoch:16 iter: 254 end\n",
      "Train epoch:16 iter: 255 begin\n",
      "Train epoch:16 iter: 255 end\n",
      "Train epoch:16 iter: 256 begin\n",
      "Train epoch:16 iter: 256 end\n",
      "Train epoch:16 iter: 257 begin\n",
      "Train epoch:16 iter: 257 end\n",
      "Train epoch:16 iter: 258 begin\n",
      "Train epoch:16 iter: 258 end\n",
      "Train epoch:16 iter: 259 begin\n",
      "Train epoch:16 iter: 259 end\n",
      "Train epoch:16 iter: 260 begin\n",
      "Train epoch:16 iter: 260 end\n",
      "Train epoch:16 iter: 261 begin\n",
      "Train epoch:16 iter: 261 end\n",
      "Train epoch:16 iter: 262 begin\n",
      "Train epoch:16 iter: 262 end\n",
      "Train epoch:16 iter: 263 begin\n",
      "Train epoch:16 iter: 263 end\n",
      "Train epoch:16 iter: 264 begin\n",
      "Train epoch:16 iter: 264 end\n",
      "Train epoch:16 iter: 265 begin\n",
      "Train epoch:16 iter: 265 end\n",
      "Train epoch:16 iter: 266 begin\n",
      "Train epoch:16 iter: 266 end\n",
      "Train epoch:16 iter: 267 begin\n",
      "Train epoch:16 iter: 267 end\n",
      "Train epoch:16 iter: 268 begin\n",
      "Train epoch:16 iter: 268 end\n",
      "Train epoch:16 iter: 269 begin\n",
      "Train epoch:16 iter: 269 end\n",
      "Train epoch:16 iter: 270 begin\n",
      "Train epoch:16 iter: 270 end\n",
      "Train epoch:16 iter: 271 begin\n",
      "Train epoch:16 iter: 271 end\n",
      "Train epoch:16 iter: 272 begin\n",
      "Train epoch:16 iter: 272 end\n",
      "Train epoch:16 iter: 273 begin\n",
      "Train epoch:16 iter: 273 end\n",
      "Train epoch:16 iter: 274 begin\n",
      "Train epoch:16 iter: 274 end\n",
      "Train epoch:16 iter: 275 begin\n",
      "Train epoch:16 iter: 275 end\n",
      "Train epoch:16 iter: 276 begin\n",
      "Train epoch:16 iter: 276 end\n",
      "Train epoch:16 iter: 277 begin\n",
      "Train epoch:16 iter: 277 end\n",
      "Train epoch:16 iter: 278 begin\n",
      "Train epoch:16 iter: 278 end\n",
      "Train epoch:16 iter: 279 begin\n",
      "Train epoch:16 iter: 279 end\n",
      "Train epoch:16 iter: 280 begin\n",
      "Train epoch:16 iter: 280 end\n",
      "Train epoch:16 iter: 281 begin\n",
      "Train epoch:16 iter: 281 end\n",
      "Train epoch:16 iter: 282 begin\n",
      "Train epoch:16 iter: 282 end\n",
      "Train epoch:16 iter: 283 begin\n",
      "Train epoch:16 iter: 283 end\n",
      "Train epoch:16 iter: 284 begin\n",
      "Train epoch:16 iter: 284 end\n",
      "Train epoch:16 iter: 285 begin\n",
      "Train epoch:16 iter: 285 end\n",
      "Train epoch:16 iter: 286 begin\n",
      "Train epoch:16 iter: 286 end\n",
      "Train epoch:16 iter: 287 begin\n",
      "Train epoch:16 iter: 287 end\n",
      "Train epoch:16 iter: 288 begin\n",
      "Train epoch:16 iter: 288 end\n",
      "Train epoch:16 iter: 289 begin\n",
      "Train epoch:16 iter: 289 end\n",
      "Train epoch:16 iter: 290 begin\n",
      "Train epoch:16 iter: 290 end\n",
      "Train epoch:16 iter: 291 begin\n",
      "Train epoch:16 iter: 291 end\n",
      "Train epoch:16 iter: 292 begin\n",
      "Train epoch:16 iter: 292 end\n",
      "Train epoch:16 iter: 293 begin\n",
      "Train epoch:16 iter: 293 end\n",
      "Train epoch:16 iter: 294 begin\n",
      "Train epoch:16 iter: 294 end\n",
      "Train epoch:16 iter: 295 begin\n",
      "Train epoch:16 iter: 295 end\n",
      "Train epoch:16 iter: 296 begin\n",
      "Train epoch:16 iter: 296 end\n",
      "Train epoch:16 iter: 297 begin\n",
      "Train epoch:16 iter: 297 end\n",
      "Train epoch:16 iter: 298 begin\n",
      "Train epoch:16 iter: 298 end\n",
      "Train epoch:16 iter: 299 begin\n",
      "Train epoch:16 iter: 299 end\n",
      "Train epoch:16 iter: 300 begin\n",
      "Train epoch:16 iter: 300 end\n",
      "Train epoch:16 iter: 301 begin\n",
      "Train epoch:16 iter: 301 end\n",
      "Train epoch:16 iter: 302 begin\n",
      "Train epoch:16 iter: 302 end\n",
      "Train epoch:16 iter: 303 begin\n",
      "Train epoch:16 iter: 303 end\n",
      "Train epoch:16 iter: 304 begin\n",
      "Train epoch:16 iter: 304 end\n",
      "Train epoch:16 iter: 305 begin\n",
      "Train epoch:16 iter: 305 end\n",
      "Train epoch:16 iter: 306 begin\n",
      "Train epoch:16 iter: 306 end\n",
      "Train epoch:16 iter: 307 begin\n",
      "Train epoch:16 iter: 307 end\n",
      "Train epoch:16 iter: 308 begin\n",
      "Train epoch:16 iter: 308 end\n",
      "Train epoch:16 iter: 309 begin\n",
      "Train epoch:16 iter: 309 end\n",
      "Train epoch:16 iter: 310 begin\n",
      "Train epoch:16 iter: 310 end\n",
      "Train epoch:16 iter: 311 begin\n",
      "Train epoch:16 iter: 311 end\n",
      "Train epoch:16 iter: 312 begin\n",
      "Train epoch:16 iter: 312 end\n",
      "Train epoch:16 iter: 313 begin\n",
      "Train epoch:16 iter: 313 end\n",
      "Train epoch:16 iter: 314 begin\n",
      "Train epoch:16 iter: 314 end\n",
      "Train epoch:16 iter: 315 begin\n",
      "Train epoch:16 iter: 315 end\n",
      "Train epoch:16 iter: 316 begin\n",
      "Train epoch:16 iter: 316 end\n",
      "Train epoch:16 iter: 317 begin\n",
      "Train epoch:16 iter: 317 end\n",
      "Train epoch:16 iter: 318 begin\n",
      "Train epoch:16 iter: 318 end\n",
      "Train epoch:16 iter: 319 begin\n",
      "Train epoch:16 iter: 319 end\n",
      "Train epoch:16 iter: 320 begin\n",
      "Train epoch:16 iter: 320 end\n",
      "Train epoch:16 iter: 321 begin\n",
      "Train epoch:16 iter: 321 end\n",
      "Train epoch:16 iter: 322 begin\n",
      "Train epoch:16 iter: 322 end\n",
      "Train epoch:16 iter: 323 begin\n",
      "Train epoch:16 iter: 323 end\n",
      "Train epoch:16 iter: 324 begin\n",
      "Train epoch:16 iter: 324 end\n",
      "Train epoch:16 iter: 325 begin\n",
      "Train epoch:16 iter: 325 end\n",
      "Train epoch:16 iter: 326 begin\n",
      "Train epoch:16 iter: 326 end\n",
      "Train epoch:16 iter: 327 begin\n",
      "Train epoch:16 iter: 327 end\n",
      "Train epoch:16 iter: 328 begin\n",
      "Train epoch:16 iter: 328 end\n",
      "Train epoch:16 iter: 329 begin\n",
      "Train epoch:16 iter: 329 end\n",
      "Train epoch:16 iter: 330 begin\n",
      "Train epoch:16 iter: 330 end\n",
      "Train epoch:16 iter: 331 begin\n",
      "Train epoch:16 iter: 331 end\n",
      "Train epoch:16 iter: 332 begin\n",
      "Train epoch:16 iter: 332 end\n",
      "Train epoch:16 iter: 333 begin\n",
      "Train epoch:16 iter: 333 end\n",
      "Train epoch:16 iter: 334 begin\n",
      "Train epoch:16 iter: 334 end\n",
      "Train epoch:16 iter: 335 begin\n",
      "Train epoch:16 iter: 335 end\n",
      "Train epoch:16 iter: 336 begin\n",
      "Train epoch:16 iter: 336 end\n",
      "Train epoch:16 iter: 337 begin\n",
      "Train epoch:16 iter: 337 end\n",
      "Train epoch:16 iter: 338 begin\n",
      "Train epoch:16 iter: 338 end\n",
      "Train epoch:16 iter: 339 begin\n",
      "Train epoch:16 iter: 339 end\n",
      "Train epoch:16 iter: 340 begin\n",
      "Train epoch:16 iter: 340 end\n",
      "Train epoch:16 iter: 341 begin\n",
      "Train epoch:16 iter: 341 end\n",
      "Train epoch:16 iter: 342 begin\n",
      "Train epoch:16 iter: 342 end\n",
      "Train epoch:16 iter: 343 begin\n",
      "Train epoch:16 iter: 343 end\n",
      "Train epoch:16 iter: 344 begin\n",
      "Train epoch:16 iter: 344 end\n",
      "Train epoch:16 iter: 345 begin\n",
      "Train epoch:16 iter: 345 end\n",
      "Train epoch:16 iter: 346 begin\n",
      "Train epoch:16 iter: 346 end\n",
      "Train epoch:16 iter: 347 begin\n",
      "Train epoch:16 iter: 347 end\n",
      "Train epoch:16 iter: 348 begin\n",
      "Train epoch:16 iter: 348 end\n",
      "Train epoch:16 iter: 349 begin\n",
      "Train epoch:16 iter: 349 end\n",
      "Train epoch:16 iter: 350 begin\n",
      "Train epoch:16 iter: 350 end\n",
      "Train epoch:16 iter: 351 begin\n",
      "Train epoch:16 iter: 351 end\n",
      "Train epoch:16 iter: 352 begin\n",
      "Train epoch:16 iter: 352 end\n",
      "Train epoch:16 iter: 353 begin\n",
      "Train epoch:16 iter: 353 end\n",
      "Train epoch:16 iter: 354 begin\n",
      "Train epoch:16 iter: 354 end\n",
      "Train epoch:16 iter: 355 begin\n",
      "Train epoch:16 iter: 355 end\n",
      "Train epoch:16 iter: 356 begin\n",
      "Train epoch:16 iter: 356 end\n",
      "Train epoch:16 iter: 357 begin\n",
      "Train epoch:16 iter: 357 end\n",
      "Train epoch:16 iter: 358 begin\n",
      "Train epoch:16 iter: 358 end\n",
      "Train epoch:16 iter: 359 begin\n",
      "Train epoch:16 iter: 359 end\n",
      "Train epoch:16 iter: 360 begin\n",
      "Train epoch:16 iter: 360 end\n",
      "Train epoch:16 iter: 361 begin\n",
      "Train epoch:16 iter: 361 end\n",
      "Train epoch:16 iter: 362 begin\n",
      "Train epoch:16 iter: 362 end\n",
      "Train epoch:16 iter: 363 begin\n",
      "Train epoch:16 iter: 363 end\n",
      "Train epoch:16 iter: 364 begin\n",
      "Train epoch:16 iter: 364 end\n",
      "Train epoch:16 iter: 365 begin\n",
      "Train epoch:16 iter: 365 end\n",
      "Train epoch:16 iter: 366 begin\n",
      "Train epoch:16 iter: 366 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:16 iter: 367 begin\n",
      "Train epoch:16 iter: 367 end\n",
      "Train epoch:16 iter: 368 begin\n",
      "Train epoch:16 iter: 368 end\n",
      "Train epoch:16 iter: 369 begin\n",
      "Train epoch:16 iter: 369 end\n",
      "Train epoch:16 iter: 370 begin\n",
      "Train epoch:16 iter: 370 end\n",
      "Train epoch:16 iter: 371 begin\n",
      "Train epoch:16 iter: 371 end\n",
      "Train epoch:16 iter: 372 begin\n",
      "Train epoch:16 iter: 372 end\n",
      "Train epoch:16 iter: 373 begin\n",
      "Train epoch:16 iter: 373 end\n",
      "Train epoch:16 iter: 374 begin\n",
      "Train epoch:16 iter: 374 end\n",
      "Train epoch:16 iter: 375 begin\n",
      "Train epoch:16 iter: 375 end\n",
      "Train epoch:16 iter: 376 begin\n",
      "Train epoch:16 iter: 376 end\n",
      "Train epoch:16 iter: 377 begin\n",
      "Train epoch:16 iter: 377 end\n",
      "Train epoch:16 iter: 378 begin\n",
      "Train epoch:16 iter: 378 end\n",
      "Train epoch:16 iter: 379 begin\n",
      "Train epoch:16 iter: 379 end\n",
      "Train epoch:16 iter: 380 begin\n",
      "Train epoch:16 iter: 380 end\n",
      "Train epoch:16 iter: 381 begin\n",
      "Train epoch:16 iter: 381 end\n",
      "Train epoch:16 iter: 382 begin\n",
      "Train epoch:16 iter: 382 end\n",
      "Train epoch:16 iter: 383 begin\n",
      "Train epoch:16 iter: 383 end\n",
      "Train epoch:16 iter: 384 begin\n",
      "Train epoch:16 iter: 384 end\n",
      "Train epoch:16 iter: 385 begin\n",
      "Train epoch:16 iter: 385 end\n",
      "Train epoch:16 iter: 386 begin\n",
      "Train epoch:16 iter: 386 end\n",
      "Train epoch:16 iter: 387 begin\n",
      "Train epoch:16 iter: 387 end\n",
      "Train epoch:16 iter: 388 begin\n",
      "Train epoch:16 iter: 388 end\n",
      "Train epoch:16 iter: 389 begin\n",
      "Train epoch:16 iter: 389 end\n",
      "Train epoch:16 iter: 390 begin\n",
      "Train epoch:16 iter: 390 end\n",
      "Train epoch:16 iter: 391 begin\n",
      "Train epoch:16 iter: 391 end\n",
      "Train epoch:16 iter: 392 begin\n",
      "Train epoch:16 iter: 392 end\n",
      "Train epoch:16 iter: 393 begin\n",
      "Train epoch:16 iter: 393 end\n",
      "Train epoch:16 iter: 394 begin\n",
      "Train epoch:16 iter: 394 end\n",
      "Train epoch:16 iter: 395 begin\n",
      "Train epoch:16 iter: 395 end\n",
      "Train epoch:16 iter: 396 begin\n",
      "Train epoch:16 iter: 396 end\n",
      "Train epoch:16 iter: 397 begin\n",
      "Train epoch:16 iter: 397 end\n",
      "Train epoch:16 iter: 398 begin\n",
      "Train epoch:16 iter: 398 end\n",
      "Train epoch:16 iter: 399 begin\n",
      "Train epoch:16 iter: 399 end\n",
      "Train epoch:16 iter: 400 begin\n",
      "Train epoch:16 iter: 400 end\n",
      "Train epoch:16 iter: 401 begin\n",
      "Train epoch:16 iter: 401 end\n",
      "Train epoch:16 iter: 402 begin\n",
      "Train epoch:16 iter: 402 end\n",
      "Train epoch:16 iter: 403 begin\n",
      "Train epoch:16 iter: 403 end\n",
      "Train epoch:16 iter: 404 begin\n",
      "Train epoch:16 iter: 404 end\n",
      "Train epoch:16 iter: 405 begin\n",
      "Train epoch:16 iter: 405 end\n",
      "Train epoch:16 iter: 406 begin\n",
      "Train epoch:16 iter: 406 end\n",
      "Train epoch:16 iter: 407 begin\n",
      "Train epoch:16 iter: 407 end\n",
      "Train epoch:16 iter: 408 begin\n",
      "Train epoch:16 iter: 408 end\n",
      "Train epoch:16 iter: 409 begin\n",
      "Train epoch:16 iter: 409 end\n",
      "Train epoch:16 iter: 410 begin\n",
      "Train epoch:16 iter: 410 end\n",
      "Train epoch:16 iter: 411 begin\n",
      "Train epoch:16 iter: 411 end\n",
      "Train epoch:16 iter: 412 begin\n",
      "Train epoch:16 iter: 412 end\n",
      "Train epoch:16 iter: 413 begin\n",
      "Train epoch:16 iter: 413 end\n",
      "Train epoch:16 iter: 414 begin\n",
      "Train epoch:16 iter: 414 end\n",
      "Train epoch:16 iter: 415 begin\n",
      "Train epoch:16 iter: 415 end\n",
      "Train epoch:16 iter: 416 begin\n",
      "Train epoch:16 iter: 416 end\n",
      "Train epoch:16 iter: 417 begin\n",
      "Train epoch:16 iter: 417 end\n",
      "Train epoch:16 iter: 418 begin\n",
      "Train epoch:16 iter: 418 end\n",
      "Train epoch:16 iter: 419 begin\n",
      "Train epoch:16 iter: 419 end\n",
      "Train epoch:16 iter: 420 begin\n",
      "Train epoch:16 iter: 420 end\n",
      "Train epoch:16 iter: 421 begin\n",
      "Train epoch:16 iter: 421 end\n",
      "Train epoch:16 iter: 422 begin\n",
      "Train epoch:16 iter: 422 end\n",
      "Train epoch:16 iter: 423 begin\n",
      "Train epoch:16 iter: 423 end\n",
      "Train epoch:16 iter: 424 begin\n",
      "Train epoch:16 iter: 424 end\n",
      "Train epoch:16 iter: 425 begin\n",
      "Train epoch:16 iter: 425 end\n",
      "Train epoch:16 iter: 426 begin\n",
      "Train epoch:16 iter: 426 end\n",
      "Train epoch:16 iter: 427 begin\n",
      "Train epoch:16 iter: 427 end\n",
      "Train epoch:16 iter: 428 begin\n",
      "Train epoch:16 iter: 428 end\n",
      "Train epoch:16 iter: 429 begin\n",
      "Train epoch:16 iter: 429 end\n",
      "Train epoch:16 iter: 430 begin\n",
      "Train epoch:16 iter: 430 end\n",
      "Train epoch:16 iter: 431 begin\n",
      "Train epoch:16 iter: 431 end\n",
      "Train epoch:16 iter: 432 begin\n",
      "Train epoch:16 iter: 432 end\n",
      "Train epoch:16 iter: 433 begin\n",
      "Train epoch:16 iter: 433 end\n",
      "Train epoch:16 iter: 434 begin\n",
      "Train epoch:16 iter: 434 end\n",
      "Train epoch:16 iter: 435 begin\n",
      "Train epoch:16 iter: 435 end\n",
      "Train epoch:16 iter: 436 begin\n",
      "Train epoch:16 iter: 436 end\n",
      "Train epoch:16 iter: 437 begin\n",
      "Train epoch:16 iter: 437 end\n",
      "Train epoch:16 iter: 438 begin\n",
      "Train epoch:16 iter: 438 end\n",
      "Train epoch:16 iter: 439 begin\n",
      "Train epoch:16 iter: 439 end\n",
      "Train epoch:16 iter: 440 begin\n",
      "Train epoch:16 iter: 440 end\n",
      "Train epoch:16 iter: 441 begin\n",
      "Train epoch:16 iter: 441 end\n",
      "Train epoch:16 iter: 442 begin\n",
      "Train epoch:16 iter: 442 end\n",
      "Train epoch:16 iter: 443 begin\n",
      "Train epoch:16 iter: 443 end\n",
      "Train epoch:16 iter: 444 begin\n",
      "Train epoch:16 iter: 444 end\n",
      "Train epoch:16 iter: 445 begin\n",
      "Train epoch:16 iter: 445 end\n",
      "Train epoch:16 iter: 446 begin\n",
      "Train epoch:16 iter: 446 end\n",
      "Train epoch:16 iter: 447 begin\n",
      "Train epoch:16 iter: 447 end\n",
      "Train epoch:16 iter: 448 begin\n",
      "Train epoch:16 iter: 448 end\n",
      "Train epoch:16 iter: 449 begin\n",
      "Train epoch:16 iter: 449 end\n",
      "Train epoch:16 iter: 450 begin\n",
      "Train epoch:16 iter: 450 end\n",
      "Train epoch:16 iter: 451 begin\n",
      "Train epoch:16 iter: 451 end\n",
      "Train epoch:16 iter: 452 begin\n",
      "Train epoch:16 iter: 452 end\n",
      "Train epoch:16 iter: 453 begin\n",
      "Train epoch:16 iter: 453 end\n",
      "Train epoch:16 iter: 454 begin\n",
      "Train epoch:16 iter: 454 end\n",
      "Train epoch:16 iter: 455 begin\n",
      "Train epoch:16 iter: 455 end\n",
      "Train epoch:16 iter: 456 begin\n",
      "Train epoch:16 iter: 456 end\n",
      "Train epoch:16 iter: 457 begin\n",
      "Train epoch:16 iter: 457 end\n",
      "Train epoch:16 iter: 458 begin\n",
      "Train epoch:16 iter: 458 end\n",
      "Train epoch:16 iter: 459 begin\n",
      "Train epoch:16 iter: 459 end\n",
      "Train epoch:16 iter: 460 begin\n",
      "Train epoch:16 iter: 460 end\n",
      "Train epoch:16 iter: 461 begin\n",
      "Train epoch:16 iter: 461 end\n",
      "Train epoch:16 iter: 462 begin\n",
      "Train epoch:16 iter: 462 end\n",
      "Train epoch:16 iter: 463 begin\n",
      "Train epoch:16 iter: 463 end\n",
      "Train epoch:16 iter: 464 begin\n",
      "Train epoch:16 iter: 464 end\n",
      "Train epoch:16 iter: 465 begin\n",
      "Train epoch:16 iter: 465 end\n",
      "Train epoch:16 iter: 466 begin\n",
      "Train epoch:16 iter: 466 end\n",
      "Train epoch:16 iter: 467 begin\n",
      "Train epoch:16 iter: 467 end\n",
      "Train epoch:16 iter: 468 begin\n",
      "Train epoch:16 iter: 468 end\n",
      "Train epoch:16 iter: 469 begin\n",
      "Train epoch:16 iter: 469 end\n",
      "Train epoch:16 iter: 470 begin\n",
      "Train epoch:16 iter: 470 end\n",
      "Train epoch:16 iter: 471 begin\n",
      "Train epoch:16 iter: 471 end\n",
      "Train epoch:16 iter: 472 begin\n",
      "Train epoch:16 iter: 472 end\n",
      "Train epoch:16 iter: 473 begin\n",
      "Train epoch:16 iter: 473 end\n",
      "Train epoch:16 iter: 474 begin\n",
      "Train epoch:16 iter: 474 end\n",
      "Train epoch:16 iter: 475 begin\n",
      "Train epoch:16 iter: 475 end\n",
      "Train epoch:16 iter: 476 begin\n",
      "Train epoch:16 iter: 476 end\n",
      "Train epoch:16 iter: 477 begin\n",
      "Train epoch:16 iter: 477 end\n",
      "Train epoch:16 iter: 478 begin\n",
      "Train epoch:16 iter: 478 end\n",
      "Train epoch:16 iter: 479 begin\n",
      "Train epoch:16 iter: 479 end\n",
      "Train epoch:16 iter: 480 begin\n",
      "Train epoch:16 iter: 480 end\n",
      "Train epoch:16 iter: 481 begin\n",
      "Train epoch:16 iter: 481 end\n",
      "Train epoch:16 iter: 482 begin\n",
      "Train epoch:16 iter: 482 end\n",
      "Train epoch:16 iter: 483 begin\n",
      "Train epoch:16 iter: 483 end\n",
      "Train epoch:16 iter: 484 begin\n",
      "Train epoch:16 iter: 484 end\n",
      "Train epoch:16 iter: 485 begin\n",
      "Train epoch:16 iter: 485 end\n",
      "Train epoch:16 iter: 486 begin\n",
      "Train epoch:16 iter: 486 end\n",
      "Train epoch:16 iter: 487 begin\n",
      "Train epoch:16 iter: 487 end\n",
      "Train epoch:16 iter: 488 begin\n",
      "Train epoch:16 iter: 488 end\n",
      "Train epoch:16 iter: 489 begin\n",
      "Train epoch:16 iter: 489 end\n",
      "Train epoch:16 iter: 490 begin\n",
      "Train epoch:16 iter: 490 end\n",
      "Train epoch:16 iter: 491 begin\n",
      "Train epoch:16 iter: 491 end\n",
      "Train epoch:16 iter: 492 begin\n",
      "Train epoch:16 iter: 492 end\n",
      "Train epoch:16 iter: 493 begin\n",
      "Train epoch:16 iter: 493 end\n",
      "Train epoch:16 iter: 494 begin\n",
      "Train epoch:16 iter: 494 end\n",
      "Train epoch:16 iter: 495 begin\n",
      "Train epoch:16 iter: 495 end\n",
      "Train epoch:16 iter: 496 begin\n",
      "Train epoch:16 iter: 496 end\n",
      "Train epoch:16 iter: 497 begin\n",
      "Train epoch:16 iter: 497 end\n",
      "Train epoch:16 iter: 498 begin\n",
      "Train epoch:16 iter: 498 end\n",
      "Train epoch:16 iter: 499 begin\n",
      "Train epoch:16 iter: 499 end\n",
      "Train epoch:16 iter: 500 begin\n",
      "Train epoch:16 iter: 500 end\n",
      "Train epoch:16 iter: 501 begin\n",
      "Train epoch:16 iter: 501 end\n",
      "Train epoch:16 iter: 502 begin\n",
      "Train epoch:16 iter: 502 end\n",
      "Train epoch:16 iter: 503 begin\n",
      "Train epoch:16 iter: 503 end\n",
      "Train epoch:16 iter: 504 begin\n",
      "Train epoch:16 iter: 504 end\n",
      "Train epoch:16 iter: 505 begin\n",
      "Train epoch:16 iter: 505 end\n",
      "Train epoch:16 iter: 506 begin\n",
      "Train epoch:16 iter: 506 end\n",
      "Train epoch:16 iter: 507 begin\n",
      "Train epoch:16 iter: 507 end\n",
      "Train epoch:16 iter: 508 begin\n",
      "Train epoch:16 iter: 508 end\n",
      "Train epoch:16 iter: 509 begin\n",
      "Train epoch:16 iter: 509 end\n",
      "Train epoch:16 iter: 510 begin\n",
      "Train epoch:16 iter: 510 end\n",
      "Train epoch:16 iter: 511 begin\n",
      "Train epoch:16 iter: 511 end\n",
      "Train epoch:16 iter: 512 begin\n",
      "Train epoch:16 iter: 512 end\n",
      "Train epoch:16 iter: 513 begin\n",
      "Train epoch:16 iter: 513 end\n",
      "Train epoch:16 iter: 514 begin\n",
      "Train epoch:16 iter: 514 end\n",
      "Train epoch:16 iter: 515 begin\n",
      "Train epoch:16 iter: 515 end\n",
      "Train epoch:16 iter: 516 begin\n",
      "Train epoch:16 iter: 516 end\n",
      "Train epoch:16 iter: 517 begin\n",
      "Train epoch:16 iter: 517 end\n",
      "Train epoch:16 iter: 518 begin\n",
      "Train epoch:16 iter: 518 end\n",
      "Train epoch:16 iter: 519 begin\n",
      "Train epoch:16 iter: 519 end\n",
      "Train epoch:16 iter: 520 begin\n",
      "Train epoch:16 iter: 520 end\n",
      "Train epoch:16 iter: 521 begin\n",
      "Train epoch:16 iter: 521 end\n",
      "Train epoch:16 iter: 522 begin\n",
      "Train epoch:16 iter: 522 end\n",
      "Train epoch:16 iter: 523 begin\n",
      "Train epoch:16 iter: 523 end\n",
      "Train epoch:16 iter: 524 begin\n",
      "Train epoch:16 iter: 524 end\n",
      "Train epoch:16 iter: 525 begin\n",
      "Train epoch:16 iter: 525 end\n",
      "Train epoch:16 iter: 526 begin\n",
      "Train epoch:16 iter: 526 end\n",
      "Train epoch:16 iter: 527 begin\n",
      "Train epoch:16 iter: 527 end\n",
      "Train epoch:16 iter: 528 begin\n",
      "Train epoch:16 iter: 528 end\n",
      "Train epoch:16 iter: 529 begin\n",
      "Train epoch:16 iter: 529 end\n",
      "Train epoch:16 iter: 530 begin\n",
      "Train epoch:16 iter: 530 end\n",
      "Train epoch:16 iter: 531 begin\n",
      "Train epoch:16 iter: 531 end\n",
      "Train epoch:16 iter: 532 begin\n",
      "Train epoch:16 iter: 532 end\n",
      "Train epoch:16 iter: 533 begin\n",
      "Train epoch:16 iter: 533 end\n",
      "Train epoch:16 iter: 534 begin\n",
      "Train epoch:16 iter: 534 end\n",
      "Train epoch:16 iter: 535 begin\n",
      "Train epoch:16 iter: 535 end\n",
      "Train epoch:16 iter: 536 begin\n",
      "Train epoch:16 iter: 536 end\n",
      "Train epoch:16 iter: 537 begin\n",
      "Train epoch:16 iter: 537 end\n",
      "Train epoch:16 iter: 538 begin\n",
      "Train epoch:16 iter: 538 end\n",
      "Train epoch:16 iter: 539 begin\n",
      "Train epoch:16 iter: 539 end\n",
      "Train epoch:16 iter: 540 begin\n",
      "Train epoch:16 iter: 540 end\n",
      "Train epoch:16 iter: 541 begin\n",
      "Train epoch:16 iter: 541 end\n",
      "Train epoch:16 iter: 542 begin\n",
      "Train epoch:16 iter: 542 end\n",
      "Train epoch:16 iter: 543 begin\n",
      "Train epoch:16 iter: 543 end\n",
      "Train epoch:16 iter: 544 begin\n",
      "Train epoch:16 iter: 544 end\n",
      "Train epoch:16 iter: 545 begin\n",
      "Train epoch:16 iter: 545 end\n",
      "Train epoch:16 iter: 546 begin\n",
      "Train epoch:16 iter: 546 end\n",
      "Train epoch:16 iter: 547 begin\n",
      "Train epoch:16 iter: 547 end\n",
      "Train epoch:16 iter: 548 begin\n",
      "Train epoch:16 iter: 548 end\n",
      "Train epoch:16 iter: 549 begin\n",
      "Train epoch:16 iter: 549 end\n",
      "Train epoch:16 iter: 550 begin\n",
      "Train epoch:16 iter: 550 end\n",
      "Train epoch:16 iter: 551 begin\n",
      "Train epoch:16 iter: 551 end\n",
      "Train epoch:16 iter: 552 begin\n",
      "Train epoch:16 iter: 552 end\n",
      "Train epoch:16 iter: 553 begin\n",
      "Train epoch:16 iter: 553 end\n",
      "Train epoch:16 iter: 554 begin\n",
      "Train epoch:16 iter: 554 end\n",
      "Train epoch:16 iter: 555 begin\n",
      "Train epoch:16 iter: 555 end\n",
      "Train epoch:16 iter: 556 begin\n",
      "Train epoch:16 iter: 556 end\n",
      "Train epoch:16 iter: 557 begin\n",
      "Train epoch:16 iter: 557 end\n",
      "Train epoch:16 iter: 558 begin\n",
      "Train epoch:16 iter: 558 end\n",
      "Train epoch:16 iter: 559 begin\n",
      "Train epoch:16 iter: 559 end\n",
      "Train epoch:16 iter: 560 begin\n",
      "Train epoch:16 iter: 560 end\n",
      "Train epoch:16 iter: 561 begin\n",
      "Train epoch:16 iter: 561 end\n",
      "Train epoch:16 iter: 562 begin\n",
      "Train epoch:16 iter: 562 end\n",
      "Train epoch:16 iter: 563 begin\n",
      "Train epoch:16 iter: 563 end\n",
      "Train epoch:16 iter: 564 begin\n",
      "Train epoch:16 iter: 564 end\n",
      "Train epoch:16 iter: 565 begin\n",
      "Train epoch:16 iter: 565 end\n",
      "Train epoch:16 iter: 566 begin\n",
      "Train epoch:16 iter: 566 end\n",
      "Train epoch:16 iter: 567 begin\n",
      "Train epoch:16 iter: 567 end\n",
      "Train epoch:16 iter: 568 begin\n",
      "Train epoch:16 iter: 568 end\n",
      "Train epoch:16 iter: 569 begin\n",
      "Train epoch:16 iter: 569 end\n",
      "Train epoch:16 iter: 570 begin\n",
      "Train epoch:16 iter: 570 end\n",
      "Train epoch:16 iter: 571 begin\n",
      "Train epoch:16 iter: 571 end\n",
      "Train epoch:16 iter: 572 begin\n",
      "Train epoch:16 iter: 572 end\n",
      "Train epoch:16 iter: 573 begin\n",
      "Train epoch:16 iter: 573 end\n",
      "Train epoch:16 iter: 574 begin\n",
      "Train epoch:16 iter: 574 end\n",
      "Train epoch:16 iter: 575 begin\n",
      "Train epoch:16 iter: 575 end\n",
      "Train epoch:16 iter: 576 begin\n",
      "Train epoch:16 iter: 576 end\n",
      "Train epoch:16 iter: 577 begin\n",
      "Train epoch:16 iter: 577 end\n",
      "Train epoch:16 iter: 578 begin\n",
      "Train epoch:16 iter: 578 end\n",
      "Train epoch:16 iter: 579 begin\n",
      "Train epoch:16 iter: 579 end\n",
      "Train epoch:16 iter: 580 begin\n",
      "Train epoch:16 iter: 580 end\n",
      "Train epoch:16 iter: 581 begin\n",
      "Train epoch:16 iter: 581 end\n",
      "Train epoch:16 iter: 582 begin\n",
      "Train epoch:16 iter: 582 end\n",
      "Train epoch:16 iter: 583 begin\n",
      "Train epoch:16 iter: 583 end\n",
      "Train epoch:16 iter: 584 begin\n",
      "Train epoch:16 iter: 584 end\n",
      "Train epoch:16 iter: 585 begin\n",
      "Train epoch:16 iter: 585 end\n",
      "Train epoch:16 iter: 586 begin\n",
      "Train epoch:16 iter: 586 end\n",
      "Train epoch:16 iter: 587 begin\n",
      "Train epoch:16 iter: 587 end\n",
      "Train epoch:16 iter: 588 begin\n",
      "Train epoch:16 iter: 588 end\n",
      "Train epoch:16 iter: 589 begin\n",
      "Train epoch:16 iter: 589 end\n",
      "Train epoch:16 iter: 590 begin\n",
      "Train epoch:16 iter: 590 end\n",
      "Train epoch:16 iter: 591 begin\n",
      "Train epoch:16 iter: 591 end\n",
      "Train epoch:16 iter: 592 begin\n",
      "Train epoch:16 iter: 592 end\n",
      "Train epoch:16 iter: 593 begin\n",
      "Train epoch:16 iter: 593 end\n",
      "Train epoch:16 iter: 594 begin\n",
      "Train epoch:16 iter: 594 end\n",
      "Train epoch:16 iter: 595 begin\n",
      "Train epoch:16 iter: 595 end\n",
      "Train epoch:16 iter: 596 begin\n",
      "Train epoch:16 iter: 596 end\n",
      "Train epoch:16 iter: 597 begin\n",
      "Train epoch:16 iter: 597 end\n",
      "Train epoch:16 iter: 598 begin\n",
      "Train epoch:16 iter: 598 end\n",
      "Train epoch:16 iter: 599 begin\n",
      "Train epoch:16 iter: 599 end\n",
      "Train epoch:16 iter: 600 begin\n",
      "Train epoch:16 iter: 600 end\n",
      "Train epoch:16 iter: 601 begin\n",
      "Train epoch:16 iter: 601 end\n",
      "Train epoch:16 iter: 602 begin\n",
      "Train epoch:16 iter: 602 end\n",
      "Train epoch:16 iter: 603 begin\n",
      "Train epoch:16 iter: 603 end\n",
      "Train epoch:16 iter: 604 begin\n",
      "Train epoch:16 iter: 604 end\n",
      "Train epoch:16 iter: 605 begin\n",
      "Train epoch:16 iter: 605 end\n",
      "Train epoch:16 iter: 606 begin\n",
      "Train epoch:16 iter: 606 end\n",
      "Train epoch:16 iter: 607 begin\n",
      "Train epoch:16 iter: 607 end\n",
      "Train epoch:16 iter: 608 begin\n",
      "Train epoch:16 iter: 608 end\n",
      "Train epoch:16 iter: 609 begin\n",
      "Train epoch:16 iter: 609 end\n",
      "Train epoch:16 iter: 610 begin\n",
      "Train epoch:16 iter: 610 end\n",
      "Train epoch:16 iter: 611 begin\n",
      "Train epoch:16 iter: 611 end\n",
      "Train epoch:16 iter: 612 begin\n",
      "Train epoch:16 iter: 612 end\n",
      "Train epoch:16 iter: 613 begin\n",
      "Train epoch:16 iter: 613 end\n",
      "Train epoch:16 iter: 614 begin\n",
      "Train epoch:16 iter: 614 end\n",
      "Train epoch:16 iter: 615 begin\n",
      "Train epoch:16 iter: 615 end\n",
      "Train epoch:16 iter: 616 begin\n",
      "Train epoch:16 iter: 616 end\n",
      "Train epoch:16 iter: 617 begin\n",
      "Train epoch:16 iter: 617 end\n",
      "Train epoch:16 iter: 618 begin\n",
      "Train epoch:16 iter: 618 end\n",
      "Train epoch:16 iter: 619 begin\n",
      "Train epoch:16 iter: 619 end\n",
      "Train epoch:16 iter: 620 begin\n",
      "Train epoch:16 iter: 620 end\n",
      "Train epoch:16 iter: 621 begin\n",
      "Train epoch:16 iter: 621 end\n",
      "Train epoch:16 iter: 622 begin\n",
      "Train epoch:16 iter: 622 end\n",
      "Train epoch:16 iter: 623 begin\n",
      "Train epoch:16 iter: 623 end\n",
      "Train epoch:16 iter: 624 begin\n",
      "Train epoch:16 iter: 624 end\n",
      "Train epoch:16 iter: 625 begin\n",
      "Train epoch:16 iter: 625 end\n",
      "Train epoch:16 iter: 626 begin\n",
      "Train epoch:16 iter: 626 end\n",
      "Train epoch:16 iter: 627 begin\n",
      "Train epoch:16 iter: 627 end\n",
      "Train epoch:16 iter: 628 begin\n",
      "Train epoch:16 iter: 628 end\n",
      "Train epoch:16 iter: 629 begin\n",
      "Train epoch:16 iter: 629 end\n",
      "Train epoch:16 iter: 630 begin\n",
      "Train epoch:16 iter: 630 end\n",
      "Train epoch:16 iter: 631 begin\n",
      "Train epoch:16 iter: 631 end\n",
      "Train epoch:16 iter: 632 begin\n",
      "Train epoch:16 iter: 632 end\n",
      "Train epoch:16 iter: 633 begin\n",
      "Train epoch:16 iter: 633 end\n",
      "Train epoch:16 iter: 634 begin\n",
      "Train epoch:16 iter: 634 end\n",
      "Train epoch:16 iter: 635 begin\n",
      "Train epoch:16 iter: 635 end\n",
      "Train epoch:16 iter: 636 begin\n",
      "Train epoch:16 iter: 636 end\n",
      "Train epoch:16 iter: 637 begin\n",
      "Train epoch:16 iter: 637 end\n",
      "Train epoch:16 iter: 638 begin\n",
      "Train epoch:16 iter: 638 end\n",
      "Train epoch:16 iter: 639 begin\n",
      "Train epoch:16 iter: 639 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:16 iter: 640 begin\n",
      "Train epoch:16 iter: 640 end\n",
      "Train epoch:16 iter: 641 begin\n",
      "Train epoch:16 iter: 641 end\n",
      "Train epoch:16 iter: 642 begin\n",
      "Train epoch:16 iter: 642 end\n",
      "Train epoch:16 iter: 643 begin\n",
      "Train epoch:16 iter: 643 end\n",
      "Train epoch:16 iter: 644 begin\n",
      "Train epoch:16 iter: 644 end\n",
      "Train epoch:16 iter: 645 begin\n",
      "Train epoch:16 iter: 645 end\n",
      "Train epoch:16 iter: 646 begin\n",
      "Train epoch:16 iter: 646 end\n",
      "Train epoch:16 iter: 647 begin\n",
      "Train epoch:16 iter: 647 end\n",
      "Train epoch:16 iter: 648 begin\n",
      "Train epoch:16 iter: 648 end\n",
      "Train epoch:16 iter: 649 begin\n",
      "Train epoch:16 iter: 649 end\n",
      "Train epoch:16 iter: 650 begin\n",
      "Train epoch:16 iter: 650 end\n",
      "Train epoch:16 iter: 651 begin\n",
      "Train epoch:16 iter: 651 end\n",
      "Train epoch:16 iter: 652 begin\n",
      "Train epoch:16 iter: 652 end\n",
      "Train epoch:16 iter: 653 begin\n",
      "Train epoch:16 iter: 653 end\n",
      "Train epoch:16 iter: 654 begin\n",
      "Train epoch:16 iter: 654 end\n",
      "Train epoch:16 iter: 655 begin\n",
      "Train epoch:16 iter: 655 end\n",
      "Train epoch:16 iter: 656 begin\n",
      "Train epoch:16 iter: 656 end\n",
      "Train epoch:16 iter: 657 begin\n",
      "Train epoch:16 iter: 657 end\n",
      "Train epoch:16 iter: 658 begin\n",
      "Train epoch:16 iter: 658 end\n",
      "Train epoch:16 iter: 659 begin\n",
      "Train epoch:16 iter: 659 end\n",
      "Train epoch:16 iter: 660 begin\n",
      "Train epoch:16 iter: 660 end\n",
      "Train epoch:16 iter: 661 begin\n",
      "Train epoch:16 iter: 661 end\n",
      "Train epoch:16 iter: 662 begin\n",
      "Train epoch:16 iter: 662 end\n",
      "Train epoch:16 iter: 663 begin\n",
      "Train epoch:16 iter: 663 end\n",
      "Train epoch:16 iter: 664 begin\n",
      "Train epoch:16 iter: 664 end\n",
      "Train epoch:16 iter: 665 begin\n",
      "Train epoch:16 iter: 665 end\n",
      "Train epoch:16 iter: 666 begin\n",
      "Train epoch:16 iter: 666 end\n",
      "Train epoch:16 iter: 667 begin\n",
      "Train epoch:16 iter: 667 end\n",
      "Train epoch:16 iter: 668 begin\n",
      "Train epoch:16 iter: 668 end\n",
      "Train epoch:16 iter: 669 begin\n",
      "Train epoch:16 iter: 669 end\n",
      "Train epoch:16 iter: 670 begin\n",
      "Train epoch:16 iter: 670 end\n",
      "Train epoch:16 iter: 671 begin\n",
      "Train epoch:16 iter: 671 end\n",
      "Train epoch:16 iter: 672 begin\n",
      "Train epoch:16 iter: 672 end\n",
      "Train epoch:16 iter: 673 begin\n",
      "Train epoch:16 iter: 673 end\n",
      "Train epoch:16 iter: 674 begin\n",
      "Train epoch:16 iter: 674 end\n",
      "Train epoch:16 iter: 675 begin\n",
      "Train epoch:16 iter: 675 end\n",
      "Train epoch:16 iter: 676 begin\n",
      "Train epoch:16 iter: 676 end\n",
      "Train epoch:16 iter: 677 begin\n",
      "Train epoch:16 iter: 677 end\n",
      "Train epoch:16 iter: 678 begin\n",
      "Train epoch:16 iter: 678 end\n",
      "Train epoch:16 iter: 679 begin\n",
      "Train epoch:16 iter: 679 end\n",
      "Train epoch:16 iter: 680 begin\n",
      "Train epoch:16 iter: 680 end\n",
      "Train epoch:16 iter: 681 begin\n",
      "Train epoch:16 iter: 681 end\n",
      "Train epoch:16 iter: 682 begin\n",
      "Train epoch:16 iter: 682 end\n",
      "Train epoch:16 iter: 683 begin\n",
      "Train epoch:16 iter: 683 end\n",
      "Train epoch:16 iter: 684 begin\n",
      "Train epoch:16 iter: 684 end\n",
      "Train epoch:16 iter: 685 begin\n",
      "Train epoch:16 iter: 685 end\n",
      "Train epoch:16 iter: 686 begin\n",
      "Train epoch:16 iter: 686 end\n",
      "Train epoch:16 iter: 687 begin\n",
      "Train epoch:16 iter: 687 end\n",
      "Train epoch:16 iter: 688 begin\n",
      "Train epoch:16 iter: 688 end\n",
      "Train epoch:16 iter: 689 begin\n",
      "Train epoch:16 iter: 689 end\n",
      "Train epoch:16 iter: 690 begin\n",
      "Train epoch:16 iter: 690 end\n",
      "Train epoch:16 iter: 691 begin\n",
      "Train epoch:16 iter: 691 end\n",
      "Train epoch:16 iter: 692 begin\n",
      "Train epoch:16 iter: 692 end\n",
      "Train epoch:16 iter: 693 begin\n",
      "Train epoch:16 iter: 693 end\n",
      "Train epoch:16 iter: 694 begin\n",
      "Train epoch:16 iter: 694 end\n",
      "Train epoch:16 iter: 695 begin\n",
      "Train epoch:16 iter: 695 end\n",
      "Train epoch:16 iter: 696 begin\n",
      "Train epoch:16 iter: 696 end\n",
      "Train epoch:16 iter: 697 begin\n",
      "Train epoch:16 iter: 697 end\n",
      "Train epoch:16 iter: 698 begin\n",
      "Train epoch:16 iter: 698 end\n",
      "Train epoch:16 iter: 699 begin\n",
      "Train epoch:16 iter: 699 end\n",
      "Train epoch:16 iter: 700 begin\n",
      "Train epoch:16 iter: 700 end\n",
      "Train epoch:16 iter: 701 begin\n",
      "Train epoch:16 iter: 701 end\n",
      "Train epoch:16 iter: 702 begin\n",
      "Train epoch:16 iter: 702 end\n",
      "Train epoch:16 iter: 703 begin\n",
      "Train epoch:16 iter: 703 end\n",
      "Train epoch:16 iter: 704 begin\n",
      "Train epoch:16 iter: 704 end\n",
      "Train epoch:16 iter: 705 begin\n",
      "Train epoch:16 iter: 705 end\n",
      "Train epoch:16 iter: 706 begin\n",
      "Train epoch:16 iter: 706 end\n",
      "Train epoch:16 iter: 707 begin\n",
      "Train epoch:16 iter: 707 end\n",
      "Train epoch:16 iter: 708 begin\n",
      "Train epoch:16 iter: 708 end\n",
      "Train epoch:16 iter: 709 begin\n",
      "Train epoch:16 iter: 709 end\n",
      "Train epoch:16 iter: 710 begin\n",
      "Train epoch:16 iter: 710 end\n",
      "Train epoch:16 iter: 711 begin\n",
      "Train epoch:16 iter: 711 end\n",
      "Train epoch:16 iter: 712 begin\n",
      "Train epoch:16 iter: 712 end\n",
      "Train epoch:16 iter: 713 begin\n",
      "Train epoch:16 iter: 713 end\n",
      "Train epoch:16 iter: 714 begin\n",
      "Train epoch:16 iter: 714 end\n",
      "Train epoch:16 iter: 715 begin\n",
      "Train epoch:16 iter: 715 end\n",
      "Train epoch:16 iter: 716 begin\n",
      "Train epoch:16 iter: 716 end\n",
      "Train epoch:16 iter: 717 begin\n",
      "Train epoch:16 iter: 717 end\n",
      "Train epoch:16 iter: 718 begin\n",
      "Train epoch:16 iter: 718 end\n",
      "Train epoch:16 iter: 719 begin\n",
      "Train epoch:16 iter: 719 end\n",
      "Train epoch:16 iter: 720 begin\n",
      "Train epoch:16 iter: 720 end\n",
      "Train epoch:16 iter: 721 begin\n",
      "Train epoch:16 iter: 721 end\n",
      "Train epoch:16 iter: 722 begin\n",
      "Train epoch:16 iter: 722 end\n",
      "Train epoch:16 iter: 723 begin\n",
      "Train epoch:16 iter: 723 end\n",
      "Train epoch:16 iter: 724 begin\n",
      "Train epoch:16 iter: 724 end\n",
      "Train epoch:16 iter: 725 begin\n",
      "Train epoch:16 iter: 725 end\n",
      "Train epoch:16 iter: 726 begin\n",
      "Train epoch:16 iter: 726 end\n",
      "Train epoch:16 iter: 727 begin\n",
      "Train epoch:16 iter: 727 end\n",
      "Train epoch:16 iter: 728 begin\n",
      "Train epoch:16 iter: 728 end\n",
      "Train epoch:16 iter: 729 begin\n",
      "Train epoch:16 iter: 729 end\n",
      "Train epoch:16 iter: 730 begin\n",
      "Train epoch:16 iter: 730 end\n",
      "Train epoch:16 iter: 731 begin\n",
      "Train epoch:16 iter: 731 end\n",
      "Train epoch:16 iter: 732 begin\n",
      "Train epoch:16 iter: 732 end\n",
      "Train epoch:16 iter: 733 begin\n",
      "Train epoch:16 iter: 733 end\n",
      "Train epoch:16 iter: 734 begin\n",
      "Train epoch:16 iter: 734 end\n",
      "Train epoch:16 iter: 735 begin\n",
      "Train epoch:16 iter: 735 end\n",
      "Train epoch:16 iter: 736 begin\n",
      "Train epoch:16 iter: 736 end\n",
      "Train epoch:16 iter: 737 begin\n",
      "Train epoch:16 iter: 737 end\n",
      "Train epoch:16 iter: 738 begin\n",
      "Train epoch:16 iter: 738 end\n",
      "Train epoch:16 iter: 739 begin\n",
      "Train epoch:16 iter: 739 end\n",
      "Train epoch:16 iter: 740 begin\n",
      "Train epoch:16 iter: 740 end\n",
      "Train epoch:16 iter: 741 begin\n",
      "Train epoch:16 iter: 741 end\n",
      "Train epoch:16 iter: 742 begin\n",
      "Train epoch:16 iter: 742 end\n",
      "Train epoch:16 iter: 743 begin\n",
      "Train epoch:16 iter: 743 end\n",
      "Train epoch:16 iter: 744 begin\n",
      "Train epoch:16 iter: 744 end\n",
      "Train epoch:16 iter: 745 begin\n",
      "Train epoch:16 iter: 745 end\n",
      "Train epoch:16 iter: 746 begin\n",
      "Train epoch:16 iter: 746 end\n",
      "Train epoch:16 iter: 747 begin\n",
      "Train epoch:16 iter: 747 end\n",
      "Train epoch:16 iter: 748 begin\n",
      "Train epoch:16 iter: 748 end\n",
      "Train epoch:16 iter: 749 begin\n",
      "Train epoch:16 iter: 749 end\n",
      "Train epoch:16 iter: 750 begin\n",
      "Train epoch:16 iter: 750 end\n",
      "Train epoch:16 iter: 751 begin\n",
      "Train epoch:16 iter: 751 end\n",
      "Train epoch:16 iter: 752 begin\n",
      "Train epoch:16 iter: 752 end\n",
      "Train epoch:16 iter: 753 begin\n",
      "Train epoch:16 iter: 753 end\n",
      "Train epoch:16 iter: 754 begin\n",
      "Train epoch:16 iter: 754 end\n",
      "Train epoch:16 iter: 755 begin\n",
      "Train epoch:16 iter: 755 end\n",
      "Train epoch:16 iter: 756 begin\n",
      "Train epoch:16 iter: 756 end\n",
      "Train epoch:16 iter: 757 begin\n",
      "Train epoch:16 iter: 757 end\n",
      "Train epoch:16 iter: 758 begin\n",
      "Train epoch:16 iter: 758 end\n",
      "Train epoch:16 iter: 759 begin\n",
      "Train epoch:16 iter: 759 end\n",
      "Train epoch:16 iter: 760 begin\n",
      "Train epoch:16 iter: 760 end\n",
      "Train epoch:16 iter: 761 begin\n",
      "Train epoch:16 iter: 761 end\n",
      "Train epoch:16 iter: 762 begin\n",
      "Train epoch:16 iter: 762 end\n",
      "Train epoch:16 iter: 763 begin\n",
      "Train epoch:16 iter: 763 end\n",
      "Train epoch:16 iter: 764 begin\n",
      "Train epoch:16 iter: 764 end\n",
      "Train epoch:16 iter: 765 begin\n",
      "Train epoch:16 iter: 765 end\n",
      "Train epoch:16 iter: 766 begin\n",
      "Train epoch:16 iter: 766 end\n",
      "Train epoch:16 iter: 767 begin\n",
      "Train epoch:16 iter: 767 end\n",
      "Train epoch:16 iter: 768 begin\n",
      "Train epoch:16 iter: 768 end\n",
      "Train epoch:16 iter: 769 begin\n",
      "Train epoch:16 iter: 769 end\n",
      "Train epoch:16 iter: 770 begin\n",
      "Train epoch:16 iter: 770 end\n",
      "Train epoch:16 iter: 771 begin\n",
      "Train epoch:16 iter: 771 end\n",
      "Train epoch:16 iter: 772 begin\n",
      "Train epoch:16 iter: 772 end\n",
      "Train epoch:16 iter: 773 begin\n",
      "Train epoch:16 iter: 773 end\n",
      "Train epoch:16 iter: 774 begin\n",
      "Train epoch:16 iter: 774 end\n",
      "Train epoch:16 iter: 775 begin\n",
      "Train epoch:16 iter: 775 end\n",
      "Train epoch:16 iter: 776 begin\n",
      "Train epoch:16 iter: 776 end\n",
      "Train epoch:16 iter: 777 begin\n",
      "Train epoch:16 iter: 777 end\n",
      "Train epoch:16 iter: 778 begin\n",
      "Train epoch:16 iter: 778 end\n",
      "Train epoch:16 iter: 779 begin\n",
      "Train epoch:16 iter: 779 end\n",
      "Train epoch:16 iter: 780 begin\n",
      "Train epoch:16 iter: 780 end\n",
      "Train epoch:16 iter: 781 begin\n",
      "Train epoch:16 iter: 781 end\n",
      "Train epoch:16 iter: 782 begin\n",
      "Train epoch:16 iter: 782 end\n",
      "Train epoch:16 iter: 783 begin\n",
      "Train epoch:16 iter: 783 end\n",
      "Train epoch:16 iter: 784 begin\n",
      "Train epoch:16 iter: 784 end\n",
      "Train epoch:16 iter: 785 begin\n",
      "Train epoch:16 iter: 785 end\n",
      "Train epoch:16 iter: 786 begin\n",
      "Train epoch:16 iter: 786 end\n",
      "Train epoch:16 iter: 787 begin\n",
      "Train epoch:16 iter: 787 end\n",
      "Train epoch:16 iter: 788 begin\n",
      "Train epoch:16 iter: 788 end\n",
      "Train epoch:16 iter: 789 begin\n",
      "Train epoch:16 iter: 789 end\n",
      "Train epoch:16 iter: 790 begin\n",
      "Train epoch:16 iter: 790 end\n",
      "Train epoch:16 iter: 791 begin\n",
      "Train epoch:16 iter: 791 end\n",
      "Train epoch:16 iter: 792 begin\n",
      "Train epoch:16 iter: 792 end\n",
      "Train epoch:16 iter: 793 begin\n",
      "Train epoch:16 iter: 793 end\n",
      "Train epoch:16 iter: 794 begin\n",
      "Train epoch:16 iter: 794 end\n",
      "Train epoch:16 iter: 795 begin\n",
      "Train epoch:16 iter: 795 end\n",
      "Train epoch:16 iter: 796 begin\n",
      "Train epoch:16 iter: 796 end\n",
      "Train epoch:16 iter: 797 begin\n",
      "Train epoch:16 iter: 797 end\n",
      "Train epoch:16 iter: 798 begin\n",
      "Train epoch:16 iter: 798 end\n",
      "Train epoch:16 iter: 799 begin\n",
      "Train epoch:16 iter: 799 end\n",
      "Train epoch:16 iter: 800 begin\n",
      "Train epoch:16 iter: 800 end\n",
      "Train epoch:16 iter: 801 begin\n",
      "Train epoch:16 iter: 801 end\n",
      "Train epoch:16 iter: 802 begin\n",
      "Train epoch:16 iter: 802 end\n",
      "Train epoch:16 iter: 803 begin\n",
      "Train epoch:16 iter: 803 end\n",
      "Train epoch:16 iter: 804 begin\n",
      "Train epoch:16 iter: 804 end\n",
      "Train epoch:16 iter: 805 begin\n",
      "Train epoch:16 iter: 805 end\n",
      "Train epoch:16 iter: 806 begin\n",
      "Train epoch:16 iter: 806 end\n",
      "Train epoch:16 iter: 807 begin\n",
      "Train epoch:16 iter: 807 end\n",
      "Train epoch:16 iter: 808 begin\n",
      "Train epoch:16 iter: 808 end\n",
      "Train epoch:16 iter: 809 begin\n",
      "Train epoch:16 iter: 809 end\n",
      "Train epoch:16 iter: 810 begin\n",
      "Train epoch:16 iter: 810 end\n",
      "Train epoch:16 iter: 811 begin\n",
      "Train epoch:16 iter: 811 end\n",
      "Train epoch:16 iter: 812 begin\n",
      "Train epoch:16 iter: 812 end\n",
      "Train epoch:16 iter: 813 begin\n",
      "Train epoch:16 iter: 813 end\n",
      "Train epoch:16 iter: 814 begin\n",
      "Train epoch:16 iter: 814 end\n",
      "Train epoch:16 iter: 815 begin\n",
      "Train epoch:16 iter: 815 end\n",
      "Train epoch:16 iter: 816 begin\n",
      "Train epoch:16 iter: 816 end\n",
      "Train epoch:16 iter: 817 begin\n",
      "Train epoch:16 iter: 817 end\n",
      "Train epoch:16 iter: 818 begin\n",
      "Train epoch:16 iter: 818 end\n",
      "Train epoch:16 iter: 819 begin\n",
      "Train epoch:16 iter: 819 end\n",
      "Train epoch:16 iter: 820 begin\n",
      "Train epoch:16 iter: 820 end\n",
      "Train epoch:16 iter: 821 begin\n",
      "Train epoch:16 iter: 821 end\n",
      "Train epoch:16 iter: 822 begin\n",
      "Train epoch:16 iter: 822 end\n",
      "Train epoch:16 iter: 823 begin\n",
      "Train epoch:16 iter: 823 end\n",
      "Train epoch:16 iter: 824 begin\n",
      "Train epoch:16 iter: 824 end\n",
      "Train epoch:16 iter: 825 begin\n",
      "Train epoch:16 iter: 825 end\n",
      "Train epoch:16 iter: 826 begin\n",
      "Train epoch:16 iter: 826 end\n",
      "Train epoch:16 iter: 827 begin\n",
      "Train epoch:16 iter: 827 end\n",
      "Train epoch:16 iter: 828 begin\n",
      "Train epoch:16 iter: 828 end\n",
      "Train epoch:16 iter: 829 begin\n",
      "Train epoch:16 iter: 829 end\n",
      "Train epoch:16 iter: 830 begin\n",
      "Train epoch:16 iter: 830 end\n",
      "Train epoch:16 iter: 831 begin\n",
      "Train epoch:16 iter: 831 end\n",
      "Train epoch:16 iter: 832 begin\n",
      "Train epoch:16 iter: 832 end\n",
      "Train epoch:16 iter: 833 begin\n",
      "Train epoch:16 iter: 833 end\n",
      "Train epoch:16 iter: 834 begin\n",
      "Train epoch:16 iter: 834 end\n",
      "Train epoch:16 iter: 835 begin\n",
      "Train epoch:16 iter: 835 end\n",
      "Train epoch:16 iter: 836 begin\n",
      "Train epoch:16 iter: 836 end\n",
      "Train epoch:16 iter: 837 begin\n",
      "Train epoch:16 iter: 837 end\n",
      "Train epoch:16 iter: 838 begin\n",
      "Train epoch:16 iter: 838 end\n",
      "Train epoch:16 iter: 839 begin\n",
      "Train epoch:16 iter: 839 end\n",
      "Train epoch:16 iter: 840 begin\n",
      "Train epoch:16 iter: 840 end\n",
      "Train epoch:16 iter: 841 begin\n",
      "Train epoch:16 iter: 841 end\n",
      "Train epoch:16 iter: 842 begin\n",
      "Train epoch:16 iter: 842 end\n",
      "Train epoch:16 iter: 843 begin\n",
      "Train epoch:16 iter: 843 end\n",
      "Train epoch:16 iter: 844 begin\n",
      "Train epoch:16 iter: 844 end\n",
      "Train epoch:16 iter: 845 begin\n",
      "Train epoch:16 iter: 845 end\n",
      "Train epoch:16 iter: 846 begin\n",
      "Train epoch:16 iter: 846 end\n",
      "Train epoch:16 iter: 847 begin\n",
      "Train epoch:16 iter: 847 end\n",
      "Train epoch:16 iter: 848 begin\n",
      "Train epoch:16 iter: 848 end\n",
      "Train epoch:16 iter: 849 begin\n",
      "Train epoch:16 iter: 849 end\n",
      "Train epoch:16 iter: 850 begin\n",
      "Train epoch:16 iter: 850 end\n",
      "Train epoch:16 iter: 851 begin\n",
      "Train epoch:16 iter: 851 end\n",
      "Train epoch:16 iter: 852 begin\n",
      "Train epoch:16 iter: 852 end\n",
      "Train epoch:16 iter: 853 begin\n",
      "Train epoch:16 iter: 853 end\n",
      "Train epoch:16 iter: 854 begin\n",
      "Train epoch:16 iter: 854 end\n",
      "Train epoch:16 iter: 855 begin\n",
      "Train epoch:16 iter: 855 end\n",
      "Train epoch:16 iter: 856 begin\n",
      "Train epoch:16 iter: 856 end\n",
      "Train epoch:16 iter: 857 begin\n",
      "Train epoch:16 iter: 857 end\n",
      "Train epoch:16 iter: 858 begin\n",
      "Train epoch:16 iter: 858 end\n",
      "Train epoch:16 iter: 859 begin\n",
      "Train epoch:16 iter: 859 end\n",
      "Train epoch:16 iter: 860 begin\n",
      "Train epoch:16 iter: 860 end\n",
      "Train epoch:16 iter: 861 begin\n",
      "Train epoch:16 iter: 861 end\n",
      "Train epoch:16 iter: 862 begin\n",
      "Train epoch:16 iter: 862 end\n",
      "Train epoch:16 iter: 863 begin\n",
      "Train epoch:16 iter: 863 end\n",
      "Train epoch:16 iter: 864 begin\n",
      "Train epoch:16 iter: 864 end\n",
      "Train epoch:16 iter: 865 begin\n",
      "Train epoch:16 iter: 865 end\n",
      "Train epoch:16 iter: 866 begin\n",
      "Train epoch:16 iter: 866 end\n",
      "Train epoch:16 iter: 867 begin\n",
      "Train epoch:16 iter: 867 end\n",
      "Train epoch:16 iter: 868 begin\n",
      "Train epoch:16 iter: 868 end\n",
      "Train epoch:16 iter: 869 begin\n",
      "Train epoch:16 iter: 869 end\n",
      "Train epoch:16 iter: 870 begin\n",
      "Train epoch:16 iter: 870 end\n",
      "Train epoch:16 iter: 871 begin\n",
      "Train epoch:16 iter: 871 end\n",
      "Train epoch:16 iter: 872 begin\n",
      "Train epoch:16 iter: 872 end\n",
      "Train epoch:16 iter: 873 begin\n",
      "Train epoch:16 iter: 873 end\n",
      "Train epoch:16 iter: 874 begin\n",
      "Train epoch:16 iter: 874 end\n",
      "Train epoch:16 iter: 875 begin\n",
      "Train epoch:16 iter: 875 end\n",
      "Train epoch:16 iter: 876 begin\n",
      "Train epoch:16 iter: 876 end\n",
      "Train epoch:16 iter: 877 begin\n",
      "Train epoch:16 iter: 877 end\n",
      "Train epoch:16 iter: 878 begin\n",
      "Train epoch:16 iter: 878 end\n",
      "Train epoch:16 iter: 879 begin\n",
      "Train epoch:16 iter: 879 end\n",
      "Train epoch:16 iter: 880 begin\n",
      "Train epoch:16 iter: 880 end\n",
      "Train epoch:16 iter: 881 begin\n",
      "Train epoch:16 iter: 881 end\n",
      "Train epoch:16 iter: 882 begin\n",
      "Train epoch:16 iter: 882 end\n",
      "Train epoch:16 iter: 883 begin\n",
      "Train epoch:16 iter: 883 end\n",
      "Train epoch:16 iter: 884 begin\n",
      "Train epoch:16 iter: 884 end\n",
      "Train epoch:16 iter: 885 begin\n",
      "Train epoch:16 iter: 885 end\n",
      "Train epoch:16 iter: 886 begin\n",
      "Train epoch:16 iter: 886 end\n",
      "Train epoch:16 iter: 887 begin\n",
      "Train epoch:16 iter: 887 end\n",
      "Train epoch:16 iter: 888 begin\n",
      "Train epoch:16 iter: 888 end\n",
      "Train epoch:16 iter: 889 begin\n",
      "Train epoch:16 iter: 889 end\n",
      "Train epoch:16 iter: 890 begin\n",
      "Train epoch:16 iter: 890 end\n",
      "Train epoch:16 iter: 891 begin\n",
      "Train epoch:16 iter: 891 end\n",
      "Train epoch:16 iter: 892 begin\n",
      "Train epoch:16 iter: 892 end\n",
      "Train epoch:16 iter: 893 begin\n",
      "Train epoch:16 iter: 893 end\n",
      "Train epoch:16 iter: 894 begin\n",
      "Train epoch:16 iter: 894 end\n",
      "Train epoch:16 iter: 895 begin\n",
      "Train epoch:16 iter: 895 end\n",
      "Train epoch:16 iter: 896 begin\n",
      "Train epoch:16 iter: 896 end\n",
      "Train epoch:16 iter: 897 begin\n",
      "Train epoch:16 iter: 897 end\n",
      "Train epoch:16 iter: 898 begin\n",
      "Train epoch:16 iter: 898 end\n",
      "Train epoch:16 iter: 899 begin\n",
      "Train epoch:16 iter: 899 end\n",
      "Train epoch:16 iter: 900 begin\n",
      "Train epoch:16 iter: 900 end\n",
      "Train epoch:16 iter: 901 begin\n",
      "Train epoch:16 iter: 901 end\n",
      "Train epoch:16 iter: 902 begin\n",
      "Train epoch:16 iter: 902 end\n",
      "Train epoch:16 iter: 903 begin\n",
      "Train epoch:16 iter: 903 end\n",
      "Train epoch:16 iter: 904 begin\n",
      "Train epoch:16 iter: 904 end\n",
      "Train epoch:16 iter: 905 begin\n",
      "Train epoch:16 iter: 905 end\n",
      "Train epoch:16 iter: 906 begin\n",
      "Train epoch:16 iter: 906 end\n",
      "Train epoch:16 iter: 907 begin\n",
      "Train epoch:16 iter: 907 end\n",
      "Train epoch:16 iter: 908 begin\n",
      "Train epoch:16 iter: 908 end\n",
      "Train epoch:16 iter: 909 begin\n",
      "Train epoch:16 iter: 909 end\n",
      "Train epoch:16 iter: 910 begin\n",
      "Train epoch:16 iter: 910 end\n",
      "Train epoch:16 iter: 911 begin\n",
      "Train epoch:16 iter: 911 end\n",
      "Train epoch:16 iter: 912 begin\n",
      "Train epoch:16 iter: 912 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:16 iter: 913 begin\n",
      "Train epoch:16 iter: 913 end\n",
      "Train epoch:16 iter: 914 begin\n",
      "Train epoch:16 iter: 914 end\n",
      "Train epoch:16 iter: 915 begin\n",
      "Train epoch:16 iter: 915 end\n",
      "Train epoch:16 iter: 916 begin\n",
      "Train epoch:16 iter: 916 end\n",
      "Train epoch:16 iter: 917 begin\n",
      "Train epoch:16 iter: 917 end\n",
      "Train epoch:16 iter: 918 begin\n",
      "Train epoch:16 iter: 918 end\n",
      "Train epoch:16 iter: 919 begin\n",
      "Train epoch:16 iter: 919 end\n",
      "Train epoch:16 iter: 920 begin\n",
      "Train epoch:16 iter: 920 end\n",
      "Train epoch:16 iter: 921 begin\n",
      "Train epoch:16 iter: 921 end\n",
      "Train epoch:16 iter: 922 begin\n",
      "Train epoch:16 iter: 922 end\n",
      "Train epoch:16 iter: 923 begin\n",
      "Train epoch:16 iter: 923 end\n",
      "Train epoch:16 iter: 924 begin\n",
      "Train epoch:16 iter: 924 end\n",
      "Train epoch:16 iter: 925 begin\n",
      "Train epoch:16 iter: 925 end\n",
      "Train epoch:16 iter: 926 begin\n",
      "Train epoch:16 iter: 926 end\n",
      "Train epoch:16 iter: 927 begin\n",
      "Train epoch:16 iter: 927 end\n",
      "Train epoch:16 iter: 928 begin\n",
      "Train epoch:16 iter: 928 end\n",
      "Train epoch:16 iter: 929 begin\n",
      "Train epoch:16 iter: 929 end\n",
      "Train epoch:16 iter: 930 begin\n",
      "Train epoch:16 iter: 930 end\n",
      "Train epoch:16 iter: 931 begin\n",
      "Train epoch:16 iter: 931 end\n",
      "Train epoch:16 iter: 932 begin\n",
      "Train epoch:16 iter: 932 end\n",
      "Train epoch:16 iter: 933 begin\n",
      "Train epoch:16 iter: 933 end\n",
      "Train epoch:16 iter: 934 begin\n",
      "Train epoch:16 iter: 934 end\n",
      "Train epoch:16 iter: 935 begin\n",
      "Train epoch:16 iter: 935 end\n",
      "Train epoch:16 iter: 936 begin\n",
      "Train epoch:16 iter: 936 end\n",
      "Train epoch:16 iter: 937 begin\n",
      "Train epoch:16 iter: 937 end\n",
      "Train epoch:16 iter: 938 begin\n",
      "Train epoch:16 iter: 938 end\n",
      "Train Loss: 0.000989, Acc: 0.976167\n",
      "save model for best accuate: 0.9761666666666666 begin\n",
      "save model for best accuate: 0.9761666666666666 end\n",
      "epoch 18\n",
      "Train epoch:17 iter: 1 begin\n",
      "Train epoch:17 iter: 1 end\n",
      "Train epoch:17 iter: 2 begin\n",
      "Train epoch:17 iter: 2 end\n",
      "Train epoch:17 iter: 3 begin\n",
      "Train epoch:17 iter: 3 end\n",
      "Train epoch:17 iter: 4 begin\n",
      "Train epoch:17 iter: 4 end\n",
      "Train epoch:17 iter: 5 begin\n",
      "Train epoch:17 iter: 5 end\n",
      "Train epoch:17 iter: 6 begin\n",
      "Train epoch:17 iter: 6 end\n",
      "Train epoch:17 iter: 7 begin\n",
      "Train epoch:17 iter: 7 end\n",
      "Train epoch:17 iter: 8 begin\n",
      "Train epoch:17 iter: 8 end\n",
      "Train epoch:17 iter: 9 begin\n",
      "Train epoch:17 iter: 9 end\n",
      "Train epoch:17 iter: 10 begin\n",
      "Train epoch:17 iter: 10 end\n",
      "Train epoch:17 iter: 11 begin\n",
      "Train epoch:17 iter: 11 end\n",
      "Train epoch:17 iter: 12 begin\n",
      "Train epoch:17 iter: 12 end\n",
      "Train epoch:17 iter: 13 begin\n",
      "Train epoch:17 iter: 13 end\n",
      "Train epoch:17 iter: 14 begin\n",
      "Train epoch:17 iter: 14 end\n",
      "Train epoch:17 iter: 15 begin\n",
      "Train epoch:17 iter: 15 end\n",
      "Train epoch:17 iter: 16 begin\n",
      "Train epoch:17 iter: 16 end\n",
      "Train epoch:17 iter: 17 begin\n",
      "Train epoch:17 iter: 17 end\n",
      "Train epoch:17 iter: 18 begin\n",
      "Train epoch:17 iter: 18 end\n",
      "Train epoch:17 iter: 19 begin\n",
      "Train epoch:17 iter: 19 end\n",
      "Train epoch:17 iter: 20 begin\n",
      "Train epoch:17 iter: 20 end\n",
      "Train epoch:17 iter: 21 begin\n",
      "Train epoch:17 iter: 21 end\n",
      "Train epoch:17 iter: 22 begin\n",
      "Train epoch:17 iter: 22 end\n",
      "Train epoch:17 iter: 23 begin\n",
      "Train epoch:17 iter: 23 end\n",
      "Train epoch:17 iter: 24 begin\n",
      "Train epoch:17 iter: 24 end\n",
      "Train epoch:17 iter: 25 begin\n",
      "Train epoch:17 iter: 25 end\n",
      "Train epoch:17 iter: 26 begin\n",
      "Train epoch:17 iter: 26 end\n",
      "Train epoch:17 iter: 27 begin\n",
      "Train epoch:17 iter: 27 end\n",
      "Train epoch:17 iter: 28 begin\n",
      "Train epoch:17 iter: 28 end\n",
      "Train epoch:17 iter: 29 begin\n",
      "Train epoch:17 iter: 29 end\n",
      "Train epoch:17 iter: 30 begin\n",
      "Train epoch:17 iter: 30 end\n",
      "Train epoch:17 iter: 31 begin\n",
      "Train epoch:17 iter: 31 end\n",
      "Train epoch:17 iter: 32 begin\n",
      "Train epoch:17 iter: 32 end\n",
      "Train epoch:17 iter: 33 begin\n",
      "Train epoch:17 iter: 33 end\n",
      "Train epoch:17 iter: 34 begin\n",
      "Train epoch:17 iter: 34 end\n",
      "Train epoch:17 iter: 35 begin\n",
      "Train epoch:17 iter: 35 end\n",
      "Train epoch:17 iter: 36 begin\n",
      "Train epoch:17 iter: 36 end\n",
      "Train epoch:17 iter: 37 begin\n",
      "Train epoch:17 iter: 37 end\n",
      "Train epoch:17 iter: 38 begin\n",
      "Train epoch:17 iter: 38 end\n",
      "Train epoch:17 iter: 39 begin\n",
      "Train epoch:17 iter: 39 end\n",
      "Train epoch:17 iter: 40 begin\n",
      "Train epoch:17 iter: 40 end\n",
      "Train epoch:17 iter: 41 begin\n",
      "Train epoch:17 iter: 41 end\n",
      "Train epoch:17 iter: 42 begin\n",
      "Train epoch:17 iter: 42 end\n",
      "Train epoch:17 iter: 43 begin\n",
      "Train epoch:17 iter: 43 end\n",
      "Train epoch:17 iter: 44 begin\n",
      "Train epoch:17 iter: 44 end\n",
      "Train epoch:17 iter: 45 begin\n",
      "Train epoch:17 iter: 45 end\n",
      "Train epoch:17 iter: 46 begin\n",
      "Train epoch:17 iter: 46 end\n",
      "Train epoch:17 iter: 47 begin\n",
      "Train epoch:17 iter: 47 end\n",
      "Train epoch:17 iter: 48 begin\n",
      "Train epoch:17 iter: 48 end\n",
      "Train epoch:17 iter: 49 begin\n",
      "Train epoch:17 iter: 49 end\n",
      "Train epoch:17 iter: 50 begin\n",
      "Train epoch:17 iter: 50 end\n",
      "Train epoch:17 iter: 51 begin\n",
      "Train epoch:17 iter: 51 end\n",
      "Train epoch:17 iter: 52 begin\n",
      "Train epoch:17 iter: 52 end\n",
      "Train epoch:17 iter: 53 begin\n",
      "Train epoch:17 iter: 53 end\n",
      "Train epoch:17 iter: 54 begin\n",
      "Train epoch:17 iter: 54 end\n",
      "Train epoch:17 iter: 55 begin\n",
      "Train epoch:17 iter: 55 end\n",
      "Train epoch:17 iter: 56 begin\n",
      "Train epoch:17 iter: 56 end\n",
      "Train epoch:17 iter: 57 begin\n",
      "Train epoch:17 iter: 57 end\n",
      "Train epoch:17 iter: 58 begin\n",
      "Train epoch:17 iter: 58 end\n",
      "Train epoch:17 iter: 59 begin\n",
      "Train epoch:17 iter: 59 end\n",
      "Train epoch:17 iter: 60 begin\n",
      "Train epoch:17 iter: 60 end\n",
      "Train epoch:17 iter: 61 begin\n",
      "Train epoch:17 iter: 61 end\n",
      "Train epoch:17 iter: 62 begin\n",
      "Train epoch:17 iter: 62 end\n",
      "Train epoch:17 iter: 63 begin\n",
      "Train epoch:17 iter: 63 end\n",
      "Train epoch:17 iter: 64 begin\n",
      "Train epoch:17 iter: 64 end\n",
      "Train epoch:17 iter: 65 begin\n",
      "Train epoch:17 iter: 65 end\n",
      "Train epoch:17 iter: 66 begin\n",
      "Train epoch:17 iter: 66 end\n",
      "Train epoch:17 iter: 67 begin\n",
      "Train epoch:17 iter: 67 end\n",
      "Train epoch:17 iter: 68 begin\n",
      "Train epoch:17 iter: 68 end\n",
      "Train epoch:17 iter: 69 begin\n",
      "Train epoch:17 iter: 69 end\n",
      "Train epoch:17 iter: 70 begin\n",
      "Train epoch:17 iter: 70 end\n",
      "Train epoch:17 iter: 71 begin\n",
      "Train epoch:17 iter: 71 end\n",
      "Train epoch:17 iter: 72 begin\n",
      "Train epoch:17 iter: 72 end\n",
      "Train epoch:17 iter: 73 begin\n",
      "Train epoch:17 iter: 73 end\n",
      "Train epoch:17 iter: 74 begin\n",
      "Train epoch:17 iter: 74 end\n",
      "Train epoch:17 iter: 75 begin\n",
      "Train epoch:17 iter: 75 end\n",
      "Train epoch:17 iter: 76 begin\n",
      "Train epoch:17 iter: 76 end\n",
      "Train epoch:17 iter: 77 begin\n",
      "Train epoch:17 iter: 77 end\n",
      "Train epoch:17 iter: 78 begin\n",
      "Train epoch:17 iter: 78 end\n",
      "Train epoch:17 iter: 79 begin\n",
      "Train epoch:17 iter: 79 end\n",
      "Train epoch:17 iter: 80 begin\n",
      "Train epoch:17 iter: 80 end\n",
      "Train epoch:17 iter: 81 begin\n",
      "Train epoch:17 iter: 81 end\n",
      "Train epoch:17 iter: 82 begin\n",
      "Train epoch:17 iter: 82 end\n",
      "Train epoch:17 iter: 83 begin\n",
      "Train epoch:17 iter: 83 end\n",
      "Train epoch:17 iter: 84 begin\n",
      "Train epoch:17 iter: 84 end\n",
      "Train epoch:17 iter: 85 begin\n",
      "Train epoch:17 iter: 85 end\n",
      "Train epoch:17 iter: 86 begin\n",
      "Train epoch:17 iter: 86 end\n",
      "Train epoch:17 iter: 87 begin\n",
      "Train epoch:17 iter: 87 end\n",
      "Train epoch:17 iter: 88 begin\n",
      "Train epoch:17 iter: 88 end\n",
      "Train epoch:17 iter: 89 begin\n",
      "Train epoch:17 iter: 89 end\n",
      "Train epoch:17 iter: 90 begin\n",
      "Train epoch:17 iter: 90 end\n",
      "Train epoch:17 iter: 91 begin\n",
      "Train epoch:17 iter: 91 end\n",
      "Train epoch:17 iter: 92 begin\n",
      "Train epoch:17 iter: 92 end\n",
      "Train epoch:17 iter: 93 begin\n",
      "Train epoch:17 iter: 93 end\n",
      "Train epoch:17 iter: 94 begin\n",
      "Train epoch:17 iter: 94 end\n",
      "Train epoch:17 iter: 95 begin\n",
      "Train epoch:17 iter: 95 end\n",
      "Train epoch:17 iter: 96 begin\n",
      "Train epoch:17 iter: 96 end\n",
      "Train epoch:17 iter: 97 begin\n",
      "Train epoch:17 iter: 97 end\n",
      "Train epoch:17 iter: 98 begin\n",
      "Train epoch:17 iter: 98 end\n",
      "Train epoch:17 iter: 99 begin\n",
      "Train epoch:17 iter: 99 end\n",
      "Train epoch:17 iter: 100 begin\n",
      "Train epoch:17 iter: 100 end\n",
      "Train epoch:17 iter: 101 begin\n",
      "Train epoch:17 iter: 101 end\n",
      "Train epoch:17 iter: 102 begin\n",
      "Train epoch:17 iter: 102 end\n",
      "Train epoch:17 iter: 103 begin\n",
      "Train epoch:17 iter: 103 end\n",
      "Train epoch:17 iter: 104 begin\n",
      "Train epoch:17 iter: 104 end\n",
      "Train epoch:17 iter: 105 begin\n",
      "Train epoch:17 iter: 105 end\n",
      "Train epoch:17 iter: 106 begin\n",
      "Train epoch:17 iter: 106 end\n",
      "Train epoch:17 iter: 107 begin\n",
      "Train epoch:17 iter: 107 end\n",
      "Train epoch:17 iter: 108 begin\n",
      "Train epoch:17 iter: 108 end\n",
      "Train epoch:17 iter: 109 begin\n",
      "Train epoch:17 iter: 109 end\n",
      "Train epoch:17 iter: 110 begin\n",
      "Train epoch:17 iter: 110 end\n",
      "Train epoch:17 iter: 111 begin\n",
      "Train epoch:17 iter: 111 end\n",
      "Train epoch:17 iter: 112 begin\n",
      "Train epoch:17 iter: 112 end\n",
      "Train epoch:17 iter: 113 begin\n",
      "Train epoch:17 iter: 113 end\n",
      "Train epoch:17 iter: 114 begin\n",
      "Train epoch:17 iter: 114 end\n",
      "Train epoch:17 iter: 115 begin\n",
      "Train epoch:17 iter: 115 end\n",
      "Train epoch:17 iter: 116 begin\n",
      "Train epoch:17 iter: 116 end\n",
      "Train epoch:17 iter: 117 begin\n",
      "Train epoch:17 iter: 117 end\n",
      "Train epoch:17 iter: 118 begin\n",
      "Train epoch:17 iter: 118 end\n",
      "Train epoch:17 iter: 119 begin\n",
      "Train epoch:17 iter: 119 end\n",
      "Train epoch:17 iter: 120 begin\n",
      "Train epoch:17 iter: 120 end\n",
      "Train epoch:17 iter: 121 begin\n",
      "Train epoch:17 iter: 121 end\n",
      "Train epoch:17 iter: 122 begin\n",
      "Train epoch:17 iter: 122 end\n",
      "Train epoch:17 iter: 123 begin\n",
      "Train epoch:17 iter: 123 end\n",
      "Train epoch:17 iter: 124 begin\n",
      "Train epoch:17 iter: 124 end\n",
      "Train epoch:17 iter: 125 begin\n",
      "Train epoch:17 iter: 125 end\n",
      "Train epoch:17 iter: 126 begin\n",
      "Train epoch:17 iter: 126 end\n",
      "Train epoch:17 iter: 127 begin\n",
      "Train epoch:17 iter: 127 end\n",
      "Train epoch:17 iter: 128 begin\n",
      "Train epoch:17 iter: 128 end\n",
      "Train epoch:17 iter: 129 begin\n",
      "Train epoch:17 iter: 129 end\n",
      "Train epoch:17 iter: 130 begin\n",
      "Train epoch:17 iter: 130 end\n",
      "Train epoch:17 iter: 131 begin\n",
      "Train epoch:17 iter: 131 end\n",
      "Train epoch:17 iter: 132 begin\n",
      "Train epoch:17 iter: 132 end\n",
      "Train epoch:17 iter: 133 begin\n",
      "Train epoch:17 iter: 133 end\n",
      "Train epoch:17 iter: 134 begin\n",
      "Train epoch:17 iter: 134 end\n",
      "Train epoch:17 iter: 135 begin\n",
      "Train epoch:17 iter: 135 end\n",
      "Train epoch:17 iter: 136 begin\n",
      "Train epoch:17 iter: 136 end\n",
      "Train epoch:17 iter: 137 begin\n",
      "Train epoch:17 iter: 137 end\n",
      "Train epoch:17 iter: 138 begin\n",
      "Train epoch:17 iter: 138 end\n",
      "Train epoch:17 iter: 139 begin\n",
      "Train epoch:17 iter: 139 end\n",
      "Train epoch:17 iter: 140 begin\n",
      "Train epoch:17 iter: 140 end\n",
      "Train epoch:17 iter: 141 begin\n",
      "Train epoch:17 iter: 141 end\n",
      "Train epoch:17 iter: 142 begin\n",
      "Train epoch:17 iter: 142 end\n",
      "Train epoch:17 iter: 143 begin\n",
      "Train epoch:17 iter: 143 end\n",
      "Train epoch:17 iter: 144 begin\n",
      "Train epoch:17 iter: 144 end\n",
      "Train epoch:17 iter: 145 begin\n",
      "Train epoch:17 iter: 145 end\n",
      "Train epoch:17 iter: 146 begin\n",
      "Train epoch:17 iter: 146 end\n",
      "Train epoch:17 iter: 147 begin\n",
      "Train epoch:17 iter: 147 end\n",
      "Train epoch:17 iter: 148 begin\n",
      "Train epoch:17 iter: 148 end\n",
      "Train epoch:17 iter: 149 begin\n",
      "Train epoch:17 iter: 149 end\n",
      "Train epoch:17 iter: 150 begin\n",
      "Train epoch:17 iter: 150 end\n",
      "Train epoch:17 iter: 151 begin\n",
      "Train epoch:17 iter: 151 end\n",
      "Train epoch:17 iter: 152 begin\n",
      "Train epoch:17 iter: 152 end\n",
      "Train epoch:17 iter: 153 begin\n",
      "Train epoch:17 iter: 153 end\n",
      "Train epoch:17 iter: 154 begin\n",
      "Train epoch:17 iter: 154 end\n",
      "Train epoch:17 iter: 155 begin\n",
      "Train epoch:17 iter: 155 end\n",
      "Train epoch:17 iter: 156 begin\n",
      "Train epoch:17 iter: 156 end\n",
      "Train epoch:17 iter: 157 begin\n",
      "Train epoch:17 iter: 157 end\n",
      "Train epoch:17 iter: 158 begin\n",
      "Train epoch:17 iter: 158 end\n",
      "Train epoch:17 iter: 159 begin\n",
      "Train epoch:17 iter: 159 end\n",
      "Train epoch:17 iter: 160 begin\n",
      "Train epoch:17 iter: 160 end\n",
      "Train epoch:17 iter: 161 begin\n",
      "Train epoch:17 iter: 161 end\n",
      "Train epoch:17 iter: 162 begin\n",
      "Train epoch:17 iter: 162 end\n",
      "Train epoch:17 iter: 163 begin\n",
      "Train epoch:17 iter: 163 end\n",
      "Train epoch:17 iter: 164 begin\n",
      "Train epoch:17 iter: 164 end\n",
      "Train epoch:17 iter: 165 begin\n",
      "Train epoch:17 iter: 165 end\n",
      "Train epoch:17 iter: 166 begin\n",
      "Train epoch:17 iter: 166 end\n",
      "Train epoch:17 iter: 167 begin\n",
      "Train epoch:17 iter: 167 end\n",
      "Train epoch:17 iter: 168 begin\n",
      "Train epoch:17 iter: 168 end\n",
      "Train epoch:17 iter: 169 begin\n",
      "Train epoch:17 iter: 169 end\n",
      "Train epoch:17 iter: 170 begin\n",
      "Train epoch:17 iter: 170 end\n",
      "Train epoch:17 iter: 171 begin\n",
      "Train epoch:17 iter: 171 end\n",
      "Train epoch:17 iter: 172 begin\n",
      "Train epoch:17 iter: 172 end\n",
      "Train epoch:17 iter: 173 begin\n",
      "Train epoch:17 iter: 173 end\n",
      "Train epoch:17 iter: 174 begin\n",
      "Train epoch:17 iter: 174 end\n",
      "Train epoch:17 iter: 175 begin\n",
      "Train epoch:17 iter: 175 end\n",
      "Train epoch:17 iter: 176 begin\n",
      "Train epoch:17 iter: 176 end\n",
      "Train epoch:17 iter: 177 begin\n",
      "Train epoch:17 iter: 177 end\n",
      "Train epoch:17 iter: 178 begin\n",
      "Train epoch:17 iter: 178 end\n",
      "Train epoch:17 iter: 179 begin\n",
      "Train epoch:17 iter: 179 end\n",
      "Train epoch:17 iter: 180 begin\n",
      "Train epoch:17 iter: 180 end\n",
      "Train epoch:17 iter: 181 begin\n",
      "Train epoch:17 iter: 181 end\n",
      "Train epoch:17 iter: 182 begin\n",
      "Train epoch:17 iter: 182 end\n",
      "Train epoch:17 iter: 183 begin\n",
      "Train epoch:17 iter: 183 end\n",
      "Train epoch:17 iter: 184 begin\n",
      "Train epoch:17 iter: 184 end\n",
      "Train epoch:17 iter: 185 begin\n",
      "Train epoch:17 iter: 185 end\n",
      "Train epoch:17 iter: 186 begin\n",
      "Train epoch:17 iter: 186 end\n",
      "Train epoch:17 iter: 187 begin\n",
      "Train epoch:17 iter: 187 end\n",
      "Train epoch:17 iter: 188 begin\n",
      "Train epoch:17 iter: 188 end\n",
      "Train epoch:17 iter: 189 begin\n",
      "Train epoch:17 iter: 189 end\n",
      "Train epoch:17 iter: 190 begin\n",
      "Train epoch:17 iter: 190 end\n",
      "Train epoch:17 iter: 191 begin\n",
      "Train epoch:17 iter: 191 end\n",
      "Train epoch:17 iter: 192 begin\n",
      "Train epoch:17 iter: 192 end\n",
      "Train epoch:17 iter: 193 begin\n",
      "Train epoch:17 iter: 193 end\n",
      "Train epoch:17 iter: 194 begin\n",
      "Train epoch:17 iter: 194 end\n",
      "Train epoch:17 iter: 195 begin\n",
      "Train epoch:17 iter: 195 end\n",
      "Train epoch:17 iter: 196 begin\n",
      "Train epoch:17 iter: 196 end\n",
      "Train epoch:17 iter: 197 begin\n",
      "Train epoch:17 iter: 197 end\n",
      "Train epoch:17 iter: 198 begin\n",
      "Train epoch:17 iter: 198 end\n",
      "Train epoch:17 iter: 199 begin\n",
      "Train epoch:17 iter: 199 end\n",
      "Train epoch:17 iter: 200 begin\n",
      "Train epoch:17 iter: 200 end\n",
      "Train epoch:17 iter: 201 begin\n",
      "Train epoch:17 iter: 201 end\n",
      "Train epoch:17 iter: 202 begin\n",
      "Train epoch:17 iter: 202 end\n",
      "Train epoch:17 iter: 203 begin\n",
      "Train epoch:17 iter: 203 end\n",
      "Train epoch:17 iter: 204 begin\n",
      "Train epoch:17 iter: 204 end\n",
      "Train epoch:17 iter: 205 begin\n",
      "Train epoch:17 iter: 205 end\n",
      "Train epoch:17 iter: 206 begin\n",
      "Train epoch:17 iter: 206 end\n",
      "Train epoch:17 iter: 207 begin\n",
      "Train epoch:17 iter: 207 end\n",
      "Train epoch:17 iter: 208 begin\n",
      "Train epoch:17 iter: 208 end\n",
      "Train epoch:17 iter: 209 begin\n",
      "Train epoch:17 iter: 209 end\n",
      "Train epoch:17 iter: 210 begin\n",
      "Train epoch:17 iter: 210 end\n",
      "Train epoch:17 iter: 211 begin\n",
      "Train epoch:17 iter: 211 end\n",
      "Train epoch:17 iter: 212 begin\n",
      "Train epoch:17 iter: 212 end\n",
      "Train epoch:17 iter: 213 begin\n",
      "Train epoch:17 iter: 213 end\n",
      "Train epoch:17 iter: 214 begin\n",
      "Train epoch:17 iter: 214 end\n",
      "Train epoch:17 iter: 215 begin\n",
      "Train epoch:17 iter: 215 end\n",
      "Train epoch:17 iter: 216 begin\n",
      "Train epoch:17 iter: 216 end\n",
      "Train epoch:17 iter: 217 begin\n",
      "Train epoch:17 iter: 217 end\n",
      "Train epoch:17 iter: 218 begin\n",
      "Train epoch:17 iter: 218 end\n",
      "Train epoch:17 iter: 219 begin\n",
      "Train epoch:17 iter: 219 end\n",
      "Train epoch:17 iter: 220 begin\n",
      "Train epoch:17 iter: 220 end\n",
      "Train epoch:17 iter: 221 begin\n",
      "Train epoch:17 iter: 221 end\n",
      "Train epoch:17 iter: 222 begin\n",
      "Train epoch:17 iter: 222 end\n",
      "Train epoch:17 iter: 223 begin\n",
      "Train epoch:17 iter: 223 end\n",
      "Train epoch:17 iter: 224 begin\n",
      "Train epoch:17 iter: 224 end\n",
      "Train epoch:17 iter: 225 begin\n",
      "Train epoch:17 iter: 225 end\n",
      "Train epoch:17 iter: 226 begin\n",
      "Train epoch:17 iter: 226 end\n",
      "Train epoch:17 iter: 227 begin\n",
      "Train epoch:17 iter: 227 end\n",
      "Train epoch:17 iter: 228 begin\n",
      "Train epoch:17 iter: 228 end\n",
      "Train epoch:17 iter: 229 begin\n",
      "Train epoch:17 iter: 229 end\n",
      "Train epoch:17 iter: 230 begin\n",
      "Train epoch:17 iter: 230 end\n",
      "Train epoch:17 iter: 231 begin\n",
      "Train epoch:17 iter: 231 end\n",
      "Train epoch:17 iter: 232 begin\n",
      "Train epoch:17 iter: 232 end\n",
      "Train epoch:17 iter: 233 begin\n",
      "Train epoch:17 iter: 233 end\n",
      "Train epoch:17 iter: 234 begin\n",
      "Train epoch:17 iter: 234 end\n",
      "Train epoch:17 iter: 235 begin\n",
      "Train epoch:17 iter: 235 end\n",
      "Train epoch:17 iter: 236 begin\n",
      "Train epoch:17 iter: 236 end\n",
      "Train epoch:17 iter: 237 begin\n",
      "Train epoch:17 iter: 237 end\n",
      "Train epoch:17 iter: 238 begin\n",
      "Train epoch:17 iter: 238 end\n",
      "Train epoch:17 iter: 239 begin\n",
      "Train epoch:17 iter: 239 end\n",
      "Train epoch:17 iter: 240 begin\n",
      "Train epoch:17 iter: 240 end\n",
      "Train epoch:17 iter: 241 begin\n",
      "Train epoch:17 iter: 241 end\n",
      "Train epoch:17 iter: 242 begin\n",
      "Train epoch:17 iter: 242 end\n",
      "Train epoch:17 iter: 243 begin\n",
      "Train epoch:17 iter: 243 end\n",
      "Train epoch:17 iter: 244 begin\n",
      "Train epoch:17 iter: 244 end\n",
      "Train epoch:17 iter: 245 begin\n",
      "Train epoch:17 iter: 245 end\n",
      "Train epoch:17 iter: 246 begin\n",
      "Train epoch:17 iter: 246 end\n",
      "Train epoch:17 iter: 247 begin\n",
      "Train epoch:17 iter: 247 end\n",
      "Train epoch:17 iter: 248 begin\n",
      "Train epoch:17 iter: 248 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:17 iter: 249 begin\n",
      "Train epoch:17 iter: 249 end\n",
      "Train epoch:17 iter: 250 begin\n",
      "Train epoch:17 iter: 250 end\n",
      "Train epoch:17 iter: 251 begin\n",
      "Train epoch:17 iter: 251 end\n",
      "Train epoch:17 iter: 252 begin\n",
      "Train epoch:17 iter: 252 end\n",
      "Train epoch:17 iter: 253 begin\n",
      "Train epoch:17 iter: 253 end\n",
      "Train epoch:17 iter: 254 begin\n",
      "Train epoch:17 iter: 254 end\n",
      "Train epoch:17 iter: 255 begin\n",
      "Train epoch:17 iter: 255 end\n",
      "Train epoch:17 iter: 256 begin\n",
      "Train epoch:17 iter: 256 end\n",
      "Train epoch:17 iter: 257 begin\n",
      "Train epoch:17 iter: 257 end\n",
      "Train epoch:17 iter: 258 begin\n",
      "Train epoch:17 iter: 258 end\n",
      "Train epoch:17 iter: 259 begin\n",
      "Train epoch:17 iter: 259 end\n",
      "Train epoch:17 iter: 260 begin\n",
      "Train epoch:17 iter: 260 end\n",
      "Train epoch:17 iter: 261 begin\n",
      "Train epoch:17 iter: 261 end\n",
      "Train epoch:17 iter: 262 begin\n",
      "Train epoch:17 iter: 262 end\n",
      "Train epoch:17 iter: 263 begin\n",
      "Train epoch:17 iter: 263 end\n",
      "Train epoch:17 iter: 264 begin\n",
      "Train epoch:17 iter: 264 end\n",
      "Train epoch:17 iter: 265 begin\n",
      "Train epoch:17 iter: 265 end\n",
      "Train epoch:17 iter: 266 begin\n",
      "Train epoch:17 iter: 266 end\n",
      "Train epoch:17 iter: 267 begin\n",
      "Train epoch:17 iter: 267 end\n",
      "Train epoch:17 iter: 268 begin\n",
      "Train epoch:17 iter: 268 end\n",
      "Train epoch:17 iter: 269 begin\n",
      "Train epoch:17 iter: 269 end\n",
      "Train epoch:17 iter: 270 begin\n",
      "Train epoch:17 iter: 270 end\n",
      "Train epoch:17 iter: 271 begin\n",
      "Train epoch:17 iter: 271 end\n",
      "Train epoch:17 iter: 272 begin\n",
      "Train epoch:17 iter: 272 end\n",
      "Train epoch:17 iter: 273 begin\n",
      "Train epoch:17 iter: 273 end\n",
      "Train epoch:17 iter: 274 begin\n",
      "Train epoch:17 iter: 274 end\n",
      "Train epoch:17 iter: 275 begin\n",
      "Train epoch:17 iter: 275 end\n",
      "Train epoch:17 iter: 276 begin\n",
      "Train epoch:17 iter: 276 end\n",
      "Train epoch:17 iter: 277 begin\n",
      "Train epoch:17 iter: 277 end\n",
      "Train epoch:17 iter: 278 begin\n",
      "Train epoch:17 iter: 278 end\n",
      "Train epoch:17 iter: 279 begin\n",
      "Train epoch:17 iter: 279 end\n",
      "Train epoch:17 iter: 280 begin\n",
      "Train epoch:17 iter: 280 end\n",
      "Train epoch:17 iter: 281 begin\n",
      "Train epoch:17 iter: 281 end\n",
      "Train epoch:17 iter: 282 begin\n",
      "Train epoch:17 iter: 282 end\n",
      "Train epoch:17 iter: 283 begin\n",
      "Train epoch:17 iter: 283 end\n",
      "Train epoch:17 iter: 284 begin\n",
      "Train epoch:17 iter: 284 end\n",
      "Train epoch:17 iter: 285 begin\n",
      "Train epoch:17 iter: 285 end\n",
      "Train epoch:17 iter: 286 begin\n",
      "Train epoch:17 iter: 286 end\n",
      "Train epoch:17 iter: 287 begin\n",
      "Train epoch:17 iter: 287 end\n",
      "Train epoch:17 iter: 288 begin\n",
      "Train epoch:17 iter: 288 end\n",
      "Train epoch:17 iter: 289 begin\n",
      "Train epoch:17 iter: 289 end\n",
      "Train epoch:17 iter: 290 begin\n",
      "Train epoch:17 iter: 290 end\n",
      "Train epoch:17 iter: 291 begin\n",
      "Train epoch:17 iter: 291 end\n",
      "Train epoch:17 iter: 292 begin\n",
      "Train epoch:17 iter: 292 end\n",
      "Train epoch:17 iter: 293 begin\n",
      "Train epoch:17 iter: 293 end\n",
      "Train epoch:17 iter: 294 begin\n",
      "Train epoch:17 iter: 294 end\n",
      "Train epoch:17 iter: 295 begin\n",
      "Train epoch:17 iter: 295 end\n",
      "Train epoch:17 iter: 296 begin\n",
      "Train epoch:17 iter: 296 end\n",
      "Train epoch:17 iter: 297 begin\n",
      "Train epoch:17 iter: 297 end\n",
      "Train epoch:17 iter: 298 begin\n",
      "Train epoch:17 iter: 298 end\n",
      "Train epoch:17 iter: 299 begin\n",
      "Train epoch:17 iter: 299 end\n",
      "Train epoch:17 iter: 300 begin\n",
      "Train epoch:17 iter: 300 end\n",
      "Train epoch:17 iter: 301 begin\n",
      "Train epoch:17 iter: 301 end\n",
      "Train epoch:17 iter: 302 begin\n",
      "Train epoch:17 iter: 302 end\n",
      "Train epoch:17 iter: 303 begin\n",
      "Train epoch:17 iter: 303 end\n",
      "Train epoch:17 iter: 304 begin\n",
      "Train epoch:17 iter: 304 end\n",
      "Train epoch:17 iter: 305 begin\n",
      "Train epoch:17 iter: 305 end\n",
      "Train epoch:17 iter: 306 begin\n",
      "Train epoch:17 iter: 306 end\n",
      "Train epoch:17 iter: 307 begin\n",
      "Train epoch:17 iter: 307 end\n",
      "Train epoch:17 iter: 308 begin\n",
      "Train epoch:17 iter: 308 end\n",
      "Train epoch:17 iter: 309 begin\n",
      "Train epoch:17 iter: 309 end\n",
      "Train epoch:17 iter: 310 begin\n",
      "Train epoch:17 iter: 310 end\n",
      "Train epoch:17 iter: 311 begin\n",
      "Train epoch:17 iter: 311 end\n",
      "Train epoch:17 iter: 312 begin\n",
      "Train epoch:17 iter: 312 end\n",
      "Train epoch:17 iter: 313 begin\n",
      "Train epoch:17 iter: 313 end\n",
      "Train epoch:17 iter: 314 begin\n",
      "Train epoch:17 iter: 314 end\n",
      "Train epoch:17 iter: 315 begin\n",
      "Train epoch:17 iter: 315 end\n",
      "Train epoch:17 iter: 316 begin\n",
      "Train epoch:17 iter: 316 end\n",
      "Train epoch:17 iter: 317 begin\n",
      "Train epoch:17 iter: 317 end\n",
      "Train epoch:17 iter: 318 begin\n",
      "Train epoch:17 iter: 318 end\n",
      "Train epoch:17 iter: 319 begin\n",
      "Train epoch:17 iter: 319 end\n",
      "Train epoch:17 iter: 320 begin\n",
      "Train epoch:17 iter: 320 end\n",
      "Train epoch:17 iter: 321 begin\n",
      "Train epoch:17 iter: 321 end\n",
      "Train epoch:17 iter: 322 begin\n",
      "Train epoch:17 iter: 322 end\n",
      "Train epoch:17 iter: 323 begin\n",
      "Train epoch:17 iter: 323 end\n",
      "Train epoch:17 iter: 324 begin\n",
      "Train epoch:17 iter: 324 end\n",
      "Train epoch:17 iter: 325 begin\n",
      "Train epoch:17 iter: 325 end\n",
      "Train epoch:17 iter: 326 begin\n",
      "Train epoch:17 iter: 326 end\n",
      "Train epoch:17 iter: 327 begin\n",
      "Train epoch:17 iter: 327 end\n",
      "Train epoch:17 iter: 328 begin\n",
      "Train epoch:17 iter: 328 end\n",
      "Train epoch:17 iter: 329 begin\n",
      "Train epoch:17 iter: 329 end\n",
      "Train epoch:17 iter: 330 begin\n",
      "Train epoch:17 iter: 330 end\n",
      "Train epoch:17 iter: 331 begin\n",
      "Train epoch:17 iter: 331 end\n",
      "Train epoch:17 iter: 332 begin\n",
      "Train epoch:17 iter: 332 end\n",
      "Train epoch:17 iter: 333 begin\n",
      "Train epoch:17 iter: 333 end\n",
      "Train epoch:17 iter: 334 begin\n",
      "Train epoch:17 iter: 334 end\n",
      "Train epoch:17 iter: 335 begin\n",
      "Train epoch:17 iter: 335 end\n",
      "Train epoch:17 iter: 336 begin\n",
      "Train epoch:17 iter: 336 end\n",
      "Train epoch:17 iter: 337 begin\n",
      "Train epoch:17 iter: 337 end\n",
      "Train epoch:17 iter: 338 begin\n",
      "Train epoch:17 iter: 338 end\n",
      "Train epoch:17 iter: 339 begin\n",
      "Train epoch:17 iter: 339 end\n",
      "Train epoch:17 iter: 340 begin\n",
      "Train epoch:17 iter: 340 end\n",
      "Train epoch:17 iter: 341 begin\n",
      "Train epoch:17 iter: 341 end\n",
      "Train epoch:17 iter: 342 begin\n",
      "Train epoch:17 iter: 342 end\n",
      "Train epoch:17 iter: 343 begin\n",
      "Train epoch:17 iter: 343 end\n",
      "Train epoch:17 iter: 344 begin\n",
      "Train epoch:17 iter: 344 end\n",
      "Train epoch:17 iter: 345 begin\n",
      "Train epoch:17 iter: 345 end\n",
      "Train epoch:17 iter: 346 begin\n",
      "Train epoch:17 iter: 346 end\n",
      "Train epoch:17 iter: 347 begin\n",
      "Train epoch:17 iter: 347 end\n",
      "Train epoch:17 iter: 348 begin\n",
      "Train epoch:17 iter: 348 end\n",
      "Train epoch:17 iter: 349 begin\n",
      "Train epoch:17 iter: 349 end\n",
      "Train epoch:17 iter: 350 begin\n",
      "Train epoch:17 iter: 350 end\n",
      "Train epoch:17 iter: 351 begin\n",
      "Train epoch:17 iter: 351 end\n",
      "Train epoch:17 iter: 352 begin\n",
      "Train epoch:17 iter: 352 end\n",
      "Train epoch:17 iter: 353 begin\n",
      "Train epoch:17 iter: 353 end\n",
      "Train epoch:17 iter: 354 begin\n",
      "Train epoch:17 iter: 354 end\n",
      "Train epoch:17 iter: 355 begin\n",
      "Train epoch:17 iter: 355 end\n",
      "Train epoch:17 iter: 356 begin\n",
      "Train epoch:17 iter: 356 end\n",
      "Train epoch:17 iter: 357 begin\n",
      "Train epoch:17 iter: 357 end\n",
      "Train epoch:17 iter: 358 begin\n",
      "Train epoch:17 iter: 358 end\n",
      "Train epoch:17 iter: 359 begin\n",
      "Train epoch:17 iter: 359 end\n",
      "Train epoch:17 iter: 360 begin\n",
      "Train epoch:17 iter: 360 end\n",
      "Train epoch:17 iter: 361 begin\n",
      "Train epoch:17 iter: 361 end\n",
      "Train epoch:17 iter: 362 begin\n",
      "Train epoch:17 iter: 362 end\n",
      "Train epoch:17 iter: 363 begin\n",
      "Train epoch:17 iter: 363 end\n",
      "Train epoch:17 iter: 364 begin\n",
      "Train epoch:17 iter: 364 end\n",
      "Train epoch:17 iter: 365 begin\n",
      "Train epoch:17 iter: 365 end\n",
      "Train epoch:17 iter: 366 begin\n",
      "Train epoch:17 iter: 366 end\n",
      "Train epoch:17 iter: 367 begin\n",
      "Train epoch:17 iter: 367 end\n",
      "Train epoch:17 iter: 368 begin\n",
      "Train epoch:17 iter: 368 end\n",
      "Train epoch:17 iter: 369 begin\n",
      "Train epoch:17 iter: 369 end\n",
      "Train epoch:17 iter: 370 begin\n",
      "Train epoch:17 iter: 370 end\n",
      "Train epoch:17 iter: 371 begin\n",
      "Train epoch:17 iter: 371 end\n",
      "Train epoch:17 iter: 372 begin\n",
      "Train epoch:17 iter: 372 end\n",
      "Train epoch:17 iter: 373 begin\n",
      "Train epoch:17 iter: 373 end\n",
      "Train epoch:17 iter: 374 begin\n",
      "Train epoch:17 iter: 374 end\n",
      "Train epoch:17 iter: 375 begin\n",
      "Train epoch:17 iter: 375 end\n",
      "Train epoch:17 iter: 376 begin\n",
      "Train epoch:17 iter: 376 end\n",
      "Train epoch:17 iter: 377 begin\n",
      "Train epoch:17 iter: 377 end\n",
      "Train epoch:17 iter: 378 begin\n",
      "Train epoch:17 iter: 378 end\n",
      "Train epoch:17 iter: 379 begin\n",
      "Train epoch:17 iter: 379 end\n",
      "Train epoch:17 iter: 380 begin\n",
      "Train epoch:17 iter: 380 end\n",
      "Train epoch:17 iter: 381 begin\n",
      "Train epoch:17 iter: 381 end\n",
      "Train epoch:17 iter: 382 begin\n",
      "Train epoch:17 iter: 382 end\n",
      "Train epoch:17 iter: 383 begin\n",
      "Train epoch:17 iter: 383 end\n",
      "Train epoch:17 iter: 384 begin\n",
      "Train epoch:17 iter: 384 end\n",
      "Train epoch:17 iter: 385 begin\n",
      "Train epoch:17 iter: 385 end\n",
      "Train epoch:17 iter: 386 begin\n",
      "Train epoch:17 iter: 386 end\n",
      "Train epoch:17 iter: 387 begin\n",
      "Train epoch:17 iter: 387 end\n",
      "Train epoch:17 iter: 388 begin\n",
      "Train epoch:17 iter: 388 end\n",
      "Train epoch:17 iter: 389 begin\n",
      "Train epoch:17 iter: 389 end\n",
      "Train epoch:17 iter: 390 begin\n",
      "Train epoch:17 iter: 390 end\n",
      "Train epoch:17 iter: 391 begin\n",
      "Train epoch:17 iter: 391 end\n",
      "Train epoch:17 iter: 392 begin\n",
      "Train epoch:17 iter: 392 end\n",
      "Train epoch:17 iter: 393 begin\n",
      "Train epoch:17 iter: 393 end\n",
      "Train epoch:17 iter: 394 begin\n",
      "Train epoch:17 iter: 394 end\n",
      "Train epoch:17 iter: 395 begin\n",
      "Train epoch:17 iter: 395 end\n",
      "Train epoch:17 iter: 396 begin\n",
      "Train epoch:17 iter: 396 end\n",
      "Train epoch:17 iter: 397 begin\n",
      "Train epoch:17 iter: 397 end\n",
      "Train epoch:17 iter: 398 begin\n",
      "Train epoch:17 iter: 398 end\n",
      "Train epoch:17 iter: 399 begin\n",
      "Train epoch:17 iter: 399 end\n",
      "Train epoch:17 iter: 400 begin\n",
      "Train epoch:17 iter: 400 end\n",
      "Train epoch:17 iter: 401 begin\n",
      "Train epoch:17 iter: 401 end\n",
      "Train epoch:17 iter: 402 begin\n",
      "Train epoch:17 iter: 402 end\n",
      "Train epoch:17 iter: 403 begin\n",
      "Train epoch:17 iter: 403 end\n",
      "Train epoch:17 iter: 404 begin\n",
      "Train epoch:17 iter: 404 end\n",
      "Train epoch:17 iter: 405 begin\n",
      "Train epoch:17 iter: 405 end\n",
      "Train epoch:17 iter: 406 begin\n",
      "Train epoch:17 iter: 406 end\n",
      "Train epoch:17 iter: 407 begin\n",
      "Train epoch:17 iter: 407 end\n",
      "Train epoch:17 iter: 408 begin\n",
      "Train epoch:17 iter: 408 end\n",
      "Train epoch:17 iter: 409 begin\n",
      "Train epoch:17 iter: 409 end\n",
      "Train epoch:17 iter: 410 begin\n",
      "Train epoch:17 iter: 410 end\n",
      "Train epoch:17 iter: 411 begin\n",
      "Train epoch:17 iter: 411 end\n",
      "Train epoch:17 iter: 412 begin\n",
      "Train epoch:17 iter: 412 end\n",
      "Train epoch:17 iter: 413 begin\n",
      "Train epoch:17 iter: 413 end\n",
      "Train epoch:17 iter: 414 begin\n",
      "Train epoch:17 iter: 414 end\n",
      "Train epoch:17 iter: 415 begin\n",
      "Train epoch:17 iter: 415 end\n",
      "Train epoch:17 iter: 416 begin\n",
      "Train epoch:17 iter: 416 end\n",
      "Train epoch:17 iter: 417 begin\n",
      "Train epoch:17 iter: 417 end\n",
      "Train epoch:17 iter: 418 begin\n",
      "Train epoch:17 iter: 418 end\n",
      "Train epoch:17 iter: 419 begin\n",
      "Train epoch:17 iter: 419 end\n",
      "Train epoch:17 iter: 420 begin\n",
      "Train epoch:17 iter: 420 end\n",
      "Train epoch:17 iter: 421 begin\n",
      "Train epoch:17 iter: 421 end\n",
      "Train epoch:17 iter: 422 begin\n",
      "Train epoch:17 iter: 422 end\n",
      "Train epoch:17 iter: 423 begin\n",
      "Train epoch:17 iter: 423 end\n",
      "Train epoch:17 iter: 424 begin\n",
      "Train epoch:17 iter: 424 end\n",
      "Train epoch:17 iter: 425 begin\n",
      "Train epoch:17 iter: 425 end\n",
      "Train epoch:17 iter: 426 begin\n",
      "Train epoch:17 iter: 426 end\n",
      "Train epoch:17 iter: 427 begin\n",
      "Train epoch:17 iter: 427 end\n",
      "Train epoch:17 iter: 428 begin\n",
      "Train epoch:17 iter: 428 end\n",
      "Train epoch:17 iter: 429 begin\n",
      "Train epoch:17 iter: 429 end\n",
      "Train epoch:17 iter: 430 begin\n",
      "Train epoch:17 iter: 430 end\n",
      "Train epoch:17 iter: 431 begin\n",
      "Train epoch:17 iter: 431 end\n",
      "Train epoch:17 iter: 432 begin\n",
      "Train epoch:17 iter: 432 end\n",
      "Train epoch:17 iter: 433 begin\n",
      "Train epoch:17 iter: 433 end\n",
      "Train epoch:17 iter: 434 begin\n",
      "Train epoch:17 iter: 434 end\n",
      "Train epoch:17 iter: 435 begin\n",
      "Train epoch:17 iter: 435 end\n",
      "Train epoch:17 iter: 436 begin\n",
      "Train epoch:17 iter: 436 end\n",
      "Train epoch:17 iter: 437 begin\n",
      "Train epoch:17 iter: 437 end\n",
      "Train epoch:17 iter: 438 begin\n",
      "Train epoch:17 iter: 438 end\n",
      "Train epoch:17 iter: 439 begin\n",
      "Train epoch:17 iter: 439 end\n",
      "Train epoch:17 iter: 440 begin\n",
      "Train epoch:17 iter: 440 end\n",
      "Train epoch:17 iter: 441 begin\n",
      "Train epoch:17 iter: 441 end\n",
      "Train epoch:17 iter: 442 begin\n",
      "Train epoch:17 iter: 442 end\n",
      "Train epoch:17 iter: 443 begin\n",
      "Train epoch:17 iter: 443 end\n",
      "Train epoch:17 iter: 444 begin\n",
      "Train epoch:17 iter: 444 end\n",
      "Train epoch:17 iter: 445 begin\n",
      "Train epoch:17 iter: 445 end\n",
      "Train epoch:17 iter: 446 begin\n",
      "Train epoch:17 iter: 446 end\n",
      "Train epoch:17 iter: 447 begin\n",
      "Train epoch:17 iter: 447 end\n",
      "Train epoch:17 iter: 448 begin\n",
      "Train epoch:17 iter: 448 end\n",
      "Train epoch:17 iter: 449 begin\n",
      "Train epoch:17 iter: 449 end\n",
      "Train epoch:17 iter: 450 begin\n",
      "Train epoch:17 iter: 450 end\n",
      "Train epoch:17 iter: 451 begin\n",
      "Train epoch:17 iter: 451 end\n",
      "Train epoch:17 iter: 452 begin\n",
      "Train epoch:17 iter: 452 end\n",
      "Train epoch:17 iter: 453 begin\n",
      "Train epoch:17 iter: 453 end\n",
      "Train epoch:17 iter: 454 begin\n",
      "Train epoch:17 iter: 454 end\n",
      "Train epoch:17 iter: 455 begin\n",
      "Train epoch:17 iter: 455 end\n",
      "Train epoch:17 iter: 456 begin\n",
      "Train epoch:17 iter: 456 end\n",
      "Train epoch:17 iter: 457 begin\n",
      "Train epoch:17 iter: 457 end\n",
      "Train epoch:17 iter: 458 begin\n",
      "Train epoch:17 iter: 458 end\n",
      "Train epoch:17 iter: 459 begin\n",
      "Train epoch:17 iter: 459 end\n",
      "Train epoch:17 iter: 460 begin\n",
      "Train epoch:17 iter: 460 end\n",
      "Train epoch:17 iter: 461 begin\n",
      "Train epoch:17 iter: 461 end\n",
      "Train epoch:17 iter: 462 begin\n",
      "Train epoch:17 iter: 462 end\n",
      "Train epoch:17 iter: 463 begin\n",
      "Train epoch:17 iter: 463 end\n",
      "Train epoch:17 iter: 464 begin\n",
      "Train epoch:17 iter: 464 end\n",
      "Train epoch:17 iter: 465 begin\n",
      "Train epoch:17 iter: 465 end\n",
      "Train epoch:17 iter: 466 begin\n",
      "Train epoch:17 iter: 466 end\n",
      "Train epoch:17 iter: 467 begin\n",
      "Train epoch:17 iter: 467 end\n",
      "Train epoch:17 iter: 468 begin\n",
      "Train epoch:17 iter: 468 end\n",
      "Train epoch:17 iter: 469 begin\n",
      "Train epoch:17 iter: 469 end\n",
      "Train epoch:17 iter: 470 begin\n",
      "Train epoch:17 iter: 470 end\n",
      "Train epoch:17 iter: 471 begin\n",
      "Train epoch:17 iter: 471 end\n",
      "Train epoch:17 iter: 472 begin\n",
      "Train epoch:17 iter: 472 end\n",
      "Train epoch:17 iter: 473 begin\n",
      "Train epoch:17 iter: 473 end\n",
      "Train epoch:17 iter: 474 begin\n",
      "Train epoch:17 iter: 474 end\n",
      "Train epoch:17 iter: 475 begin\n",
      "Train epoch:17 iter: 475 end\n",
      "Train epoch:17 iter: 476 begin\n",
      "Train epoch:17 iter: 476 end\n",
      "Train epoch:17 iter: 477 begin\n",
      "Train epoch:17 iter: 477 end\n",
      "Train epoch:17 iter: 478 begin\n",
      "Train epoch:17 iter: 478 end\n",
      "Train epoch:17 iter: 479 begin\n",
      "Train epoch:17 iter: 479 end\n",
      "Train epoch:17 iter: 480 begin\n",
      "Train epoch:17 iter: 480 end\n",
      "Train epoch:17 iter: 481 begin\n",
      "Train epoch:17 iter: 481 end\n",
      "Train epoch:17 iter: 482 begin\n",
      "Train epoch:17 iter: 482 end\n",
      "Train epoch:17 iter: 483 begin\n",
      "Train epoch:17 iter: 483 end\n",
      "Train epoch:17 iter: 484 begin\n",
      "Train epoch:17 iter: 484 end\n",
      "Train epoch:17 iter: 485 begin\n",
      "Train epoch:17 iter: 485 end\n",
      "Train epoch:17 iter: 486 begin\n",
      "Train epoch:17 iter: 486 end\n",
      "Train epoch:17 iter: 487 begin\n",
      "Train epoch:17 iter: 487 end\n",
      "Train epoch:17 iter: 488 begin\n",
      "Train epoch:17 iter: 488 end\n",
      "Train epoch:17 iter: 489 begin\n",
      "Train epoch:17 iter: 489 end\n",
      "Train epoch:17 iter: 490 begin\n",
      "Train epoch:17 iter: 490 end\n",
      "Train epoch:17 iter: 491 begin\n",
      "Train epoch:17 iter: 491 end\n",
      "Train epoch:17 iter: 492 begin\n",
      "Train epoch:17 iter: 492 end\n",
      "Train epoch:17 iter: 493 begin\n",
      "Train epoch:17 iter: 493 end\n",
      "Train epoch:17 iter: 494 begin\n",
      "Train epoch:17 iter: 494 end\n",
      "Train epoch:17 iter: 495 begin\n",
      "Train epoch:17 iter: 495 end\n",
      "Train epoch:17 iter: 496 begin\n",
      "Train epoch:17 iter: 496 end\n",
      "Train epoch:17 iter: 497 begin\n",
      "Train epoch:17 iter: 497 end\n",
      "Train epoch:17 iter: 498 begin\n",
      "Train epoch:17 iter: 498 end\n",
      "Train epoch:17 iter: 499 begin\n",
      "Train epoch:17 iter: 499 end\n",
      "Train epoch:17 iter: 500 begin\n",
      "Train epoch:17 iter: 500 end\n",
      "Train epoch:17 iter: 501 begin\n",
      "Train epoch:17 iter: 501 end\n",
      "Train epoch:17 iter: 502 begin\n",
      "Train epoch:17 iter: 502 end\n",
      "Train epoch:17 iter: 503 begin\n",
      "Train epoch:17 iter: 503 end\n",
      "Train epoch:17 iter: 504 begin\n",
      "Train epoch:17 iter: 504 end\n",
      "Train epoch:17 iter: 505 begin\n",
      "Train epoch:17 iter: 505 end\n",
      "Train epoch:17 iter: 506 begin\n",
      "Train epoch:17 iter: 506 end\n",
      "Train epoch:17 iter: 507 begin\n",
      "Train epoch:17 iter: 507 end\n",
      "Train epoch:17 iter: 508 begin\n",
      "Train epoch:17 iter: 508 end\n",
      "Train epoch:17 iter: 509 begin\n",
      "Train epoch:17 iter: 509 end\n",
      "Train epoch:17 iter: 510 begin\n",
      "Train epoch:17 iter: 510 end\n",
      "Train epoch:17 iter: 511 begin\n",
      "Train epoch:17 iter: 511 end\n",
      "Train epoch:17 iter: 512 begin\n",
      "Train epoch:17 iter: 512 end\n",
      "Train epoch:17 iter: 513 begin\n",
      "Train epoch:17 iter: 513 end\n",
      "Train epoch:17 iter: 514 begin\n",
      "Train epoch:17 iter: 514 end\n",
      "Train epoch:17 iter: 515 begin\n",
      "Train epoch:17 iter: 515 end\n",
      "Train epoch:17 iter: 516 begin\n",
      "Train epoch:17 iter: 516 end\n",
      "Train epoch:17 iter: 517 begin\n",
      "Train epoch:17 iter: 517 end\n",
      "Train epoch:17 iter: 518 begin\n",
      "Train epoch:17 iter: 518 end\n",
      "Train epoch:17 iter: 519 begin\n",
      "Train epoch:17 iter: 519 end\n",
      "Train epoch:17 iter: 520 begin\n",
      "Train epoch:17 iter: 520 end\n",
      "Train epoch:17 iter: 521 begin\n",
      "Train epoch:17 iter: 521 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:17 iter: 522 begin\n",
      "Train epoch:17 iter: 522 end\n",
      "Train epoch:17 iter: 523 begin\n",
      "Train epoch:17 iter: 523 end\n",
      "Train epoch:17 iter: 524 begin\n",
      "Train epoch:17 iter: 524 end\n",
      "Train epoch:17 iter: 525 begin\n",
      "Train epoch:17 iter: 525 end\n",
      "Train epoch:17 iter: 526 begin\n",
      "Train epoch:17 iter: 526 end\n",
      "Train epoch:17 iter: 527 begin\n",
      "Train epoch:17 iter: 527 end\n",
      "Train epoch:17 iter: 528 begin\n",
      "Train epoch:17 iter: 528 end\n",
      "Train epoch:17 iter: 529 begin\n",
      "Train epoch:17 iter: 529 end\n",
      "Train epoch:17 iter: 530 begin\n",
      "Train epoch:17 iter: 530 end\n",
      "Train epoch:17 iter: 531 begin\n",
      "Train epoch:17 iter: 531 end\n",
      "Train epoch:17 iter: 532 begin\n",
      "Train epoch:17 iter: 532 end\n",
      "Train epoch:17 iter: 533 begin\n",
      "Train epoch:17 iter: 533 end\n",
      "Train epoch:17 iter: 534 begin\n",
      "Train epoch:17 iter: 534 end\n",
      "Train epoch:17 iter: 535 begin\n",
      "Train epoch:17 iter: 535 end\n",
      "Train epoch:17 iter: 536 begin\n",
      "Train epoch:17 iter: 536 end\n",
      "Train epoch:17 iter: 537 begin\n",
      "Train epoch:17 iter: 537 end\n",
      "Train epoch:17 iter: 538 begin\n",
      "Train epoch:17 iter: 538 end\n",
      "Train epoch:17 iter: 539 begin\n",
      "Train epoch:17 iter: 539 end\n",
      "Train epoch:17 iter: 540 begin\n",
      "Train epoch:17 iter: 540 end\n",
      "Train epoch:17 iter: 541 begin\n",
      "Train epoch:17 iter: 541 end\n",
      "Train epoch:17 iter: 542 begin\n",
      "Train epoch:17 iter: 542 end\n",
      "Train epoch:17 iter: 543 begin\n",
      "Train epoch:17 iter: 543 end\n",
      "Train epoch:17 iter: 544 begin\n",
      "Train epoch:17 iter: 544 end\n",
      "Train epoch:17 iter: 545 begin\n",
      "Train epoch:17 iter: 545 end\n",
      "Train epoch:17 iter: 546 begin\n",
      "Train epoch:17 iter: 546 end\n",
      "Train epoch:17 iter: 547 begin\n",
      "Train epoch:17 iter: 547 end\n",
      "Train epoch:17 iter: 548 begin\n",
      "Train epoch:17 iter: 548 end\n",
      "Train epoch:17 iter: 549 begin\n",
      "Train epoch:17 iter: 549 end\n",
      "Train epoch:17 iter: 550 begin\n",
      "Train epoch:17 iter: 550 end\n",
      "Train epoch:17 iter: 551 begin\n",
      "Train epoch:17 iter: 551 end\n",
      "Train epoch:17 iter: 552 begin\n",
      "Train epoch:17 iter: 552 end\n",
      "Train epoch:17 iter: 553 begin\n",
      "Train epoch:17 iter: 553 end\n",
      "Train epoch:17 iter: 554 begin\n",
      "Train epoch:17 iter: 554 end\n",
      "Train epoch:17 iter: 555 begin\n",
      "Train epoch:17 iter: 555 end\n",
      "Train epoch:17 iter: 556 begin\n",
      "Train epoch:17 iter: 556 end\n",
      "Train epoch:17 iter: 557 begin\n",
      "Train epoch:17 iter: 557 end\n",
      "Train epoch:17 iter: 558 begin\n",
      "Train epoch:17 iter: 558 end\n",
      "Train epoch:17 iter: 559 begin\n",
      "Train epoch:17 iter: 559 end\n",
      "Train epoch:17 iter: 560 begin\n",
      "Train epoch:17 iter: 560 end\n",
      "Train epoch:17 iter: 561 begin\n",
      "Train epoch:17 iter: 561 end\n",
      "Train epoch:17 iter: 562 begin\n",
      "Train epoch:17 iter: 562 end\n",
      "Train epoch:17 iter: 563 begin\n",
      "Train epoch:17 iter: 563 end\n",
      "Train epoch:17 iter: 564 begin\n",
      "Train epoch:17 iter: 564 end\n",
      "Train epoch:17 iter: 565 begin\n",
      "Train epoch:17 iter: 565 end\n",
      "Train epoch:17 iter: 566 begin\n",
      "Train epoch:17 iter: 566 end\n",
      "Train epoch:17 iter: 567 begin\n",
      "Train epoch:17 iter: 567 end\n",
      "Train epoch:17 iter: 568 begin\n",
      "Train epoch:17 iter: 568 end\n",
      "Train epoch:17 iter: 569 begin\n",
      "Train epoch:17 iter: 569 end\n",
      "Train epoch:17 iter: 570 begin\n",
      "Train epoch:17 iter: 570 end\n",
      "Train epoch:17 iter: 571 begin\n",
      "Train epoch:17 iter: 571 end\n",
      "Train epoch:17 iter: 572 begin\n",
      "Train epoch:17 iter: 572 end\n",
      "Train epoch:17 iter: 573 begin\n",
      "Train epoch:17 iter: 573 end\n",
      "Train epoch:17 iter: 574 begin\n",
      "Train epoch:17 iter: 574 end\n",
      "Train epoch:17 iter: 575 begin\n",
      "Train epoch:17 iter: 575 end\n",
      "Train epoch:17 iter: 576 begin\n",
      "Train epoch:17 iter: 576 end\n",
      "Train epoch:17 iter: 577 begin\n",
      "Train epoch:17 iter: 577 end\n",
      "Train epoch:17 iter: 578 begin\n",
      "Train epoch:17 iter: 578 end\n",
      "Train epoch:17 iter: 579 begin\n",
      "Train epoch:17 iter: 579 end\n",
      "Train epoch:17 iter: 580 begin\n",
      "Train epoch:17 iter: 580 end\n",
      "Train epoch:17 iter: 581 begin\n",
      "Train epoch:17 iter: 581 end\n",
      "Train epoch:17 iter: 582 begin\n",
      "Train epoch:17 iter: 582 end\n",
      "Train epoch:17 iter: 583 begin\n",
      "Train epoch:17 iter: 583 end\n",
      "Train epoch:17 iter: 584 begin\n",
      "Train epoch:17 iter: 584 end\n",
      "Train epoch:17 iter: 585 begin\n",
      "Train epoch:17 iter: 585 end\n",
      "Train epoch:17 iter: 586 begin\n",
      "Train epoch:17 iter: 586 end\n",
      "Train epoch:17 iter: 587 begin\n",
      "Train epoch:17 iter: 587 end\n",
      "Train epoch:17 iter: 588 begin\n",
      "Train epoch:17 iter: 588 end\n",
      "Train epoch:17 iter: 589 begin\n",
      "Train epoch:17 iter: 589 end\n",
      "Train epoch:17 iter: 590 begin\n",
      "Train epoch:17 iter: 590 end\n",
      "Train epoch:17 iter: 591 begin\n",
      "Train epoch:17 iter: 591 end\n",
      "Train epoch:17 iter: 592 begin\n",
      "Train epoch:17 iter: 592 end\n",
      "Train epoch:17 iter: 593 begin\n",
      "Train epoch:17 iter: 593 end\n",
      "Train epoch:17 iter: 594 begin\n",
      "Train epoch:17 iter: 594 end\n",
      "Train epoch:17 iter: 595 begin\n",
      "Train epoch:17 iter: 595 end\n",
      "Train epoch:17 iter: 596 begin\n",
      "Train epoch:17 iter: 596 end\n",
      "Train epoch:17 iter: 597 begin\n",
      "Train epoch:17 iter: 597 end\n",
      "Train epoch:17 iter: 598 begin\n",
      "Train epoch:17 iter: 598 end\n",
      "Train epoch:17 iter: 599 begin\n",
      "Train epoch:17 iter: 599 end\n",
      "Train epoch:17 iter: 600 begin\n",
      "Train epoch:17 iter: 600 end\n",
      "Train epoch:17 iter: 601 begin\n",
      "Train epoch:17 iter: 601 end\n",
      "Train epoch:17 iter: 602 begin\n",
      "Train epoch:17 iter: 602 end\n",
      "Train epoch:17 iter: 603 begin\n",
      "Train epoch:17 iter: 603 end\n",
      "Train epoch:17 iter: 604 begin\n",
      "Train epoch:17 iter: 604 end\n",
      "Train epoch:17 iter: 605 begin\n",
      "Train epoch:17 iter: 605 end\n",
      "Train epoch:17 iter: 606 begin\n",
      "Train epoch:17 iter: 606 end\n",
      "Train epoch:17 iter: 607 begin\n",
      "Train epoch:17 iter: 607 end\n",
      "Train epoch:17 iter: 608 begin\n",
      "Train epoch:17 iter: 608 end\n",
      "Train epoch:17 iter: 609 begin\n",
      "Train epoch:17 iter: 609 end\n",
      "Train epoch:17 iter: 610 begin\n",
      "Train epoch:17 iter: 610 end\n",
      "Train epoch:17 iter: 611 begin\n",
      "Train epoch:17 iter: 611 end\n",
      "Train epoch:17 iter: 612 begin\n",
      "Train epoch:17 iter: 612 end\n",
      "Train epoch:17 iter: 613 begin\n",
      "Train epoch:17 iter: 613 end\n",
      "Train epoch:17 iter: 614 begin\n",
      "Train epoch:17 iter: 614 end\n",
      "Train epoch:17 iter: 615 begin\n",
      "Train epoch:17 iter: 615 end\n",
      "Train epoch:17 iter: 616 begin\n",
      "Train epoch:17 iter: 616 end\n",
      "Train epoch:17 iter: 617 begin\n",
      "Train epoch:17 iter: 617 end\n",
      "Train epoch:17 iter: 618 begin\n",
      "Train epoch:17 iter: 618 end\n",
      "Train epoch:17 iter: 619 begin\n",
      "Train epoch:17 iter: 619 end\n",
      "Train epoch:17 iter: 620 begin\n",
      "Train epoch:17 iter: 620 end\n",
      "Train epoch:17 iter: 621 begin\n",
      "Train epoch:17 iter: 621 end\n",
      "Train epoch:17 iter: 622 begin\n",
      "Train epoch:17 iter: 622 end\n",
      "Train epoch:17 iter: 623 begin\n",
      "Train epoch:17 iter: 623 end\n",
      "Train epoch:17 iter: 624 begin\n",
      "Train epoch:17 iter: 624 end\n",
      "Train epoch:17 iter: 625 begin\n",
      "Train epoch:17 iter: 625 end\n",
      "Train epoch:17 iter: 626 begin\n",
      "Train epoch:17 iter: 626 end\n",
      "Train epoch:17 iter: 627 begin\n",
      "Train epoch:17 iter: 627 end\n",
      "Train epoch:17 iter: 628 begin\n",
      "Train epoch:17 iter: 628 end\n",
      "Train epoch:17 iter: 629 begin\n",
      "Train epoch:17 iter: 629 end\n",
      "Train epoch:17 iter: 630 begin\n",
      "Train epoch:17 iter: 630 end\n",
      "Train epoch:17 iter: 631 begin\n",
      "Train epoch:17 iter: 631 end\n",
      "Train epoch:17 iter: 632 begin\n",
      "Train epoch:17 iter: 632 end\n",
      "Train epoch:17 iter: 633 begin\n",
      "Train epoch:17 iter: 633 end\n",
      "Train epoch:17 iter: 634 begin\n",
      "Train epoch:17 iter: 634 end\n",
      "Train epoch:17 iter: 635 begin\n",
      "Train epoch:17 iter: 635 end\n",
      "Train epoch:17 iter: 636 begin\n",
      "Train epoch:17 iter: 636 end\n",
      "Train epoch:17 iter: 637 begin\n",
      "Train epoch:17 iter: 637 end\n",
      "Train epoch:17 iter: 638 begin\n",
      "Train epoch:17 iter: 638 end\n",
      "Train epoch:17 iter: 639 begin\n",
      "Train epoch:17 iter: 639 end\n",
      "Train epoch:17 iter: 640 begin\n",
      "Train epoch:17 iter: 640 end\n",
      "Train epoch:17 iter: 641 begin\n",
      "Train epoch:17 iter: 641 end\n",
      "Train epoch:17 iter: 642 begin\n",
      "Train epoch:17 iter: 642 end\n",
      "Train epoch:17 iter: 643 begin\n",
      "Train epoch:17 iter: 643 end\n",
      "Train epoch:17 iter: 644 begin\n",
      "Train epoch:17 iter: 644 end\n",
      "Train epoch:17 iter: 645 begin\n",
      "Train epoch:17 iter: 645 end\n",
      "Train epoch:17 iter: 646 begin\n",
      "Train epoch:17 iter: 646 end\n",
      "Train epoch:17 iter: 647 begin\n",
      "Train epoch:17 iter: 647 end\n",
      "Train epoch:17 iter: 648 begin\n",
      "Train epoch:17 iter: 648 end\n",
      "Train epoch:17 iter: 649 begin\n",
      "Train epoch:17 iter: 649 end\n",
      "Train epoch:17 iter: 650 begin\n",
      "Train epoch:17 iter: 650 end\n",
      "Train epoch:17 iter: 651 begin\n",
      "Train epoch:17 iter: 651 end\n",
      "Train epoch:17 iter: 652 begin\n",
      "Train epoch:17 iter: 652 end\n",
      "Train epoch:17 iter: 653 begin\n",
      "Train epoch:17 iter: 653 end\n",
      "Train epoch:17 iter: 654 begin\n",
      "Train epoch:17 iter: 654 end\n",
      "Train epoch:17 iter: 655 begin\n",
      "Train epoch:17 iter: 655 end\n",
      "Train epoch:17 iter: 656 begin\n",
      "Train epoch:17 iter: 656 end\n",
      "Train epoch:17 iter: 657 begin\n",
      "Train epoch:17 iter: 657 end\n",
      "Train epoch:17 iter: 658 begin\n",
      "Train epoch:17 iter: 658 end\n",
      "Train epoch:17 iter: 659 begin\n",
      "Train epoch:17 iter: 659 end\n",
      "Train epoch:17 iter: 660 begin\n",
      "Train epoch:17 iter: 660 end\n",
      "Train epoch:17 iter: 661 begin\n",
      "Train epoch:17 iter: 661 end\n",
      "Train epoch:17 iter: 662 begin\n",
      "Train epoch:17 iter: 662 end\n",
      "Train epoch:17 iter: 663 begin\n",
      "Train epoch:17 iter: 663 end\n",
      "Train epoch:17 iter: 664 begin\n",
      "Train epoch:17 iter: 664 end\n",
      "Train epoch:17 iter: 665 begin\n",
      "Train epoch:17 iter: 665 end\n",
      "Train epoch:17 iter: 666 begin\n",
      "Train epoch:17 iter: 666 end\n",
      "Train epoch:17 iter: 667 begin\n",
      "Train epoch:17 iter: 667 end\n",
      "Train epoch:17 iter: 668 begin\n",
      "Train epoch:17 iter: 668 end\n",
      "Train epoch:17 iter: 669 begin\n",
      "Train epoch:17 iter: 669 end\n",
      "Train epoch:17 iter: 670 begin\n",
      "Train epoch:17 iter: 670 end\n",
      "Train epoch:17 iter: 671 begin\n",
      "Train epoch:17 iter: 671 end\n",
      "Train epoch:17 iter: 672 begin\n",
      "Train epoch:17 iter: 672 end\n",
      "Train epoch:17 iter: 673 begin\n",
      "Train epoch:17 iter: 673 end\n",
      "Train epoch:17 iter: 674 begin\n",
      "Train epoch:17 iter: 674 end\n",
      "Train epoch:17 iter: 675 begin\n",
      "Train epoch:17 iter: 675 end\n",
      "Train epoch:17 iter: 676 begin\n",
      "Train epoch:17 iter: 676 end\n",
      "Train epoch:17 iter: 677 begin\n",
      "Train epoch:17 iter: 677 end\n",
      "Train epoch:17 iter: 678 begin\n",
      "Train epoch:17 iter: 678 end\n",
      "Train epoch:17 iter: 679 begin\n",
      "Train epoch:17 iter: 679 end\n",
      "Train epoch:17 iter: 680 begin\n",
      "Train epoch:17 iter: 680 end\n",
      "Train epoch:17 iter: 681 begin\n",
      "Train epoch:17 iter: 681 end\n",
      "Train epoch:17 iter: 682 begin\n",
      "Train epoch:17 iter: 682 end\n",
      "Train epoch:17 iter: 683 begin\n",
      "Train epoch:17 iter: 683 end\n",
      "Train epoch:17 iter: 684 begin\n",
      "Train epoch:17 iter: 684 end\n",
      "Train epoch:17 iter: 685 begin\n",
      "Train epoch:17 iter: 685 end\n",
      "Train epoch:17 iter: 686 begin\n",
      "Train epoch:17 iter: 686 end\n",
      "Train epoch:17 iter: 687 begin\n",
      "Train epoch:17 iter: 687 end\n",
      "Train epoch:17 iter: 688 begin\n",
      "Train epoch:17 iter: 688 end\n",
      "Train epoch:17 iter: 689 begin\n",
      "Train epoch:17 iter: 689 end\n",
      "Train epoch:17 iter: 690 begin\n",
      "Train epoch:17 iter: 690 end\n",
      "Train epoch:17 iter: 691 begin\n",
      "Train epoch:17 iter: 691 end\n",
      "Train epoch:17 iter: 692 begin\n",
      "Train epoch:17 iter: 692 end\n",
      "Train epoch:17 iter: 693 begin\n",
      "Train epoch:17 iter: 693 end\n",
      "Train epoch:17 iter: 694 begin\n",
      "Train epoch:17 iter: 694 end\n",
      "Train epoch:17 iter: 695 begin\n",
      "Train epoch:17 iter: 695 end\n",
      "Train epoch:17 iter: 696 begin\n",
      "Train epoch:17 iter: 696 end\n",
      "Train epoch:17 iter: 697 begin\n",
      "Train epoch:17 iter: 697 end\n",
      "Train epoch:17 iter: 698 begin\n",
      "Train epoch:17 iter: 698 end\n",
      "Train epoch:17 iter: 699 begin\n",
      "Train epoch:17 iter: 699 end\n",
      "Train epoch:17 iter: 700 begin\n",
      "Train epoch:17 iter: 700 end\n",
      "Train epoch:17 iter: 701 begin\n",
      "Train epoch:17 iter: 701 end\n",
      "Train epoch:17 iter: 702 begin\n",
      "Train epoch:17 iter: 702 end\n",
      "Train epoch:17 iter: 703 begin\n",
      "Train epoch:17 iter: 703 end\n",
      "Train epoch:17 iter: 704 begin\n",
      "Train epoch:17 iter: 704 end\n",
      "Train epoch:17 iter: 705 begin\n",
      "Train epoch:17 iter: 705 end\n",
      "Train epoch:17 iter: 706 begin\n",
      "Train epoch:17 iter: 706 end\n",
      "Train epoch:17 iter: 707 begin\n",
      "Train epoch:17 iter: 707 end\n",
      "Train epoch:17 iter: 708 begin\n",
      "Train epoch:17 iter: 708 end\n",
      "Train epoch:17 iter: 709 begin\n",
      "Train epoch:17 iter: 709 end\n",
      "Train epoch:17 iter: 710 begin\n",
      "Train epoch:17 iter: 710 end\n",
      "Train epoch:17 iter: 711 begin\n",
      "Train epoch:17 iter: 711 end\n",
      "Train epoch:17 iter: 712 begin\n",
      "Train epoch:17 iter: 712 end\n",
      "Train epoch:17 iter: 713 begin\n",
      "Train epoch:17 iter: 713 end\n",
      "Train epoch:17 iter: 714 begin\n",
      "Train epoch:17 iter: 714 end\n",
      "Train epoch:17 iter: 715 begin\n",
      "Train epoch:17 iter: 715 end\n",
      "Train epoch:17 iter: 716 begin\n",
      "Train epoch:17 iter: 716 end\n",
      "Train epoch:17 iter: 717 begin\n",
      "Train epoch:17 iter: 717 end\n",
      "Train epoch:17 iter: 718 begin\n",
      "Train epoch:17 iter: 718 end\n",
      "Train epoch:17 iter: 719 begin\n",
      "Train epoch:17 iter: 719 end\n",
      "Train epoch:17 iter: 720 begin\n",
      "Train epoch:17 iter: 720 end\n",
      "Train epoch:17 iter: 721 begin\n",
      "Train epoch:17 iter: 721 end\n",
      "Train epoch:17 iter: 722 begin\n",
      "Train epoch:17 iter: 722 end\n",
      "Train epoch:17 iter: 723 begin\n",
      "Train epoch:17 iter: 723 end\n",
      "Train epoch:17 iter: 724 begin\n",
      "Train epoch:17 iter: 724 end\n",
      "Train epoch:17 iter: 725 begin\n",
      "Train epoch:17 iter: 725 end\n",
      "Train epoch:17 iter: 726 begin\n",
      "Train epoch:17 iter: 726 end\n",
      "Train epoch:17 iter: 727 begin\n",
      "Train epoch:17 iter: 727 end\n",
      "Train epoch:17 iter: 728 begin\n",
      "Train epoch:17 iter: 728 end\n",
      "Train epoch:17 iter: 729 begin\n",
      "Train epoch:17 iter: 729 end\n",
      "Train epoch:17 iter: 730 begin\n",
      "Train epoch:17 iter: 730 end\n",
      "Train epoch:17 iter: 731 begin\n",
      "Train epoch:17 iter: 731 end\n",
      "Train epoch:17 iter: 732 begin\n",
      "Train epoch:17 iter: 732 end\n",
      "Train epoch:17 iter: 733 begin\n",
      "Train epoch:17 iter: 733 end\n",
      "Train epoch:17 iter: 734 begin\n",
      "Train epoch:17 iter: 734 end\n",
      "Train epoch:17 iter: 735 begin\n",
      "Train epoch:17 iter: 735 end\n",
      "Train epoch:17 iter: 736 begin\n",
      "Train epoch:17 iter: 736 end\n",
      "Train epoch:17 iter: 737 begin\n",
      "Train epoch:17 iter: 737 end\n",
      "Train epoch:17 iter: 738 begin\n",
      "Train epoch:17 iter: 738 end\n",
      "Train epoch:17 iter: 739 begin\n",
      "Train epoch:17 iter: 739 end\n",
      "Train epoch:17 iter: 740 begin\n",
      "Train epoch:17 iter: 740 end\n",
      "Train epoch:17 iter: 741 begin\n",
      "Train epoch:17 iter: 741 end\n",
      "Train epoch:17 iter: 742 begin\n",
      "Train epoch:17 iter: 742 end\n",
      "Train epoch:17 iter: 743 begin\n",
      "Train epoch:17 iter: 743 end\n",
      "Train epoch:17 iter: 744 begin\n",
      "Train epoch:17 iter: 744 end\n",
      "Train epoch:17 iter: 745 begin\n",
      "Train epoch:17 iter: 745 end\n",
      "Train epoch:17 iter: 746 begin\n",
      "Train epoch:17 iter: 746 end\n",
      "Train epoch:17 iter: 747 begin\n",
      "Train epoch:17 iter: 747 end\n",
      "Train epoch:17 iter: 748 begin\n",
      "Train epoch:17 iter: 748 end\n",
      "Train epoch:17 iter: 749 begin\n",
      "Train epoch:17 iter: 749 end\n",
      "Train epoch:17 iter: 750 begin\n",
      "Train epoch:17 iter: 750 end\n",
      "Train epoch:17 iter: 751 begin\n",
      "Train epoch:17 iter: 751 end\n",
      "Train epoch:17 iter: 752 begin\n",
      "Train epoch:17 iter: 752 end\n",
      "Train epoch:17 iter: 753 begin\n",
      "Train epoch:17 iter: 753 end\n",
      "Train epoch:17 iter: 754 begin\n",
      "Train epoch:17 iter: 754 end\n",
      "Train epoch:17 iter: 755 begin\n",
      "Train epoch:17 iter: 755 end\n",
      "Train epoch:17 iter: 756 begin\n",
      "Train epoch:17 iter: 756 end\n",
      "Train epoch:17 iter: 757 begin\n",
      "Train epoch:17 iter: 757 end\n",
      "Train epoch:17 iter: 758 begin\n",
      "Train epoch:17 iter: 758 end\n",
      "Train epoch:17 iter: 759 begin\n",
      "Train epoch:17 iter: 759 end\n",
      "Train epoch:17 iter: 760 begin\n",
      "Train epoch:17 iter: 760 end\n",
      "Train epoch:17 iter: 761 begin\n",
      "Train epoch:17 iter: 761 end\n",
      "Train epoch:17 iter: 762 begin\n",
      "Train epoch:17 iter: 762 end\n",
      "Train epoch:17 iter: 763 begin\n",
      "Train epoch:17 iter: 763 end\n",
      "Train epoch:17 iter: 764 begin\n",
      "Train epoch:17 iter: 764 end\n",
      "Train epoch:17 iter: 765 begin\n",
      "Train epoch:17 iter: 765 end\n",
      "Train epoch:17 iter: 766 begin\n",
      "Train epoch:17 iter: 766 end\n",
      "Train epoch:17 iter: 767 begin\n",
      "Train epoch:17 iter: 767 end\n",
      "Train epoch:17 iter: 768 begin\n",
      "Train epoch:17 iter: 768 end\n",
      "Train epoch:17 iter: 769 begin\n",
      "Train epoch:17 iter: 769 end\n",
      "Train epoch:17 iter: 770 begin\n",
      "Train epoch:17 iter: 770 end\n",
      "Train epoch:17 iter: 771 begin\n",
      "Train epoch:17 iter: 771 end\n",
      "Train epoch:17 iter: 772 begin\n",
      "Train epoch:17 iter: 772 end\n",
      "Train epoch:17 iter: 773 begin\n",
      "Train epoch:17 iter: 773 end\n",
      "Train epoch:17 iter: 774 begin\n",
      "Train epoch:17 iter: 774 end\n",
      "Train epoch:17 iter: 775 begin\n",
      "Train epoch:17 iter: 775 end\n",
      "Train epoch:17 iter: 776 begin\n",
      "Train epoch:17 iter: 776 end\n",
      "Train epoch:17 iter: 777 begin\n",
      "Train epoch:17 iter: 777 end\n",
      "Train epoch:17 iter: 778 begin\n",
      "Train epoch:17 iter: 778 end\n",
      "Train epoch:17 iter: 779 begin\n",
      "Train epoch:17 iter: 779 end\n",
      "Train epoch:17 iter: 780 begin\n",
      "Train epoch:17 iter: 780 end\n",
      "Train epoch:17 iter: 781 begin\n",
      "Train epoch:17 iter: 781 end\n",
      "Train epoch:17 iter: 782 begin\n",
      "Train epoch:17 iter: 782 end\n",
      "Train epoch:17 iter: 783 begin\n",
      "Train epoch:17 iter: 783 end\n",
      "Train epoch:17 iter: 784 begin\n",
      "Train epoch:17 iter: 784 end\n",
      "Train epoch:17 iter: 785 begin\n",
      "Train epoch:17 iter: 785 end\n",
      "Train epoch:17 iter: 786 begin\n",
      "Train epoch:17 iter: 786 end\n",
      "Train epoch:17 iter: 787 begin\n",
      "Train epoch:17 iter: 787 end\n",
      "Train epoch:17 iter: 788 begin\n",
      "Train epoch:17 iter: 788 end\n",
      "Train epoch:17 iter: 789 begin\n",
      "Train epoch:17 iter: 789 end\n",
      "Train epoch:17 iter: 790 begin\n",
      "Train epoch:17 iter: 790 end\n",
      "Train epoch:17 iter: 791 begin\n",
      "Train epoch:17 iter: 791 end\n",
      "Train epoch:17 iter: 792 begin\n",
      "Train epoch:17 iter: 792 end\n",
      "Train epoch:17 iter: 793 begin\n",
      "Train epoch:17 iter: 793 end\n",
      "Train epoch:17 iter: 794 begin\n",
      "Train epoch:17 iter: 794 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:17 iter: 795 begin\n",
      "Train epoch:17 iter: 795 end\n",
      "Train epoch:17 iter: 796 begin\n",
      "Train epoch:17 iter: 796 end\n",
      "Train epoch:17 iter: 797 begin\n",
      "Train epoch:17 iter: 797 end\n",
      "Train epoch:17 iter: 798 begin\n",
      "Train epoch:17 iter: 798 end\n",
      "Train epoch:17 iter: 799 begin\n",
      "Train epoch:17 iter: 799 end\n",
      "Train epoch:17 iter: 800 begin\n",
      "Train epoch:17 iter: 800 end\n",
      "Train epoch:17 iter: 801 begin\n",
      "Train epoch:17 iter: 801 end\n",
      "Train epoch:17 iter: 802 begin\n",
      "Train epoch:17 iter: 802 end\n",
      "Train epoch:17 iter: 803 begin\n",
      "Train epoch:17 iter: 803 end\n",
      "Train epoch:17 iter: 804 begin\n",
      "Train epoch:17 iter: 804 end\n",
      "Train epoch:17 iter: 805 begin\n",
      "Train epoch:17 iter: 805 end\n",
      "Train epoch:17 iter: 806 begin\n",
      "Train epoch:17 iter: 806 end\n",
      "Train epoch:17 iter: 807 begin\n",
      "Train epoch:17 iter: 807 end\n",
      "Train epoch:17 iter: 808 begin\n",
      "Train epoch:17 iter: 808 end\n",
      "Train epoch:17 iter: 809 begin\n",
      "Train epoch:17 iter: 809 end\n",
      "Train epoch:17 iter: 810 begin\n",
      "Train epoch:17 iter: 810 end\n",
      "Train epoch:17 iter: 811 begin\n",
      "Train epoch:17 iter: 811 end\n",
      "Train epoch:17 iter: 812 begin\n",
      "Train epoch:17 iter: 812 end\n",
      "Train epoch:17 iter: 813 begin\n",
      "Train epoch:17 iter: 813 end\n",
      "Train epoch:17 iter: 814 begin\n",
      "Train epoch:17 iter: 814 end\n",
      "Train epoch:17 iter: 815 begin\n",
      "Train epoch:17 iter: 815 end\n",
      "Train epoch:17 iter: 816 begin\n",
      "Train epoch:17 iter: 816 end\n",
      "Train epoch:17 iter: 817 begin\n",
      "Train epoch:17 iter: 817 end\n",
      "Train epoch:17 iter: 818 begin\n",
      "Train epoch:17 iter: 818 end\n",
      "Train epoch:17 iter: 819 begin\n",
      "Train epoch:17 iter: 819 end\n",
      "Train epoch:17 iter: 820 begin\n",
      "Train epoch:17 iter: 820 end\n",
      "Train epoch:17 iter: 821 begin\n",
      "Train epoch:17 iter: 821 end\n",
      "Train epoch:17 iter: 822 begin\n",
      "Train epoch:17 iter: 822 end\n",
      "Train epoch:17 iter: 823 begin\n",
      "Train epoch:17 iter: 823 end\n",
      "Train epoch:17 iter: 824 begin\n",
      "Train epoch:17 iter: 824 end\n",
      "Train epoch:17 iter: 825 begin\n",
      "Train epoch:17 iter: 825 end\n",
      "Train epoch:17 iter: 826 begin\n",
      "Train epoch:17 iter: 826 end\n",
      "Train epoch:17 iter: 827 begin\n",
      "Train epoch:17 iter: 827 end\n",
      "Train epoch:17 iter: 828 begin\n",
      "Train epoch:17 iter: 828 end\n",
      "Train epoch:17 iter: 829 begin\n",
      "Train epoch:17 iter: 829 end\n",
      "Train epoch:17 iter: 830 begin\n",
      "Train epoch:17 iter: 830 end\n",
      "Train epoch:17 iter: 831 begin\n",
      "Train epoch:17 iter: 831 end\n",
      "Train epoch:17 iter: 832 begin\n",
      "Train epoch:17 iter: 832 end\n",
      "Train epoch:17 iter: 833 begin\n",
      "Train epoch:17 iter: 833 end\n",
      "Train epoch:17 iter: 834 begin\n",
      "Train epoch:17 iter: 834 end\n",
      "Train epoch:17 iter: 835 begin\n",
      "Train epoch:17 iter: 835 end\n",
      "Train epoch:17 iter: 836 begin\n",
      "Train epoch:17 iter: 836 end\n",
      "Train epoch:17 iter: 837 begin\n",
      "Train epoch:17 iter: 837 end\n",
      "Train epoch:17 iter: 838 begin\n",
      "Train epoch:17 iter: 838 end\n",
      "Train epoch:17 iter: 839 begin\n",
      "Train epoch:17 iter: 839 end\n",
      "Train epoch:17 iter: 840 begin\n",
      "Train epoch:17 iter: 840 end\n",
      "Train epoch:17 iter: 841 begin\n",
      "Train epoch:17 iter: 841 end\n",
      "Train epoch:17 iter: 842 begin\n",
      "Train epoch:17 iter: 842 end\n",
      "Train epoch:17 iter: 843 begin\n",
      "Train epoch:17 iter: 843 end\n",
      "Train epoch:17 iter: 844 begin\n",
      "Train epoch:17 iter: 844 end\n",
      "Train epoch:17 iter: 845 begin\n",
      "Train epoch:17 iter: 845 end\n",
      "Train epoch:17 iter: 846 begin\n",
      "Train epoch:17 iter: 846 end\n",
      "Train epoch:17 iter: 847 begin\n",
      "Train epoch:17 iter: 847 end\n",
      "Train epoch:17 iter: 848 begin\n",
      "Train epoch:17 iter: 848 end\n",
      "Train epoch:17 iter: 849 begin\n",
      "Train epoch:17 iter: 849 end\n",
      "Train epoch:17 iter: 850 begin\n",
      "Train epoch:17 iter: 850 end\n",
      "Train epoch:17 iter: 851 begin\n",
      "Train epoch:17 iter: 851 end\n",
      "Train epoch:17 iter: 852 begin\n",
      "Train epoch:17 iter: 852 end\n",
      "Train epoch:17 iter: 853 begin\n",
      "Train epoch:17 iter: 853 end\n",
      "Train epoch:17 iter: 854 begin\n",
      "Train epoch:17 iter: 854 end\n",
      "Train epoch:17 iter: 855 begin\n",
      "Train epoch:17 iter: 855 end\n",
      "Train epoch:17 iter: 856 begin\n",
      "Train epoch:17 iter: 856 end\n",
      "Train epoch:17 iter: 857 begin\n",
      "Train epoch:17 iter: 857 end\n",
      "Train epoch:17 iter: 858 begin\n",
      "Train epoch:17 iter: 858 end\n",
      "Train epoch:17 iter: 859 begin\n",
      "Train epoch:17 iter: 859 end\n",
      "Train epoch:17 iter: 860 begin\n",
      "Train epoch:17 iter: 860 end\n",
      "Train epoch:17 iter: 861 begin\n",
      "Train epoch:17 iter: 861 end\n",
      "Train epoch:17 iter: 862 begin\n",
      "Train epoch:17 iter: 862 end\n",
      "Train epoch:17 iter: 863 begin\n",
      "Train epoch:17 iter: 863 end\n",
      "Train epoch:17 iter: 864 begin\n",
      "Train epoch:17 iter: 864 end\n",
      "Train epoch:17 iter: 865 begin\n",
      "Train epoch:17 iter: 865 end\n",
      "Train epoch:17 iter: 866 begin\n",
      "Train epoch:17 iter: 866 end\n",
      "Train epoch:17 iter: 867 begin\n",
      "Train epoch:17 iter: 867 end\n",
      "Train epoch:17 iter: 868 begin\n",
      "Train epoch:17 iter: 868 end\n",
      "Train epoch:17 iter: 869 begin\n",
      "Train epoch:17 iter: 869 end\n",
      "Train epoch:17 iter: 870 begin\n",
      "Train epoch:17 iter: 870 end\n",
      "Train epoch:17 iter: 871 begin\n",
      "Train epoch:17 iter: 871 end\n",
      "Train epoch:17 iter: 872 begin\n",
      "Train epoch:17 iter: 872 end\n",
      "Train epoch:17 iter: 873 begin\n",
      "Train epoch:17 iter: 873 end\n",
      "Train epoch:17 iter: 874 begin\n",
      "Train epoch:17 iter: 874 end\n",
      "Train epoch:17 iter: 875 begin\n",
      "Train epoch:17 iter: 875 end\n",
      "Train epoch:17 iter: 876 begin\n",
      "Train epoch:17 iter: 876 end\n",
      "Train epoch:17 iter: 877 begin\n",
      "Train epoch:17 iter: 877 end\n",
      "Train epoch:17 iter: 878 begin\n",
      "Train epoch:17 iter: 878 end\n",
      "Train epoch:17 iter: 879 begin\n",
      "Train epoch:17 iter: 879 end\n",
      "Train epoch:17 iter: 880 begin\n",
      "Train epoch:17 iter: 880 end\n",
      "Train epoch:17 iter: 881 begin\n",
      "Train epoch:17 iter: 881 end\n",
      "Train epoch:17 iter: 882 begin\n",
      "Train epoch:17 iter: 882 end\n",
      "Train epoch:17 iter: 883 begin\n",
      "Train epoch:17 iter: 883 end\n",
      "Train epoch:17 iter: 884 begin\n",
      "Train epoch:17 iter: 884 end\n",
      "Train epoch:17 iter: 885 begin\n",
      "Train epoch:17 iter: 885 end\n",
      "Train epoch:17 iter: 886 begin\n",
      "Train epoch:17 iter: 886 end\n",
      "Train epoch:17 iter: 887 begin\n",
      "Train epoch:17 iter: 887 end\n",
      "Train epoch:17 iter: 888 begin\n",
      "Train epoch:17 iter: 888 end\n",
      "Train epoch:17 iter: 889 begin\n",
      "Train epoch:17 iter: 889 end\n",
      "Train epoch:17 iter: 890 begin\n",
      "Train epoch:17 iter: 890 end\n",
      "Train epoch:17 iter: 891 begin\n",
      "Train epoch:17 iter: 891 end\n",
      "Train epoch:17 iter: 892 begin\n",
      "Train epoch:17 iter: 892 end\n",
      "Train epoch:17 iter: 893 begin\n",
      "Train epoch:17 iter: 893 end\n",
      "Train epoch:17 iter: 894 begin\n",
      "Train epoch:17 iter: 894 end\n",
      "Train epoch:17 iter: 895 begin\n",
      "Train epoch:17 iter: 895 end\n",
      "Train epoch:17 iter: 896 begin\n",
      "Train epoch:17 iter: 896 end\n",
      "Train epoch:17 iter: 897 begin\n",
      "Train epoch:17 iter: 897 end\n",
      "Train epoch:17 iter: 898 begin\n",
      "Train epoch:17 iter: 898 end\n",
      "Train epoch:17 iter: 899 begin\n",
      "Train epoch:17 iter: 899 end\n",
      "Train epoch:17 iter: 900 begin\n",
      "Train epoch:17 iter: 900 end\n",
      "Train epoch:17 iter: 901 begin\n",
      "Train epoch:17 iter: 901 end\n",
      "Train epoch:17 iter: 902 begin\n",
      "Train epoch:17 iter: 902 end\n",
      "Train epoch:17 iter: 903 begin\n",
      "Train epoch:17 iter: 903 end\n",
      "Train epoch:17 iter: 904 begin\n",
      "Train epoch:17 iter: 904 end\n",
      "Train epoch:17 iter: 905 begin\n",
      "Train epoch:17 iter: 905 end\n",
      "Train epoch:17 iter: 906 begin\n",
      "Train epoch:17 iter: 906 end\n",
      "Train epoch:17 iter: 907 begin\n",
      "Train epoch:17 iter: 907 end\n",
      "Train epoch:17 iter: 908 begin\n",
      "Train epoch:17 iter: 908 end\n",
      "Train epoch:17 iter: 909 begin\n",
      "Train epoch:17 iter: 909 end\n",
      "Train epoch:17 iter: 910 begin\n",
      "Train epoch:17 iter: 910 end\n",
      "Train epoch:17 iter: 911 begin\n",
      "Train epoch:17 iter: 911 end\n",
      "Train epoch:17 iter: 912 begin\n",
      "Train epoch:17 iter: 912 end\n",
      "Train epoch:17 iter: 913 begin\n",
      "Train epoch:17 iter: 913 end\n",
      "Train epoch:17 iter: 914 begin\n",
      "Train epoch:17 iter: 914 end\n",
      "Train epoch:17 iter: 915 begin\n",
      "Train epoch:17 iter: 915 end\n",
      "Train epoch:17 iter: 916 begin\n",
      "Train epoch:17 iter: 916 end\n",
      "Train epoch:17 iter: 917 begin\n",
      "Train epoch:17 iter: 917 end\n",
      "Train epoch:17 iter: 918 begin\n",
      "Train epoch:17 iter: 918 end\n",
      "Train epoch:17 iter: 919 begin\n",
      "Train epoch:17 iter: 919 end\n",
      "Train epoch:17 iter: 920 begin\n",
      "Train epoch:17 iter: 920 end\n",
      "Train epoch:17 iter: 921 begin\n",
      "Train epoch:17 iter: 921 end\n",
      "Train epoch:17 iter: 922 begin\n",
      "Train epoch:17 iter: 922 end\n",
      "Train epoch:17 iter: 923 begin\n",
      "Train epoch:17 iter: 923 end\n",
      "Train epoch:17 iter: 924 begin\n",
      "Train epoch:17 iter: 924 end\n",
      "Train epoch:17 iter: 925 begin\n",
      "Train epoch:17 iter: 925 end\n",
      "Train epoch:17 iter: 926 begin\n",
      "Train epoch:17 iter: 926 end\n",
      "Train epoch:17 iter: 927 begin\n",
      "Train epoch:17 iter: 927 end\n",
      "Train epoch:17 iter: 928 begin\n",
      "Train epoch:17 iter: 928 end\n",
      "Train epoch:17 iter: 929 begin\n",
      "Train epoch:17 iter: 929 end\n",
      "Train epoch:17 iter: 930 begin\n",
      "Train epoch:17 iter: 930 end\n",
      "Train epoch:17 iter: 931 begin\n",
      "Train epoch:17 iter: 931 end\n",
      "Train epoch:17 iter: 932 begin\n",
      "Train epoch:17 iter: 932 end\n",
      "Train epoch:17 iter: 933 begin\n",
      "Train epoch:17 iter: 933 end\n",
      "Train epoch:17 iter: 934 begin\n",
      "Train epoch:17 iter: 934 end\n",
      "Train epoch:17 iter: 935 begin\n",
      "Train epoch:17 iter: 935 end\n",
      "Train epoch:17 iter: 936 begin\n",
      "Train epoch:17 iter: 936 end\n",
      "Train epoch:17 iter: 937 begin\n",
      "Train epoch:17 iter: 937 end\n",
      "Train epoch:17 iter: 938 begin\n",
      "Train epoch:17 iter: 938 end\n",
      "Train Loss: 0.000995, Acc: 0.975867\n",
      "save model for best accuate: 0.9758666666666667 begin\n",
      "save model for best accuate: 0.9758666666666667 end\n",
      "epoch 19\n",
      "Train epoch:18 iter: 1 begin\n",
      "Train epoch:18 iter: 1 end\n",
      "Train epoch:18 iter: 2 begin\n",
      "Train epoch:18 iter: 2 end\n",
      "Train epoch:18 iter: 3 begin\n",
      "Train epoch:18 iter: 3 end\n",
      "Train epoch:18 iter: 4 begin\n",
      "Train epoch:18 iter: 4 end\n",
      "Train epoch:18 iter: 5 begin\n",
      "Train epoch:18 iter: 5 end\n",
      "Train epoch:18 iter: 6 begin\n",
      "Train epoch:18 iter: 6 end\n",
      "Train epoch:18 iter: 7 begin\n",
      "Train epoch:18 iter: 7 end\n",
      "Train epoch:18 iter: 8 begin\n",
      "Train epoch:18 iter: 8 end\n",
      "Train epoch:18 iter: 9 begin\n",
      "Train epoch:18 iter: 9 end\n",
      "Train epoch:18 iter: 10 begin\n",
      "Train epoch:18 iter: 10 end\n",
      "Train epoch:18 iter: 11 begin\n",
      "Train epoch:18 iter: 11 end\n",
      "Train epoch:18 iter: 12 begin\n",
      "Train epoch:18 iter: 12 end\n",
      "Train epoch:18 iter: 13 begin\n",
      "Train epoch:18 iter: 13 end\n",
      "Train epoch:18 iter: 14 begin\n",
      "Train epoch:18 iter: 14 end\n",
      "Train epoch:18 iter: 15 begin\n",
      "Train epoch:18 iter: 15 end\n",
      "Train epoch:18 iter: 16 begin\n",
      "Train epoch:18 iter: 16 end\n",
      "Train epoch:18 iter: 17 begin\n",
      "Train epoch:18 iter: 17 end\n",
      "Train epoch:18 iter: 18 begin\n",
      "Train epoch:18 iter: 18 end\n",
      "Train epoch:18 iter: 19 begin\n",
      "Train epoch:18 iter: 19 end\n",
      "Train epoch:18 iter: 20 begin\n",
      "Train epoch:18 iter: 20 end\n",
      "Train epoch:18 iter: 21 begin\n",
      "Train epoch:18 iter: 21 end\n",
      "Train epoch:18 iter: 22 begin\n",
      "Train epoch:18 iter: 22 end\n",
      "Train epoch:18 iter: 23 begin\n",
      "Train epoch:18 iter: 23 end\n",
      "Train epoch:18 iter: 24 begin\n",
      "Train epoch:18 iter: 24 end\n",
      "Train epoch:18 iter: 25 begin\n",
      "Train epoch:18 iter: 25 end\n",
      "Train epoch:18 iter: 26 begin\n",
      "Train epoch:18 iter: 26 end\n",
      "Train epoch:18 iter: 27 begin\n",
      "Train epoch:18 iter: 27 end\n",
      "Train epoch:18 iter: 28 begin\n",
      "Train epoch:18 iter: 28 end\n",
      "Train epoch:18 iter: 29 begin\n",
      "Train epoch:18 iter: 29 end\n",
      "Train epoch:18 iter: 30 begin\n",
      "Train epoch:18 iter: 30 end\n",
      "Train epoch:18 iter: 31 begin\n",
      "Train epoch:18 iter: 31 end\n",
      "Train epoch:18 iter: 32 begin\n",
      "Train epoch:18 iter: 32 end\n",
      "Train epoch:18 iter: 33 begin\n",
      "Train epoch:18 iter: 33 end\n",
      "Train epoch:18 iter: 34 begin\n",
      "Train epoch:18 iter: 34 end\n",
      "Train epoch:18 iter: 35 begin\n",
      "Train epoch:18 iter: 35 end\n",
      "Train epoch:18 iter: 36 begin\n",
      "Train epoch:18 iter: 36 end\n",
      "Train epoch:18 iter: 37 begin\n",
      "Train epoch:18 iter: 37 end\n",
      "Train epoch:18 iter: 38 begin\n",
      "Train epoch:18 iter: 38 end\n",
      "Train epoch:18 iter: 39 begin\n",
      "Train epoch:18 iter: 39 end\n",
      "Train epoch:18 iter: 40 begin\n",
      "Train epoch:18 iter: 40 end\n",
      "Train epoch:18 iter: 41 begin\n",
      "Train epoch:18 iter: 41 end\n",
      "Train epoch:18 iter: 42 begin\n",
      "Train epoch:18 iter: 42 end\n",
      "Train epoch:18 iter: 43 begin\n",
      "Train epoch:18 iter: 43 end\n",
      "Train epoch:18 iter: 44 begin\n",
      "Train epoch:18 iter: 44 end\n",
      "Train epoch:18 iter: 45 begin\n",
      "Train epoch:18 iter: 45 end\n",
      "Train epoch:18 iter: 46 begin\n",
      "Train epoch:18 iter: 46 end\n",
      "Train epoch:18 iter: 47 begin\n",
      "Train epoch:18 iter: 47 end\n",
      "Train epoch:18 iter: 48 begin\n",
      "Train epoch:18 iter: 48 end\n",
      "Train epoch:18 iter: 49 begin\n",
      "Train epoch:18 iter: 49 end\n",
      "Train epoch:18 iter: 50 begin\n",
      "Train epoch:18 iter: 50 end\n",
      "Train epoch:18 iter: 51 begin\n",
      "Train epoch:18 iter: 51 end\n",
      "Train epoch:18 iter: 52 begin\n",
      "Train epoch:18 iter: 52 end\n",
      "Train epoch:18 iter: 53 begin\n",
      "Train epoch:18 iter: 53 end\n",
      "Train epoch:18 iter: 54 begin\n",
      "Train epoch:18 iter: 54 end\n",
      "Train epoch:18 iter: 55 begin\n",
      "Train epoch:18 iter: 55 end\n",
      "Train epoch:18 iter: 56 begin\n",
      "Train epoch:18 iter: 56 end\n",
      "Train epoch:18 iter: 57 begin\n",
      "Train epoch:18 iter: 57 end\n",
      "Train epoch:18 iter: 58 begin\n",
      "Train epoch:18 iter: 58 end\n",
      "Train epoch:18 iter: 59 begin\n",
      "Train epoch:18 iter: 59 end\n",
      "Train epoch:18 iter: 60 begin\n",
      "Train epoch:18 iter: 60 end\n",
      "Train epoch:18 iter: 61 begin\n",
      "Train epoch:18 iter: 61 end\n",
      "Train epoch:18 iter: 62 begin\n",
      "Train epoch:18 iter: 62 end\n",
      "Train epoch:18 iter: 63 begin\n",
      "Train epoch:18 iter: 63 end\n",
      "Train epoch:18 iter: 64 begin\n",
      "Train epoch:18 iter: 64 end\n",
      "Train epoch:18 iter: 65 begin\n",
      "Train epoch:18 iter: 65 end\n",
      "Train epoch:18 iter: 66 begin\n",
      "Train epoch:18 iter: 66 end\n",
      "Train epoch:18 iter: 67 begin\n",
      "Train epoch:18 iter: 67 end\n",
      "Train epoch:18 iter: 68 begin\n",
      "Train epoch:18 iter: 68 end\n",
      "Train epoch:18 iter: 69 begin\n",
      "Train epoch:18 iter: 69 end\n",
      "Train epoch:18 iter: 70 begin\n",
      "Train epoch:18 iter: 70 end\n",
      "Train epoch:18 iter: 71 begin\n",
      "Train epoch:18 iter: 71 end\n",
      "Train epoch:18 iter: 72 begin\n",
      "Train epoch:18 iter: 72 end\n",
      "Train epoch:18 iter: 73 begin\n",
      "Train epoch:18 iter: 73 end\n",
      "Train epoch:18 iter: 74 begin\n",
      "Train epoch:18 iter: 74 end\n",
      "Train epoch:18 iter: 75 begin\n",
      "Train epoch:18 iter: 75 end\n",
      "Train epoch:18 iter: 76 begin\n",
      "Train epoch:18 iter: 76 end\n",
      "Train epoch:18 iter: 77 begin\n",
      "Train epoch:18 iter: 77 end\n",
      "Train epoch:18 iter: 78 begin\n",
      "Train epoch:18 iter: 78 end\n",
      "Train epoch:18 iter: 79 begin\n",
      "Train epoch:18 iter: 79 end\n",
      "Train epoch:18 iter: 80 begin\n",
      "Train epoch:18 iter: 80 end\n",
      "Train epoch:18 iter: 81 begin\n",
      "Train epoch:18 iter: 81 end\n",
      "Train epoch:18 iter: 82 begin\n",
      "Train epoch:18 iter: 82 end\n",
      "Train epoch:18 iter: 83 begin\n",
      "Train epoch:18 iter: 83 end\n",
      "Train epoch:18 iter: 84 begin\n",
      "Train epoch:18 iter: 84 end\n",
      "Train epoch:18 iter: 85 begin\n",
      "Train epoch:18 iter: 85 end\n",
      "Train epoch:18 iter: 86 begin\n",
      "Train epoch:18 iter: 86 end\n",
      "Train epoch:18 iter: 87 begin\n",
      "Train epoch:18 iter: 87 end\n",
      "Train epoch:18 iter: 88 begin\n",
      "Train epoch:18 iter: 88 end\n",
      "Train epoch:18 iter: 89 begin\n",
      "Train epoch:18 iter: 89 end\n",
      "Train epoch:18 iter: 90 begin\n",
      "Train epoch:18 iter: 90 end\n",
      "Train epoch:18 iter: 91 begin\n",
      "Train epoch:18 iter: 91 end\n",
      "Train epoch:18 iter: 92 begin\n",
      "Train epoch:18 iter: 92 end\n",
      "Train epoch:18 iter: 93 begin\n",
      "Train epoch:18 iter: 93 end\n",
      "Train epoch:18 iter: 94 begin\n",
      "Train epoch:18 iter: 94 end\n",
      "Train epoch:18 iter: 95 begin\n",
      "Train epoch:18 iter: 95 end\n",
      "Train epoch:18 iter: 96 begin\n",
      "Train epoch:18 iter: 96 end\n",
      "Train epoch:18 iter: 97 begin\n",
      "Train epoch:18 iter: 97 end\n",
      "Train epoch:18 iter: 98 begin\n",
      "Train epoch:18 iter: 98 end\n",
      "Train epoch:18 iter: 99 begin\n",
      "Train epoch:18 iter: 99 end\n",
      "Train epoch:18 iter: 100 begin\n",
      "Train epoch:18 iter: 100 end\n",
      "Train epoch:18 iter: 101 begin\n",
      "Train epoch:18 iter: 101 end\n",
      "Train epoch:18 iter: 102 begin\n",
      "Train epoch:18 iter: 102 end\n",
      "Train epoch:18 iter: 103 begin\n",
      "Train epoch:18 iter: 103 end\n",
      "Train epoch:18 iter: 104 begin\n",
      "Train epoch:18 iter: 104 end\n",
      "Train epoch:18 iter: 105 begin\n",
      "Train epoch:18 iter: 105 end\n",
      "Train epoch:18 iter: 106 begin\n",
      "Train epoch:18 iter: 106 end\n",
      "Train epoch:18 iter: 107 begin\n",
      "Train epoch:18 iter: 107 end\n",
      "Train epoch:18 iter: 108 begin\n",
      "Train epoch:18 iter: 108 end\n",
      "Train epoch:18 iter: 109 begin\n",
      "Train epoch:18 iter: 109 end\n",
      "Train epoch:18 iter: 110 begin\n",
      "Train epoch:18 iter: 110 end\n",
      "Train epoch:18 iter: 111 begin\n",
      "Train epoch:18 iter: 111 end\n",
      "Train epoch:18 iter: 112 begin\n",
      "Train epoch:18 iter: 112 end\n",
      "Train epoch:18 iter: 113 begin\n",
      "Train epoch:18 iter: 113 end\n",
      "Train epoch:18 iter: 114 begin\n",
      "Train epoch:18 iter: 114 end\n",
      "Train epoch:18 iter: 115 begin\n",
      "Train epoch:18 iter: 115 end\n",
      "Train epoch:18 iter: 116 begin\n",
      "Train epoch:18 iter: 116 end\n",
      "Train epoch:18 iter: 117 begin\n",
      "Train epoch:18 iter: 117 end\n",
      "Train epoch:18 iter: 118 begin\n",
      "Train epoch:18 iter: 118 end\n",
      "Train epoch:18 iter: 119 begin\n",
      "Train epoch:18 iter: 119 end\n",
      "Train epoch:18 iter: 120 begin\n",
      "Train epoch:18 iter: 120 end\n",
      "Train epoch:18 iter: 121 begin\n",
      "Train epoch:18 iter: 121 end\n",
      "Train epoch:18 iter: 122 begin\n",
      "Train epoch:18 iter: 122 end\n",
      "Train epoch:18 iter: 123 begin\n",
      "Train epoch:18 iter: 123 end\n",
      "Train epoch:18 iter: 124 begin\n",
      "Train epoch:18 iter: 124 end\n",
      "Train epoch:18 iter: 125 begin\n",
      "Train epoch:18 iter: 125 end\n",
      "Train epoch:18 iter: 126 begin\n",
      "Train epoch:18 iter: 126 end\n",
      "Train epoch:18 iter: 127 begin\n",
      "Train epoch:18 iter: 127 end\n",
      "Train epoch:18 iter: 128 begin\n",
      "Train epoch:18 iter: 128 end\n",
      "Train epoch:18 iter: 129 begin\n",
      "Train epoch:18 iter: 129 end\n",
      "Train epoch:18 iter: 130 begin\n",
      "Train epoch:18 iter: 130 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:18 iter: 131 begin\n",
      "Train epoch:18 iter: 131 end\n",
      "Train epoch:18 iter: 132 begin\n",
      "Train epoch:18 iter: 132 end\n",
      "Train epoch:18 iter: 133 begin\n",
      "Train epoch:18 iter: 133 end\n",
      "Train epoch:18 iter: 134 begin\n",
      "Train epoch:18 iter: 134 end\n",
      "Train epoch:18 iter: 135 begin\n",
      "Train epoch:18 iter: 135 end\n",
      "Train epoch:18 iter: 136 begin\n",
      "Train epoch:18 iter: 136 end\n",
      "Train epoch:18 iter: 137 begin\n",
      "Train epoch:18 iter: 137 end\n",
      "Train epoch:18 iter: 138 begin\n",
      "Train epoch:18 iter: 138 end\n",
      "Train epoch:18 iter: 139 begin\n",
      "Train epoch:18 iter: 139 end\n",
      "Train epoch:18 iter: 140 begin\n",
      "Train epoch:18 iter: 140 end\n",
      "Train epoch:18 iter: 141 begin\n",
      "Train epoch:18 iter: 141 end\n",
      "Train epoch:18 iter: 142 begin\n",
      "Train epoch:18 iter: 142 end\n",
      "Train epoch:18 iter: 143 begin\n",
      "Train epoch:18 iter: 143 end\n",
      "Train epoch:18 iter: 144 begin\n",
      "Train epoch:18 iter: 144 end\n",
      "Train epoch:18 iter: 145 begin\n",
      "Train epoch:18 iter: 145 end\n",
      "Train epoch:18 iter: 146 begin\n",
      "Train epoch:18 iter: 146 end\n",
      "Train epoch:18 iter: 147 begin\n",
      "Train epoch:18 iter: 147 end\n",
      "Train epoch:18 iter: 148 begin\n",
      "Train epoch:18 iter: 148 end\n",
      "Train epoch:18 iter: 149 begin\n",
      "Train epoch:18 iter: 149 end\n",
      "Train epoch:18 iter: 150 begin\n",
      "Train epoch:18 iter: 150 end\n",
      "Train epoch:18 iter: 151 begin\n",
      "Train epoch:18 iter: 151 end\n",
      "Train epoch:18 iter: 152 begin\n",
      "Train epoch:18 iter: 152 end\n",
      "Train epoch:18 iter: 153 begin\n",
      "Train epoch:18 iter: 153 end\n",
      "Train epoch:18 iter: 154 begin\n",
      "Train epoch:18 iter: 154 end\n",
      "Train epoch:18 iter: 155 begin\n",
      "Train epoch:18 iter: 155 end\n",
      "Train epoch:18 iter: 156 begin\n",
      "Train epoch:18 iter: 156 end\n",
      "Train epoch:18 iter: 157 begin\n",
      "Train epoch:18 iter: 157 end\n",
      "Train epoch:18 iter: 158 begin\n",
      "Train epoch:18 iter: 158 end\n",
      "Train epoch:18 iter: 159 begin\n",
      "Train epoch:18 iter: 159 end\n",
      "Train epoch:18 iter: 160 begin\n",
      "Train epoch:18 iter: 160 end\n",
      "Train epoch:18 iter: 161 begin\n",
      "Train epoch:18 iter: 161 end\n",
      "Train epoch:18 iter: 162 begin\n",
      "Train epoch:18 iter: 162 end\n",
      "Train epoch:18 iter: 163 begin\n",
      "Train epoch:18 iter: 163 end\n",
      "Train epoch:18 iter: 164 begin\n",
      "Train epoch:18 iter: 164 end\n",
      "Train epoch:18 iter: 165 begin\n",
      "Train epoch:18 iter: 165 end\n",
      "Train epoch:18 iter: 166 begin\n",
      "Train epoch:18 iter: 166 end\n",
      "Train epoch:18 iter: 167 begin\n",
      "Train epoch:18 iter: 167 end\n",
      "Train epoch:18 iter: 168 begin\n",
      "Train epoch:18 iter: 168 end\n",
      "Train epoch:18 iter: 169 begin\n",
      "Train epoch:18 iter: 169 end\n",
      "Train epoch:18 iter: 170 begin\n",
      "Train epoch:18 iter: 170 end\n",
      "Train epoch:18 iter: 171 begin\n",
      "Train epoch:18 iter: 171 end\n",
      "Train epoch:18 iter: 172 begin\n",
      "Train epoch:18 iter: 172 end\n",
      "Train epoch:18 iter: 173 begin\n",
      "Train epoch:18 iter: 173 end\n",
      "Train epoch:18 iter: 174 begin\n",
      "Train epoch:18 iter: 174 end\n",
      "Train epoch:18 iter: 175 begin\n",
      "Train epoch:18 iter: 175 end\n",
      "Train epoch:18 iter: 176 begin\n",
      "Train epoch:18 iter: 176 end\n",
      "Train epoch:18 iter: 177 begin\n",
      "Train epoch:18 iter: 177 end\n",
      "Train epoch:18 iter: 178 begin\n",
      "Train epoch:18 iter: 178 end\n",
      "Train epoch:18 iter: 179 begin\n",
      "Train epoch:18 iter: 179 end\n",
      "Train epoch:18 iter: 180 begin\n",
      "Train epoch:18 iter: 180 end\n",
      "Train epoch:18 iter: 181 begin\n",
      "Train epoch:18 iter: 181 end\n",
      "Train epoch:18 iter: 182 begin\n",
      "Train epoch:18 iter: 182 end\n",
      "Train epoch:18 iter: 183 begin\n",
      "Train epoch:18 iter: 183 end\n",
      "Train epoch:18 iter: 184 begin\n",
      "Train epoch:18 iter: 184 end\n",
      "Train epoch:18 iter: 185 begin\n",
      "Train epoch:18 iter: 185 end\n",
      "Train epoch:18 iter: 186 begin\n",
      "Train epoch:18 iter: 186 end\n",
      "Train epoch:18 iter: 187 begin\n",
      "Train epoch:18 iter: 187 end\n",
      "Train epoch:18 iter: 188 begin\n",
      "Train epoch:18 iter: 188 end\n",
      "Train epoch:18 iter: 189 begin\n",
      "Train epoch:18 iter: 189 end\n",
      "Train epoch:18 iter: 190 begin\n",
      "Train epoch:18 iter: 190 end\n",
      "Train epoch:18 iter: 191 begin\n",
      "Train epoch:18 iter: 191 end\n",
      "Train epoch:18 iter: 192 begin\n",
      "Train epoch:18 iter: 192 end\n",
      "Train epoch:18 iter: 193 begin\n",
      "Train epoch:18 iter: 193 end\n",
      "Train epoch:18 iter: 194 begin\n",
      "Train epoch:18 iter: 194 end\n",
      "Train epoch:18 iter: 195 begin\n",
      "Train epoch:18 iter: 195 end\n",
      "Train epoch:18 iter: 196 begin\n",
      "Train epoch:18 iter: 196 end\n",
      "Train epoch:18 iter: 197 begin\n",
      "Train epoch:18 iter: 197 end\n",
      "Train epoch:18 iter: 198 begin\n",
      "Train epoch:18 iter: 198 end\n",
      "Train epoch:18 iter: 199 begin\n",
      "Train epoch:18 iter: 199 end\n",
      "Train epoch:18 iter: 200 begin\n",
      "Train epoch:18 iter: 200 end\n",
      "Train epoch:18 iter: 201 begin\n",
      "Train epoch:18 iter: 201 end\n",
      "Train epoch:18 iter: 202 begin\n",
      "Train epoch:18 iter: 202 end\n",
      "Train epoch:18 iter: 203 begin\n",
      "Train epoch:18 iter: 203 end\n",
      "Train epoch:18 iter: 204 begin\n",
      "Train epoch:18 iter: 204 end\n",
      "Train epoch:18 iter: 205 begin\n",
      "Train epoch:18 iter: 205 end\n",
      "Train epoch:18 iter: 206 begin\n",
      "Train epoch:18 iter: 206 end\n",
      "Train epoch:18 iter: 207 begin\n",
      "Train epoch:18 iter: 207 end\n",
      "Train epoch:18 iter: 208 begin\n",
      "Train epoch:18 iter: 208 end\n",
      "Train epoch:18 iter: 209 begin\n",
      "Train epoch:18 iter: 209 end\n",
      "Train epoch:18 iter: 210 begin\n",
      "Train epoch:18 iter: 210 end\n",
      "Train epoch:18 iter: 211 begin\n",
      "Train epoch:18 iter: 211 end\n",
      "Train epoch:18 iter: 212 begin\n",
      "Train epoch:18 iter: 212 end\n",
      "Train epoch:18 iter: 213 begin\n",
      "Train epoch:18 iter: 213 end\n",
      "Train epoch:18 iter: 214 begin\n",
      "Train epoch:18 iter: 214 end\n",
      "Train epoch:18 iter: 215 begin\n",
      "Train epoch:18 iter: 215 end\n",
      "Train epoch:18 iter: 216 begin\n",
      "Train epoch:18 iter: 216 end\n",
      "Train epoch:18 iter: 217 begin\n",
      "Train epoch:18 iter: 217 end\n",
      "Train epoch:18 iter: 218 begin\n",
      "Train epoch:18 iter: 218 end\n",
      "Train epoch:18 iter: 219 begin\n",
      "Train epoch:18 iter: 219 end\n",
      "Train epoch:18 iter: 220 begin\n",
      "Train epoch:18 iter: 220 end\n",
      "Train epoch:18 iter: 221 begin\n",
      "Train epoch:18 iter: 221 end\n",
      "Train epoch:18 iter: 222 begin\n",
      "Train epoch:18 iter: 222 end\n",
      "Train epoch:18 iter: 223 begin\n",
      "Train epoch:18 iter: 223 end\n",
      "Train epoch:18 iter: 224 begin\n",
      "Train epoch:18 iter: 224 end\n",
      "Train epoch:18 iter: 225 begin\n",
      "Train epoch:18 iter: 225 end\n",
      "Train epoch:18 iter: 226 begin\n",
      "Train epoch:18 iter: 226 end\n",
      "Train epoch:18 iter: 227 begin\n",
      "Train epoch:18 iter: 227 end\n",
      "Train epoch:18 iter: 228 begin\n",
      "Train epoch:18 iter: 228 end\n",
      "Train epoch:18 iter: 229 begin\n",
      "Train epoch:18 iter: 229 end\n",
      "Train epoch:18 iter: 230 begin\n",
      "Train epoch:18 iter: 230 end\n",
      "Train epoch:18 iter: 231 begin\n",
      "Train epoch:18 iter: 231 end\n",
      "Train epoch:18 iter: 232 begin\n",
      "Train epoch:18 iter: 232 end\n",
      "Train epoch:18 iter: 233 begin\n",
      "Train epoch:18 iter: 233 end\n",
      "Train epoch:18 iter: 234 begin\n",
      "Train epoch:18 iter: 234 end\n",
      "Train epoch:18 iter: 235 begin\n",
      "Train epoch:18 iter: 235 end\n",
      "Train epoch:18 iter: 236 begin\n",
      "Train epoch:18 iter: 236 end\n",
      "Train epoch:18 iter: 237 begin\n",
      "Train epoch:18 iter: 237 end\n",
      "Train epoch:18 iter: 238 begin\n",
      "Train epoch:18 iter: 238 end\n",
      "Train epoch:18 iter: 239 begin\n",
      "Train epoch:18 iter: 239 end\n",
      "Train epoch:18 iter: 240 begin\n",
      "Train epoch:18 iter: 240 end\n",
      "Train epoch:18 iter: 241 begin\n",
      "Train epoch:18 iter: 241 end\n",
      "Train epoch:18 iter: 242 begin\n",
      "Train epoch:18 iter: 242 end\n",
      "Train epoch:18 iter: 243 begin\n",
      "Train epoch:18 iter: 243 end\n",
      "Train epoch:18 iter: 244 begin\n",
      "Train epoch:18 iter: 244 end\n",
      "Train epoch:18 iter: 245 begin\n",
      "Train epoch:18 iter: 245 end\n",
      "Train epoch:18 iter: 246 begin\n",
      "Train epoch:18 iter: 246 end\n",
      "Train epoch:18 iter: 247 begin\n",
      "Train epoch:18 iter: 247 end\n",
      "Train epoch:18 iter: 248 begin\n",
      "Train epoch:18 iter: 248 end\n",
      "Train epoch:18 iter: 249 begin\n",
      "Train epoch:18 iter: 249 end\n",
      "Train epoch:18 iter: 250 begin\n",
      "Train epoch:18 iter: 250 end\n",
      "Train epoch:18 iter: 251 begin\n",
      "Train epoch:18 iter: 251 end\n",
      "Train epoch:18 iter: 252 begin\n",
      "Train epoch:18 iter: 252 end\n",
      "Train epoch:18 iter: 253 begin\n",
      "Train epoch:18 iter: 253 end\n",
      "Train epoch:18 iter: 254 begin\n",
      "Train epoch:18 iter: 254 end\n",
      "Train epoch:18 iter: 255 begin\n",
      "Train epoch:18 iter: 255 end\n",
      "Train epoch:18 iter: 256 begin\n",
      "Train epoch:18 iter: 256 end\n",
      "Train epoch:18 iter: 257 begin\n",
      "Train epoch:18 iter: 257 end\n",
      "Train epoch:18 iter: 258 begin\n",
      "Train epoch:18 iter: 258 end\n",
      "Train epoch:18 iter: 259 begin\n",
      "Train epoch:18 iter: 259 end\n",
      "Train epoch:18 iter: 260 begin\n",
      "Train epoch:18 iter: 260 end\n",
      "Train epoch:18 iter: 261 begin\n",
      "Train epoch:18 iter: 261 end\n",
      "Train epoch:18 iter: 262 begin\n",
      "Train epoch:18 iter: 262 end\n",
      "Train epoch:18 iter: 263 begin\n",
      "Train epoch:18 iter: 263 end\n",
      "Train epoch:18 iter: 264 begin\n",
      "Train epoch:18 iter: 264 end\n",
      "Train epoch:18 iter: 265 begin\n",
      "Train epoch:18 iter: 265 end\n",
      "Train epoch:18 iter: 266 begin\n",
      "Train epoch:18 iter: 266 end\n",
      "Train epoch:18 iter: 267 begin\n",
      "Train epoch:18 iter: 267 end\n",
      "Train epoch:18 iter: 268 begin\n",
      "Train epoch:18 iter: 268 end\n",
      "Train epoch:18 iter: 269 begin\n",
      "Train epoch:18 iter: 269 end\n",
      "Train epoch:18 iter: 270 begin\n",
      "Train epoch:18 iter: 270 end\n",
      "Train epoch:18 iter: 271 begin\n",
      "Train epoch:18 iter: 271 end\n",
      "Train epoch:18 iter: 272 begin\n",
      "Train epoch:18 iter: 272 end\n",
      "Train epoch:18 iter: 273 begin\n",
      "Train epoch:18 iter: 273 end\n",
      "Train epoch:18 iter: 274 begin\n",
      "Train epoch:18 iter: 274 end\n",
      "Train epoch:18 iter: 275 begin\n",
      "Train epoch:18 iter: 275 end\n",
      "Train epoch:18 iter: 276 begin\n",
      "Train epoch:18 iter: 276 end\n",
      "Train epoch:18 iter: 277 begin\n",
      "Train epoch:18 iter: 277 end\n",
      "Train epoch:18 iter: 278 begin\n",
      "Train epoch:18 iter: 278 end\n",
      "Train epoch:18 iter: 279 begin\n",
      "Train epoch:18 iter: 279 end\n",
      "Train epoch:18 iter: 280 begin\n",
      "Train epoch:18 iter: 280 end\n",
      "Train epoch:18 iter: 281 begin\n",
      "Train epoch:18 iter: 281 end\n",
      "Train epoch:18 iter: 282 begin\n",
      "Train epoch:18 iter: 282 end\n",
      "Train epoch:18 iter: 283 begin\n",
      "Train epoch:18 iter: 283 end\n",
      "Train epoch:18 iter: 284 begin\n",
      "Train epoch:18 iter: 284 end\n",
      "Train epoch:18 iter: 285 begin\n",
      "Train epoch:18 iter: 285 end\n",
      "Train epoch:18 iter: 286 begin\n",
      "Train epoch:18 iter: 286 end\n",
      "Train epoch:18 iter: 287 begin\n",
      "Train epoch:18 iter: 287 end\n",
      "Train epoch:18 iter: 288 begin\n",
      "Train epoch:18 iter: 288 end\n",
      "Train epoch:18 iter: 289 begin\n",
      "Train epoch:18 iter: 289 end\n",
      "Train epoch:18 iter: 290 begin\n",
      "Train epoch:18 iter: 290 end\n",
      "Train epoch:18 iter: 291 begin\n",
      "Train epoch:18 iter: 291 end\n",
      "Train epoch:18 iter: 292 begin\n",
      "Train epoch:18 iter: 292 end\n",
      "Train epoch:18 iter: 293 begin\n",
      "Train epoch:18 iter: 293 end\n",
      "Train epoch:18 iter: 294 begin\n",
      "Train epoch:18 iter: 294 end\n",
      "Train epoch:18 iter: 295 begin\n",
      "Train epoch:18 iter: 295 end\n",
      "Train epoch:18 iter: 296 begin\n",
      "Train epoch:18 iter: 296 end\n",
      "Train epoch:18 iter: 297 begin\n",
      "Train epoch:18 iter: 297 end\n",
      "Train epoch:18 iter: 298 begin\n",
      "Train epoch:18 iter: 298 end\n",
      "Train epoch:18 iter: 299 begin\n",
      "Train epoch:18 iter: 299 end\n",
      "Train epoch:18 iter: 300 begin\n",
      "Train epoch:18 iter: 300 end\n",
      "Train epoch:18 iter: 301 begin\n",
      "Train epoch:18 iter: 301 end\n",
      "Train epoch:18 iter: 302 begin\n",
      "Train epoch:18 iter: 302 end\n",
      "Train epoch:18 iter: 303 begin\n",
      "Train epoch:18 iter: 303 end\n",
      "Train epoch:18 iter: 304 begin\n",
      "Train epoch:18 iter: 304 end\n",
      "Train epoch:18 iter: 305 begin\n",
      "Train epoch:18 iter: 305 end\n",
      "Train epoch:18 iter: 306 begin\n",
      "Train epoch:18 iter: 306 end\n",
      "Train epoch:18 iter: 307 begin\n",
      "Train epoch:18 iter: 307 end\n",
      "Train epoch:18 iter: 308 begin\n",
      "Train epoch:18 iter: 308 end\n",
      "Train epoch:18 iter: 309 begin\n",
      "Train epoch:18 iter: 309 end\n",
      "Train epoch:18 iter: 310 begin\n",
      "Train epoch:18 iter: 310 end\n",
      "Train epoch:18 iter: 311 begin\n",
      "Train epoch:18 iter: 311 end\n",
      "Train epoch:18 iter: 312 begin\n",
      "Train epoch:18 iter: 312 end\n",
      "Train epoch:18 iter: 313 begin\n",
      "Train epoch:18 iter: 313 end\n",
      "Train epoch:18 iter: 314 begin\n",
      "Train epoch:18 iter: 314 end\n",
      "Train epoch:18 iter: 315 begin\n",
      "Train epoch:18 iter: 315 end\n",
      "Train epoch:18 iter: 316 begin\n",
      "Train epoch:18 iter: 316 end\n",
      "Train epoch:18 iter: 317 begin\n",
      "Train epoch:18 iter: 317 end\n",
      "Train epoch:18 iter: 318 begin\n",
      "Train epoch:18 iter: 318 end\n",
      "Train epoch:18 iter: 319 begin\n",
      "Train epoch:18 iter: 319 end\n",
      "Train epoch:18 iter: 320 begin\n",
      "Train epoch:18 iter: 320 end\n",
      "Train epoch:18 iter: 321 begin\n",
      "Train epoch:18 iter: 321 end\n",
      "Train epoch:18 iter: 322 begin\n",
      "Train epoch:18 iter: 322 end\n",
      "Train epoch:18 iter: 323 begin\n",
      "Train epoch:18 iter: 323 end\n",
      "Train epoch:18 iter: 324 begin\n",
      "Train epoch:18 iter: 324 end\n",
      "Train epoch:18 iter: 325 begin\n",
      "Train epoch:18 iter: 325 end\n",
      "Train epoch:18 iter: 326 begin\n",
      "Train epoch:18 iter: 326 end\n",
      "Train epoch:18 iter: 327 begin\n",
      "Train epoch:18 iter: 327 end\n",
      "Train epoch:18 iter: 328 begin\n",
      "Train epoch:18 iter: 328 end\n",
      "Train epoch:18 iter: 329 begin\n",
      "Train epoch:18 iter: 329 end\n",
      "Train epoch:18 iter: 330 begin\n",
      "Train epoch:18 iter: 330 end\n",
      "Train epoch:18 iter: 331 begin\n",
      "Train epoch:18 iter: 331 end\n",
      "Train epoch:18 iter: 332 begin\n",
      "Train epoch:18 iter: 332 end\n",
      "Train epoch:18 iter: 333 begin\n",
      "Train epoch:18 iter: 333 end\n",
      "Train epoch:18 iter: 334 begin\n",
      "Train epoch:18 iter: 334 end\n",
      "Train epoch:18 iter: 335 begin\n",
      "Train epoch:18 iter: 335 end\n",
      "Train epoch:18 iter: 336 begin\n",
      "Train epoch:18 iter: 336 end\n",
      "Train epoch:18 iter: 337 begin\n",
      "Train epoch:18 iter: 337 end\n",
      "Train epoch:18 iter: 338 begin\n",
      "Train epoch:18 iter: 338 end\n",
      "Train epoch:18 iter: 339 begin\n",
      "Train epoch:18 iter: 339 end\n",
      "Train epoch:18 iter: 340 begin\n",
      "Train epoch:18 iter: 340 end\n",
      "Train epoch:18 iter: 341 begin\n",
      "Train epoch:18 iter: 341 end\n",
      "Train epoch:18 iter: 342 begin\n",
      "Train epoch:18 iter: 342 end\n",
      "Train epoch:18 iter: 343 begin\n",
      "Train epoch:18 iter: 343 end\n",
      "Train epoch:18 iter: 344 begin\n",
      "Train epoch:18 iter: 344 end\n",
      "Train epoch:18 iter: 345 begin\n",
      "Train epoch:18 iter: 345 end\n",
      "Train epoch:18 iter: 346 begin\n",
      "Train epoch:18 iter: 346 end\n",
      "Train epoch:18 iter: 347 begin\n",
      "Train epoch:18 iter: 347 end\n",
      "Train epoch:18 iter: 348 begin\n",
      "Train epoch:18 iter: 348 end\n",
      "Train epoch:18 iter: 349 begin\n",
      "Train epoch:18 iter: 349 end\n",
      "Train epoch:18 iter: 350 begin\n",
      "Train epoch:18 iter: 350 end\n",
      "Train epoch:18 iter: 351 begin\n",
      "Train epoch:18 iter: 351 end\n",
      "Train epoch:18 iter: 352 begin\n",
      "Train epoch:18 iter: 352 end\n",
      "Train epoch:18 iter: 353 begin\n",
      "Train epoch:18 iter: 353 end\n",
      "Train epoch:18 iter: 354 begin\n",
      "Train epoch:18 iter: 354 end\n",
      "Train epoch:18 iter: 355 begin\n",
      "Train epoch:18 iter: 355 end\n",
      "Train epoch:18 iter: 356 begin\n",
      "Train epoch:18 iter: 356 end\n",
      "Train epoch:18 iter: 357 begin\n",
      "Train epoch:18 iter: 357 end\n",
      "Train epoch:18 iter: 358 begin\n",
      "Train epoch:18 iter: 358 end\n",
      "Train epoch:18 iter: 359 begin\n",
      "Train epoch:18 iter: 359 end\n",
      "Train epoch:18 iter: 360 begin\n",
      "Train epoch:18 iter: 360 end\n",
      "Train epoch:18 iter: 361 begin\n",
      "Train epoch:18 iter: 361 end\n",
      "Train epoch:18 iter: 362 begin\n",
      "Train epoch:18 iter: 362 end\n",
      "Train epoch:18 iter: 363 begin\n",
      "Train epoch:18 iter: 363 end\n",
      "Train epoch:18 iter: 364 begin\n",
      "Train epoch:18 iter: 364 end\n",
      "Train epoch:18 iter: 365 begin\n",
      "Train epoch:18 iter: 365 end\n",
      "Train epoch:18 iter: 366 begin\n",
      "Train epoch:18 iter: 366 end\n",
      "Train epoch:18 iter: 367 begin\n",
      "Train epoch:18 iter: 367 end\n",
      "Train epoch:18 iter: 368 begin\n",
      "Train epoch:18 iter: 368 end\n",
      "Train epoch:18 iter: 369 begin\n",
      "Train epoch:18 iter: 369 end\n",
      "Train epoch:18 iter: 370 begin\n",
      "Train epoch:18 iter: 370 end\n",
      "Train epoch:18 iter: 371 begin\n",
      "Train epoch:18 iter: 371 end\n",
      "Train epoch:18 iter: 372 begin\n",
      "Train epoch:18 iter: 372 end\n",
      "Train epoch:18 iter: 373 begin\n",
      "Train epoch:18 iter: 373 end\n",
      "Train epoch:18 iter: 374 begin\n",
      "Train epoch:18 iter: 374 end\n",
      "Train epoch:18 iter: 375 begin\n",
      "Train epoch:18 iter: 375 end\n",
      "Train epoch:18 iter: 376 begin\n",
      "Train epoch:18 iter: 376 end\n",
      "Train epoch:18 iter: 377 begin\n",
      "Train epoch:18 iter: 377 end\n",
      "Train epoch:18 iter: 378 begin\n",
      "Train epoch:18 iter: 378 end\n",
      "Train epoch:18 iter: 379 begin\n",
      "Train epoch:18 iter: 379 end\n",
      "Train epoch:18 iter: 380 begin\n",
      "Train epoch:18 iter: 380 end\n",
      "Train epoch:18 iter: 381 begin\n",
      "Train epoch:18 iter: 381 end\n",
      "Train epoch:18 iter: 382 begin\n",
      "Train epoch:18 iter: 382 end\n",
      "Train epoch:18 iter: 383 begin\n",
      "Train epoch:18 iter: 383 end\n",
      "Train epoch:18 iter: 384 begin\n",
      "Train epoch:18 iter: 384 end\n",
      "Train epoch:18 iter: 385 begin\n",
      "Train epoch:18 iter: 385 end\n",
      "Train epoch:18 iter: 386 begin\n",
      "Train epoch:18 iter: 386 end\n",
      "Train epoch:18 iter: 387 begin\n",
      "Train epoch:18 iter: 387 end\n",
      "Train epoch:18 iter: 388 begin\n",
      "Train epoch:18 iter: 388 end\n",
      "Train epoch:18 iter: 389 begin\n",
      "Train epoch:18 iter: 389 end\n",
      "Train epoch:18 iter: 390 begin\n",
      "Train epoch:18 iter: 390 end\n",
      "Train epoch:18 iter: 391 begin\n",
      "Train epoch:18 iter: 391 end\n",
      "Train epoch:18 iter: 392 begin\n",
      "Train epoch:18 iter: 392 end\n",
      "Train epoch:18 iter: 393 begin\n",
      "Train epoch:18 iter: 393 end\n",
      "Train epoch:18 iter: 394 begin\n",
      "Train epoch:18 iter: 394 end\n",
      "Train epoch:18 iter: 395 begin\n",
      "Train epoch:18 iter: 395 end\n",
      "Train epoch:18 iter: 396 begin\n",
      "Train epoch:18 iter: 396 end\n",
      "Train epoch:18 iter: 397 begin\n",
      "Train epoch:18 iter: 397 end\n",
      "Train epoch:18 iter: 398 begin\n",
      "Train epoch:18 iter: 398 end\n",
      "Train epoch:18 iter: 399 begin\n",
      "Train epoch:18 iter: 399 end\n",
      "Train epoch:18 iter: 400 begin\n",
      "Train epoch:18 iter: 400 end\n",
      "Train epoch:18 iter: 401 begin\n",
      "Train epoch:18 iter: 401 end\n",
      "Train epoch:18 iter: 402 begin\n",
      "Train epoch:18 iter: 402 end\n",
      "Train epoch:18 iter: 403 begin\n",
      "Train epoch:18 iter: 403 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:18 iter: 404 begin\n",
      "Train epoch:18 iter: 404 end\n",
      "Train epoch:18 iter: 405 begin\n",
      "Train epoch:18 iter: 405 end\n",
      "Train epoch:18 iter: 406 begin\n",
      "Train epoch:18 iter: 406 end\n",
      "Train epoch:18 iter: 407 begin\n",
      "Train epoch:18 iter: 407 end\n",
      "Train epoch:18 iter: 408 begin\n",
      "Train epoch:18 iter: 408 end\n",
      "Train epoch:18 iter: 409 begin\n",
      "Train epoch:18 iter: 409 end\n",
      "Train epoch:18 iter: 410 begin\n",
      "Train epoch:18 iter: 410 end\n",
      "Train epoch:18 iter: 411 begin\n",
      "Train epoch:18 iter: 411 end\n",
      "Train epoch:18 iter: 412 begin\n",
      "Train epoch:18 iter: 412 end\n",
      "Train epoch:18 iter: 413 begin\n",
      "Train epoch:18 iter: 413 end\n",
      "Train epoch:18 iter: 414 begin\n",
      "Train epoch:18 iter: 414 end\n",
      "Train epoch:18 iter: 415 begin\n",
      "Train epoch:18 iter: 415 end\n",
      "Train epoch:18 iter: 416 begin\n",
      "Train epoch:18 iter: 416 end\n",
      "Train epoch:18 iter: 417 begin\n",
      "Train epoch:18 iter: 417 end\n",
      "Train epoch:18 iter: 418 begin\n",
      "Train epoch:18 iter: 418 end\n",
      "Train epoch:18 iter: 419 begin\n",
      "Train epoch:18 iter: 419 end\n",
      "Train epoch:18 iter: 420 begin\n",
      "Train epoch:18 iter: 420 end\n",
      "Train epoch:18 iter: 421 begin\n",
      "Train epoch:18 iter: 421 end\n",
      "Train epoch:18 iter: 422 begin\n",
      "Train epoch:18 iter: 422 end\n",
      "Train epoch:18 iter: 423 begin\n",
      "Train epoch:18 iter: 423 end\n",
      "Train epoch:18 iter: 424 begin\n",
      "Train epoch:18 iter: 424 end\n",
      "Train epoch:18 iter: 425 begin\n",
      "Train epoch:18 iter: 425 end\n",
      "Train epoch:18 iter: 426 begin\n",
      "Train epoch:18 iter: 426 end\n",
      "Train epoch:18 iter: 427 begin\n",
      "Train epoch:18 iter: 427 end\n",
      "Train epoch:18 iter: 428 begin\n",
      "Train epoch:18 iter: 428 end\n",
      "Train epoch:18 iter: 429 begin\n",
      "Train epoch:18 iter: 429 end\n",
      "Train epoch:18 iter: 430 begin\n",
      "Train epoch:18 iter: 430 end\n",
      "Train epoch:18 iter: 431 begin\n",
      "Train epoch:18 iter: 431 end\n",
      "Train epoch:18 iter: 432 begin\n",
      "Train epoch:18 iter: 432 end\n",
      "Train epoch:18 iter: 433 begin\n",
      "Train epoch:18 iter: 433 end\n",
      "Train epoch:18 iter: 434 begin\n",
      "Train epoch:18 iter: 434 end\n",
      "Train epoch:18 iter: 435 begin\n",
      "Train epoch:18 iter: 435 end\n",
      "Train epoch:18 iter: 436 begin\n",
      "Train epoch:18 iter: 436 end\n",
      "Train epoch:18 iter: 437 begin\n",
      "Train epoch:18 iter: 437 end\n",
      "Train epoch:18 iter: 438 begin\n",
      "Train epoch:18 iter: 438 end\n",
      "Train epoch:18 iter: 439 begin\n",
      "Train epoch:18 iter: 439 end\n",
      "Train epoch:18 iter: 440 begin\n",
      "Train epoch:18 iter: 440 end\n",
      "Train epoch:18 iter: 441 begin\n",
      "Train epoch:18 iter: 441 end\n",
      "Train epoch:18 iter: 442 begin\n",
      "Train epoch:18 iter: 442 end\n",
      "Train epoch:18 iter: 443 begin\n",
      "Train epoch:18 iter: 443 end\n",
      "Train epoch:18 iter: 444 begin\n",
      "Train epoch:18 iter: 444 end\n",
      "Train epoch:18 iter: 445 begin\n",
      "Train epoch:18 iter: 445 end\n",
      "Train epoch:18 iter: 446 begin\n",
      "Train epoch:18 iter: 446 end\n",
      "Train epoch:18 iter: 447 begin\n",
      "Train epoch:18 iter: 447 end\n",
      "Train epoch:18 iter: 448 begin\n",
      "Train epoch:18 iter: 448 end\n",
      "Train epoch:18 iter: 449 begin\n",
      "Train epoch:18 iter: 449 end\n",
      "Train epoch:18 iter: 450 begin\n",
      "Train epoch:18 iter: 450 end\n",
      "Train epoch:18 iter: 451 begin\n",
      "Train epoch:18 iter: 451 end\n",
      "Train epoch:18 iter: 452 begin\n",
      "Train epoch:18 iter: 452 end\n",
      "Train epoch:18 iter: 453 begin\n",
      "Train epoch:18 iter: 453 end\n",
      "Train epoch:18 iter: 454 begin\n",
      "Train epoch:18 iter: 454 end\n",
      "Train epoch:18 iter: 455 begin\n",
      "Train epoch:18 iter: 455 end\n",
      "Train epoch:18 iter: 456 begin\n",
      "Train epoch:18 iter: 456 end\n",
      "Train epoch:18 iter: 457 begin\n",
      "Train epoch:18 iter: 457 end\n",
      "Train epoch:18 iter: 458 begin\n",
      "Train epoch:18 iter: 458 end\n",
      "Train epoch:18 iter: 459 begin\n",
      "Train epoch:18 iter: 459 end\n",
      "Train epoch:18 iter: 460 begin\n",
      "Train epoch:18 iter: 460 end\n",
      "Train epoch:18 iter: 461 begin\n",
      "Train epoch:18 iter: 461 end\n",
      "Train epoch:18 iter: 462 begin\n",
      "Train epoch:18 iter: 462 end\n",
      "Train epoch:18 iter: 463 begin\n",
      "Train epoch:18 iter: 463 end\n",
      "Train epoch:18 iter: 464 begin\n",
      "Train epoch:18 iter: 464 end\n",
      "Train epoch:18 iter: 465 begin\n",
      "Train epoch:18 iter: 465 end\n",
      "Train epoch:18 iter: 466 begin\n",
      "Train epoch:18 iter: 466 end\n",
      "Train epoch:18 iter: 467 begin\n",
      "Train epoch:18 iter: 467 end\n",
      "Train epoch:18 iter: 468 begin\n",
      "Train epoch:18 iter: 468 end\n",
      "Train epoch:18 iter: 469 begin\n",
      "Train epoch:18 iter: 469 end\n",
      "Train epoch:18 iter: 470 begin\n",
      "Train epoch:18 iter: 470 end\n",
      "Train epoch:18 iter: 471 begin\n",
      "Train epoch:18 iter: 471 end\n",
      "Train epoch:18 iter: 472 begin\n",
      "Train epoch:18 iter: 472 end\n",
      "Train epoch:18 iter: 473 begin\n",
      "Train epoch:18 iter: 473 end\n",
      "Train epoch:18 iter: 474 begin\n",
      "Train epoch:18 iter: 474 end\n",
      "Train epoch:18 iter: 475 begin\n",
      "Train epoch:18 iter: 475 end\n",
      "Train epoch:18 iter: 476 begin\n",
      "Train epoch:18 iter: 476 end\n",
      "Train epoch:18 iter: 477 begin\n",
      "Train epoch:18 iter: 477 end\n",
      "Train epoch:18 iter: 478 begin\n",
      "Train epoch:18 iter: 478 end\n",
      "Train epoch:18 iter: 479 begin\n",
      "Train epoch:18 iter: 479 end\n",
      "Train epoch:18 iter: 480 begin\n",
      "Train epoch:18 iter: 480 end\n",
      "Train epoch:18 iter: 481 begin\n",
      "Train epoch:18 iter: 481 end\n",
      "Train epoch:18 iter: 482 begin\n",
      "Train epoch:18 iter: 482 end\n",
      "Train epoch:18 iter: 483 begin\n",
      "Train epoch:18 iter: 483 end\n",
      "Train epoch:18 iter: 484 begin\n",
      "Train epoch:18 iter: 484 end\n",
      "Train epoch:18 iter: 485 begin\n",
      "Train epoch:18 iter: 485 end\n",
      "Train epoch:18 iter: 486 begin\n",
      "Train epoch:18 iter: 486 end\n",
      "Train epoch:18 iter: 487 begin\n",
      "Train epoch:18 iter: 487 end\n",
      "Train epoch:18 iter: 488 begin\n",
      "Train epoch:18 iter: 488 end\n",
      "Train epoch:18 iter: 489 begin\n",
      "Train epoch:18 iter: 489 end\n",
      "Train epoch:18 iter: 490 begin\n",
      "Train epoch:18 iter: 490 end\n",
      "Train epoch:18 iter: 491 begin\n",
      "Train epoch:18 iter: 491 end\n",
      "Train epoch:18 iter: 492 begin\n",
      "Train epoch:18 iter: 492 end\n",
      "Train epoch:18 iter: 493 begin\n",
      "Train epoch:18 iter: 493 end\n",
      "Train epoch:18 iter: 494 begin\n",
      "Train epoch:18 iter: 494 end\n",
      "Train epoch:18 iter: 495 begin\n",
      "Train epoch:18 iter: 495 end\n",
      "Train epoch:18 iter: 496 begin\n",
      "Train epoch:18 iter: 496 end\n",
      "Train epoch:18 iter: 497 begin\n",
      "Train epoch:18 iter: 497 end\n",
      "Train epoch:18 iter: 498 begin\n",
      "Train epoch:18 iter: 498 end\n",
      "Train epoch:18 iter: 499 begin\n",
      "Train epoch:18 iter: 499 end\n",
      "Train epoch:18 iter: 500 begin\n",
      "Train epoch:18 iter: 500 end\n",
      "Train epoch:18 iter: 501 begin\n",
      "Train epoch:18 iter: 501 end\n",
      "Train epoch:18 iter: 502 begin\n",
      "Train epoch:18 iter: 502 end\n",
      "Train epoch:18 iter: 503 begin\n",
      "Train epoch:18 iter: 503 end\n",
      "Train epoch:18 iter: 504 begin\n",
      "Train epoch:18 iter: 504 end\n",
      "Train epoch:18 iter: 505 begin\n",
      "Train epoch:18 iter: 505 end\n",
      "Train epoch:18 iter: 506 begin\n",
      "Train epoch:18 iter: 506 end\n",
      "Train epoch:18 iter: 507 begin\n",
      "Train epoch:18 iter: 507 end\n",
      "Train epoch:18 iter: 508 begin\n",
      "Train epoch:18 iter: 508 end\n",
      "Train epoch:18 iter: 509 begin\n",
      "Train epoch:18 iter: 509 end\n",
      "Train epoch:18 iter: 510 begin\n",
      "Train epoch:18 iter: 510 end\n",
      "Train epoch:18 iter: 511 begin\n",
      "Train epoch:18 iter: 511 end\n",
      "Train epoch:18 iter: 512 begin\n",
      "Train epoch:18 iter: 512 end\n",
      "Train epoch:18 iter: 513 begin\n",
      "Train epoch:18 iter: 513 end\n",
      "Train epoch:18 iter: 514 begin\n",
      "Train epoch:18 iter: 514 end\n",
      "Train epoch:18 iter: 515 begin\n",
      "Train epoch:18 iter: 515 end\n",
      "Train epoch:18 iter: 516 begin\n",
      "Train epoch:18 iter: 516 end\n",
      "Train epoch:18 iter: 517 begin\n",
      "Train epoch:18 iter: 517 end\n",
      "Train epoch:18 iter: 518 begin\n",
      "Train epoch:18 iter: 518 end\n",
      "Train epoch:18 iter: 519 begin\n",
      "Train epoch:18 iter: 519 end\n",
      "Train epoch:18 iter: 520 begin\n",
      "Train epoch:18 iter: 520 end\n",
      "Train epoch:18 iter: 521 begin\n",
      "Train epoch:18 iter: 521 end\n",
      "Train epoch:18 iter: 522 begin\n",
      "Train epoch:18 iter: 522 end\n",
      "Train epoch:18 iter: 523 begin\n",
      "Train epoch:18 iter: 523 end\n",
      "Train epoch:18 iter: 524 begin\n",
      "Train epoch:18 iter: 524 end\n",
      "Train epoch:18 iter: 525 begin\n",
      "Train epoch:18 iter: 525 end\n",
      "Train epoch:18 iter: 526 begin\n",
      "Train epoch:18 iter: 526 end\n",
      "Train epoch:18 iter: 527 begin\n",
      "Train epoch:18 iter: 527 end\n",
      "Train epoch:18 iter: 528 begin\n",
      "Train epoch:18 iter: 528 end\n",
      "Train epoch:18 iter: 529 begin\n",
      "Train epoch:18 iter: 529 end\n",
      "Train epoch:18 iter: 530 begin\n",
      "Train epoch:18 iter: 530 end\n",
      "Train epoch:18 iter: 531 begin\n",
      "Train epoch:18 iter: 531 end\n",
      "Train epoch:18 iter: 532 begin\n",
      "Train epoch:18 iter: 532 end\n",
      "Train epoch:18 iter: 533 begin\n",
      "Train epoch:18 iter: 533 end\n",
      "Train epoch:18 iter: 534 begin\n",
      "Train epoch:18 iter: 534 end\n",
      "Train epoch:18 iter: 535 begin\n",
      "Train epoch:18 iter: 535 end\n",
      "Train epoch:18 iter: 536 begin\n",
      "Train epoch:18 iter: 536 end\n",
      "Train epoch:18 iter: 537 begin\n",
      "Train epoch:18 iter: 537 end\n",
      "Train epoch:18 iter: 538 begin\n",
      "Train epoch:18 iter: 538 end\n",
      "Train epoch:18 iter: 539 begin\n",
      "Train epoch:18 iter: 539 end\n",
      "Train epoch:18 iter: 540 begin\n",
      "Train epoch:18 iter: 540 end\n",
      "Train epoch:18 iter: 541 begin\n",
      "Train epoch:18 iter: 541 end\n",
      "Train epoch:18 iter: 542 begin\n",
      "Train epoch:18 iter: 542 end\n",
      "Train epoch:18 iter: 543 begin\n",
      "Train epoch:18 iter: 543 end\n",
      "Train epoch:18 iter: 544 begin\n",
      "Train epoch:18 iter: 544 end\n",
      "Train epoch:18 iter: 545 begin\n",
      "Train epoch:18 iter: 545 end\n",
      "Train epoch:18 iter: 546 begin\n",
      "Train epoch:18 iter: 546 end\n",
      "Train epoch:18 iter: 547 begin\n",
      "Train epoch:18 iter: 547 end\n",
      "Train epoch:18 iter: 548 begin\n",
      "Train epoch:18 iter: 548 end\n",
      "Train epoch:18 iter: 549 begin\n",
      "Train epoch:18 iter: 549 end\n",
      "Train epoch:18 iter: 550 begin\n",
      "Train epoch:18 iter: 550 end\n",
      "Train epoch:18 iter: 551 begin\n",
      "Train epoch:18 iter: 551 end\n",
      "Train epoch:18 iter: 552 begin\n",
      "Train epoch:18 iter: 552 end\n",
      "Train epoch:18 iter: 553 begin\n",
      "Train epoch:18 iter: 553 end\n",
      "Train epoch:18 iter: 554 begin\n",
      "Train epoch:18 iter: 554 end\n",
      "Train epoch:18 iter: 555 begin\n",
      "Train epoch:18 iter: 555 end\n",
      "Train epoch:18 iter: 556 begin\n",
      "Train epoch:18 iter: 556 end\n",
      "Train epoch:18 iter: 557 begin\n",
      "Train epoch:18 iter: 557 end\n",
      "Train epoch:18 iter: 558 begin\n",
      "Train epoch:18 iter: 558 end\n",
      "Train epoch:18 iter: 559 begin\n",
      "Train epoch:18 iter: 559 end\n",
      "Train epoch:18 iter: 560 begin\n",
      "Train epoch:18 iter: 560 end\n",
      "Train epoch:18 iter: 561 begin\n",
      "Train epoch:18 iter: 561 end\n",
      "Train epoch:18 iter: 562 begin\n",
      "Train epoch:18 iter: 562 end\n",
      "Train epoch:18 iter: 563 begin\n",
      "Train epoch:18 iter: 563 end\n",
      "Train epoch:18 iter: 564 begin\n",
      "Train epoch:18 iter: 564 end\n",
      "Train epoch:18 iter: 565 begin\n",
      "Train epoch:18 iter: 565 end\n",
      "Train epoch:18 iter: 566 begin\n",
      "Train epoch:18 iter: 566 end\n",
      "Train epoch:18 iter: 567 begin\n",
      "Train epoch:18 iter: 567 end\n",
      "Train epoch:18 iter: 568 begin\n",
      "Train epoch:18 iter: 568 end\n",
      "Train epoch:18 iter: 569 begin\n",
      "Train epoch:18 iter: 569 end\n",
      "Train epoch:18 iter: 570 begin\n",
      "Train epoch:18 iter: 570 end\n",
      "Train epoch:18 iter: 571 begin\n",
      "Train epoch:18 iter: 571 end\n",
      "Train epoch:18 iter: 572 begin\n",
      "Train epoch:18 iter: 572 end\n",
      "Train epoch:18 iter: 573 begin\n",
      "Train epoch:18 iter: 573 end\n",
      "Train epoch:18 iter: 574 begin\n",
      "Train epoch:18 iter: 574 end\n",
      "Train epoch:18 iter: 575 begin\n",
      "Train epoch:18 iter: 575 end\n",
      "Train epoch:18 iter: 576 begin\n",
      "Train epoch:18 iter: 576 end\n",
      "Train epoch:18 iter: 577 begin\n",
      "Train epoch:18 iter: 577 end\n",
      "Train epoch:18 iter: 578 begin\n",
      "Train epoch:18 iter: 578 end\n",
      "Train epoch:18 iter: 579 begin\n",
      "Train epoch:18 iter: 579 end\n",
      "Train epoch:18 iter: 580 begin\n",
      "Train epoch:18 iter: 580 end\n",
      "Train epoch:18 iter: 581 begin\n",
      "Train epoch:18 iter: 581 end\n",
      "Train epoch:18 iter: 582 begin\n",
      "Train epoch:18 iter: 582 end\n",
      "Train epoch:18 iter: 583 begin\n",
      "Train epoch:18 iter: 583 end\n",
      "Train epoch:18 iter: 584 begin\n",
      "Train epoch:18 iter: 584 end\n",
      "Train epoch:18 iter: 585 begin\n",
      "Train epoch:18 iter: 585 end\n",
      "Train epoch:18 iter: 586 begin\n",
      "Train epoch:18 iter: 586 end\n",
      "Train epoch:18 iter: 587 begin\n",
      "Train epoch:18 iter: 587 end\n",
      "Train epoch:18 iter: 588 begin\n",
      "Train epoch:18 iter: 588 end\n",
      "Train epoch:18 iter: 589 begin\n",
      "Train epoch:18 iter: 589 end\n",
      "Train epoch:18 iter: 590 begin\n",
      "Train epoch:18 iter: 590 end\n",
      "Train epoch:18 iter: 591 begin\n",
      "Train epoch:18 iter: 591 end\n",
      "Train epoch:18 iter: 592 begin\n",
      "Train epoch:18 iter: 592 end\n",
      "Train epoch:18 iter: 593 begin\n",
      "Train epoch:18 iter: 593 end\n",
      "Train epoch:18 iter: 594 begin\n",
      "Train epoch:18 iter: 594 end\n",
      "Train epoch:18 iter: 595 begin\n",
      "Train epoch:18 iter: 595 end\n",
      "Train epoch:18 iter: 596 begin\n",
      "Train epoch:18 iter: 596 end\n",
      "Train epoch:18 iter: 597 begin\n",
      "Train epoch:18 iter: 597 end\n",
      "Train epoch:18 iter: 598 begin\n",
      "Train epoch:18 iter: 598 end\n",
      "Train epoch:18 iter: 599 begin\n",
      "Train epoch:18 iter: 599 end\n",
      "Train epoch:18 iter: 600 begin\n",
      "Train epoch:18 iter: 600 end\n",
      "Train epoch:18 iter: 601 begin\n",
      "Train epoch:18 iter: 601 end\n",
      "Train epoch:18 iter: 602 begin\n",
      "Train epoch:18 iter: 602 end\n",
      "Train epoch:18 iter: 603 begin\n",
      "Train epoch:18 iter: 603 end\n",
      "Train epoch:18 iter: 604 begin\n",
      "Train epoch:18 iter: 604 end\n",
      "Train epoch:18 iter: 605 begin\n",
      "Train epoch:18 iter: 605 end\n",
      "Train epoch:18 iter: 606 begin\n",
      "Train epoch:18 iter: 606 end\n",
      "Train epoch:18 iter: 607 begin\n",
      "Train epoch:18 iter: 607 end\n",
      "Train epoch:18 iter: 608 begin\n",
      "Train epoch:18 iter: 608 end\n",
      "Train epoch:18 iter: 609 begin\n",
      "Train epoch:18 iter: 609 end\n",
      "Train epoch:18 iter: 610 begin\n",
      "Train epoch:18 iter: 610 end\n",
      "Train epoch:18 iter: 611 begin\n",
      "Train epoch:18 iter: 611 end\n",
      "Train epoch:18 iter: 612 begin\n",
      "Train epoch:18 iter: 612 end\n",
      "Train epoch:18 iter: 613 begin\n",
      "Train epoch:18 iter: 613 end\n",
      "Train epoch:18 iter: 614 begin\n",
      "Train epoch:18 iter: 614 end\n",
      "Train epoch:18 iter: 615 begin\n",
      "Train epoch:18 iter: 615 end\n",
      "Train epoch:18 iter: 616 begin\n",
      "Train epoch:18 iter: 616 end\n",
      "Train epoch:18 iter: 617 begin\n",
      "Train epoch:18 iter: 617 end\n",
      "Train epoch:18 iter: 618 begin\n",
      "Train epoch:18 iter: 618 end\n",
      "Train epoch:18 iter: 619 begin\n",
      "Train epoch:18 iter: 619 end\n",
      "Train epoch:18 iter: 620 begin\n",
      "Train epoch:18 iter: 620 end\n",
      "Train epoch:18 iter: 621 begin\n",
      "Train epoch:18 iter: 621 end\n",
      "Train epoch:18 iter: 622 begin\n",
      "Train epoch:18 iter: 622 end\n",
      "Train epoch:18 iter: 623 begin\n",
      "Train epoch:18 iter: 623 end\n",
      "Train epoch:18 iter: 624 begin\n",
      "Train epoch:18 iter: 624 end\n",
      "Train epoch:18 iter: 625 begin\n",
      "Train epoch:18 iter: 625 end\n",
      "Train epoch:18 iter: 626 begin\n",
      "Train epoch:18 iter: 626 end\n",
      "Train epoch:18 iter: 627 begin\n",
      "Train epoch:18 iter: 627 end\n",
      "Train epoch:18 iter: 628 begin\n",
      "Train epoch:18 iter: 628 end\n",
      "Train epoch:18 iter: 629 begin\n",
      "Train epoch:18 iter: 629 end\n",
      "Train epoch:18 iter: 630 begin\n",
      "Train epoch:18 iter: 630 end\n",
      "Train epoch:18 iter: 631 begin\n",
      "Train epoch:18 iter: 631 end\n",
      "Train epoch:18 iter: 632 begin\n",
      "Train epoch:18 iter: 632 end\n",
      "Train epoch:18 iter: 633 begin\n",
      "Train epoch:18 iter: 633 end\n",
      "Train epoch:18 iter: 634 begin\n",
      "Train epoch:18 iter: 634 end\n",
      "Train epoch:18 iter: 635 begin\n",
      "Train epoch:18 iter: 635 end\n",
      "Train epoch:18 iter: 636 begin\n",
      "Train epoch:18 iter: 636 end\n",
      "Train epoch:18 iter: 637 begin\n",
      "Train epoch:18 iter: 637 end\n",
      "Train epoch:18 iter: 638 begin\n",
      "Train epoch:18 iter: 638 end\n",
      "Train epoch:18 iter: 639 begin\n",
      "Train epoch:18 iter: 639 end\n",
      "Train epoch:18 iter: 640 begin\n",
      "Train epoch:18 iter: 640 end\n",
      "Train epoch:18 iter: 641 begin\n",
      "Train epoch:18 iter: 641 end\n",
      "Train epoch:18 iter: 642 begin\n",
      "Train epoch:18 iter: 642 end\n",
      "Train epoch:18 iter: 643 begin\n",
      "Train epoch:18 iter: 643 end\n",
      "Train epoch:18 iter: 644 begin\n",
      "Train epoch:18 iter: 644 end\n",
      "Train epoch:18 iter: 645 begin\n",
      "Train epoch:18 iter: 645 end\n",
      "Train epoch:18 iter: 646 begin\n",
      "Train epoch:18 iter: 646 end\n",
      "Train epoch:18 iter: 647 begin\n",
      "Train epoch:18 iter: 647 end\n",
      "Train epoch:18 iter: 648 begin\n",
      "Train epoch:18 iter: 648 end\n",
      "Train epoch:18 iter: 649 begin\n",
      "Train epoch:18 iter: 649 end\n",
      "Train epoch:18 iter: 650 begin\n",
      "Train epoch:18 iter: 650 end\n",
      "Train epoch:18 iter: 651 begin\n",
      "Train epoch:18 iter: 651 end\n",
      "Train epoch:18 iter: 652 begin\n",
      "Train epoch:18 iter: 652 end\n",
      "Train epoch:18 iter: 653 begin\n",
      "Train epoch:18 iter: 653 end\n",
      "Train epoch:18 iter: 654 begin\n",
      "Train epoch:18 iter: 654 end\n",
      "Train epoch:18 iter: 655 begin\n",
      "Train epoch:18 iter: 655 end\n",
      "Train epoch:18 iter: 656 begin\n",
      "Train epoch:18 iter: 656 end\n",
      "Train epoch:18 iter: 657 begin\n",
      "Train epoch:18 iter: 657 end\n",
      "Train epoch:18 iter: 658 begin\n",
      "Train epoch:18 iter: 658 end\n",
      "Train epoch:18 iter: 659 begin\n",
      "Train epoch:18 iter: 659 end\n",
      "Train epoch:18 iter: 660 begin\n",
      "Train epoch:18 iter: 660 end\n",
      "Train epoch:18 iter: 661 begin\n",
      "Train epoch:18 iter: 661 end\n",
      "Train epoch:18 iter: 662 begin\n",
      "Train epoch:18 iter: 662 end\n",
      "Train epoch:18 iter: 663 begin\n",
      "Train epoch:18 iter: 663 end\n",
      "Train epoch:18 iter: 664 begin\n",
      "Train epoch:18 iter: 664 end\n",
      "Train epoch:18 iter: 665 begin\n",
      "Train epoch:18 iter: 665 end\n",
      "Train epoch:18 iter: 666 begin\n",
      "Train epoch:18 iter: 666 end\n",
      "Train epoch:18 iter: 667 begin\n",
      "Train epoch:18 iter: 667 end\n",
      "Train epoch:18 iter: 668 begin\n",
      "Train epoch:18 iter: 668 end\n",
      "Train epoch:18 iter: 669 begin\n",
      "Train epoch:18 iter: 669 end\n",
      "Train epoch:18 iter: 670 begin\n",
      "Train epoch:18 iter: 670 end\n",
      "Train epoch:18 iter: 671 begin\n",
      "Train epoch:18 iter: 671 end\n",
      "Train epoch:18 iter: 672 begin\n",
      "Train epoch:18 iter: 672 end\n",
      "Train epoch:18 iter: 673 begin\n",
      "Train epoch:18 iter: 673 end\n",
      "Train epoch:18 iter: 674 begin\n",
      "Train epoch:18 iter: 674 end\n",
      "Train epoch:18 iter: 675 begin\n",
      "Train epoch:18 iter: 675 end\n",
      "Train epoch:18 iter: 676 begin\n",
      "Train epoch:18 iter: 676 end\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:18 iter: 677 begin\n",
      "Train epoch:18 iter: 677 end\n",
      "Train epoch:18 iter: 678 begin\n",
      "Train epoch:18 iter: 678 end\n",
      "Train epoch:18 iter: 679 begin\n",
      "Train epoch:18 iter: 679 end\n",
      "Train epoch:18 iter: 680 begin\n",
      "Train epoch:18 iter: 680 end\n",
      "Train epoch:18 iter: 681 begin\n",
      "Train epoch:18 iter: 681 end\n",
      "Train epoch:18 iter: 682 begin\n",
      "Train epoch:18 iter: 682 end\n",
      "Train epoch:18 iter: 683 begin\n",
      "Train epoch:18 iter: 683 end\n",
      "Train epoch:18 iter: 684 begin\n",
      "Train epoch:18 iter: 684 end\n",
      "Train epoch:18 iter: 685 begin\n",
      "Train epoch:18 iter: 685 end\n",
      "Train epoch:18 iter: 686 begin\n",
      "Train epoch:18 iter: 686 end\n",
      "Train epoch:18 iter: 687 begin\n",
      "Train epoch:18 iter: 687 end\n",
      "Train epoch:18 iter: 688 begin\n",
      "Train epoch:18 iter: 688 end\n",
      "Train epoch:18 iter: 689 begin\n",
      "Train epoch:18 iter: 689 end\n",
      "Train epoch:18 iter: 690 begin\n",
      "Train epoch:18 iter: 690 end\n",
      "Train epoch:18 iter: 691 begin\n",
      "Train epoch:18 iter: 691 end\n",
      "Train epoch:18 iter: 692 begin\n",
      "Train epoch:18 iter: 692 end\n",
      "Train epoch:18 iter: 693 begin\n",
      "Train epoch:18 iter: 693 end\n",
      "Train epoch:18 iter: 694 begin\n",
      "Train epoch:18 iter: 694 end\n",
      "Train epoch:18 iter: 695 begin\n",
      "Train epoch:18 iter: 695 end\n",
      "Train epoch:18 iter: 696 begin\n",
      "Train epoch:18 iter: 696 end\n",
      "Train epoch:18 iter: 697 begin\n",
      "Train epoch:18 iter: 697 end\n",
      "Train epoch:18 iter: 698 begin\n",
      "Train epoch:18 iter: 698 end\n",
      "Train epoch:18 iter: 699 begin\n",
      "Train epoch:18 iter: 699 end\n",
      "Train epoch:18 iter: 700 begin\n",
      "Train epoch:18 iter: 700 end\n",
      "Train epoch:18 iter: 701 begin\n",
      "Train epoch:18 iter: 701 end\n",
      "Train epoch:18 iter: 702 begin\n",
      "Train epoch:18 iter: 702 end\n",
      "Train epoch:18 iter: 703 begin\n",
      "Train epoch:18 iter: 703 end\n",
      "Train epoch:18 iter: 704 begin\n",
      "Train epoch:18 iter: 704 end\n",
      "Train epoch:18 iter: 705 begin\n",
      "Train epoch:18 iter: 705 end\n",
      "Train epoch:18 iter: 706 begin\n",
      "Train epoch:18 iter: 706 end\n",
      "Train epoch:18 iter: 707 begin\n",
      "Train epoch:18 iter: 707 end\n",
      "Train epoch:18 iter: 708 begin\n",
      "Train epoch:18 iter: 708 end\n",
      "Train epoch:18 iter: 709 begin\n",
      "Train epoch:18 iter: 709 end\n",
      "Train epoch:18 iter: 710 begin\n",
      "Train epoch:18 iter: 710 end\n",
      "Train epoch:18 iter: 711 begin\n",
      "Train epoch:18 iter: 711 end\n",
      "Train epoch:18 iter: 712 begin\n",
      "Train epoch:18 iter: 712 end\n",
      "Train epoch:18 iter: 713 begin\n",
      "Train epoch:18 iter: 713 end\n",
      "Train epoch:18 iter: 714 begin\n",
      "Train epoch:18 iter: 714 end\n",
      "Train epoch:18 iter: 715 begin\n",
      "Train epoch:18 iter: 715 end\n",
      "Train epoch:18 iter: 716 begin\n",
      "Train epoch:18 iter: 716 end\n",
      "Train epoch:18 iter: 717 begin\n",
      "Train epoch:18 iter: 717 end\n",
      "Train epoch:18 iter: 718 begin\n",
      "Train epoch:18 iter: 718 end\n",
      "Train epoch:18 iter: 719 begin\n",
      "Train epoch:18 iter: 719 end\n",
      "Train epoch:18 iter: 720 begin\n",
      "Train epoch:18 iter: 720 end\n",
      "Train epoch:18 iter: 721 begin\n",
      "Train epoch:18 iter: 721 end\n",
      "Train epoch:18 iter: 722 begin\n",
      "Train epoch:18 iter: 722 end\n",
      "Train epoch:18 iter: 723 begin\n",
      "Train epoch:18 iter: 723 end\n",
      "Train epoch:18 iter: 724 begin\n",
      "Train epoch:18 iter: 724 end\n",
      "Train epoch:18 iter: 725 begin\n",
      "Train epoch:18 iter: 725 end\n",
      "Train epoch:18 iter: 726 begin\n",
      "Train epoch:18 iter: 726 end\n",
      "Train epoch:18 iter: 727 begin\n",
      "Train epoch:18 iter: 727 end\n",
      "Train epoch:18 iter: 728 begin\n",
      "Train epoch:18 iter: 728 end\n",
      "Train epoch:18 iter: 729 begin\n",
      "Train epoch:18 iter: 729 end\n",
      "Train epoch:18 iter: 730 begin\n",
      "Train epoch:18 iter: 730 end\n",
      "Train epoch:18 iter: 731 begin\n",
      "Train epoch:18 iter: 731 end\n",
      "Train epoch:18 iter: 732 begin\n",
      "Train epoch:18 iter: 732 end\n",
      "Train epoch:18 iter: 733 begin\n",
      "Train epoch:18 iter: 733 end\n",
      "Train epoch:18 iter: 734 begin\n",
      "Train epoch:18 iter: 734 end\n",
      "Train epoch:18 iter: 735 begin\n",
      "Train epoch:18 iter: 735 end\n",
      "Train epoch:18 iter: 736 begin\n",
      "Train epoch:18 iter: 736 end\n",
      "Train epoch:18 iter: 737 begin\n",
      "Train epoch:18 iter: 737 end\n",
      "Train epoch:18 iter: 738 begin\n",
      "Train epoch:18 iter: 738 end\n",
      "Train epoch:18 iter: 739 begin\n",
      "Train epoch:18 iter: 739 end\n",
      "Train epoch:18 iter: 740 begin\n",
      "Train epoch:18 iter: 740 end\n",
      "Train epoch:18 iter: 741 begin\n",
      "Train epoch:18 iter: 741 end\n",
      "Train epoch:18 iter: 742 begin\n",
      "Train epoch:18 iter: 742 end\n",
      "Train epoch:18 iter: 743 begin\n",
      "Train epoch:18 iter: 743 end\n",
      "Train epoch:18 iter: 744 begin\n",
      "Train epoch:18 iter: 744 end\n",
      "Train epoch:18 iter: 745 begin\n",
      "Train epoch:18 iter: 745 end\n",
      "Train epoch:18 iter: 746 begin\n",
      "Train epoch:18 iter: 746 end\n",
      "Train epoch:18 iter: 747 begin\n",
      "Train epoch:18 iter: 747 end\n",
      "Train epoch:18 iter: 748 begin\n",
      "Train epoch:18 iter: 748 end\n",
      "Train epoch:18 iter: 749 begin\n",
      "Train epoch:18 iter: 749 end\n",
      "Train epoch:18 iter: 750 begin\n",
      "Train epoch:18 iter: 750 end\n",
      "Train epoch:18 iter: 751 begin\n",
      "Train epoch:18 iter: 751 end\n",
      "Train epoch:18 iter: 752 begin\n",
      "Train epoch:18 iter: 752 end\n",
      "Train epoch:18 iter: 753 begin\n",
      "Train epoch:18 iter: 753 end\n",
      "Train epoch:18 iter: 754 begin\n",
      "Train epoch:18 iter: 754 end\n",
      "Train epoch:18 iter: 755 begin\n",
      "Train epoch:18 iter: 755 end\n",
      "Train epoch:18 iter: 756 begin\n",
      "Train epoch:18 iter: 756 end\n",
      "Train epoch:18 iter: 757 begin\n",
      "Train epoch:18 iter: 757 end\n",
      "Train epoch:18 iter: 758 begin\n",
      "Train epoch:18 iter: 758 end\n",
      "Train epoch:18 iter: 759 begin\n",
      "Train epoch:18 iter: 759 end\n",
      "Train epoch:18 iter: 760 begin\n",
      "Train epoch:18 iter: 760 end\n",
      "Train epoch:18 iter: 761 begin\n",
      "Train epoch:18 iter: 761 end\n",
      "Train epoch:18 iter: 762 begin\n",
      "Train epoch:18 iter: 762 end\n",
      "Train epoch:18 iter: 763 begin\n",
      "Train epoch:18 iter: 763 end\n",
      "Train epoch:18 iter: 764 begin\n",
      "Train epoch:18 iter: 764 end\n",
      "Train epoch:18 iter: 765 begin\n",
      "Train epoch:18 iter: 765 end\n",
      "Train epoch:18 iter: 766 begin\n",
      "Train epoch:18 iter: 766 end\n",
      "Train epoch:18 iter: 767 begin\n",
      "Train epoch:18 iter: 767 end\n",
      "Train epoch:18 iter: 768 begin\n",
      "Train epoch:18 iter: 768 end\n",
      "Train epoch:18 iter: 769 begin\n",
      "Train epoch:18 iter: 769 end\n",
      "Train epoch:18 iter: 770 begin\n",
      "Train epoch:18 iter: 770 end\n",
      "Train epoch:18 iter: 771 begin\n",
      "Train epoch:18 iter: 771 end\n",
      "Train epoch:18 iter: 772 begin\n",
      "Train epoch:18 iter: 772 end\n",
      "Train epoch:18 iter: 773 begin\n",
      "Train epoch:18 iter: 773 end\n",
      "Train epoch:18 iter: 774 begin\n",
      "Train epoch:18 iter: 774 end\n",
      "Train epoch:18 iter: 775 begin\n",
      "Train epoch:18 iter: 775 end\n",
      "Train epoch:18 iter: 776 begin\n",
      "Train epoch:18 iter: 776 end\n",
      "Train epoch:18 iter: 777 begin\n",
      "Train epoch:18 iter: 777 end\n",
      "Train epoch:18 iter: 778 begin\n",
      "Train epoch:18 iter: 778 end\n",
      "Train epoch:18 iter: 779 begin\n",
      "Train epoch:18 iter: 779 end\n",
      "Train epoch:18 iter: 780 begin\n",
      "Train epoch:18 iter: 780 end\n",
      "Train epoch:18 iter: 781 begin\n",
      "Train epoch:18 iter: 781 end\n",
      "Train epoch:18 iter: 782 begin\n",
      "Train epoch:18 iter: 782 end\n",
      "Train epoch:18 iter: 783 begin\n",
      "Train epoch:18 iter: 783 end\n",
      "Train epoch:18 iter: 784 begin\n",
      "Train epoch:18 iter: 784 end\n",
      "Train epoch:18 iter: 785 begin\n",
      "Train epoch:18 iter: 785 end\n",
      "Train epoch:18 iter: 786 begin\n",
      "Train epoch:18 iter: 786 end\n",
      "Train epoch:18 iter: 787 begin\n",
      "Train epoch:18 iter: 787 end\n",
      "Train epoch:18 iter: 788 begin\n",
      "Train epoch:18 iter: 788 end\n",
      "Train epoch:18 iter: 789 begin\n",
      "Train epoch:18 iter: 789 end\n",
      "Train epoch:18 iter: 790 begin\n",
      "Train epoch:18 iter: 790 end\n",
      "Train epoch:18 iter: 791 begin\n",
      "Train epoch:18 iter: 791 end\n",
      "Train epoch:18 iter: 792 begin\n",
      "Train epoch:18 iter: 792 end\n",
      "Train epoch:18 iter: 793 begin\n",
      "Train epoch:18 iter: 793 end\n",
      "Train epoch:18 iter: 794 begin\n",
      "Train epoch:18 iter: 794 end\n",
      "Train epoch:18 iter: 795 begin\n",
      "Train epoch:18 iter: 795 end\n",
      "Train epoch:18 iter: 796 begin\n",
      "Train epoch:18 iter: 796 end\n",
      "Train epoch:18 iter: 797 begin\n",
      "Train epoch:18 iter: 797 end\n",
      "Train epoch:18 iter: 798 begin\n",
      "Train epoch:18 iter: 798 end\n",
      "Train epoch:18 iter: 799 begin\n",
      "Train epoch:18 iter: 799 end\n",
      "Train epoch:18 iter: 800 begin\n",
      "Train epoch:18 iter: 800 end\n",
      "Train epoch:18 iter: 801 begin\n",
      "Train epoch:18 iter: 801 end\n",
      "Train epoch:18 iter: 802 begin\n",
      "Train epoch:18 iter: 802 end\n",
      "Train epoch:18 iter: 803 begin\n",
      "Train epoch:18 iter: 803 end\n",
      "Train epoch:18 iter: 804 begin\n",
      "Train epoch:18 iter: 804 end\n",
      "Train epoch:18 iter: 805 begin\n",
      "Train epoch:18 iter: 805 end\n",
      "Train epoch:18 iter: 806 begin\n",
      "Train epoch:18 iter: 806 end\n",
      "Train epoch:18 iter: 807 begin\n",
      "Train epoch:18 iter: 807 end\n",
      "Train epoch:18 iter: 808 begin\n",
      "Train epoch:18 iter: 808 end\n",
      "Train epoch:18 iter: 809 begin\n",
      "Train epoch:18 iter: 809 end\n",
      "Train epoch:18 iter: 810 begin\n",
      "Train epoch:18 iter: 810 end\n",
      "Train epoch:18 iter: 811 begin\n",
      "Train epoch:18 iter: 811 end\n",
      "Train epoch:18 iter: 812 begin\n",
      "Train epoch:18 iter: 812 end\n",
      "Train epoch:18 iter: 813 begin\n",
      "Train epoch:18 iter: 813 end\n",
      "Train epoch:18 iter: 814 begin\n",
      "Train epoch:18 iter: 814 end\n",
      "Train epoch:18 iter: 815 begin\n",
      "Train epoch:18 iter: 815 end\n",
      "Train epoch:18 iter: 816 begin\n",
      "Train epoch:18 iter: 816 end\n",
      "Train epoch:18 iter: 817 begin\n",
      "Train epoch:18 iter: 817 end\n",
      "Train epoch:18 iter: 818 begin\n",
      "Train epoch:18 iter: 818 end\n",
      "Train epoch:18 iter: 819 begin\n",
      "Train epoch:18 iter: 819 end\n",
      "Train epoch:18 iter: 820 begin\n",
      "Train epoch:18 iter: 820 end\n",
      "Train epoch:18 iter: 821 begin\n",
      "Train epoch:18 iter: 821 end\n",
      "Train epoch:18 iter: 822 begin\n",
      "Train epoch:18 iter: 822 end\n",
      "Train epoch:18 iter: 823 begin\n",
      "Train epoch:18 iter: 823 end\n",
      "Train epoch:18 iter: 824 begin\n",
      "Train epoch:18 iter: 824 end\n",
      "Train epoch:18 iter: 825 begin\n",
      "Train epoch:18 iter: 825 end\n",
      "Train epoch:18 iter: 826 begin\n",
      "Train epoch:18 iter: 826 end\n",
      "Train epoch:18 iter: 827 begin\n",
      "Train epoch:18 iter: 827 end\n",
      "Train epoch:18 iter: 828 begin\n",
      "Train epoch:18 iter: 828 end\n",
      "Train epoch:18 iter: 829 begin\n",
      "Train epoch:18 iter: 829 end\n",
      "Train epoch:18 iter: 830 begin\n",
      "Train epoch:18 iter: 830 end\n",
      "Train epoch:18 iter: 831 begin\n",
      "Train epoch:18 iter: 831 end\n",
      "Train epoch:18 iter: 832 begin\n",
      "Train epoch:18 iter: 832 end\n",
      "Train epoch:18 iter: 833 begin\n",
      "Train epoch:18 iter: 833 end\n",
      "Train epoch:18 iter: 834 begin\n",
      "Train epoch:18 iter: 834 end\n",
      "Train epoch:18 iter: 835 begin\n",
      "Train epoch:18 iter: 835 end\n",
      "Train epoch:18 iter: 836 begin\n",
      "Train epoch:18 iter: 836 end\n",
      "Train epoch:18 iter: 837 begin\n",
      "Train epoch:18 iter: 837 end\n",
      "Train epoch:18 iter: 838 begin\n",
      "Train epoch:18 iter: 838 end\n",
      "Train epoch:18 iter: 839 begin\n",
      "Train epoch:18 iter: 839 end\n",
      "Train epoch:18 iter: 840 begin\n",
      "Train epoch:18 iter: 840 end\n",
      "Train epoch:18 iter: 841 begin\n",
      "Train epoch:18 iter: 841 end\n",
      "Train epoch:18 iter: 842 begin\n",
      "Train epoch:18 iter: 842 end\n",
      "Train epoch:18 iter: 843 begin\n",
      "Train epoch:18 iter: 843 end\n",
      "Train epoch:18 iter: 844 begin\n",
      "Train epoch:18 iter: 844 end\n",
      "Train epoch:18 iter: 845 begin\n",
      "Train epoch:18 iter: 845 end\n",
      "Train epoch:18 iter: 846 begin\n",
      "Train epoch:18 iter: 846 end\n",
      "Train epoch:18 iter: 847 begin\n",
      "Train epoch:18 iter: 847 end\n",
      "Train epoch:18 iter: 848 begin\n",
      "Train epoch:18 iter: 848 end\n",
      "Train epoch:18 iter: 849 begin\n",
      "Train epoch:18 iter: 849 end\n",
      "Train epoch:18 iter: 850 begin\n",
      "Train epoch:18 iter: 850 end\n",
      "Train epoch:18 iter: 851 begin\n",
      "Train epoch:18 iter: 851 end\n",
      "Train epoch:18 iter: 852 begin\n",
      "Train epoch:18 iter: 852 end\n",
      "Train epoch:18 iter: 853 begin\n",
      "Train epoch:18 iter: 853 end\n",
      "Train epoch:18 iter: 854 begin\n",
      "Train epoch:18 iter: 854 end\n",
      "Train epoch:18 iter: 855 begin\n",
      "Train epoch:18 iter: 855 end\n",
      "Train epoch:18 iter: 856 begin\n",
      "Train epoch:18 iter: 856 end\n",
      "Train epoch:18 iter: 857 begin\n",
      "Train epoch:18 iter: 857 end\n",
      "Train epoch:18 iter: 858 begin\n",
      "Train epoch:18 iter: 858 end\n",
      "Train epoch:18 iter: 859 begin\n",
      "Train epoch:18 iter: 859 end\n",
      "Train epoch:18 iter: 860 begin\n",
      "Train epoch:18 iter: 860 end\n",
      "Train epoch:18 iter: 861 begin\n",
      "Train epoch:18 iter: 861 end\n",
      "Train epoch:18 iter: 862 begin\n",
      "Train epoch:18 iter: 862 end\n",
      "Train epoch:18 iter: 863 begin\n",
      "Train epoch:18 iter: 863 end\n",
      "Train epoch:18 iter: 864 begin\n",
      "Train epoch:18 iter: 864 end\n",
      "Train epoch:18 iter: 865 begin\n",
      "Train epoch:18 iter: 865 end\n",
      "Train epoch:18 iter: 866 begin\n",
      "Train epoch:18 iter: 866 end\n",
      "Train epoch:18 iter: 867 begin\n",
      "Train epoch:18 iter: 867 end\n",
      "Train epoch:18 iter: 868 begin\n",
      "Train epoch:18 iter: 868 end\n",
      "Train epoch:18 iter: 869 begin\n",
      "Train epoch:18 iter: 869 end\n",
      "Train epoch:18 iter: 870 begin\n",
      "Train epoch:18 iter: 870 end\n",
      "Train epoch:18 iter: 871 begin\n",
      "Train epoch:18 iter: 871 end\n",
      "Train epoch:18 iter: 872 begin\n",
      "Train epoch:18 iter: 872 end\n",
      "Train epoch:18 iter: 873 begin\n",
      "Train epoch:18 iter: 873 end\n",
      "Train epoch:18 iter: 874 begin\n",
      "Train epoch:18 iter: 874 end\n",
      "Train epoch:18 iter: 875 begin\n",
      "Train epoch:18 iter: 875 end\n",
      "Train epoch:18 iter: 876 begin\n",
      "Train epoch:18 iter: 876 end\n",
      "Train epoch:18 iter: 877 begin\n",
      "Train epoch:18 iter: 877 end\n",
      "Train epoch:18 iter: 878 begin\n",
      "Train epoch:18 iter: 878 end\n",
      "Train epoch:18 iter: 879 begin\n",
      "Train epoch:18 iter: 879 end\n",
      "Train epoch:18 iter: 880 begin\n",
      "Train epoch:18 iter: 880 end\n",
      "Train epoch:18 iter: 881 begin\n",
      "Train epoch:18 iter: 881 end\n",
      "Train epoch:18 iter: 882 begin\n",
      "Train epoch:18 iter: 882 end\n",
      "Train epoch:18 iter: 883 begin\n",
      "Train epoch:18 iter: 883 end\n",
      "Train epoch:18 iter: 884 begin\n",
      "Train epoch:18 iter: 884 end\n",
      "Train epoch:18 iter: 885 begin\n",
      "Train epoch:18 iter: 885 end\n",
      "Train epoch:18 iter: 886 begin\n",
      "Train epoch:18 iter: 886 end\n",
      "Train epoch:18 iter: 887 begin\n",
      "Train epoch:18 iter: 887 end\n",
      "Train epoch:18 iter: 888 begin\n",
      "Train epoch:18 iter: 888 end\n",
      "Train epoch:18 iter: 889 begin\n",
      "Train epoch:18 iter: 889 end\n",
      "Train epoch:18 iter: 890 begin\n",
      "Train epoch:18 iter: 890 end\n",
      "Train epoch:18 iter: 891 begin\n",
      "Train epoch:18 iter: 891 end\n",
      "Train epoch:18 iter: 892 begin\n",
      "Train epoch:18 iter: 892 end\n",
      "Train epoch:18 iter: 893 begin\n",
      "Train epoch:18 iter: 893 end\n",
      "Train epoch:18 iter: 894 begin\n",
      "Train epoch:18 iter: 894 end\n",
      "Train epoch:18 iter: 895 begin\n",
      "Train epoch:18 iter: 895 end\n",
      "Train epoch:18 iter: 896 begin\n",
      "Train epoch:18 iter: 896 end\n",
      "Train epoch:18 iter: 897 begin\n",
      "Train epoch:18 iter: 897 end\n",
      "Train epoch:18 iter: 898 begin\n",
      "Train epoch:18 iter: 898 end\n",
      "Train epoch:18 iter: 899 begin\n",
      "Train epoch:18 iter: 899 end\n",
      "Train epoch:18 iter: 900 begin\n",
      "Train epoch:18 iter: 900 end\n",
      "Train epoch:18 iter: 901 begin\n",
      "Train epoch:18 iter: 901 end\n",
      "Train epoch:18 iter: 902 begin\n",
      "Train epoch:18 iter: 902 end\n",
      "Train epoch:18 iter: 903 begin\n",
      "Train epoch:18 iter: 903 end\n",
      "Train epoch:18 iter: 904 begin\n",
      "Train epoch:18 iter: 904 end\n",
      "Train epoch:18 iter: 905 begin\n",
      "Train epoch:18 iter: 905 end\n",
      "Train epoch:18 iter: 906 begin\n",
      "Train epoch:18 iter: 906 end\n",
      "Train epoch:18 iter: 907 begin\n",
      "Train epoch:18 iter: 907 end\n",
      "Train epoch:18 iter: 908 begin\n",
      "Train epoch:18 iter: 908 end\n",
      "Train epoch:18 iter: 909 begin\n",
      "Train epoch:18 iter: 909 end\n",
      "Train epoch:18 iter: 910 begin\n",
      "Train epoch:18 iter: 910 end\n",
      "Train epoch:18 iter: 911 begin\n",
      "Train epoch:18 iter: 911 end\n",
      "Train epoch:18 iter: 912 begin\n",
      "Train epoch:18 iter: 912 end\n",
      "Train epoch:18 iter: 913 begin\n",
      "Train epoch:18 iter: 913 end\n",
      "Train epoch:18 iter: 914 begin\n",
      "Train epoch:18 iter: 914 end\n",
      "Train epoch:18 iter: 915 begin\n",
      "Train epoch:18 iter: 915 end\n",
      "Train epoch:18 iter: 916 begin\n",
      "Train epoch:18 iter: 916 end\n",
      "Train epoch:18 iter: 917 begin\n",
      "Train epoch:18 iter: 917 end\n",
      "Train epoch:18 iter: 918 begin\n",
      "Train epoch:18 iter: 918 end\n",
      "Train epoch:18 iter: 919 begin\n",
      "Train epoch:18 iter: 919 end\n",
      "Train epoch:18 iter: 920 begin\n",
      "Train epoch:18 iter: 920 end\n",
      "Train epoch:18 iter: 921 begin\n",
      "Train epoch:18 iter: 921 end\n",
      "Train epoch:18 iter: 922 begin\n",
      "Train epoch:18 iter: 922 end\n",
      "Train epoch:18 iter: 923 begin\n",
      "Train epoch:18 iter: 923 end\n",
      "Train epoch:18 iter: 924 begin\n",
      "Train epoch:18 iter: 924 end\n",
      "Train epoch:18 iter: 925 begin\n",
      "Train epoch:18 iter: 925 end\n",
      "Train epoch:18 iter: 926 begin\n",
      "Train epoch:18 iter: 926 end\n",
      "Train epoch:18 iter: 927 begin\n",
      "Train epoch:18 iter: 927 end\n",
      "Train epoch:18 iter: 928 begin\n",
      "Train epoch:18 iter: 928 end\n",
      "Train epoch:18 iter: 929 begin\n",
      "Train epoch:18 iter: 929 end\n",
      "Train epoch:18 iter: 930 begin\n",
      "Train epoch:18 iter: 930 end\n",
      "Train epoch:18 iter: 931 begin\n",
      "Train epoch:18 iter: 931 end\n",
      "Train epoch:18 iter: 932 begin\n",
      "Train epoch:18 iter: 932 end\n",
      "Train epoch:18 iter: 933 begin\n",
      "Train epoch:18 iter: 933 end\n",
      "Train epoch:18 iter: 934 begin\n",
      "Train epoch:18 iter: 934 end\n",
      "Train epoch:18 iter: 935 begin\n",
      "Train epoch:18 iter: 935 end\n",
      "Train epoch:18 iter: 936 begin\n",
      "Train epoch:18 iter: 936 end\n",
      "Train epoch:18 iter: 937 begin\n",
      "Train epoch:18 iter: 937 end\n",
      "Train epoch:18 iter: 938 begin\n",
      "Train epoch:18 iter: 938 end\n",
      "Train Loss: 0.000881, Acc: 0.978550\n",
      "save model for best accuate: 0.97855 begin\n",
      "save model for best accuate: 0.97855 end\n",
      "epoch 20\n",
      "Train epoch:19 iter: 1 begin\n",
      "Train epoch:19 iter: 1 end\n",
      "Train epoch:19 iter: 2 begin\n",
      "Train epoch:19 iter: 2 end\n",
      "Train epoch:19 iter: 3 begin\n",
      "Train epoch:19 iter: 3 end\n",
      "Train epoch:19 iter: 4 begin\n",
      "Train epoch:19 iter: 4 end\n",
      "Train epoch:19 iter: 5 begin\n",
      "Train epoch:19 iter: 5 end\n",
      "Train epoch:19 iter: 6 begin\n",
      "Train epoch:19 iter: 6 end\n",
      "Train epoch:19 iter: 7 begin\n",
      "Train epoch:19 iter: 7 end\n",
      "Train epoch:19 iter: 8 begin\n",
      "Train epoch:19 iter: 8 end\n",
      "Train epoch:19 iter: 9 begin\n",
      "Train epoch:19 iter: 9 end\n",
      "Train epoch:19 iter: 10 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:19 iter: 10 end\n",
      "Train epoch:19 iter: 11 begin\n",
      "Train epoch:19 iter: 11 end\n",
      "Train epoch:19 iter: 12 begin\n",
      "Train epoch:19 iter: 12 end\n",
      "Train epoch:19 iter: 13 begin\n",
      "Train epoch:19 iter: 13 end\n",
      "Train epoch:19 iter: 14 begin\n",
      "Train epoch:19 iter: 14 end\n",
      "Train epoch:19 iter: 15 begin\n",
      "Train epoch:19 iter: 15 end\n",
      "Train epoch:19 iter: 16 begin\n",
      "Train epoch:19 iter: 16 end\n",
      "Train epoch:19 iter: 17 begin\n",
      "Train epoch:19 iter: 17 end\n",
      "Train epoch:19 iter: 18 begin\n",
      "Train epoch:19 iter: 18 end\n",
      "Train epoch:19 iter: 19 begin\n",
      "Train epoch:19 iter: 19 end\n",
      "Train epoch:19 iter: 20 begin\n",
      "Train epoch:19 iter: 20 end\n",
      "Train epoch:19 iter: 21 begin\n",
      "Train epoch:19 iter: 21 end\n",
      "Train epoch:19 iter: 22 begin\n",
      "Train epoch:19 iter: 22 end\n",
      "Train epoch:19 iter: 23 begin\n",
      "Train epoch:19 iter: 23 end\n",
      "Train epoch:19 iter: 24 begin\n",
      "Train epoch:19 iter: 24 end\n",
      "Train epoch:19 iter: 25 begin\n",
      "Train epoch:19 iter: 25 end\n",
      "Train epoch:19 iter: 26 begin\n",
      "Train epoch:19 iter: 26 end\n",
      "Train epoch:19 iter: 27 begin\n",
      "Train epoch:19 iter: 27 end\n",
      "Train epoch:19 iter: 28 begin\n",
      "Train epoch:19 iter: 28 end\n",
      "Train epoch:19 iter: 29 begin\n",
      "Train epoch:19 iter: 29 end\n",
      "Train epoch:19 iter: 30 begin\n",
      "Train epoch:19 iter: 30 end\n",
      "Train epoch:19 iter: 31 begin\n",
      "Train epoch:19 iter: 31 end\n",
      "Train epoch:19 iter: 32 begin\n",
      "Train epoch:19 iter: 32 end\n",
      "Train epoch:19 iter: 33 begin\n",
      "Train epoch:19 iter: 33 end\n",
      "Train epoch:19 iter: 34 begin\n",
      "Train epoch:19 iter: 34 end\n",
      "Train epoch:19 iter: 35 begin\n",
      "Train epoch:19 iter: 35 end\n",
      "Train epoch:19 iter: 36 begin\n",
      "Train epoch:19 iter: 36 end\n",
      "Train epoch:19 iter: 37 begin\n",
      "Train epoch:19 iter: 37 end\n",
      "Train epoch:19 iter: 38 begin\n",
      "Train epoch:19 iter: 38 end\n",
      "Train epoch:19 iter: 39 begin\n",
      "Train epoch:19 iter: 39 end\n",
      "Train epoch:19 iter: 40 begin\n",
      "Train epoch:19 iter: 40 end\n",
      "Train epoch:19 iter: 41 begin\n",
      "Train epoch:19 iter: 41 end\n",
      "Train epoch:19 iter: 42 begin\n",
      "Train epoch:19 iter: 42 end\n",
      "Train epoch:19 iter: 43 begin\n",
      "Train epoch:19 iter: 43 end\n",
      "Train epoch:19 iter: 44 begin\n",
      "Train epoch:19 iter: 44 end\n",
      "Train epoch:19 iter: 45 begin\n",
      "Train epoch:19 iter: 45 end\n",
      "Train epoch:19 iter: 46 begin\n",
      "Train epoch:19 iter: 46 end\n",
      "Train epoch:19 iter: 47 begin\n",
      "Train epoch:19 iter: 47 end\n",
      "Train epoch:19 iter: 48 begin\n",
      "Train epoch:19 iter: 48 end\n",
      "Train epoch:19 iter: 49 begin\n",
      "Train epoch:19 iter: 49 end\n",
      "Train epoch:19 iter: 50 begin\n",
      "Train epoch:19 iter: 50 end\n",
      "Train epoch:19 iter: 51 begin\n",
      "Train epoch:19 iter: 51 end\n",
      "Train epoch:19 iter: 52 begin\n",
      "Train epoch:19 iter: 52 end\n",
      "Train epoch:19 iter: 53 begin\n",
      "Train epoch:19 iter: 53 end\n",
      "Train epoch:19 iter: 54 begin\n",
      "Train epoch:19 iter: 54 end\n",
      "Train epoch:19 iter: 55 begin\n",
      "Train epoch:19 iter: 55 end\n",
      "Train epoch:19 iter: 56 begin\n",
      "Train epoch:19 iter: 56 end\n",
      "Train epoch:19 iter: 57 begin\n",
      "Train epoch:19 iter: 57 end\n",
      "Train epoch:19 iter: 58 begin\n",
      "Train epoch:19 iter: 58 end\n",
      "Train epoch:19 iter: 59 begin\n",
      "Train epoch:19 iter: 59 end\n",
      "Train epoch:19 iter: 60 begin\n",
      "Train epoch:19 iter: 60 end\n",
      "Train epoch:19 iter: 61 begin\n",
      "Train epoch:19 iter: 61 end\n",
      "Train epoch:19 iter: 62 begin\n",
      "Train epoch:19 iter: 62 end\n",
      "Train epoch:19 iter: 63 begin\n",
      "Train epoch:19 iter: 63 end\n",
      "Train epoch:19 iter: 64 begin\n",
      "Train epoch:19 iter: 64 end\n",
      "Train epoch:19 iter: 65 begin\n",
      "Train epoch:19 iter: 65 end\n",
      "Train epoch:19 iter: 66 begin\n",
      "Train epoch:19 iter: 66 end\n",
      "Train epoch:19 iter: 67 begin\n",
      "Train epoch:19 iter: 67 end\n",
      "Train epoch:19 iter: 68 begin\n",
      "Train epoch:19 iter: 68 end\n",
      "Train epoch:19 iter: 69 begin\n",
      "Train epoch:19 iter: 69 end\n",
      "Train epoch:19 iter: 70 begin\n",
      "Train epoch:19 iter: 70 end\n",
      "Train epoch:19 iter: 71 begin\n",
      "Train epoch:19 iter: 71 end\n",
      "Train epoch:19 iter: 72 begin\n",
      "Train epoch:19 iter: 72 end\n",
      "Train epoch:19 iter: 73 begin\n",
      "Train epoch:19 iter: 73 end\n",
      "Train epoch:19 iter: 74 begin\n",
      "Train epoch:19 iter: 74 end\n",
      "Train epoch:19 iter: 75 begin\n",
      "Train epoch:19 iter: 75 end\n",
      "Train epoch:19 iter: 76 begin\n",
      "Train epoch:19 iter: 76 end\n",
      "Train epoch:19 iter: 77 begin\n",
      "Train epoch:19 iter: 77 end\n",
      "Train epoch:19 iter: 78 begin\n",
      "Train epoch:19 iter: 78 end\n",
      "Train epoch:19 iter: 79 begin\n",
      "Train epoch:19 iter: 79 end\n",
      "Train epoch:19 iter: 80 begin\n",
      "Train epoch:19 iter: 80 end\n",
      "Train epoch:19 iter: 81 begin\n",
      "Train epoch:19 iter: 81 end\n",
      "Train epoch:19 iter: 82 begin\n",
      "Train epoch:19 iter: 82 end\n",
      "Train epoch:19 iter: 83 begin\n",
      "Train epoch:19 iter: 83 end\n",
      "Train epoch:19 iter: 84 begin\n",
      "Train epoch:19 iter: 84 end\n",
      "Train epoch:19 iter: 85 begin\n",
      "Train epoch:19 iter: 85 end\n",
      "Train epoch:19 iter: 86 begin\n",
      "Train epoch:19 iter: 86 end\n",
      "Train epoch:19 iter: 87 begin\n",
      "Train epoch:19 iter: 87 end\n",
      "Train epoch:19 iter: 88 begin\n",
      "Train epoch:19 iter: 88 end\n",
      "Train epoch:19 iter: 89 begin\n",
      "Train epoch:19 iter: 89 end\n",
      "Train epoch:19 iter: 90 begin\n",
      "Train epoch:19 iter: 90 end\n",
      "Train epoch:19 iter: 91 begin\n",
      "Train epoch:19 iter: 91 end\n",
      "Train epoch:19 iter: 92 begin\n",
      "Train epoch:19 iter: 92 end\n",
      "Train epoch:19 iter: 93 begin\n",
      "Train epoch:19 iter: 93 end\n",
      "Train epoch:19 iter: 94 begin\n",
      "Train epoch:19 iter: 94 end\n",
      "Train epoch:19 iter: 95 begin\n",
      "Train epoch:19 iter: 95 end\n",
      "Train epoch:19 iter: 96 begin\n",
      "Train epoch:19 iter: 96 end\n",
      "Train epoch:19 iter: 97 begin\n",
      "Train epoch:19 iter: 97 end\n",
      "Train epoch:19 iter: 98 begin\n",
      "Train epoch:19 iter: 98 end\n",
      "Train epoch:19 iter: 99 begin\n",
      "Train epoch:19 iter: 99 end\n",
      "Train epoch:19 iter: 100 begin\n",
      "Train epoch:19 iter: 100 end\n",
      "Train epoch:19 iter: 101 begin\n",
      "Train epoch:19 iter: 101 end\n",
      "Train epoch:19 iter: 102 begin\n",
      "Train epoch:19 iter: 102 end\n",
      "Train epoch:19 iter: 103 begin\n",
      "Train epoch:19 iter: 103 end\n",
      "Train epoch:19 iter: 104 begin\n",
      "Train epoch:19 iter: 104 end\n",
      "Train epoch:19 iter: 105 begin\n",
      "Train epoch:19 iter: 105 end\n",
      "Train epoch:19 iter: 106 begin\n",
      "Train epoch:19 iter: 106 end\n",
      "Train epoch:19 iter: 107 begin\n",
      "Train epoch:19 iter: 107 end\n",
      "Train epoch:19 iter: 108 begin\n",
      "Train epoch:19 iter: 108 end\n",
      "Train epoch:19 iter: 109 begin\n",
      "Train epoch:19 iter: 109 end\n",
      "Train epoch:19 iter: 110 begin\n",
      "Train epoch:19 iter: 110 end\n",
      "Train epoch:19 iter: 111 begin\n",
      "Train epoch:19 iter: 111 end\n",
      "Train epoch:19 iter: 112 begin\n",
      "Train epoch:19 iter: 112 end\n",
      "Train epoch:19 iter: 113 begin\n",
      "Train epoch:19 iter: 113 end\n",
      "Train epoch:19 iter: 114 begin\n",
      "Train epoch:19 iter: 114 end\n",
      "Train epoch:19 iter: 115 begin\n",
      "Train epoch:19 iter: 115 end\n",
      "Train epoch:19 iter: 116 begin\n",
      "Train epoch:19 iter: 116 end\n",
      "Train epoch:19 iter: 117 begin\n",
      "Train epoch:19 iter: 117 end\n",
      "Train epoch:19 iter: 118 begin\n",
      "Train epoch:19 iter: 118 end\n",
      "Train epoch:19 iter: 119 begin\n",
      "Train epoch:19 iter: 119 end\n",
      "Train epoch:19 iter: 120 begin\n",
      "Train epoch:19 iter: 120 end\n",
      "Train epoch:19 iter: 121 begin\n",
      "Train epoch:19 iter: 121 end\n",
      "Train epoch:19 iter: 122 begin\n",
      "Train epoch:19 iter: 122 end\n",
      "Train epoch:19 iter: 123 begin\n",
      "Train epoch:19 iter: 123 end\n",
      "Train epoch:19 iter: 124 begin\n",
      "Train epoch:19 iter: 124 end\n",
      "Train epoch:19 iter: 125 begin\n",
      "Train epoch:19 iter: 125 end\n",
      "Train epoch:19 iter: 126 begin\n",
      "Train epoch:19 iter: 126 end\n",
      "Train epoch:19 iter: 127 begin\n",
      "Train epoch:19 iter: 127 end\n",
      "Train epoch:19 iter: 128 begin\n",
      "Train epoch:19 iter: 128 end\n",
      "Train epoch:19 iter: 129 begin\n",
      "Train epoch:19 iter: 129 end\n",
      "Train epoch:19 iter: 130 begin\n",
      "Train epoch:19 iter: 130 end\n",
      "Train epoch:19 iter: 131 begin\n",
      "Train epoch:19 iter: 131 end\n",
      "Train epoch:19 iter: 132 begin\n",
      "Train epoch:19 iter: 132 end\n",
      "Train epoch:19 iter: 133 begin\n",
      "Train epoch:19 iter: 133 end\n",
      "Train epoch:19 iter: 134 begin\n",
      "Train epoch:19 iter: 134 end\n",
      "Train epoch:19 iter: 135 begin\n",
      "Train epoch:19 iter: 135 end\n",
      "Train epoch:19 iter: 136 begin\n",
      "Train epoch:19 iter: 136 end\n",
      "Train epoch:19 iter: 137 begin\n",
      "Train epoch:19 iter: 137 end\n",
      "Train epoch:19 iter: 138 begin\n",
      "Train epoch:19 iter: 138 end\n",
      "Train epoch:19 iter: 139 begin\n",
      "Train epoch:19 iter: 139 end\n",
      "Train epoch:19 iter: 140 begin\n",
      "Train epoch:19 iter: 140 end\n",
      "Train epoch:19 iter: 141 begin\n",
      "Train epoch:19 iter: 141 end\n",
      "Train epoch:19 iter: 142 begin\n",
      "Train epoch:19 iter: 142 end\n",
      "Train epoch:19 iter: 143 begin\n",
      "Train epoch:19 iter: 143 end\n",
      "Train epoch:19 iter: 144 begin\n",
      "Train epoch:19 iter: 144 end\n",
      "Train epoch:19 iter: 145 begin\n",
      "Train epoch:19 iter: 145 end\n",
      "Train epoch:19 iter: 146 begin\n",
      "Train epoch:19 iter: 146 end\n",
      "Train epoch:19 iter: 147 begin\n",
      "Train epoch:19 iter: 147 end\n",
      "Train epoch:19 iter: 148 begin\n",
      "Train epoch:19 iter: 148 end\n",
      "Train epoch:19 iter: 149 begin\n",
      "Train epoch:19 iter: 149 end\n",
      "Train epoch:19 iter: 150 begin\n",
      "Train epoch:19 iter: 150 end\n",
      "Train epoch:19 iter: 151 begin\n",
      "Train epoch:19 iter: 151 end\n",
      "Train epoch:19 iter: 152 begin\n",
      "Train epoch:19 iter: 152 end\n",
      "Train epoch:19 iter: 153 begin\n",
      "Train epoch:19 iter: 153 end\n",
      "Train epoch:19 iter: 154 begin\n",
      "Train epoch:19 iter: 154 end\n",
      "Train epoch:19 iter: 155 begin\n",
      "Train epoch:19 iter: 155 end\n",
      "Train epoch:19 iter: 156 begin\n",
      "Train epoch:19 iter: 156 end\n",
      "Train epoch:19 iter: 157 begin\n",
      "Train epoch:19 iter: 157 end\n",
      "Train epoch:19 iter: 158 begin\n",
      "Train epoch:19 iter: 158 end\n",
      "Train epoch:19 iter: 159 begin\n",
      "Train epoch:19 iter: 159 end\n",
      "Train epoch:19 iter: 160 begin\n",
      "Train epoch:19 iter: 160 end\n",
      "Train epoch:19 iter: 161 begin\n",
      "Train epoch:19 iter: 161 end\n",
      "Train epoch:19 iter: 162 begin\n",
      "Train epoch:19 iter: 162 end\n",
      "Train epoch:19 iter: 163 begin\n",
      "Train epoch:19 iter: 163 end\n",
      "Train epoch:19 iter: 164 begin\n",
      "Train epoch:19 iter: 164 end\n",
      "Train epoch:19 iter: 165 begin\n",
      "Train epoch:19 iter: 165 end\n",
      "Train epoch:19 iter: 166 begin\n",
      "Train epoch:19 iter: 166 end\n",
      "Train epoch:19 iter: 167 begin\n",
      "Train epoch:19 iter: 167 end\n",
      "Train epoch:19 iter: 168 begin\n",
      "Train epoch:19 iter: 168 end\n",
      "Train epoch:19 iter: 169 begin\n",
      "Train epoch:19 iter: 169 end\n",
      "Train epoch:19 iter: 170 begin\n",
      "Train epoch:19 iter: 170 end\n",
      "Train epoch:19 iter: 171 begin\n",
      "Train epoch:19 iter: 171 end\n",
      "Train epoch:19 iter: 172 begin\n",
      "Train epoch:19 iter: 172 end\n",
      "Train epoch:19 iter: 173 begin\n",
      "Train epoch:19 iter: 173 end\n",
      "Train epoch:19 iter: 174 begin\n",
      "Train epoch:19 iter: 174 end\n",
      "Train epoch:19 iter: 175 begin\n",
      "Train epoch:19 iter: 175 end\n",
      "Train epoch:19 iter: 176 begin\n",
      "Train epoch:19 iter: 176 end\n",
      "Train epoch:19 iter: 177 begin\n",
      "Train epoch:19 iter: 177 end\n",
      "Train epoch:19 iter: 178 begin\n",
      "Train epoch:19 iter: 178 end\n",
      "Train epoch:19 iter: 179 begin\n",
      "Train epoch:19 iter: 179 end\n",
      "Train epoch:19 iter: 180 begin\n",
      "Train epoch:19 iter: 180 end\n",
      "Train epoch:19 iter: 181 begin\n",
      "Train epoch:19 iter: 181 end\n",
      "Train epoch:19 iter: 182 begin\n",
      "Train epoch:19 iter: 182 end\n",
      "Train epoch:19 iter: 183 begin\n",
      "Train epoch:19 iter: 183 end\n",
      "Train epoch:19 iter: 184 begin\n",
      "Train epoch:19 iter: 184 end\n",
      "Train epoch:19 iter: 185 begin\n",
      "Train epoch:19 iter: 185 end\n",
      "Train epoch:19 iter: 186 begin\n",
      "Train epoch:19 iter: 186 end\n",
      "Train epoch:19 iter: 187 begin\n",
      "Train epoch:19 iter: 187 end\n",
      "Train epoch:19 iter: 188 begin\n",
      "Train epoch:19 iter: 188 end\n",
      "Train epoch:19 iter: 189 begin\n",
      "Train epoch:19 iter: 189 end\n",
      "Train epoch:19 iter: 190 begin\n",
      "Train epoch:19 iter: 190 end\n",
      "Train epoch:19 iter: 191 begin\n",
      "Train epoch:19 iter: 191 end\n",
      "Train epoch:19 iter: 192 begin\n",
      "Train epoch:19 iter: 192 end\n",
      "Train epoch:19 iter: 193 begin\n",
      "Train epoch:19 iter: 193 end\n",
      "Train epoch:19 iter: 194 begin\n",
      "Train epoch:19 iter: 194 end\n",
      "Train epoch:19 iter: 195 begin\n",
      "Train epoch:19 iter: 195 end\n",
      "Train epoch:19 iter: 196 begin\n",
      "Train epoch:19 iter: 196 end\n",
      "Train epoch:19 iter: 197 begin\n",
      "Train epoch:19 iter: 197 end\n",
      "Train epoch:19 iter: 198 begin\n",
      "Train epoch:19 iter: 198 end\n",
      "Train epoch:19 iter: 199 begin\n",
      "Train epoch:19 iter: 199 end\n",
      "Train epoch:19 iter: 200 begin\n",
      "Train epoch:19 iter: 200 end\n",
      "Train epoch:19 iter: 201 begin\n",
      "Train epoch:19 iter: 201 end\n",
      "Train epoch:19 iter: 202 begin\n",
      "Train epoch:19 iter: 202 end\n",
      "Train epoch:19 iter: 203 begin\n",
      "Train epoch:19 iter: 203 end\n",
      "Train epoch:19 iter: 204 begin\n",
      "Train epoch:19 iter: 204 end\n",
      "Train epoch:19 iter: 205 begin\n",
      "Train epoch:19 iter: 205 end\n",
      "Train epoch:19 iter: 206 begin\n",
      "Train epoch:19 iter: 206 end\n",
      "Train epoch:19 iter: 207 begin\n",
      "Train epoch:19 iter: 207 end\n",
      "Train epoch:19 iter: 208 begin\n",
      "Train epoch:19 iter: 208 end\n",
      "Train epoch:19 iter: 209 begin\n",
      "Train epoch:19 iter: 209 end\n",
      "Train epoch:19 iter: 210 begin\n",
      "Train epoch:19 iter: 210 end\n",
      "Train epoch:19 iter: 211 begin\n",
      "Train epoch:19 iter: 211 end\n",
      "Train epoch:19 iter: 212 begin\n",
      "Train epoch:19 iter: 212 end\n",
      "Train epoch:19 iter: 213 begin\n",
      "Train epoch:19 iter: 213 end\n",
      "Train epoch:19 iter: 214 begin\n",
      "Train epoch:19 iter: 214 end\n",
      "Train epoch:19 iter: 215 begin\n",
      "Train epoch:19 iter: 215 end\n",
      "Train epoch:19 iter: 216 begin\n",
      "Train epoch:19 iter: 216 end\n",
      "Train epoch:19 iter: 217 begin\n",
      "Train epoch:19 iter: 217 end\n",
      "Train epoch:19 iter: 218 begin\n",
      "Train epoch:19 iter: 218 end\n",
      "Train epoch:19 iter: 219 begin\n",
      "Train epoch:19 iter: 219 end\n",
      "Train epoch:19 iter: 220 begin\n",
      "Train epoch:19 iter: 220 end\n",
      "Train epoch:19 iter: 221 begin\n",
      "Train epoch:19 iter: 221 end\n",
      "Train epoch:19 iter: 222 begin\n",
      "Train epoch:19 iter: 222 end\n",
      "Train epoch:19 iter: 223 begin\n",
      "Train epoch:19 iter: 223 end\n",
      "Train epoch:19 iter: 224 begin\n",
      "Train epoch:19 iter: 224 end\n",
      "Train epoch:19 iter: 225 begin\n",
      "Train epoch:19 iter: 225 end\n",
      "Train epoch:19 iter: 226 begin\n",
      "Train epoch:19 iter: 226 end\n",
      "Train epoch:19 iter: 227 begin\n",
      "Train epoch:19 iter: 227 end\n",
      "Train epoch:19 iter: 228 begin\n",
      "Train epoch:19 iter: 228 end\n",
      "Train epoch:19 iter: 229 begin\n",
      "Train epoch:19 iter: 229 end\n",
      "Train epoch:19 iter: 230 begin\n",
      "Train epoch:19 iter: 230 end\n",
      "Train epoch:19 iter: 231 begin\n",
      "Train epoch:19 iter: 231 end\n",
      "Train epoch:19 iter: 232 begin\n",
      "Train epoch:19 iter: 232 end\n",
      "Train epoch:19 iter: 233 begin\n",
      "Train epoch:19 iter: 233 end\n",
      "Train epoch:19 iter: 234 begin\n",
      "Train epoch:19 iter: 234 end\n",
      "Train epoch:19 iter: 235 begin\n",
      "Train epoch:19 iter: 235 end\n",
      "Train epoch:19 iter: 236 begin\n",
      "Train epoch:19 iter: 236 end\n",
      "Train epoch:19 iter: 237 begin\n",
      "Train epoch:19 iter: 237 end\n",
      "Train epoch:19 iter: 238 begin\n",
      "Train epoch:19 iter: 238 end\n",
      "Train epoch:19 iter: 239 begin\n",
      "Train epoch:19 iter: 239 end\n",
      "Train epoch:19 iter: 240 begin\n",
      "Train epoch:19 iter: 240 end\n",
      "Train epoch:19 iter: 241 begin\n",
      "Train epoch:19 iter: 241 end\n",
      "Train epoch:19 iter: 242 begin\n",
      "Train epoch:19 iter: 242 end\n",
      "Train epoch:19 iter: 243 begin\n",
      "Train epoch:19 iter: 243 end\n",
      "Train epoch:19 iter: 244 begin\n",
      "Train epoch:19 iter: 244 end\n",
      "Train epoch:19 iter: 245 begin\n",
      "Train epoch:19 iter: 245 end\n",
      "Train epoch:19 iter: 246 begin\n",
      "Train epoch:19 iter: 246 end\n",
      "Train epoch:19 iter: 247 begin\n",
      "Train epoch:19 iter: 247 end\n",
      "Train epoch:19 iter: 248 begin\n",
      "Train epoch:19 iter: 248 end\n",
      "Train epoch:19 iter: 249 begin\n",
      "Train epoch:19 iter: 249 end\n",
      "Train epoch:19 iter: 250 begin\n",
      "Train epoch:19 iter: 250 end\n",
      "Train epoch:19 iter: 251 begin\n",
      "Train epoch:19 iter: 251 end\n",
      "Train epoch:19 iter: 252 begin\n",
      "Train epoch:19 iter: 252 end\n",
      "Train epoch:19 iter: 253 begin\n",
      "Train epoch:19 iter: 253 end\n",
      "Train epoch:19 iter: 254 begin\n",
      "Train epoch:19 iter: 254 end\n",
      "Train epoch:19 iter: 255 begin\n",
      "Train epoch:19 iter: 255 end\n",
      "Train epoch:19 iter: 256 begin\n",
      "Train epoch:19 iter: 256 end\n",
      "Train epoch:19 iter: 257 begin\n",
      "Train epoch:19 iter: 257 end\n",
      "Train epoch:19 iter: 258 begin\n",
      "Train epoch:19 iter: 258 end\n",
      "Train epoch:19 iter: 259 begin\n",
      "Train epoch:19 iter: 259 end\n",
      "Train epoch:19 iter: 260 begin\n",
      "Train epoch:19 iter: 260 end\n",
      "Train epoch:19 iter: 261 begin\n",
      "Train epoch:19 iter: 261 end\n",
      "Train epoch:19 iter: 262 begin\n",
      "Train epoch:19 iter: 262 end\n",
      "Train epoch:19 iter: 263 begin\n",
      "Train epoch:19 iter: 263 end\n",
      "Train epoch:19 iter: 264 begin\n",
      "Train epoch:19 iter: 264 end\n",
      "Train epoch:19 iter: 265 begin\n",
      "Train epoch:19 iter: 265 end\n",
      "Train epoch:19 iter: 266 begin\n",
      "Train epoch:19 iter: 266 end\n",
      "Train epoch:19 iter: 267 begin\n",
      "Train epoch:19 iter: 267 end\n",
      "Train epoch:19 iter: 268 begin\n",
      "Train epoch:19 iter: 268 end\n",
      "Train epoch:19 iter: 269 begin\n",
      "Train epoch:19 iter: 269 end\n",
      "Train epoch:19 iter: 270 begin\n",
      "Train epoch:19 iter: 270 end\n",
      "Train epoch:19 iter: 271 begin\n",
      "Train epoch:19 iter: 271 end\n",
      "Train epoch:19 iter: 272 begin\n",
      "Train epoch:19 iter: 272 end\n",
      "Train epoch:19 iter: 273 begin\n",
      "Train epoch:19 iter: 273 end\n",
      "Train epoch:19 iter: 274 begin\n",
      "Train epoch:19 iter: 274 end\n",
      "Train epoch:19 iter: 275 begin\n",
      "Train epoch:19 iter: 275 end\n",
      "Train epoch:19 iter: 276 begin\n",
      "Train epoch:19 iter: 276 end\n",
      "Train epoch:19 iter: 277 begin\n",
      "Train epoch:19 iter: 277 end\n",
      "Train epoch:19 iter: 278 begin\n",
      "Train epoch:19 iter: 278 end\n",
      "Train epoch:19 iter: 279 begin\n",
      "Train epoch:19 iter: 279 end\n",
      "Train epoch:19 iter: 280 begin\n",
      "Train epoch:19 iter: 280 end\n",
      "Train epoch:19 iter: 281 begin\n",
      "Train epoch:19 iter: 281 end\n",
      "Train epoch:19 iter: 282 begin\n",
      "Train epoch:19 iter: 282 end\n",
      "Train epoch:19 iter: 283 begin\n",
      "Train epoch:19 iter: 283 end\n",
      "Train epoch:19 iter: 284 begin\n",
      "Train epoch:19 iter: 284 end\n",
      "Train epoch:19 iter: 285 begin\n",
      "Train epoch:19 iter: 285 end\n",
      "Train epoch:19 iter: 286 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:19 iter: 286 end\n",
      "Train epoch:19 iter: 287 begin\n",
      "Train epoch:19 iter: 287 end\n",
      "Train epoch:19 iter: 288 begin\n",
      "Train epoch:19 iter: 288 end\n",
      "Train epoch:19 iter: 289 begin\n",
      "Train epoch:19 iter: 289 end\n",
      "Train epoch:19 iter: 290 begin\n",
      "Train epoch:19 iter: 290 end\n",
      "Train epoch:19 iter: 291 begin\n",
      "Train epoch:19 iter: 291 end\n",
      "Train epoch:19 iter: 292 begin\n",
      "Train epoch:19 iter: 292 end\n",
      "Train epoch:19 iter: 293 begin\n",
      "Train epoch:19 iter: 293 end\n",
      "Train epoch:19 iter: 294 begin\n",
      "Train epoch:19 iter: 294 end\n",
      "Train epoch:19 iter: 295 begin\n",
      "Train epoch:19 iter: 295 end\n",
      "Train epoch:19 iter: 296 begin\n",
      "Train epoch:19 iter: 296 end\n",
      "Train epoch:19 iter: 297 begin\n",
      "Train epoch:19 iter: 297 end\n",
      "Train epoch:19 iter: 298 begin\n",
      "Train epoch:19 iter: 298 end\n",
      "Train epoch:19 iter: 299 begin\n",
      "Train epoch:19 iter: 299 end\n",
      "Train epoch:19 iter: 300 begin\n",
      "Train epoch:19 iter: 300 end\n",
      "Train epoch:19 iter: 301 begin\n",
      "Train epoch:19 iter: 301 end\n",
      "Train epoch:19 iter: 302 begin\n",
      "Train epoch:19 iter: 302 end\n",
      "Train epoch:19 iter: 303 begin\n",
      "Train epoch:19 iter: 303 end\n",
      "Train epoch:19 iter: 304 begin\n",
      "Train epoch:19 iter: 304 end\n",
      "Train epoch:19 iter: 305 begin\n",
      "Train epoch:19 iter: 305 end\n",
      "Train epoch:19 iter: 306 begin\n",
      "Train epoch:19 iter: 306 end\n",
      "Train epoch:19 iter: 307 begin\n",
      "Train epoch:19 iter: 307 end\n",
      "Train epoch:19 iter: 308 begin\n",
      "Train epoch:19 iter: 308 end\n",
      "Train epoch:19 iter: 309 begin\n",
      "Train epoch:19 iter: 309 end\n",
      "Train epoch:19 iter: 310 begin\n",
      "Train epoch:19 iter: 310 end\n",
      "Train epoch:19 iter: 311 begin\n",
      "Train epoch:19 iter: 311 end\n",
      "Train epoch:19 iter: 312 begin\n",
      "Train epoch:19 iter: 312 end\n",
      "Train epoch:19 iter: 313 begin\n",
      "Train epoch:19 iter: 313 end\n",
      "Train epoch:19 iter: 314 begin\n",
      "Train epoch:19 iter: 314 end\n",
      "Train epoch:19 iter: 315 begin\n",
      "Train epoch:19 iter: 315 end\n",
      "Train epoch:19 iter: 316 begin\n",
      "Train epoch:19 iter: 316 end\n",
      "Train epoch:19 iter: 317 begin\n",
      "Train epoch:19 iter: 317 end\n",
      "Train epoch:19 iter: 318 begin\n",
      "Train epoch:19 iter: 318 end\n",
      "Train epoch:19 iter: 319 begin\n",
      "Train epoch:19 iter: 319 end\n",
      "Train epoch:19 iter: 320 begin\n",
      "Train epoch:19 iter: 320 end\n",
      "Train epoch:19 iter: 321 begin\n",
      "Train epoch:19 iter: 321 end\n",
      "Train epoch:19 iter: 322 begin\n",
      "Train epoch:19 iter: 322 end\n",
      "Train epoch:19 iter: 323 begin\n",
      "Train epoch:19 iter: 323 end\n",
      "Train epoch:19 iter: 324 begin\n",
      "Train epoch:19 iter: 324 end\n",
      "Train epoch:19 iter: 325 begin\n",
      "Train epoch:19 iter: 325 end\n",
      "Train epoch:19 iter: 326 begin\n",
      "Train epoch:19 iter: 326 end\n",
      "Train epoch:19 iter: 327 begin\n",
      "Train epoch:19 iter: 327 end\n",
      "Train epoch:19 iter: 328 begin\n",
      "Train epoch:19 iter: 328 end\n",
      "Train epoch:19 iter: 329 begin\n",
      "Train epoch:19 iter: 329 end\n",
      "Train epoch:19 iter: 330 begin\n",
      "Train epoch:19 iter: 330 end\n",
      "Train epoch:19 iter: 331 begin\n",
      "Train epoch:19 iter: 331 end\n",
      "Train epoch:19 iter: 332 begin\n",
      "Train epoch:19 iter: 332 end\n",
      "Train epoch:19 iter: 333 begin\n",
      "Train epoch:19 iter: 333 end\n",
      "Train epoch:19 iter: 334 begin\n",
      "Train epoch:19 iter: 334 end\n",
      "Train epoch:19 iter: 335 begin\n",
      "Train epoch:19 iter: 335 end\n",
      "Train epoch:19 iter: 336 begin\n",
      "Train epoch:19 iter: 336 end\n",
      "Train epoch:19 iter: 337 begin\n",
      "Train epoch:19 iter: 337 end\n",
      "Train epoch:19 iter: 338 begin\n",
      "Train epoch:19 iter: 338 end\n",
      "Train epoch:19 iter: 339 begin\n",
      "Train epoch:19 iter: 339 end\n",
      "Train epoch:19 iter: 340 begin\n",
      "Train epoch:19 iter: 340 end\n",
      "Train epoch:19 iter: 341 begin\n",
      "Train epoch:19 iter: 341 end\n",
      "Train epoch:19 iter: 342 begin\n",
      "Train epoch:19 iter: 342 end\n",
      "Train epoch:19 iter: 343 begin\n",
      "Train epoch:19 iter: 343 end\n",
      "Train epoch:19 iter: 344 begin\n",
      "Train epoch:19 iter: 344 end\n",
      "Train epoch:19 iter: 345 begin\n",
      "Train epoch:19 iter: 345 end\n",
      "Train epoch:19 iter: 346 begin\n",
      "Train epoch:19 iter: 346 end\n",
      "Train epoch:19 iter: 347 begin\n",
      "Train epoch:19 iter: 347 end\n",
      "Train epoch:19 iter: 348 begin\n",
      "Train epoch:19 iter: 348 end\n",
      "Train epoch:19 iter: 349 begin\n",
      "Train epoch:19 iter: 349 end\n",
      "Train epoch:19 iter: 350 begin\n",
      "Train epoch:19 iter: 350 end\n",
      "Train epoch:19 iter: 351 begin\n",
      "Train epoch:19 iter: 351 end\n",
      "Train epoch:19 iter: 352 begin\n",
      "Train epoch:19 iter: 352 end\n",
      "Train epoch:19 iter: 353 begin\n",
      "Train epoch:19 iter: 353 end\n",
      "Train epoch:19 iter: 354 begin\n",
      "Train epoch:19 iter: 354 end\n",
      "Train epoch:19 iter: 355 begin\n",
      "Train epoch:19 iter: 355 end\n",
      "Train epoch:19 iter: 356 begin\n",
      "Train epoch:19 iter: 356 end\n",
      "Train epoch:19 iter: 357 begin\n",
      "Train epoch:19 iter: 357 end\n",
      "Train epoch:19 iter: 358 begin\n",
      "Train epoch:19 iter: 358 end\n",
      "Train epoch:19 iter: 359 begin\n",
      "Train epoch:19 iter: 359 end\n",
      "Train epoch:19 iter: 360 begin\n",
      "Train epoch:19 iter: 360 end\n",
      "Train epoch:19 iter: 361 begin\n",
      "Train epoch:19 iter: 361 end\n",
      "Train epoch:19 iter: 362 begin\n",
      "Train epoch:19 iter: 362 end\n",
      "Train epoch:19 iter: 363 begin\n",
      "Train epoch:19 iter: 363 end\n",
      "Train epoch:19 iter: 364 begin\n",
      "Train epoch:19 iter: 364 end\n",
      "Train epoch:19 iter: 365 begin\n",
      "Train epoch:19 iter: 365 end\n",
      "Train epoch:19 iter: 366 begin\n",
      "Train epoch:19 iter: 366 end\n",
      "Train epoch:19 iter: 367 begin\n",
      "Train epoch:19 iter: 367 end\n",
      "Train epoch:19 iter: 368 begin\n",
      "Train epoch:19 iter: 368 end\n",
      "Train epoch:19 iter: 369 begin\n",
      "Train epoch:19 iter: 369 end\n",
      "Train epoch:19 iter: 370 begin\n",
      "Train epoch:19 iter: 370 end\n",
      "Train epoch:19 iter: 371 begin\n",
      "Train epoch:19 iter: 371 end\n",
      "Train epoch:19 iter: 372 begin\n",
      "Train epoch:19 iter: 372 end\n",
      "Train epoch:19 iter: 373 begin\n",
      "Train epoch:19 iter: 373 end\n",
      "Train epoch:19 iter: 374 begin\n",
      "Train epoch:19 iter: 374 end\n",
      "Train epoch:19 iter: 375 begin\n",
      "Train epoch:19 iter: 375 end\n",
      "Train epoch:19 iter: 376 begin\n",
      "Train epoch:19 iter: 376 end\n",
      "Train epoch:19 iter: 377 begin\n",
      "Train epoch:19 iter: 377 end\n",
      "Train epoch:19 iter: 378 begin\n",
      "Train epoch:19 iter: 378 end\n",
      "Train epoch:19 iter: 379 begin\n",
      "Train epoch:19 iter: 379 end\n",
      "Train epoch:19 iter: 380 begin\n",
      "Train epoch:19 iter: 380 end\n",
      "Train epoch:19 iter: 381 begin\n",
      "Train epoch:19 iter: 381 end\n",
      "Train epoch:19 iter: 382 begin\n",
      "Train epoch:19 iter: 382 end\n",
      "Train epoch:19 iter: 383 begin\n",
      "Train epoch:19 iter: 383 end\n",
      "Train epoch:19 iter: 384 begin\n",
      "Train epoch:19 iter: 384 end\n",
      "Train epoch:19 iter: 385 begin\n",
      "Train epoch:19 iter: 385 end\n",
      "Train epoch:19 iter: 386 begin\n",
      "Train epoch:19 iter: 386 end\n",
      "Train epoch:19 iter: 387 begin\n",
      "Train epoch:19 iter: 387 end\n",
      "Train epoch:19 iter: 388 begin\n",
      "Train epoch:19 iter: 388 end\n",
      "Train epoch:19 iter: 389 begin\n",
      "Train epoch:19 iter: 389 end\n",
      "Train epoch:19 iter: 390 begin\n",
      "Train epoch:19 iter: 390 end\n",
      "Train epoch:19 iter: 391 begin\n",
      "Train epoch:19 iter: 391 end\n",
      "Train epoch:19 iter: 392 begin\n",
      "Train epoch:19 iter: 392 end\n",
      "Train epoch:19 iter: 393 begin\n",
      "Train epoch:19 iter: 393 end\n",
      "Train epoch:19 iter: 394 begin\n",
      "Train epoch:19 iter: 394 end\n",
      "Train epoch:19 iter: 395 begin\n",
      "Train epoch:19 iter: 395 end\n",
      "Train epoch:19 iter: 396 begin\n",
      "Train epoch:19 iter: 396 end\n",
      "Train epoch:19 iter: 397 begin\n",
      "Train epoch:19 iter: 397 end\n",
      "Train epoch:19 iter: 398 begin\n",
      "Train epoch:19 iter: 398 end\n",
      "Train epoch:19 iter: 399 begin\n",
      "Train epoch:19 iter: 399 end\n",
      "Train epoch:19 iter: 400 begin\n",
      "Train epoch:19 iter: 400 end\n",
      "Train epoch:19 iter: 401 begin\n",
      "Train epoch:19 iter: 401 end\n",
      "Train epoch:19 iter: 402 begin\n",
      "Train epoch:19 iter: 402 end\n",
      "Train epoch:19 iter: 403 begin\n",
      "Train epoch:19 iter: 403 end\n",
      "Train epoch:19 iter: 404 begin\n",
      "Train epoch:19 iter: 404 end\n",
      "Train epoch:19 iter: 405 begin\n",
      "Train epoch:19 iter: 405 end\n",
      "Train epoch:19 iter: 406 begin\n",
      "Train epoch:19 iter: 406 end\n",
      "Train epoch:19 iter: 407 begin\n",
      "Train epoch:19 iter: 407 end\n",
      "Train epoch:19 iter: 408 begin\n",
      "Train epoch:19 iter: 408 end\n",
      "Train epoch:19 iter: 409 begin\n",
      "Train epoch:19 iter: 409 end\n",
      "Train epoch:19 iter: 410 begin\n",
      "Train epoch:19 iter: 410 end\n",
      "Train epoch:19 iter: 411 begin\n",
      "Train epoch:19 iter: 411 end\n",
      "Train epoch:19 iter: 412 begin\n",
      "Train epoch:19 iter: 412 end\n",
      "Train epoch:19 iter: 413 begin\n",
      "Train epoch:19 iter: 413 end\n",
      "Train epoch:19 iter: 414 begin\n",
      "Train epoch:19 iter: 414 end\n",
      "Train epoch:19 iter: 415 begin\n",
      "Train epoch:19 iter: 415 end\n",
      "Train epoch:19 iter: 416 begin\n",
      "Train epoch:19 iter: 416 end\n",
      "Train epoch:19 iter: 417 begin\n",
      "Train epoch:19 iter: 417 end\n",
      "Train epoch:19 iter: 418 begin\n",
      "Train epoch:19 iter: 418 end\n",
      "Train epoch:19 iter: 419 begin\n",
      "Train epoch:19 iter: 419 end\n",
      "Train epoch:19 iter: 420 begin\n",
      "Train epoch:19 iter: 420 end\n",
      "Train epoch:19 iter: 421 begin\n",
      "Train epoch:19 iter: 421 end\n",
      "Train epoch:19 iter: 422 begin\n",
      "Train epoch:19 iter: 422 end\n",
      "Train epoch:19 iter: 423 begin\n",
      "Train epoch:19 iter: 423 end\n",
      "Train epoch:19 iter: 424 begin\n",
      "Train epoch:19 iter: 424 end\n",
      "Train epoch:19 iter: 425 begin\n",
      "Train epoch:19 iter: 425 end\n",
      "Train epoch:19 iter: 426 begin\n",
      "Train epoch:19 iter: 426 end\n",
      "Train epoch:19 iter: 427 begin\n",
      "Train epoch:19 iter: 427 end\n",
      "Train epoch:19 iter: 428 begin\n",
      "Train epoch:19 iter: 428 end\n",
      "Train epoch:19 iter: 429 begin\n",
      "Train epoch:19 iter: 429 end\n",
      "Train epoch:19 iter: 430 begin\n",
      "Train epoch:19 iter: 430 end\n",
      "Train epoch:19 iter: 431 begin\n",
      "Train epoch:19 iter: 431 end\n",
      "Train epoch:19 iter: 432 begin\n",
      "Train epoch:19 iter: 432 end\n",
      "Train epoch:19 iter: 433 begin\n",
      "Train epoch:19 iter: 433 end\n",
      "Train epoch:19 iter: 434 begin\n",
      "Train epoch:19 iter: 434 end\n",
      "Train epoch:19 iter: 435 begin\n",
      "Train epoch:19 iter: 435 end\n",
      "Train epoch:19 iter: 436 begin\n",
      "Train epoch:19 iter: 436 end\n",
      "Train epoch:19 iter: 437 begin\n",
      "Train epoch:19 iter: 437 end\n",
      "Train epoch:19 iter: 438 begin\n",
      "Train epoch:19 iter: 438 end\n",
      "Train epoch:19 iter: 439 begin\n",
      "Train epoch:19 iter: 439 end\n",
      "Train epoch:19 iter: 440 begin\n",
      "Train epoch:19 iter: 440 end\n",
      "Train epoch:19 iter: 441 begin\n",
      "Train epoch:19 iter: 441 end\n",
      "Train epoch:19 iter: 442 begin\n",
      "Train epoch:19 iter: 442 end\n",
      "Train epoch:19 iter: 443 begin\n",
      "Train epoch:19 iter: 443 end\n",
      "Train epoch:19 iter: 444 begin\n",
      "Train epoch:19 iter: 444 end\n",
      "Train epoch:19 iter: 445 begin\n",
      "Train epoch:19 iter: 445 end\n",
      "Train epoch:19 iter: 446 begin\n",
      "Train epoch:19 iter: 446 end\n",
      "Train epoch:19 iter: 447 begin\n",
      "Train epoch:19 iter: 447 end\n",
      "Train epoch:19 iter: 448 begin\n",
      "Train epoch:19 iter: 448 end\n",
      "Train epoch:19 iter: 449 begin\n",
      "Train epoch:19 iter: 449 end\n",
      "Train epoch:19 iter: 450 begin\n",
      "Train epoch:19 iter: 450 end\n",
      "Train epoch:19 iter: 451 begin\n",
      "Train epoch:19 iter: 451 end\n",
      "Train epoch:19 iter: 452 begin\n",
      "Train epoch:19 iter: 452 end\n",
      "Train epoch:19 iter: 453 begin\n",
      "Train epoch:19 iter: 453 end\n",
      "Train epoch:19 iter: 454 begin\n",
      "Train epoch:19 iter: 454 end\n",
      "Train epoch:19 iter: 455 begin\n",
      "Train epoch:19 iter: 455 end\n",
      "Train epoch:19 iter: 456 begin\n",
      "Train epoch:19 iter: 456 end\n",
      "Train epoch:19 iter: 457 begin\n",
      "Train epoch:19 iter: 457 end\n",
      "Train epoch:19 iter: 458 begin\n",
      "Train epoch:19 iter: 458 end\n",
      "Train epoch:19 iter: 459 begin\n",
      "Train epoch:19 iter: 459 end\n",
      "Train epoch:19 iter: 460 begin\n",
      "Train epoch:19 iter: 460 end\n",
      "Train epoch:19 iter: 461 begin\n",
      "Train epoch:19 iter: 461 end\n",
      "Train epoch:19 iter: 462 begin\n",
      "Train epoch:19 iter: 462 end\n",
      "Train epoch:19 iter: 463 begin\n",
      "Train epoch:19 iter: 463 end\n",
      "Train epoch:19 iter: 464 begin\n",
      "Train epoch:19 iter: 464 end\n",
      "Train epoch:19 iter: 465 begin\n",
      "Train epoch:19 iter: 465 end\n",
      "Train epoch:19 iter: 466 begin\n",
      "Train epoch:19 iter: 466 end\n",
      "Train epoch:19 iter: 467 begin\n",
      "Train epoch:19 iter: 467 end\n",
      "Train epoch:19 iter: 468 begin\n",
      "Train epoch:19 iter: 468 end\n",
      "Train epoch:19 iter: 469 begin\n",
      "Train epoch:19 iter: 469 end\n",
      "Train epoch:19 iter: 470 begin\n",
      "Train epoch:19 iter: 470 end\n",
      "Train epoch:19 iter: 471 begin\n",
      "Train epoch:19 iter: 471 end\n",
      "Train epoch:19 iter: 472 begin\n",
      "Train epoch:19 iter: 472 end\n",
      "Train epoch:19 iter: 473 begin\n",
      "Train epoch:19 iter: 473 end\n",
      "Train epoch:19 iter: 474 begin\n",
      "Train epoch:19 iter: 474 end\n",
      "Train epoch:19 iter: 475 begin\n",
      "Train epoch:19 iter: 475 end\n",
      "Train epoch:19 iter: 476 begin\n",
      "Train epoch:19 iter: 476 end\n",
      "Train epoch:19 iter: 477 begin\n",
      "Train epoch:19 iter: 477 end\n",
      "Train epoch:19 iter: 478 begin\n",
      "Train epoch:19 iter: 478 end\n",
      "Train epoch:19 iter: 479 begin\n",
      "Train epoch:19 iter: 479 end\n",
      "Train epoch:19 iter: 480 begin\n",
      "Train epoch:19 iter: 480 end\n",
      "Train epoch:19 iter: 481 begin\n",
      "Train epoch:19 iter: 481 end\n",
      "Train epoch:19 iter: 482 begin\n",
      "Train epoch:19 iter: 482 end\n",
      "Train epoch:19 iter: 483 begin\n",
      "Train epoch:19 iter: 483 end\n",
      "Train epoch:19 iter: 484 begin\n",
      "Train epoch:19 iter: 484 end\n",
      "Train epoch:19 iter: 485 begin\n",
      "Train epoch:19 iter: 485 end\n",
      "Train epoch:19 iter: 486 begin\n",
      "Train epoch:19 iter: 486 end\n",
      "Train epoch:19 iter: 487 begin\n",
      "Train epoch:19 iter: 487 end\n",
      "Train epoch:19 iter: 488 begin\n",
      "Train epoch:19 iter: 488 end\n",
      "Train epoch:19 iter: 489 begin\n",
      "Train epoch:19 iter: 489 end\n",
      "Train epoch:19 iter: 490 begin\n",
      "Train epoch:19 iter: 490 end\n",
      "Train epoch:19 iter: 491 begin\n",
      "Train epoch:19 iter: 491 end\n",
      "Train epoch:19 iter: 492 begin\n",
      "Train epoch:19 iter: 492 end\n",
      "Train epoch:19 iter: 493 begin\n",
      "Train epoch:19 iter: 493 end\n",
      "Train epoch:19 iter: 494 begin\n",
      "Train epoch:19 iter: 494 end\n",
      "Train epoch:19 iter: 495 begin\n",
      "Train epoch:19 iter: 495 end\n",
      "Train epoch:19 iter: 496 begin\n",
      "Train epoch:19 iter: 496 end\n",
      "Train epoch:19 iter: 497 begin\n",
      "Train epoch:19 iter: 497 end\n",
      "Train epoch:19 iter: 498 begin\n",
      "Train epoch:19 iter: 498 end\n",
      "Train epoch:19 iter: 499 begin\n",
      "Train epoch:19 iter: 499 end\n",
      "Train epoch:19 iter: 500 begin\n",
      "Train epoch:19 iter: 500 end\n",
      "Train epoch:19 iter: 501 begin\n",
      "Train epoch:19 iter: 501 end\n",
      "Train epoch:19 iter: 502 begin\n",
      "Train epoch:19 iter: 502 end\n",
      "Train epoch:19 iter: 503 begin\n",
      "Train epoch:19 iter: 503 end\n",
      "Train epoch:19 iter: 504 begin\n",
      "Train epoch:19 iter: 504 end\n",
      "Train epoch:19 iter: 505 begin\n",
      "Train epoch:19 iter: 505 end\n",
      "Train epoch:19 iter: 506 begin\n",
      "Train epoch:19 iter: 506 end\n",
      "Train epoch:19 iter: 507 begin\n",
      "Train epoch:19 iter: 507 end\n",
      "Train epoch:19 iter: 508 begin\n",
      "Train epoch:19 iter: 508 end\n",
      "Train epoch:19 iter: 509 begin\n",
      "Train epoch:19 iter: 509 end\n",
      "Train epoch:19 iter: 510 begin\n",
      "Train epoch:19 iter: 510 end\n",
      "Train epoch:19 iter: 511 begin\n",
      "Train epoch:19 iter: 511 end\n",
      "Train epoch:19 iter: 512 begin\n",
      "Train epoch:19 iter: 512 end\n",
      "Train epoch:19 iter: 513 begin\n",
      "Train epoch:19 iter: 513 end\n",
      "Train epoch:19 iter: 514 begin\n",
      "Train epoch:19 iter: 514 end\n",
      "Train epoch:19 iter: 515 begin\n",
      "Train epoch:19 iter: 515 end\n",
      "Train epoch:19 iter: 516 begin\n",
      "Train epoch:19 iter: 516 end\n",
      "Train epoch:19 iter: 517 begin\n",
      "Train epoch:19 iter: 517 end\n",
      "Train epoch:19 iter: 518 begin\n",
      "Train epoch:19 iter: 518 end\n",
      "Train epoch:19 iter: 519 begin\n",
      "Train epoch:19 iter: 519 end\n",
      "Train epoch:19 iter: 520 begin\n",
      "Train epoch:19 iter: 520 end\n",
      "Train epoch:19 iter: 521 begin\n",
      "Train epoch:19 iter: 521 end\n",
      "Train epoch:19 iter: 522 begin\n",
      "Train epoch:19 iter: 522 end\n",
      "Train epoch:19 iter: 523 begin\n",
      "Train epoch:19 iter: 523 end\n",
      "Train epoch:19 iter: 524 begin\n",
      "Train epoch:19 iter: 524 end\n",
      "Train epoch:19 iter: 525 begin\n",
      "Train epoch:19 iter: 525 end\n",
      "Train epoch:19 iter: 526 begin\n",
      "Train epoch:19 iter: 526 end\n",
      "Train epoch:19 iter: 527 begin\n",
      "Train epoch:19 iter: 527 end\n",
      "Train epoch:19 iter: 528 begin\n",
      "Train epoch:19 iter: 528 end\n",
      "Train epoch:19 iter: 529 begin\n",
      "Train epoch:19 iter: 529 end\n",
      "Train epoch:19 iter: 530 begin\n",
      "Train epoch:19 iter: 530 end\n",
      "Train epoch:19 iter: 531 begin\n",
      "Train epoch:19 iter: 531 end\n",
      "Train epoch:19 iter: 532 begin\n",
      "Train epoch:19 iter: 532 end\n",
      "Train epoch:19 iter: 533 begin\n",
      "Train epoch:19 iter: 533 end\n",
      "Train epoch:19 iter: 534 begin\n",
      "Train epoch:19 iter: 534 end\n",
      "Train epoch:19 iter: 535 begin\n",
      "Train epoch:19 iter: 535 end\n",
      "Train epoch:19 iter: 536 begin\n",
      "Train epoch:19 iter: 536 end\n",
      "Train epoch:19 iter: 537 begin\n",
      "Train epoch:19 iter: 537 end\n",
      "Train epoch:19 iter: 538 begin\n",
      "Train epoch:19 iter: 538 end\n",
      "Train epoch:19 iter: 539 begin\n",
      "Train epoch:19 iter: 539 end\n",
      "Train epoch:19 iter: 540 begin\n",
      "Train epoch:19 iter: 540 end\n",
      "Train epoch:19 iter: 541 begin\n",
      "Train epoch:19 iter: 541 end\n",
      "Train epoch:19 iter: 542 begin\n",
      "Train epoch:19 iter: 542 end\n",
      "Train epoch:19 iter: 543 begin\n",
      "Train epoch:19 iter: 543 end\n",
      "Train epoch:19 iter: 544 begin\n",
      "Train epoch:19 iter: 544 end\n",
      "Train epoch:19 iter: 545 begin\n",
      "Train epoch:19 iter: 545 end\n",
      "Train epoch:19 iter: 546 begin\n",
      "Train epoch:19 iter: 546 end\n",
      "Train epoch:19 iter: 547 begin\n",
      "Train epoch:19 iter: 547 end\n",
      "Train epoch:19 iter: 548 begin\n",
      "Train epoch:19 iter: 548 end\n",
      "Train epoch:19 iter: 549 begin\n",
      "Train epoch:19 iter: 549 end\n",
      "Train epoch:19 iter: 550 begin\n",
      "Train epoch:19 iter: 550 end\n",
      "Train epoch:19 iter: 551 begin\n",
      "Train epoch:19 iter: 551 end\n",
      "Train epoch:19 iter: 552 begin\n",
      "Train epoch:19 iter: 552 end\n",
      "Train epoch:19 iter: 553 begin\n",
      "Train epoch:19 iter: 553 end\n",
      "Train epoch:19 iter: 554 begin\n",
      "Train epoch:19 iter: 554 end\n",
      "Train epoch:19 iter: 555 begin\n",
      "Train epoch:19 iter: 555 end\n",
      "Train epoch:19 iter: 556 begin\n",
      "Train epoch:19 iter: 556 end\n",
      "Train epoch:19 iter: 557 begin\n",
      "Train epoch:19 iter: 557 end\n",
      "Train epoch:19 iter: 558 begin\n",
      "Train epoch:19 iter: 558 end\n",
      "Train epoch:19 iter: 559 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:19 iter: 559 end\n",
      "Train epoch:19 iter: 560 begin\n",
      "Train epoch:19 iter: 560 end\n",
      "Train epoch:19 iter: 561 begin\n",
      "Train epoch:19 iter: 561 end\n",
      "Train epoch:19 iter: 562 begin\n",
      "Train epoch:19 iter: 562 end\n",
      "Train epoch:19 iter: 563 begin\n",
      "Train epoch:19 iter: 563 end\n",
      "Train epoch:19 iter: 564 begin\n",
      "Train epoch:19 iter: 564 end\n",
      "Train epoch:19 iter: 565 begin\n",
      "Train epoch:19 iter: 565 end\n",
      "Train epoch:19 iter: 566 begin\n",
      "Train epoch:19 iter: 566 end\n",
      "Train epoch:19 iter: 567 begin\n",
      "Train epoch:19 iter: 567 end\n",
      "Train epoch:19 iter: 568 begin\n",
      "Train epoch:19 iter: 568 end\n",
      "Train epoch:19 iter: 569 begin\n",
      "Train epoch:19 iter: 569 end\n",
      "Train epoch:19 iter: 570 begin\n",
      "Train epoch:19 iter: 570 end\n",
      "Train epoch:19 iter: 571 begin\n",
      "Train epoch:19 iter: 571 end\n",
      "Train epoch:19 iter: 572 begin\n",
      "Train epoch:19 iter: 572 end\n",
      "Train epoch:19 iter: 573 begin\n",
      "Train epoch:19 iter: 573 end\n",
      "Train epoch:19 iter: 574 begin\n",
      "Train epoch:19 iter: 574 end\n",
      "Train epoch:19 iter: 575 begin\n",
      "Train epoch:19 iter: 575 end\n",
      "Train epoch:19 iter: 576 begin\n",
      "Train epoch:19 iter: 576 end\n",
      "Train epoch:19 iter: 577 begin\n",
      "Train epoch:19 iter: 577 end\n",
      "Train epoch:19 iter: 578 begin\n",
      "Train epoch:19 iter: 578 end\n",
      "Train epoch:19 iter: 579 begin\n",
      "Train epoch:19 iter: 579 end\n",
      "Train epoch:19 iter: 580 begin\n",
      "Train epoch:19 iter: 580 end\n",
      "Train epoch:19 iter: 581 begin\n",
      "Train epoch:19 iter: 581 end\n",
      "Train epoch:19 iter: 582 begin\n",
      "Train epoch:19 iter: 582 end\n",
      "Train epoch:19 iter: 583 begin\n",
      "Train epoch:19 iter: 583 end\n",
      "Train epoch:19 iter: 584 begin\n",
      "Train epoch:19 iter: 584 end\n",
      "Train epoch:19 iter: 585 begin\n",
      "Train epoch:19 iter: 585 end\n",
      "Train epoch:19 iter: 586 begin\n",
      "Train epoch:19 iter: 586 end\n",
      "Train epoch:19 iter: 587 begin\n",
      "Train epoch:19 iter: 587 end\n",
      "Train epoch:19 iter: 588 begin\n",
      "Train epoch:19 iter: 588 end\n",
      "Train epoch:19 iter: 589 begin\n",
      "Train epoch:19 iter: 589 end\n",
      "Train epoch:19 iter: 590 begin\n",
      "Train epoch:19 iter: 590 end\n",
      "Train epoch:19 iter: 591 begin\n",
      "Train epoch:19 iter: 591 end\n",
      "Train epoch:19 iter: 592 begin\n",
      "Train epoch:19 iter: 592 end\n",
      "Train epoch:19 iter: 593 begin\n",
      "Train epoch:19 iter: 593 end\n",
      "Train epoch:19 iter: 594 begin\n",
      "Train epoch:19 iter: 594 end\n",
      "Train epoch:19 iter: 595 begin\n",
      "Train epoch:19 iter: 595 end\n",
      "Train epoch:19 iter: 596 begin\n",
      "Train epoch:19 iter: 596 end\n",
      "Train epoch:19 iter: 597 begin\n",
      "Train epoch:19 iter: 597 end\n",
      "Train epoch:19 iter: 598 begin\n",
      "Train epoch:19 iter: 598 end\n",
      "Train epoch:19 iter: 599 begin\n",
      "Train epoch:19 iter: 599 end\n",
      "Train epoch:19 iter: 600 begin\n",
      "Train epoch:19 iter: 600 end\n",
      "Train epoch:19 iter: 601 begin\n",
      "Train epoch:19 iter: 601 end\n",
      "Train epoch:19 iter: 602 begin\n",
      "Train epoch:19 iter: 602 end\n",
      "Train epoch:19 iter: 603 begin\n",
      "Train epoch:19 iter: 603 end\n",
      "Train epoch:19 iter: 604 begin\n",
      "Train epoch:19 iter: 604 end\n",
      "Train epoch:19 iter: 605 begin\n",
      "Train epoch:19 iter: 605 end\n",
      "Train epoch:19 iter: 606 begin\n",
      "Train epoch:19 iter: 606 end\n",
      "Train epoch:19 iter: 607 begin\n",
      "Train epoch:19 iter: 607 end\n",
      "Train epoch:19 iter: 608 begin\n",
      "Train epoch:19 iter: 608 end\n",
      "Train epoch:19 iter: 609 begin\n",
      "Train epoch:19 iter: 609 end\n",
      "Train epoch:19 iter: 610 begin\n",
      "Train epoch:19 iter: 610 end\n",
      "Train epoch:19 iter: 611 begin\n",
      "Train epoch:19 iter: 611 end\n",
      "Train epoch:19 iter: 612 begin\n",
      "Train epoch:19 iter: 612 end\n",
      "Train epoch:19 iter: 613 begin\n",
      "Train epoch:19 iter: 613 end\n",
      "Train epoch:19 iter: 614 begin\n",
      "Train epoch:19 iter: 614 end\n",
      "Train epoch:19 iter: 615 begin\n",
      "Train epoch:19 iter: 615 end\n",
      "Train epoch:19 iter: 616 begin\n",
      "Train epoch:19 iter: 616 end\n",
      "Train epoch:19 iter: 617 begin\n",
      "Train epoch:19 iter: 617 end\n",
      "Train epoch:19 iter: 618 begin\n",
      "Train epoch:19 iter: 618 end\n",
      "Train epoch:19 iter: 619 begin\n",
      "Train epoch:19 iter: 619 end\n",
      "Train epoch:19 iter: 620 begin\n",
      "Train epoch:19 iter: 620 end\n",
      "Train epoch:19 iter: 621 begin\n",
      "Train epoch:19 iter: 621 end\n",
      "Train epoch:19 iter: 622 begin\n",
      "Train epoch:19 iter: 622 end\n",
      "Train epoch:19 iter: 623 begin\n",
      "Train epoch:19 iter: 623 end\n",
      "Train epoch:19 iter: 624 begin\n",
      "Train epoch:19 iter: 624 end\n",
      "Train epoch:19 iter: 625 begin\n",
      "Train epoch:19 iter: 625 end\n",
      "Train epoch:19 iter: 626 begin\n",
      "Train epoch:19 iter: 626 end\n",
      "Train epoch:19 iter: 627 begin\n",
      "Train epoch:19 iter: 627 end\n",
      "Train epoch:19 iter: 628 begin\n",
      "Train epoch:19 iter: 628 end\n",
      "Train epoch:19 iter: 629 begin\n",
      "Train epoch:19 iter: 629 end\n",
      "Train epoch:19 iter: 630 begin\n",
      "Train epoch:19 iter: 630 end\n",
      "Train epoch:19 iter: 631 begin\n",
      "Train epoch:19 iter: 631 end\n",
      "Train epoch:19 iter: 632 begin\n",
      "Train epoch:19 iter: 632 end\n",
      "Train epoch:19 iter: 633 begin\n",
      "Train epoch:19 iter: 633 end\n",
      "Train epoch:19 iter: 634 begin\n",
      "Train epoch:19 iter: 634 end\n",
      "Train epoch:19 iter: 635 begin\n",
      "Train epoch:19 iter: 635 end\n",
      "Train epoch:19 iter: 636 begin\n",
      "Train epoch:19 iter: 636 end\n",
      "Train epoch:19 iter: 637 begin\n",
      "Train epoch:19 iter: 637 end\n",
      "Train epoch:19 iter: 638 begin\n",
      "Train epoch:19 iter: 638 end\n",
      "Train epoch:19 iter: 639 begin\n",
      "Train epoch:19 iter: 639 end\n",
      "Train epoch:19 iter: 640 begin\n",
      "Train epoch:19 iter: 640 end\n",
      "Train epoch:19 iter: 641 begin\n",
      "Train epoch:19 iter: 641 end\n",
      "Train epoch:19 iter: 642 begin\n",
      "Train epoch:19 iter: 642 end\n",
      "Train epoch:19 iter: 643 begin\n",
      "Train epoch:19 iter: 643 end\n",
      "Train epoch:19 iter: 644 begin\n",
      "Train epoch:19 iter: 644 end\n",
      "Train epoch:19 iter: 645 begin\n",
      "Train epoch:19 iter: 645 end\n",
      "Train epoch:19 iter: 646 begin\n",
      "Train epoch:19 iter: 646 end\n",
      "Train epoch:19 iter: 647 begin\n",
      "Train epoch:19 iter: 647 end\n",
      "Train epoch:19 iter: 648 begin\n",
      "Train epoch:19 iter: 648 end\n",
      "Train epoch:19 iter: 649 begin\n",
      "Train epoch:19 iter: 649 end\n",
      "Train epoch:19 iter: 650 begin\n",
      "Train epoch:19 iter: 650 end\n",
      "Train epoch:19 iter: 651 begin\n",
      "Train epoch:19 iter: 651 end\n",
      "Train epoch:19 iter: 652 begin\n",
      "Train epoch:19 iter: 652 end\n",
      "Train epoch:19 iter: 653 begin\n",
      "Train epoch:19 iter: 653 end\n",
      "Train epoch:19 iter: 654 begin\n",
      "Train epoch:19 iter: 654 end\n",
      "Train epoch:19 iter: 655 begin\n",
      "Train epoch:19 iter: 655 end\n",
      "Train epoch:19 iter: 656 begin\n",
      "Train epoch:19 iter: 656 end\n",
      "Train epoch:19 iter: 657 begin\n",
      "Train epoch:19 iter: 657 end\n",
      "Train epoch:19 iter: 658 begin\n",
      "Train epoch:19 iter: 658 end\n",
      "Train epoch:19 iter: 659 begin\n",
      "Train epoch:19 iter: 659 end\n",
      "Train epoch:19 iter: 660 begin\n",
      "Train epoch:19 iter: 660 end\n",
      "Train epoch:19 iter: 661 begin\n",
      "Train epoch:19 iter: 661 end\n",
      "Train epoch:19 iter: 662 begin\n",
      "Train epoch:19 iter: 662 end\n",
      "Train epoch:19 iter: 663 begin\n",
      "Train epoch:19 iter: 663 end\n",
      "Train epoch:19 iter: 664 begin\n",
      "Train epoch:19 iter: 664 end\n",
      "Train epoch:19 iter: 665 begin\n",
      "Train epoch:19 iter: 665 end\n",
      "Train epoch:19 iter: 666 begin\n",
      "Train epoch:19 iter: 666 end\n",
      "Train epoch:19 iter: 667 begin\n",
      "Train epoch:19 iter: 667 end\n",
      "Train epoch:19 iter: 668 begin\n",
      "Train epoch:19 iter: 668 end\n",
      "Train epoch:19 iter: 669 begin\n",
      "Train epoch:19 iter: 669 end\n",
      "Train epoch:19 iter: 670 begin\n",
      "Train epoch:19 iter: 670 end\n",
      "Train epoch:19 iter: 671 begin\n",
      "Train epoch:19 iter: 671 end\n",
      "Train epoch:19 iter: 672 begin\n",
      "Train epoch:19 iter: 672 end\n",
      "Train epoch:19 iter: 673 begin\n",
      "Train epoch:19 iter: 673 end\n",
      "Train epoch:19 iter: 674 begin\n",
      "Train epoch:19 iter: 674 end\n",
      "Train epoch:19 iter: 675 begin\n",
      "Train epoch:19 iter: 675 end\n",
      "Train epoch:19 iter: 676 begin\n",
      "Train epoch:19 iter: 676 end\n",
      "Train epoch:19 iter: 677 begin\n",
      "Train epoch:19 iter: 677 end\n",
      "Train epoch:19 iter: 678 begin\n",
      "Train epoch:19 iter: 678 end\n",
      "Train epoch:19 iter: 679 begin\n",
      "Train epoch:19 iter: 679 end\n",
      "Train epoch:19 iter: 680 begin\n",
      "Train epoch:19 iter: 680 end\n",
      "Train epoch:19 iter: 681 begin\n",
      "Train epoch:19 iter: 681 end\n",
      "Train epoch:19 iter: 682 begin\n",
      "Train epoch:19 iter: 682 end\n",
      "Train epoch:19 iter: 683 begin\n",
      "Train epoch:19 iter: 683 end\n",
      "Train epoch:19 iter: 684 begin\n",
      "Train epoch:19 iter: 684 end\n",
      "Train epoch:19 iter: 685 begin\n",
      "Train epoch:19 iter: 685 end\n",
      "Train epoch:19 iter: 686 begin\n",
      "Train epoch:19 iter: 686 end\n",
      "Train epoch:19 iter: 687 begin\n",
      "Train epoch:19 iter: 687 end\n",
      "Train epoch:19 iter: 688 begin\n",
      "Train epoch:19 iter: 688 end\n",
      "Train epoch:19 iter: 689 begin\n",
      "Train epoch:19 iter: 689 end\n",
      "Train epoch:19 iter: 690 begin\n",
      "Train epoch:19 iter: 690 end\n",
      "Train epoch:19 iter: 691 begin\n",
      "Train epoch:19 iter: 691 end\n",
      "Train epoch:19 iter: 692 begin\n",
      "Train epoch:19 iter: 692 end\n",
      "Train epoch:19 iter: 693 begin\n",
      "Train epoch:19 iter: 693 end\n",
      "Train epoch:19 iter: 694 begin\n",
      "Train epoch:19 iter: 694 end\n",
      "Train epoch:19 iter: 695 begin\n",
      "Train epoch:19 iter: 695 end\n",
      "Train epoch:19 iter: 696 begin\n",
      "Train epoch:19 iter: 696 end\n",
      "Train epoch:19 iter: 697 begin\n",
      "Train epoch:19 iter: 697 end\n",
      "Train epoch:19 iter: 698 begin\n",
      "Train epoch:19 iter: 698 end\n",
      "Train epoch:19 iter: 699 begin\n",
      "Train epoch:19 iter: 699 end\n",
      "Train epoch:19 iter: 700 begin\n",
      "Train epoch:19 iter: 700 end\n",
      "Train epoch:19 iter: 701 begin\n",
      "Train epoch:19 iter: 701 end\n",
      "Train epoch:19 iter: 702 begin\n",
      "Train epoch:19 iter: 702 end\n",
      "Train epoch:19 iter: 703 begin\n",
      "Train epoch:19 iter: 703 end\n",
      "Train epoch:19 iter: 704 begin\n",
      "Train epoch:19 iter: 704 end\n",
      "Train epoch:19 iter: 705 begin\n",
      "Train epoch:19 iter: 705 end\n",
      "Train epoch:19 iter: 706 begin\n",
      "Train epoch:19 iter: 706 end\n",
      "Train epoch:19 iter: 707 begin\n",
      "Train epoch:19 iter: 707 end\n",
      "Train epoch:19 iter: 708 begin\n",
      "Train epoch:19 iter: 708 end\n",
      "Train epoch:19 iter: 709 begin\n",
      "Train epoch:19 iter: 709 end\n",
      "Train epoch:19 iter: 710 begin\n",
      "Train epoch:19 iter: 710 end\n",
      "Train epoch:19 iter: 711 begin\n",
      "Train epoch:19 iter: 711 end\n",
      "Train epoch:19 iter: 712 begin\n",
      "Train epoch:19 iter: 712 end\n",
      "Train epoch:19 iter: 713 begin\n",
      "Train epoch:19 iter: 713 end\n",
      "Train epoch:19 iter: 714 begin\n",
      "Train epoch:19 iter: 714 end\n",
      "Train epoch:19 iter: 715 begin\n",
      "Train epoch:19 iter: 715 end\n",
      "Train epoch:19 iter: 716 begin\n",
      "Train epoch:19 iter: 716 end\n",
      "Train epoch:19 iter: 717 begin\n",
      "Train epoch:19 iter: 717 end\n",
      "Train epoch:19 iter: 718 begin\n",
      "Train epoch:19 iter: 718 end\n",
      "Train epoch:19 iter: 719 begin\n",
      "Train epoch:19 iter: 719 end\n",
      "Train epoch:19 iter: 720 begin\n",
      "Train epoch:19 iter: 720 end\n",
      "Train epoch:19 iter: 721 begin\n",
      "Train epoch:19 iter: 721 end\n",
      "Train epoch:19 iter: 722 begin\n",
      "Train epoch:19 iter: 722 end\n",
      "Train epoch:19 iter: 723 begin\n",
      "Train epoch:19 iter: 723 end\n",
      "Train epoch:19 iter: 724 begin\n",
      "Train epoch:19 iter: 724 end\n",
      "Train epoch:19 iter: 725 begin\n",
      "Train epoch:19 iter: 725 end\n",
      "Train epoch:19 iter: 726 begin\n",
      "Train epoch:19 iter: 726 end\n",
      "Train epoch:19 iter: 727 begin\n",
      "Train epoch:19 iter: 727 end\n",
      "Train epoch:19 iter: 728 begin\n",
      "Train epoch:19 iter: 728 end\n",
      "Train epoch:19 iter: 729 begin\n",
      "Train epoch:19 iter: 729 end\n",
      "Train epoch:19 iter: 730 begin\n",
      "Train epoch:19 iter: 730 end\n",
      "Train epoch:19 iter: 731 begin\n",
      "Train epoch:19 iter: 731 end\n",
      "Train epoch:19 iter: 732 begin\n",
      "Train epoch:19 iter: 732 end\n",
      "Train epoch:19 iter: 733 begin\n",
      "Train epoch:19 iter: 733 end\n",
      "Train epoch:19 iter: 734 begin\n",
      "Train epoch:19 iter: 734 end\n",
      "Train epoch:19 iter: 735 begin\n",
      "Train epoch:19 iter: 735 end\n",
      "Train epoch:19 iter: 736 begin\n",
      "Train epoch:19 iter: 736 end\n",
      "Train epoch:19 iter: 737 begin\n",
      "Train epoch:19 iter: 737 end\n",
      "Train epoch:19 iter: 738 begin\n",
      "Train epoch:19 iter: 738 end\n",
      "Train epoch:19 iter: 739 begin\n",
      "Train epoch:19 iter: 739 end\n",
      "Train epoch:19 iter: 740 begin\n",
      "Train epoch:19 iter: 740 end\n",
      "Train epoch:19 iter: 741 begin\n",
      "Train epoch:19 iter: 741 end\n",
      "Train epoch:19 iter: 742 begin\n",
      "Train epoch:19 iter: 742 end\n",
      "Train epoch:19 iter: 743 begin\n",
      "Train epoch:19 iter: 743 end\n",
      "Train epoch:19 iter: 744 begin\n",
      "Train epoch:19 iter: 744 end\n",
      "Train epoch:19 iter: 745 begin\n",
      "Train epoch:19 iter: 745 end\n",
      "Train epoch:19 iter: 746 begin\n",
      "Train epoch:19 iter: 746 end\n",
      "Train epoch:19 iter: 747 begin\n",
      "Train epoch:19 iter: 747 end\n",
      "Train epoch:19 iter: 748 begin\n",
      "Train epoch:19 iter: 748 end\n",
      "Train epoch:19 iter: 749 begin\n",
      "Train epoch:19 iter: 749 end\n",
      "Train epoch:19 iter: 750 begin\n",
      "Train epoch:19 iter: 750 end\n",
      "Train epoch:19 iter: 751 begin\n",
      "Train epoch:19 iter: 751 end\n",
      "Train epoch:19 iter: 752 begin\n",
      "Train epoch:19 iter: 752 end\n",
      "Train epoch:19 iter: 753 begin\n",
      "Train epoch:19 iter: 753 end\n",
      "Train epoch:19 iter: 754 begin\n",
      "Train epoch:19 iter: 754 end\n",
      "Train epoch:19 iter: 755 begin\n",
      "Train epoch:19 iter: 755 end\n",
      "Train epoch:19 iter: 756 begin\n",
      "Train epoch:19 iter: 756 end\n",
      "Train epoch:19 iter: 757 begin\n",
      "Train epoch:19 iter: 757 end\n",
      "Train epoch:19 iter: 758 begin\n",
      "Train epoch:19 iter: 758 end\n",
      "Train epoch:19 iter: 759 begin\n",
      "Train epoch:19 iter: 759 end\n",
      "Train epoch:19 iter: 760 begin\n",
      "Train epoch:19 iter: 760 end\n",
      "Train epoch:19 iter: 761 begin\n",
      "Train epoch:19 iter: 761 end\n",
      "Train epoch:19 iter: 762 begin\n",
      "Train epoch:19 iter: 762 end\n",
      "Train epoch:19 iter: 763 begin\n",
      "Train epoch:19 iter: 763 end\n",
      "Train epoch:19 iter: 764 begin\n",
      "Train epoch:19 iter: 764 end\n",
      "Train epoch:19 iter: 765 begin\n",
      "Train epoch:19 iter: 765 end\n",
      "Train epoch:19 iter: 766 begin\n",
      "Train epoch:19 iter: 766 end\n",
      "Train epoch:19 iter: 767 begin\n",
      "Train epoch:19 iter: 767 end\n",
      "Train epoch:19 iter: 768 begin\n",
      "Train epoch:19 iter: 768 end\n",
      "Train epoch:19 iter: 769 begin\n",
      "Train epoch:19 iter: 769 end\n",
      "Train epoch:19 iter: 770 begin\n",
      "Train epoch:19 iter: 770 end\n",
      "Train epoch:19 iter: 771 begin\n",
      "Train epoch:19 iter: 771 end\n",
      "Train epoch:19 iter: 772 begin\n",
      "Train epoch:19 iter: 772 end\n",
      "Train epoch:19 iter: 773 begin\n",
      "Train epoch:19 iter: 773 end\n",
      "Train epoch:19 iter: 774 begin\n",
      "Train epoch:19 iter: 774 end\n",
      "Train epoch:19 iter: 775 begin\n",
      "Train epoch:19 iter: 775 end\n",
      "Train epoch:19 iter: 776 begin\n",
      "Train epoch:19 iter: 776 end\n",
      "Train epoch:19 iter: 777 begin\n",
      "Train epoch:19 iter: 777 end\n",
      "Train epoch:19 iter: 778 begin\n",
      "Train epoch:19 iter: 778 end\n",
      "Train epoch:19 iter: 779 begin\n",
      "Train epoch:19 iter: 779 end\n",
      "Train epoch:19 iter: 780 begin\n",
      "Train epoch:19 iter: 780 end\n",
      "Train epoch:19 iter: 781 begin\n",
      "Train epoch:19 iter: 781 end\n",
      "Train epoch:19 iter: 782 begin\n",
      "Train epoch:19 iter: 782 end\n",
      "Train epoch:19 iter: 783 begin\n",
      "Train epoch:19 iter: 783 end\n",
      "Train epoch:19 iter: 784 begin\n",
      "Train epoch:19 iter: 784 end\n",
      "Train epoch:19 iter: 785 begin\n",
      "Train epoch:19 iter: 785 end\n",
      "Train epoch:19 iter: 786 begin\n",
      "Train epoch:19 iter: 786 end\n",
      "Train epoch:19 iter: 787 begin\n",
      "Train epoch:19 iter: 787 end\n",
      "Train epoch:19 iter: 788 begin\n",
      "Train epoch:19 iter: 788 end\n",
      "Train epoch:19 iter: 789 begin\n",
      "Train epoch:19 iter: 789 end\n",
      "Train epoch:19 iter: 790 begin\n",
      "Train epoch:19 iter: 790 end\n",
      "Train epoch:19 iter: 791 begin\n",
      "Train epoch:19 iter: 791 end\n",
      "Train epoch:19 iter: 792 begin\n",
      "Train epoch:19 iter: 792 end\n",
      "Train epoch:19 iter: 793 begin\n",
      "Train epoch:19 iter: 793 end\n",
      "Train epoch:19 iter: 794 begin\n",
      "Train epoch:19 iter: 794 end\n",
      "Train epoch:19 iter: 795 begin\n",
      "Train epoch:19 iter: 795 end\n",
      "Train epoch:19 iter: 796 begin\n",
      "Train epoch:19 iter: 796 end\n",
      "Train epoch:19 iter: 797 begin\n",
      "Train epoch:19 iter: 797 end\n",
      "Train epoch:19 iter: 798 begin\n",
      "Train epoch:19 iter: 798 end\n",
      "Train epoch:19 iter: 799 begin\n",
      "Train epoch:19 iter: 799 end\n",
      "Train epoch:19 iter: 800 begin\n",
      "Train epoch:19 iter: 800 end\n",
      "Train epoch:19 iter: 801 begin\n",
      "Train epoch:19 iter: 801 end\n",
      "Train epoch:19 iter: 802 begin\n",
      "Train epoch:19 iter: 802 end\n",
      "Train epoch:19 iter: 803 begin\n",
      "Train epoch:19 iter: 803 end\n",
      "Train epoch:19 iter: 804 begin\n",
      "Train epoch:19 iter: 804 end\n",
      "Train epoch:19 iter: 805 begin\n",
      "Train epoch:19 iter: 805 end\n",
      "Train epoch:19 iter: 806 begin\n",
      "Train epoch:19 iter: 806 end\n",
      "Train epoch:19 iter: 807 begin\n",
      "Train epoch:19 iter: 807 end\n",
      "Train epoch:19 iter: 808 begin\n",
      "Train epoch:19 iter: 808 end\n",
      "Train epoch:19 iter: 809 begin\n",
      "Train epoch:19 iter: 809 end\n",
      "Train epoch:19 iter: 810 begin\n",
      "Train epoch:19 iter: 810 end\n",
      "Train epoch:19 iter: 811 begin\n",
      "Train epoch:19 iter: 811 end\n",
      "Train epoch:19 iter: 812 begin\n",
      "Train epoch:19 iter: 812 end\n",
      "Train epoch:19 iter: 813 begin\n",
      "Train epoch:19 iter: 813 end\n",
      "Train epoch:19 iter: 814 begin\n",
      "Train epoch:19 iter: 814 end\n",
      "Train epoch:19 iter: 815 begin\n",
      "Train epoch:19 iter: 815 end\n",
      "Train epoch:19 iter: 816 begin\n",
      "Train epoch:19 iter: 816 end\n",
      "Train epoch:19 iter: 817 begin\n",
      "Train epoch:19 iter: 817 end\n",
      "Train epoch:19 iter: 818 begin\n",
      "Train epoch:19 iter: 818 end\n",
      "Train epoch:19 iter: 819 begin\n",
      "Train epoch:19 iter: 819 end\n",
      "Train epoch:19 iter: 820 begin\n",
      "Train epoch:19 iter: 820 end\n",
      "Train epoch:19 iter: 821 begin\n",
      "Train epoch:19 iter: 821 end\n",
      "Train epoch:19 iter: 822 begin\n",
      "Train epoch:19 iter: 822 end\n",
      "Train epoch:19 iter: 823 begin\n",
      "Train epoch:19 iter: 823 end\n",
      "Train epoch:19 iter: 824 begin\n",
      "Train epoch:19 iter: 824 end\n",
      "Train epoch:19 iter: 825 begin\n",
      "Train epoch:19 iter: 825 end\n",
      "Train epoch:19 iter: 826 begin\n",
      "Train epoch:19 iter: 826 end\n",
      "Train epoch:19 iter: 827 begin\n",
      "Train epoch:19 iter: 827 end\n",
      "Train epoch:19 iter: 828 begin\n",
      "Train epoch:19 iter: 828 end\n",
      "Train epoch:19 iter: 829 begin\n",
      "Train epoch:19 iter: 829 end\n",
      "Train epoch:19 iter: 830 begin\n",
      "Train epoch:19 iter: 830 end\n",
      "Train epoch:19 iter: 831 begin\n",
      "Train epoch:19 iter: 831 end\n",
      "Train epoch:19 iter: 832 begin\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train epoch:19 iter: 832 end\n",
      "Train epoch:19 iter: 833 begin\n",
      "Train epoch:19 iter: 833 end\n",
      "Train epoch:19 iter: 834 begin\n",
      "Train epoch:19 iter: 834 end\n",
      "Train epoch:19 iter: 835 begin\n",
      "Train epoch:19 iter: 835 end\n",
      "Train epoch:19 iter: 836 begin\n",
      "Train epoch:19 iter: 836 end\n",
      "Train epoch:19 iter: 837 begin\n",
      "Train epoch:19 iter: 837 end\n",
      "Train epoch:19 iter: 838 begin\n",
      "Train epoch:19 iter: 838 end\n",
      "Train epoch:19 iter: 839 begin\n",
      "Train epoch:19 iter: 839 end\n",
      "Train epoch:19 iter: 840 begin\n",
      "Train epoch:19 iter: 840 end\n",
      "Train epoch:19 iter: 841 begin\n",
      "Train epoch:19 iter: 841 end\n",
      "Train epoch:19 iter: 842 begin\n",
      "Train epoch:19 iter: 842 end\n",
      "Train epoch:19 iter: 843 begin\n",
      "Train epoch:19 iter: 843 end\n",
      "Train epoch:19 iter: 844 begin\n",
      "Train epoch:19 iter: 844 end\n",
      "Train epoch:19 iter: 845 begin\n",
      "Train epoch:19 iter: 845 end\n",
      "Train epoch:19 iter: 846 begin\n",
      "Train epoch:19 iter: 846 end\n",
      "Train epoch:19 iter: 847 begin\n",
      "Train epoch:19 iter: 847 end\n",
      "Train epoch:19 iter: 848 begin\n",
      "Train epoch:19 iter: 848 end\n",
      "Train epoch:19 iter: 849 begin\n",
      "Train epoch:19 iter: 849 end\n",
      "Train epoch:19 iter: 850 begin\n",
      "Train epoch:19 iter: 850 end\n",
      "Train epoch:19 iter: 851 begin\n",
      "Train epoch:19 iter: 851 end\n",
      "Train epoch:19 iter: 852 begin\n",
      "Train epoch:19 iter: 852 end\n",
      "Train epoch:19 iter: 853 begin\n",
      "Train epoch:19 iter: 853 end\n",
      "Train epoch:19 iter: 854 begin\n",
      "Train epoch:19 iter: 854 end\n",
      "Train epoch:19 iter: 855 begin\n",
      "Train epoch:19 iter: 855 end\n",
      "Train epoch:19 iter: 856 begin\n",
      "Train epoch:19 iter: 856 end\n",
      "Train epoch:19 iter: 857 begin\n",
      "Train epoch:19 iter: 857 end\n",
      "Train epoch:19 iter: 858 begin\n",
      "Train epoch:19 iter: 858 end\n",
      "Train epoch:19 iter: 859 begin\n",
      "Train epoch:19 iter: 859 end\n",
      "Train epoch:19 iter: 860 begin\n",
      "Train epoch:19 iter: 860 end\n",
      "Train epoch:19 iter: 861 begin\n",
      "Train epoch:19 iter: 861 end\n",
      "Train epoch:19 iter: 862 begin\n",
      "Train epoch:19 iter: 862 end\n",
      "Train epoch:19 iter: 863 begin\n",
      "Train epoch:19 iter: 863 end\n",
      "Train epoch:19 iter: 864 begin\n",
      "Train epoch:19 iter: 864 end\n",
      "Train epoch:19 iter: 865 begin\n",
      "Train epoch:19 iter: 865 end\n",
      "Train epoch:19 iter: 866 begin\n",
      "Train epoch:19 iter: 866 end\n",
      "Train epoch:19 iter: 867 begin\n",
      "Train epoch:19 iter: 867 end\n",
      "Train epoch:19 iter: 868 begin\n",
      "Train epoch:19 iter: 868 end\n",
      "Train epoch:19 iter: 869 begin\n",
      "Train epoch:19 iter: 869 end\n",
      "Train epoch:19 iter: 870 begin\n",
      "Train epoch:19 iter: 870 end\n",
      "Train epoch:19 iter: 871 begin\n",
      "Train epoch:19 iter: 871 end\n",
      "Train epoch:19 iter: 872 begin\n",
      "Train epoch:19 iter: 872 end\n",
      "Train epoch:19 iter: 873 begin\n",
      "Train epoch:19 iter: 873 end\n",
      "Train epoch:19 iter: 874 begin\n",
      "Train epoch:19 iter: 874 end\n",
      "Train epoch:19 iter: 875 begin\n",
      "Train epoch:19 iter: 875 end\n",
      "Train epoch:19 iter: 876 begin\n",
      "Train epoch:19 iter: 876 end\n",
      "Train epoch:19 iter: 877 begin\n",
      "Train epoch:19 iter: 877 end\n",
      "Train epoch:19 iter: 878 begin\n",
      "Train epoch:19 iter: 878 end\n",
      "Train epoch:19 iter: 879 begin\n",
      "Train epoch:19 iter: 879 end\n",
      "Train epoch:19 iter: 880 begin\n",
      "Train epoch:19 iter: 880 end\n",
      "Train epoch:19 iter: 881 begin\n",
      "Train epoch:19 iter: 881 end\n",
      "Train epoch:19 iter: 882 begin\n",
      "Train epoch:19 iter: 882 end\n",
      "Train epoch:19 iter: 883 begin\n",
      "Train epoch:19 iter: 883 end\n",
      "Train epoch:19 iter: 884 begin\n",
      "Train epoch:19 iter: 884 end\n",
      "Train epoch:19 iter: 885 begin\n",
      "Train epoch:19 iter: 885 end\n",
      "Train epoch:19 iter: 886 begin\n",
      "Train epoch:19 iter: 886 end\n",
      "Train epoch:19 iter: 887 begin\n",
      "Train epoch:19 iter: 887 end\n",
      "Train epoch:19 iter: 888 begin\n",
      "Train epoch:19 iter: 888 end\n",
      "Train epoch:19 iter: 889 begin\n",
      "Train epoch:19 iter: 889 end\n",
      "Train epoch:19 iter: 890 begin\n",
      "Train epoch:19 iter: 890 end\n",
      "Train epoch:19 iter: 891 begin\n",
      "Train epoch:19 iter: 891 end\n",
      "Train epoch:19 iter: 892 begin\n",
      "Train epoch:19 iter: 892 end\n",
      "Train epoch:19 iter: 893 begin\n",
      "Train epoch:19 iter: 893 end\n",
      "Train epoch:19 iter: 894 begin\n",
      "Train epoch:19 iter: 894 end\n",
      "Train epoch:19 iter: 895 begin\n",
      "Train epoch:19 iter: 895 end\n",
      "Train epoch:19 iter: 896 begin\n",
      "Train epoch:19 iter: 896 end\n",
      "Train epoch:19 iter: 897 begin\n",
      "Train epoch:19 iter: 897 end\n",
      "Train epoch:19 iter: 898 begin\n",
      "Train epoch:19 iter: 898 end\n",
      "Train epoch:19 iter: 899 begin\n",
      "Train epoch:19 iter: 899 end\n",
      "Train epoch:19 iter: 900 begin\n",
      "Train epoch:19 iter: 900 end\n",
      "Train epoch:19 iter: 901 begin\n",
      "Train epoch:19 iter: 901 end\n",
      "Train epoch:19 iter: 902 begin\n",
      "Train epoch:19 iter: 902 end\n",
      "Train epoch:19 iter: 903 begin\n",
      "Train epoch:19 iter: 903 end\n",
      "Train epoch:19 iter: 904 begin\n",
      "Train epoch:19 iter: 904 end\n",
      "Train epoch:19 iter: 905 begin\n",
      "Train epoch:19 iter: 905 end\n",
      "Train epoch:19 iter: 906 begin\n",
      "Train epoch:19 iter: 906 end\n",
      "Train epoch:19 iter: 907 begin\n",
      "Train epoch:19 iter: 907 end\n",
      "Train epoch:19 iter: 908 begin\n",
      "Train epoch:19 iter: 908 end\n",
      "Train epoch:19 iter: 909 begin\n",
      "Train epoch:19 iter: 909 end\n",
      "Train epoch:19 iter: 910 begin\n",
      "Train epoch:19 iter: 910 end\n",
      "Train epoch:19 iter: 911 begin\n",
      "Train epoch:19 iter: 911 end\n",
      "Train epoch:19 iter: 912 begin\n",
      "Train epoch:19 iter: 912 end\n",
      "Train epoch:19 iter: 913 begin\n",
      "Train epoch:19 iter: 913 end\n",
      "Train epoch:19 iter: 914 begin\n",
      "Train epoch:19 iter: 914 end\n",
      "Train epoch:19 iter: 915 begin\n",
      "Train epoch:19 iter: 915 end\n",
      "Train epoch:19 iter: 916 begin\n",
      "Train epoch:19 iter: 916 end\n",
      "Train epoch:19 iter: 917 begin\n",
      "Train epoch:19 iter: 917 end\n",
      "Train epoch:19 iter: 918 begin\n",
      "Train epoch:19 iter: 918 end\n",
      "Train epoch:19 iter: 919 begin\n",
      "Train epoch:19 iter: 919 end\n",
      "Train epoch:19 iter: 920 begin\n",
      "Train epoch:19 iter: 920 end\n",
      "Train epoch:19 iter: 921 begin\n",
      "Train epoch:19 iter: 921 end\n",
      "Train epoch:19 iter: 922 begin\n",
      "Train epoch:19 iter: 922 end\n",
      "Train epoch:19 iter: 923 begin\n",
      "Train epoch:19 iter: 923 end\n",
      "Train epoch:19 iter: 924 begin\n",
      "Train epoch:19 iter: 924 end\n",
      "Train epoch:19 iter: 925 begin\n",
      "Train epoch:19 iter: 925 end\n",
      "Train epoch:19 iter: 926 begin\n",
      "Train epoch:19 iter: 926 end\n",
      "Train epoch:19 iter: 927 begin\n",
      "Train epoch:19 iter: 927 end\n",
      "Train epoch:19 iter: 928 begin\n",
      "Train epoch:19 iter: 928 end\n",
      "Train epoch:19 iter: 929 begin\n",
      "Train epoch:19 iter: 929 end\n",
      "Train epoch:19 iter: 930 begin\n",
      "Train epoch:19 iter: 930 end\n",
      "Train epoch:19 iter: 931 begin\n",
      "Train epoch:19 iter: 931 end\n",
      "Train epoch:19 iter: 932 begin\n",
      "Train epoch:19 iter: 932 end\n",
      "Train epoch:19 iter: 933 begin\n",
      "Train epoch:19 iter: 933 end\n",
      "Train epoch:19 iter: 934 begin\n",
      "Train epoch:19 iter: 934 end\n",
      "Train epoch:19 iter: 935 begin\n",
      "Train epoch:19 iter: 935 end\n",
      "Train epoch:19 iter: 936 begin\n",
      "Train epoch:19 iter: 936 end\n",
      "Train epoch:19 iter: 937 begin\n",
      "Train epoch:19 iter: 937 end\n",
      "Train epoch:19 iter: 938 begin\n",
      "Train epoch:19 iter: 938 end\n",
      "Train Loss: 0.000841, Acc: 0.979417\n",
      "save model for best accuate: 0.9794166666666667 begin\n",
      "save model for best accuate: 0.9794166666666667 end\n",
      "Train model end\n",
      "\n",
      "Test model begin\n",
      "Loading best model: ./pytorchdata_fashionmnist/model\\fashionmnist.pt begin\n",
      "Loading best model end, epoch is 20, training accuracy is 0.9794166666666667\n",
      "Validate iter: 1 begin\n",
      "Validate iter: 1 end\n",
      "Validate iter: 2 begin\n",
      "Validate iter: 2 end\n",
      "Validate iter: 3 begin\n",
      "Validate iter: 3 end\n",
      "Validate iter: 4 begin\n",
      "Validate iter: 4 end\n",
      "Validate iter: 5 begin\n",
      "Validate iter: 5 end\n",
      "Validate iter: 6 begin\n",
      "Validate iter: 6 end\n",
      "Validate iter: 7 begin\n",
      "Validate iter: 7 end\n",
      "Validate iter: 8 begin\n",
      "Validate iter: 8 end\n",
      "Validate iter: 9 begin\n",
      "Validate iter: 9 end\n",
      "Validate iter: 10 begin\n",
      "Validate iter: 10 end\n",
      "Validate iter: 11 begin\n",
      "Validate iter: 11 end\n",
      "Validate iter: 12 begin\n",
      "Validate iter: 12 end\n",
      "Validate iter: 13 begin\n",
      "Validate iter: 13 end\n",
      "Validate iter: 14 begin\n",
      "Validate iter: 14 end\n",
      "Validate iter: 15 begin\n",
      "Validate iter: 15 end\n",
      "Validate iter: 16 begin\n",
      "Validate iter: 16 end\n",
      "Validate iter: 17 begin\n",
      "Validate iter: 17 end\n",
      "Validate iter: 18 begin\n",
      "Validate iter: 18 end\n",
      "Validate iter: 19 begin\n",
      "Validate iter: 19 end\n",
      "Validate iter: 20 begin\n",
      "Validate iter: 20 end\n",
      "Validate iter: 21 begin\n",
      "Validate iter: 21 end\n",
      "Validate iter: 22 begin\n",
      "Validate iter: 22 end\n",
      "Validate iter: 23 begin\n",
      "Validate iter: 23 end\n",
      "Validate iter: 24 begin\n",
      "Validate iter: 24 end\n",
      "Validate iter: 25 begin\n",
      "Validate iter: 25 end\n",
      "Validate iter: 26 begin\n",
      "Validate iter: 26 end\n",
      "Validate iter: 27 begin\n",
      "Validate iter: 27 end\n",
      "Validate iter: 28 begin\n",
      "Validate iter: 28 end\n",
      "Validate iter: 29 begin\n",
      "Validate iter: 29 end\n",
      "Validate iter: 30 begin\n",
      "Validate iter: 30 end\n",
      "Validate iter: 31 begin\n",
      "Validate iter: 31 end\n",
      "Validate iter: 32 begin\n",
      "Validate iter: 32 end\n",
      "Validate iter: 33 begin\n",
      "Validate iter: 33 end\n",
      "Validate iter: 34 begin\n",
      "Validate iter: 34 end\n",
      "Validate iter: 35 begin\n",
      "Validate iter: 35 end\n",
      "Validate iter: 36 begin\n",
      "Validate iter: 36 end\n",
      "Validate iter: 37 begin\n",
      "Validate iter: 37 end\n",
      "Validate iter: 38 begin\n",
      "Validate iter: 38 end\n",
      "Validate iter: 39 begin\n",
      "Validate iter: 39 end\n",
      "Validate iter: 40 begin\n",
      "Validate iter: 40 end\n",
      "Validate iter: 41 begin\n",
      "Validate iter: 41 end\n",
      "Validate iter: 42 begin\n",
      "Validate iter: 42 end\n",
      "Validate iter: 43 begin\n",
      "Validate iter: 43 end\n",
      "Validate iter: 44 begin\n",
      "Validate iter: 44 end\n",
      "Validate iter: 45 begin\n",
      "Validate iter: 45 end\n",
      "Validate iter: 46 begin\n",
      "Validate iter: 46 end\n",
      "Validate iter: 47 begin\n",
      "Validate iter: 47 end\n",
      "Validate iter: 48 begin\n",
      "Validate iter: 48 end\n",
      "Validate iter: 49 begin\n",
      "Validate iter: 49 end\n",
      "Validate iter: 50 begin\n",
      "Validate iter: 50 end\n",
      "Validate iter: 51 begin\n",
      "Validate iter: 51 end\n",
      "Validate iter: 52 begin\n",
      "Validate iter: 52 end\n",
      "Validate iter: 53 begin\n",
      "Validate iter: 53 end\n",
      "Validate iter: 54 begin\n",
      "Validate iter: 54 end\n",
      "Validate iter: 55 begin\n",
      "Validate iter: 55 end\n",
      "Validate iter: 56 begin\n",
      "Validate iter: 56 end\n",
      "Validate iter: 57 begin\n",
      "Validate iter: 57 end\n",
      "Validate iter: 58 begin\n",
      "Validate iter: 58 end\n",
      "Validate iter: 59 begin\n",
      "Validate iter: 59 end\n",
      "Validate iter: 60 begin\n",
      "Validate iter: 60 end\n",
      "Validate iter: 61 begin\n",
      "Validate iter: 61 end\n",
      "Validate iter: 62 begin\n",
      "Validate iter: 62 end\n",
      "Validate iter: 63 begin\n",
      "Validate iter: 63 end\n",
      "Validate iter: 64 begin\n",
      "Validate iter: 64 end\n",
      "Validate iter: 65 begin\n",
      "Validate iter: 65 end\n",
      "Validate iter: 66 begin\n",
      "Validate iter: 66 end\n",
      "Validate iter: 67 begin\n",
      "Validate iter: 67 end\n",
      "Validate iter: 68 begin\n",
      "Validate iter: 68 end\n",
      "Validate iter: 69 begin\n",
      "Validate iter: 69 end\n",
      "Validate iter: 70 begin\n",
      "Validate iter: 70 end\n",
      "Validate iter: 71 begin\n",
      "Validate iter: 71 end\n",
      "Validate iter: 72 begin\n",
      "Validate iter: 72 end\n",
      "Validate iter: 73 begin\n",
      "Validate iter: 73 end\n",
      "Validate iter: 74 begin\n",
      "Validate iter: 74 end\n",
      "Validate iter: 75 begin\n",
      "Validate iter: 75 end\n",
      "Validate iter: 76 begin\n",
      "Validate iter: 76 end\n",
      "Validate iter: 77 begin\n",
      "Validate iter: 77 end\n",
      "Validate iter: 78 begin\n",
      "Validate iter: 78 end\n",
      "Validate iter: 79 begin\n",
      "Validate iter: 79 end\n",
      "Validate iter: 80 begin\n",
      "Validate iter: 80 end\n",
      "Validate iter: 81 begin\n",
      "Validate iter: 81 end\n",
      "Validate iter: 82 begin\n",
      "Validate iter: 82 end\n",
      "Validate iter: 83 begin\n",
      "Validate iter: 83 end\n",
      "Validate iter: 84 begin\n",
      "Validate iter: 84 end\n",
      "Validate iter: 85 begin\n",
      "Validate iter: 85 end\n",
      "Validate iter: 86 begin\n",
      "Validate iter: 86 end\n",
      "Validate iter: 87 begin\n",
      "Validate iter: 87 end\n",
      "Validate iter: 88 begin\n",
      "Validate iter: 88 end\n",
      "Validate iter: 89 begin\n",
      "Validate iter: 89 end\n",
      "Validate iter: 90 begin\n",
      "Validate iter: 90 end\n",
      "Validate iter: 91 begin\n",
      "Validate iter: 91 end\n",
      "Validate iter: 92 begin\n",
      "Validate iter: 92 end\n",
      "Validate iter: 93 begin\n",
      "Validate iter: 93 end\n",
      "Validate iter: 94 begin\n",
      "Validate iter: 94 end\n",
      "Validate iter: 95 begin\n",
      "Validate iter: 95 end\n",
      "Validate iter: 96 begin\n",
      "Validate iter: 96 end\n",
      "Validate iter: 97 begin\n",
      "Validate iter: 97 end\n",
      "Validate iter: 98 begin\n",
      "Validate iter: 98 end\n",
      "Validate iter: 99 begin\n",
      "Validate iter: 99 end\n",
      "Validate iter: 100 begin\n",
      "Validate iter: 100 end\n",
      "Validate iter: 101 begin\n",
      "Validate iter: 101 end\n",
      "Validate iter: 102 begin\n",
      "Validate iter: 102 end\n",
      "Validate iter: 103 begin\n",
      "Validate iter: 103 end\n",
      "Validate iter: 104 begin\n",
      "Validate iter: 104 end\n",
      "Validate iter: 105 begin\n",
      "Validate iter: 105 end\n",
      "Validate iter: 106 begin\n",
      "Validate iter: 106 end\n",
      "Validate iter: 107 begin\n",
      "Validate iter: 107 end\n",
      "Validate iter: 108 begin\n",
      "Validate iter: 108 end\n",
      "Validate iter: 109 begin\n",
      "Validate iter: 109 end\n",
      "Validate iter: 110 begin\n",
      "Validate iter: 110 end\n",
      "Validate iter: 111 begin\n",
      "Validate iter: 111 end\n",
      "Validate iter: 112 begin\n",
      "Validate iter: 112 end\n",
      "Validate iter: 113 begin\n",
      "Validate iter: 113 end\n",
      "Validate iter: 114 begin\n",
      "Validate iter: 114 end\n",
      "Validate iter: 115 begin\n",
      "Validate iter: 115 end\n",
      "Validate iter: 116 begin\n",
      "Validate iter: 116 end\n",
      "Validate iter: 117 begin\n",
      "Validate iter: 117 end\n",
      "Validate iter: 118 begin\n",
      "Validate iter: 118 end\n",
      "Validate iter: 119 begin\n",
      "Validate iter: 119 end\n",
      "Validate iter: 120 begin\n",
      "Validate iter: 120 end\n",
      "Validate iter: 121 begin\n",
      "Validate iter: 121 end\n",
      "Validate iter: 122 begin\n",
      "Validate iter: 122 end\n",
      "Validate iter: 123 begin\n",
      "Validate iter: 123 end\n",
      "Validate iter: 124 begin\n",
      "Validate iter: 124 end\n",
      "Validate iter: 125 begin\n",
      "Validate iter: 125 end\n",
      "Validate iter: 126 begin\n",
      "Validate iter: 126 end\n",
      "Validate iter: 127 begin\n",
      "Validate iter: 127 end\n",
      "Validate iter: 128 begin\n",
      "Validate iter: 128 end\n",
      "Validate iter: 129 begin\n",
      "Validate iter: 129 end\n",
      "Validate iter: 130 begin\n",
      "Validate iter: 130 end\n",
      "Validate iter: 131 begin\n",
      "Validate iter: 131 end\n",
      "Validate iter: 132 begin\n",
      "Validate iter: 132 end\n",
      "Validate iter: 133 begin\n",
      "Validate iter: 133 end\n",
      "Validate iter: 134 begin\n",
      "Validate iter: 134 end\n",
      "Validate iter: 135 begin\n",
      "Validate iter: 135 end\n",
      "Validate iter: 136 begin\n",
      "Validate iter: 136 end\n",
      "Validate iter: 137 begin\n",
      "Validate iter: 137 end\n",
      "Validate iter: 138 begin\n",
      "Validate iter: 138 end\n",
      "Validate iter: 139 begin\n",
      "Validate iter: 139 end\n",
      "Validate iter: 140 begin\n",
      "Validate iter: 140 end\n",
      "Validate iter: 141 begin\n",
      "Validate iter: 141 end\n",
      "Validate iter: 142 begin\n",
      "Validate iter: 142 end\n",
      "Validate iter: 143 begin\n",
      "Validate iter: 143 end\n",
      "Validate iter: 144 begin\n",
      "Validate iter: 144 end\n",
      "Validate iter: 145 begin\n",
      "Validate iter: 145 end\n",
      "Validate iter: 146 begin\n",
      "Validate iter: 146 end\n",
      "Validate iter: 147 begin\n",
      "Validate iter: 147 end\n",
      "Validate iter: 148 begin\n",
      "Validate iter: 148 end\n",
      "Validate iter: 149 begin\n",
      "Validate iter: 149 end\n",
      "Validate iter: 150 begin\n",
      "Validate iter: 150 end\n",
      "Validate iter: 151 begin\n",
      "Validate iter: 151 end\n",
      "Validate iter: 152 begin\n",
      "Validate iter: 152 end\n",
      "Validate iter: 153 begin\n",
      "Validate iter: 153 end\n",
      "Validate iter: 154 begin\n",
      "Validate iter: 154 end\n",
      "Validate iter: 155 begin\n",
      "Validate iter: 155 end\n",
      "Validate iter: 156 begin\n",
      "Validate iter: 156 end\n",
      "Validate iter: 157 begin\n",
      "Validate iter: 157 end\n",
      "Test Loss: 0.006590, Acc: 0.914700\n",
      "Test model end\n",
      "\n",
      "Validate user data begin\n"
     ]
    }
   ],
   "source": [
    "print('Convert image begin')\n",
    "convert_to_img()\n",
    "print('Convert image end')\n",
    "print()\n",
    "print('Train model begin')\n",
    "train(epochcount=20, resume=True)\n",
    "print('Train model end')\n",
    "print()\n",
    "print('Test model begin')\n",
    "test()\n",
    "print('Test model end')\n",
    "print()\n",
    "print('Validate user data begin')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAP8AAAD8CAYAAAC4nHJkAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvIxREBQAAET5JREFUeJzt3W2I3eWZx/HfladJMjFxBk0a00Rj1bhR2HQZ44rL6tJYbKmYIpXmRc1CafqihS30hZI39U1BFvsguBTSNRjB2hZaH9FVkZXsgNTEGKrb1CTorI0zmYmJeZg8J3Pti/lPmeqc6z45//OY+/sBmZlznf+ca475zf+cuf/3fZu7C0B+prW6AQCtQfiBTBF+IFOEH8gU4QcyRfiBTBF+IFOEH8gU4QcyNaOZD2ZmWV5OOH369LB+/vz5sH7NNdeE9dHR0Zq/97lz58L6tGnlzg/Rz556Xvbv3x/Wy1ydamalvnfqeRkbG7vgnurF3eMfrmAln8A7JT0iabqk/3T3hxL3zzL8PT09Yf2TTz4J6y+88EJY7+/vr1g7cuRIeOzHH38c1ufOnRvWU/9+op99/vz54bEPP/xwWD958mRYj3R1dYX106dPh/V58+aF9egXcqNVG/6af62b2XRJ/yHpK5JWSlpnZitr/X4AmqvMa7rVkva6+/vufkbSryXdXZ+2ADRamfAvkfSXSV/vK277G2a2wcy2m9n2Eo8FoM7K/MFvqvcVn3kD6O6bJG2S8n3PD7SjMmf+fZKWTvr685IGy7UDoFnKhH+bpGvNbLmZzZL0TUnP1actAI1Wdqjvq5J+rvGhvs3u/uPE/XnZP4X77rsvrD/++ONh/cSJExVr3d3d4bGp8ejUeHbqOoIzZ85UrM2ZMyc89uqrrw7rAwMDYT36t50a5585c2ZYj36uVqt2qK/URT7u/qKkF8t8DwCtweW9QKYIP5Apwg9kivADmSL8QKYIP5Cpps7nz9WMGfHTfP/994f11NTVDz/8sGJtwYIF4bFDQ0NhPXWdQGq8e9asWRVr119/fXjsbbfdFtZHRkbCejQtN7WOQdS31N7j/NXizA9kivADmSL8QKYIP5Apwg9kivADmSo1pfeCH4wpvVM6depUWB8eHg7r0ZTe1CqzZ8+eDeuzZ88O66kpvQcOHKhYW7hwYXjs4GC8Nszq1avDehmpKb+p56XMysJlNXz1XgCdjfADmSL8QKYIP5Apwg9kivADmSL8QKaY0tsEN998c1hP7RibWkb6sssuq1iLrgGQ0stnp8arU1Nbr7jiipq/d19fX1hP7SAc/eyp5zR1/UNqSnAn4MwPZIrwA5ki/ECmCD+QKcIPZIrwA5ki/ECmSo3zm9mApGOSzks65+7xwGym1q5dG9ZTc+JT4+HR8ceOHQuP7enpCeupeeup+kcffVSxNn/+/PDYaOltKb209yuvvFKxlrq2IjXOn6p3gnpc5PMv7v5xHb4PgCbiZT+QqbLhd0mvmNlbZrahHg0BaI6yL/tvdfdBM1so6VUz+7O7b518h+KXAr8YgDZT6szv7oPFxxFJT0v6zIqK7r7J3fv4YyDQXmoOv5l1m9klE59L+rKkd+vVGIDGKvOyf5Gkp4sljmdI+pW7/1ddugLQcDWH393fl/T3dezlopXaijo1ZlxmDfnUvPXUNQbTpsUvDo8fPx7WL7/88oq11Fh7qr5ixYqw/tJLL1WsjY6Ohsem1jlI7bXQzP0wasVQH5Apwg9kivADmSL8QKYIP5Apwg9kiqW7m2Dx4sVhPTUclxpWGhsbq1i75JJLwmOPHj0a1nt7e8N6SjRUODAwEB6b2sI7NQw5a9asirXUkuOp4dVOGMpL4cwPZIrwA5ki/ECmCD+QKcIPZIrwA5ki/ECmGOdvgtSYcGp57dT00nnz5tX8vRctWhTWU+PhqZ8tGi/v7u4Oj00tWX7llVeG9VTvkdS1FRcDzvxApgg/kCnCD2SK8AOZIvxApgg/kCnCD2SKcf4mKLsddNnrBCJHjhwJ66ktuMtss112eexUbzNmVP7nfe7cufDY6dOnh/VoDYVOwZkfyBThBzJF+IFMEX4gU4QfyBThBzJF+IFMJcf5zWyzpK9JGnH3G4vbeiX9RtJVkgYk3evunzSuzc528ODBsJ7aajo13h1dJ5Aah9+9e3dY7+npCevLli0L69E1CNE4fDVS24NH1wGktujOQTVn/scl3fmp2x6Q9Jq7XyvpteJrAB0kGX533yrp0KduvlvSluLzLZLW1rkvAA1W63v+Re4+JEnFx3hfJQBtp+HX9pvZBkkbGv04AC5MrWf+YTNbLEnFx5FKd3T3Te7e5+59NT4WgAaoNfzPSVpffL5e0rP1aQdAsyTDb2ZPSXpD0goz22dm35b0kKQ7zGyPpDuKrwF0kOR7fndfV6H0pTr3ctF65plnwvqaNWvC+uDgYFiP9qG/9NJLw2P37NkT1nt7e8P6ddddF9bLrJ2fukZh165dYT01Zz+SWmPhYsAVfkCmCD+QKcIPZIrwA5ki/ECmCD+QKZbuboInn3wyrD/66KNhPTV1NZoam5o2+/bbb4f11FDhXXfdFdYjqeG01PLZb775ZljPYZvtMjjzA5ki/ECmCD+QKcIPZIrwA5ki/ECmCD+QKcb5m+Dw4cNhPTXenZraGm3hnZrWumPHjrDe3d0d1lNSY/WRaHtvKb3sOGKc+YFMEX4gU4QfyBThBzJF+IFMEX4gU4QfyBTj/E0wc+bMsN7f3x/WV69eHdaHh4cvuKcJH3zwQVhP9Z4ybVrl80tXV1d47LZt28L6yZMna+qpGtFy6FK5JcnbBWd+IFOEH8gU4QcyRfiBTBF+IFOEH8gU4QcylRznN7PNkr4macTdbyxue1DSdyQdKO620d1fbFSTne78+fNh/fnnnw/rt9xyS1iP1qdPzac/ceJEWI/G6asxNjZWsZYaS0/tKZAS/eyp/ydl1iHoFNX8n31c0p1T3P4zd19V/EfwgQ6TDL+7b5V0qAm9AGiiMq/pvm9mfzSzzWbWU7eOADRFreH/haQvSFolaUjSTyrd0cw2mNl2M9te42MBaICawu/uw+5+3t3HJP1SUsWZJ+6+yd373L2v1iYB1F9N4TezxZO+/Lqkd+vTDoBmqWao7ylJt0u6zMz2SfqRpNvNbJUklzQg6bsN7BFAAyTD7+7rprj5sQb0ctFKzYk/duxYWE+Nh8+dO/eCe5pw/PjxsJ7qPdozQJJmz55dsWZm4bGDg4NhfcaM+J9vas+CSGq+fuo6gNR1BO2AK/yATBF+IFOEH8gU4QcyRfiBTBF+IFMs3d0EZbfgHh0dDetlpq6mtsFODeWlRFOCU0NxCxYsCOtlhvJSUj932eelHXDmBzJF+IFMEX4gU4QfyBThBzJF+IFMEX4gU4zzN0G0fLUk3XDDDaW+fzQ19tChcmuvpq4TOHjwYFiPpt2mxumXLFkS1lOi5yW1JHknTMktizM/kCnCD2SK8AOZIvxApgg/kCnCD2SK8AOZYpy/DaxatSqsp5aojq4j2Lt3b009TUjNW9+zZ09YX7FiRcVa6vqHZcuWhfWUstuLR1LLjnfCfH/O/ECmCD+QKcIPZIrwA5ki/ECmCD+QKcIPZCo5zm9mSyU9IelzksYkbXL3R8ysV9JvJF0laUDSve7+SeNavXj19PSE9ZMnT4b1rq6uirXdu3fX1NOE1Hj2/v37w/rKlSsr1lLbf/f29ob1lKj3smv+p7bobuSeAvVSzZn/nKQfuvvfSfpHSd8zs5WSHpD0mrtfK+m14msAHSIZfncfcvcdxefHJO2StETS3ZK2FHfbImlto5oEUH8X9J7fzK6S9EVJf5C0yN2HpPFfEJIW1rs5AI1T9bX9ZjZP0u8k/cDdj6beC046boOkDbW1B6BRqjrzm9lMjQf/SXf/fXHzsJktLuqLJY1Mday7b3L3Pnfvq0fDAOojGX4bP8U/JmmXu/90Uuk5SeuLz9dLerb+7QFolGpe9t8q6VuS3jGzncVtGyU9JOm3ZvZtSR9K+kZjWux8qSm5qWWiT5w4EdYXLqz855ayU3pTw3GHDx8O6xfr8tnVvu1tZ8nwu3u/pEo/6Zfq2w6AZuEKPyBThB/IFOEHMkX4gUwRfiBThB/IFEt3N0HZZZxT1wmcOnWqYu2NN94o9dgpO3bsCOv33HNPxVpq6e4DBw7U1NOERi7dneq9E3DmBzJF+IFMEX4gU4QfyBThBzJF+IFMEX4gU4zzN0FqXnpqzvzs2bPD+tDQUMVaf39/eGxKdA2BJG3dujWsR9c4pJa3PnToUFhPiebcp5beTo3jM84PoGMRfiBThB/IFOEHMkX4gUwRfiBThB/IFOP8TZCaj//ee++F9ZtuuimsR+PhjV77PjXn/vTp0xVrqfn2O3fuDOupsfrosefMmRMem9oW/WLAmR/IFOEHMkX4gUwRfiBThB/IFOEHMkX4gUwlx/nNbKmkJyR9TtKYpE3u/oiZPSjpO5ImBno3uvuLjWq0k6XmrafmhqfGw6Ox9tQ4f2qf+dSeA9FaApJ0/PjxirWenp7w2AULFoT1MtcwpJ7Trq6usB5dQ9ApqrnI55ykH7r7DjO7RNJbZvZqUfuZuz/cuPYANEoy/O4+JGmo+PyYme2StKTRjQForAt6z29mV0n6oqQ/FDd938z+aGabzWzK13BmtsHMtpvZ9lKdAqirqsNvZvMk/U7SD9z9qKRfSPqCpFUaf2Xwk6mOc/dN7t7n7n116BdAnVQVfjObqfHgP+nuv5ckdx929/PuPibpl5JWN65NAPWWDL+N/zn4MUm73P2nk25fPOluX5f0bv3bA9Ao1fy1/1ZJ35L0jplNzLHcKGmdma2S5JIGJH23IR1eBJYuXRrWFy5cGNZTQ15nz56tWEst+51amjs15JVadvzIkSMVa8uXLw+PXbNmTVh//fXXw/rLL79csRYNQUrp6cIXg2r+2t8vaarBYMb0gQ7GFX5Apgg/kCnCD2SK8AOZIvxApgg/kClLTdms64OZNe/BOkhqvPvgwYNhPRqzTk17TV1DkFrC+syZM2E9uoYhNaU3NW123759YT01lTpSdqpzK7l73HyBMz+QKcIPZIrwA5ki/ECmCD+QKcIPZIrwA5lq9jj/AUn/N+mmyyR93LQGLky79taufUn0Vqt69nalu19ezR2bGv7PPLjZ9nZd269de2vXviR6q1WreuNlP5Apwg9kqtXh39Tix4+0a2/t2pdEb7VqSW8tfc8PoHVafeYH0CItCb+Z3Wlm75nZXjN7oBU9VGJmA2b2jpntbPUWY8U2aCNm9u6k23rN7FUz21N8jOfFNre3B83so+K522lmX21Rb0vN7L/NbJeZ/a+Z/Vtxe0ufu6CvljxvTX/Zb2bTJe2WdIekfZK2SVrn7n9qaiMVmNmApD53b/mYsJn9s6RRSU+4+43Fbf8u6ZC7P1T84uxx9/vbpLcHJY22eufmYkOZxZN3lpa0VtK/qoXPXdDXvWrB89aKM/9qSXvd/X13PyPp15LubkEfbc/dt0o69Kmb75a0pfh8i8b/8TRdhd7agrsPufuO4vNjkiZ2lm7pcxf01RKtCP8SSX+Z9PU+tdeW3y7pFTN7y8w2tLqZKSwqtk2f2D493u6n+ZI7NzfTp3aWbpvnrpYdr+utFeGfaomhdhpyuNXd/0HSVyR9r3h5i+pUtXNzs0yxs3RbqHXH63prRfj3SZq8ed3nJQ22oI8puftg8XFE0tNqv92Hhyc2SS0+jrS4n79qp52bp9pZWm3w3LXTjtetCP82Sdea2XIzmyXpm5Kea0Efn2Fm3cUfYmRm3ZK+rPbbffg5SeuLz9dLeraFvfyNdtm5udLO0mrxc9duO1635CKfYijj55KmS9rs7j9uehNTMLOrNX62l8Y3Mf1VK3szs6ck3a7xWV/Dkn4k6RlJv5W0TNKHkr7h7k3/w1uF3m7X+EvXv+7cPPEeu8m9/ZOk/5H0jqSx4uaNGn9/3bLnLuhrnVrwvHGFH5AprvADMkX4gUwRfiBThB/IFOEHMkX4gUwRfiBThB/I1P8DvWORHjrqsgMAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "load image file: ./pytorchdata_fashionmnist/train/80.jpg, category: 1 success\n",
      "Loading best model: ./pytorchdata_fashionmnist/model\\fashionmnist.pt begin\n",
      "Loading best model end, epoch is 10, training accuracy is 0.9507333333333333\n",
      "Shape before Transorm: torch.Size([3, 28, 28])\n",
      "Channel: 3, Width: 28, Height: 28\n",
      "Shape after Transorm: torch.Size([1, 3, 28, 28])\n",
      "tensor([1], device='cuda:0') 1\n",
      "Validate user data end\n"
     ]
    }
   ],
   "source": [
    "validateuserdata()\n",
    "print('Validate user data end')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.7"
  },
  "toc": {
   "base_numbering": 1,
   "nav_menu": {},
   "number_sections": true,
   "sideBar": true,
   "skip_h1_title": false,
   "title_cell": "Table of Contents",
   "title_sidebar": "Contents",
   "toc_cell": false,
   "toc_position": {},
   "toc_section_display": true,
   "toc_window_display": false
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}