DeepLearningClassifier does not work while default classifier works for digits dataset

[stanleywang88]

HI Rocks:
Good morning. I'm sorry that I met a issue, and after some investigating, I still don't know why default classifier works well but DeepLearingClassier failed to converge during training.
The full code and log as below.
Thank you!
Best wishes!
Stanley
#python code begin

from auto_ml import Predictor
import os
import numpy as np
import pandas as pd
from sklearn.datasets import load_digits
from sklearn.model_selection import train_test_split
from PIL import Image

column_descriptions = {
'lable': 'output'
}
digits = load_digits()
df_dataset = pd.DataFrame(digits.data)
df_dataset['lable'] = digits['target']
df_train,df_test = train_test_split(df_dataset, test_size=0.2, random_state=42)
#ml_predictor = Predictor(type_of_estimator='DeepLearningClassifier', column_descriptions=column_descriptions)
ml_predictor = Predictor(type_of_estimator='classifier', column_descriptions=column_descriptions)
ml_predictor.train(df_train,model_names='DeepLearningClassifier')
#ml_predictor.train(df_train)
ml_predictor.score(df_test, df_test.lable)
#ml_predictor.predict(df_test)
#ml_predictor.save('output.dill')

#python code end

#error log for Deep Learning begin
python stanley_auto_ml.py
/home/stanley/.local/lib/python2.7/site-packages/pandas/_libs/init.py:4: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .tslib import iNaT, NaT, Timestamp, Timedelta, OutOfBoundsDatetime
/home/stanley/.local/lib/python2.7/site-packages/pandas/init.py:26: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import (hashtable as _hashtable,
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/dtypes/common.py:6: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import algos, lib
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/util/hashing.py:7: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import hashing, tslib
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/indexes/base.py:7: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import (lib, index as libindex, tslib as libts,
/home/stanley/.local/lib/python2.7/site-packages/pandas/tseries/offsets.py:21: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
import pandas._libs.tslibs.offsets as liboffsets
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/ops.py:16: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import algos as libalgos, ops as libops
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/indexes/interval.py:32: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs.interval import (
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/internals.py:14: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import internals as libinternals
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/sparse/array.py:33: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
import pandas._libs.sparse as splib
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/window.py:36: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
import pandas._libs.window as _window
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/groupby/groupby.py:68: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import (lib, reduction,
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/reshape/reshape.py:30: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import algos as _algos, reshape as _reshape
/home/stanley/.local/lib/python2.7/site-packages/pandas/io/parsers.py:45: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
import pandas._libs.parsers as parsers
/home/stanley/.local/lib/python2.7/site-packages/pandas/io/pytables.py:50: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import algos, lib, writers as libwriters
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/lil.py:19: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _csparsetools
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/csgraph/init.py:165: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._shortest_path import shortest_path, floyd_warshall, dijkstra,
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/csgraph/_validation.py:5: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._tools import csgraph_to_dense, csgraph_from_dense,
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/csgraph/init.py:167: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._traversal import breadth_first_order, depth_first_order,
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/csgraph/init.py:169: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._min_spanning_tree import minimum_spanning_tree
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/csgraph/init.py:170: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._reordering import reverse_cuthill_mckee, maximum_bipartite_matching,
/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/init.py:9: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .murmurhash import murmurhash3_32
/home/stanley/.local/lib/python2.7/site-packages/scipy/linalg/basic.py:17: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._solve_toeplitz import levinson
/home/stanley/.local/lib/python2.7/site-packages/scipy/linalg/init.py:207: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._decomp_update import *
/home/stanley/.local/lib/python2.7/site-packages/scipy/special/init.py:640: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._ufuncs import *
/home/stanley/.local/lib/python2.7/site-packages/scipy/special/_ellip_harm.py:7: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._ellip_harm_2 import _ellipsoid, _ellipsoid_norm
/home/stanley/.local/lib/python2.7/site-packages/scipy/optimize/_trlib/init.py:1: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._trlib import TRLIBQuadraticSubproblem
/home/stanley/.local/lib/python2.7/site-packages/scipy/optimize/_numdiff.py:10: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._group_columns import group_dense, group_sparse
/home/stanley/.local/lib/python2.7/site-packages/scipy/interpolate/_bsplines.py:10: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _bspl
/home/stanley/.local/lib/python2.7/site-packages/scipy/spatial/init.py:95: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .ckdtree import *
/home/stanley/.local/lib/python2.7/site-packages/scipy/spatial/init.py:96: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .qhull import *
/home/stanley/.local/lib/python2.7/site-packages/scipy/spatial/_spherical_voronoi.py:18: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _voronoi
/home/stanley/.local/lib/python2.7/site-packages/scipy/spatial/distance.py:122: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _hausdorff
/home/stanley/.local/lib/python2.7/site-packages/scipy/stats/_continuous_distns.py:18: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _stats
/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/extmath.py:24: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._logistic_sigmoid import _log_logistic_sigmoid
/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/extmath.py:26: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .sparsefuncs_fast import csr_row_norms
/home/stanley/.local/lib/python2.7/site-packages/sklearn/isotonic.py:12: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._isotonic import _inplace_contiguous_isotonic_regression, _make_unique
/home/stanley/.local/lib/python2.7/site-packages/sklearn/svm/base.py:8: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import libsvm, liblinear
/home/stanley/.local/lib/python2.7/site-packages/sklearn/svm/base.py:9: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import libsvm_sparse
/home/stanley/.local/lib/python2.7/site-packages/sklearn/linear_model/base.py:35: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ..utils.seq_dataset import ArrayDataset, CSRDataset
/home/stanley/.local/lib/python2.7/site-packages/sklearn/linear_model/least_angle.py:23: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ..utils import arrayfuncs, as_float_array, check_X_y, deprecated
/home/stanley/.local/lib/python2.7/site-packages/sklearn/metrics/cluster/supervised.py:23: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .expected_mutual_info_fast import expected_mutual_information
/home/stanley/.local/lib/python2.7/site-packages/sklearn/metrics/pairwise.py:30: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .pairwise_fast import _chi2_kernel_fast, _sparse_manhattan
/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/random.py:10: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._random import sample_without_replacement
/home/stanley/.local/lib/python2.7/site-packages/sklearn/linear_model/coordinate_descent.py:29: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import cd_fast
/home/stanley/.local/lib/python2.7/site-packages/sklearn/linear_model/init.py:22: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .sgd_fast import Hinge, Log, ModifiedHuber, SquaredLoss, Huber
/home/stanley/.local/lib/python2.7/site-packages/sklearn/linear_model/sag.py:12: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .sag_fast import sag
/home/stanley/.local/lib/python2.7/site-packages/sklearn/neighbors/init.py:6: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .ball_tree import BallTree
/home/stanley/.local/lib/python2.7/site-packages/sklearn/neighbors/init.py:7: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .kd_tree import KDTree
/home/stanley/.local/lib/python2.7/site-packages/sklearn/feature_extraction/hashing.py:10: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _hashing
/home/stanley/.local/lib/python2.7/site-packages/scipy/io/matlab/mio4.py:18: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .mio_utils import squeeze_element, chars_to_strings
/home/stanley/.local/lib/python2.7/site-packages/scipy/io/matlab/mio5.py:98: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .mio5_utils import VarReader5
/home/stanley/.local/lib/python2.7/site-packages/sklearn/datasets/svmlight_format.py:25: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._svmlight_format import _load_svmlight_file
/home/stanley/.local/lib/python2.7/site-packages/sklearn/tree/tree.py:40: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._criterion import Criterion
/home/stanley/.local/lib/python2.7/site-packages/sklearn/ensemble/gradient_boosting.py:34: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._gradient_boosting import predict_stages
/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/graph.py:15: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .graph_shortest_path import graph_shortest_path # noqa
/home/stanley/.local/lib/python2.7/site-packages/sklearn/decomposition/online_lda.py:28: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._online_lda import (mean_change, _dirichlet_expectation_1d,
/home/stanley/.local/lib/python2.7/site-packages/sklearn/manifold/t_sne.py:24: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _utils
/home/stanley/.local/lib/python2.7/site-packages/sklearn/manifold/t_sne.py:25: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import barnes_hut_tsne
/home/stanley/.local/lib/python2.7/site-packages/sklearn/cluster/k_means.py:35: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import k_means
/home/stanley/.local/lib/python2.7/site-packages/sklearn/cluster/k_means.py:36: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._k_means_elkan import k_means_elkan
/home/stanley/.local/lib/python2.7/site-packages/sklearn/cluster/hierarchical.py:23: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import hierarchical
/home/stanley/.local/lib/python2.7/site-packages/sklearn/cluster/dbscan.py:19: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._dbscan_inner import dbscan_inner
Welcome to auto_ml! We're about to go through and make sense of your data using machine learning, and give you a production-ready pipeline to get predictions with.

If you have any issues, or new feature ideas, let us know at http://auto.ml
You are running on version 2.9.10
Now using the model training_params that you passed in:
{}
After overwriting our defaults with your values, here are the final params that will be used to initialize the model:
{'epochs': 1000, 'verbose': 2, 'batch_size': 50}
/home/stanley/.local/lib/python2.7/site-packages/h5py/init.py:36: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._conv import register_converters as _register_converters
/home/stanley/.local/lib/python2.7/site-packages/h5py/init.py:45: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import h5a, h5d, h5ds, h5f, h5fd, h5g, h5r, h5s, h5t, h5p, h5z
/home/stanley/.local/lib/python2.7/site-packages/h5py/_hl/group.py:22: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .. import h5g, h5i, h5o, h5r, h5t, h5l, h5p
/home/stanley/.local/lib/python2.7/site-packages/scipy/ndimage/measurements.py:36: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _ni_label
Using TensorFlow backend.
Running basic data cleaning
Performing feature scaling
Fitting DataFrameVectorizer
Now using the model training_params that you passed in:
{}
After overwriting our defaults with your values, here are the final params that will be used to initialize the model:
{'epochs': 1000, 'verbose': 2, 'batch_size': 50}

---

About to fit the pipeline for the model DeepLearningClassifier to predict lable
Started at:
2018-08-01 03:07:57

We will stop training early if we have not seen an improvement in validation accuracy in 25 epochs
To measure validation accuracy, we will split off a random 10 percent of your training data set
Train on 1221 samples, validate on 216 samples
Epoch 1/1000

• 1s - loss: -3.9086e+00 - acc: 0.1147 - poisson: 2.5561 - val_loss: -3.4604e+01 - val_acc: 0.0787 - val_poisson: 1.0005
  Epoch 2/1000
• 0s - loss: -5.2466e+01 - acc: 0.1122 - poisson: 1.0000 - val_loss: -5.9516e+01 - val_acc: 0.0787 - val_poisson: 1.0000
  Epoch 3/1000
• 0s - loss: -5.4312e+01 - acc: 0.1122 - poisson: 1.0000 - val_loss: -5.9521e+01 - val_acc: 0.0787 - val_poisson: 1.0000
  Epoch 4/1000
• 0s - loss: -5.4261e+01 - acc: 0.1122 - poisson: 1.0000 - val_loss: -5.9524e+01 - val_acc: 0.0787 - val_poisson: 1.0000
  Epoch 5/1000
• 0s - loss: -5.4320e+01 - acc: 0.1122 - poisson: 1.0000 - val_loss: -5.9528e+01 - val_acc: 0.0787 - val_poisson: 1.0000
  Epoch 6/1000
• 0s - loss: -5.4308e+01 - acc: 0.1122 - poisson: 1.0000 - val_loss: -5.9535e+01 - val_acc: 0.0787 - val_poisson: 1.0000
  Epoch 7/1000
• 0s - loss: -5.4321e+01 - acc: 0.1122 - poisson: 1.0000 - val_loss: -5.9595e+01 - val_acc: 0.0787 - val_poisson: 1.0000
  Epoch 8/1000
• 0s - loss: -5.4551e+01 - acc: 0.1122 - poisson: 0.9997 - val_loss: -5.9934e+01 - val_acc: 0.0787 - val_poisson: 1.0000
  Epoch 9/1000
• 0s - loss: -5.5219e+01 - acc: 0.1433 - poisson: 0.9730 - val_loss: -6.0875e+01 - val_acc: 0.1759 - val_poisson: 0.9171
  Epoch 10/1000
• 0s - loss: -5.5400e+01 - acc: 0.1957 - poisson: 0.9257 - val_loss: -6.0912e+01 - val_acc: 0.1759 - val_poisson: 0.9082
  Epoch 11/1000
• 0s - loss: -5.5678e+01 - acc: 0.2015 - poisson: 0.9153 - val_loss: -6.0692e+01 - val_acc: 0.1806 - val_poisson: 0.9309
  Epoch 12/1000
• 0s - loss: -5.5694e+01 - acc: 0.2007 - poisson: 0.9119 - val_loss: -6.0994e+01 - val_acc: 0.1806 - val_poisson: 0.8997
  Epoch 13/1000
• 0s - loss: -5.5812e+01 - acc: 0.2064 - poisson: 0.9068 - val_loss: -6.0928e+01 - val_acc: 0.1806 - val_poisson: 0.8989
  Epoch 14/1000
• 0s - loss: -5.5778e+01 - acc: 0.2097 - poisson: 0.9041 - val_loss: -6.0995e+01 - val_acc: 0.1806 - val_poisson: 0.9009
  Epoch 15/1000
• 0s - loss: -5.5684e+01 - acc: 0.2072 - poisson: 0.9057 - val_loss: -6.1057e+01 - val_acc: 0.1759 - val_poisson: 0.9031
  Epoch 16/1000
• 0s - loss: -5.5792e+01 - acc: 0.2097 - poisson: 0.9031 - val_loss: -6.0963e+01 - val_acc: 0.1806 - val_poisson: 0.8990
  Epoch 17/1000
• 0s - loss: -5.5757e+01 - acc: 0.2088 - poisson: 0.9039 - val_loss: -6.0977e+01 - val_acc: 0.1806 - val_poisson: 0.9001
  Epoch 18/1000
• 0s - loss: -5.5807e+01 - acc: 0.2097 - poisson: 0.9031 - val_loss: -6.1030e+01 - val_acc: 0.1759 - val_poisson: 0.9021
  Epoch 19/1000
• 0s - loss: -5.5758e+01 - acc: 0.2097 - poisson: 0.9032 - val_loss: -6.0967e+01 - val_acc: 0.1806 - val_poisson: 0.8995
  Epoch 20/1000
• 0s - loss: -5.5840e+01 - acc: 0.2097 - poisson: 0.9036 - val_loss: -6.1020e+01 - val_acc: 0.1806 - val_poisson: 0.8993
  Epoch 21/1000
• 0s - loss: -5.5856e+01 - acc: 0.2072 - poisson: 0.9043 - val_loss: -6.1030e+01 - val_acc: 0.1759 - val_poisson: 0.9021
  Epoch 22/1000
• 0s - loss: -5.5822e+01 - acc: 0.2097 - poisson: 0.9031 - val_loss: -6.0889e+01 - val_acc: 0.1806 - val_poisson: 0.9001
  Epoch 23/1000
• 0s - loss: -5.5824e+01 - acc: 0.2105 - poisson: 0.9024 - val_loss: -6.0879e+01 - val_acc: 0.1759 - val_poisson: 0.9011
  Epoch 24/1000
• 0s - loss: -5.5861e+01 - acc: 0.2097 - poisson: 0.9033 - val_loss: -6.0777e+01 - val_acc: 0.1806 - val_poisson: 0.8998
  Epoch 25/1000
• 0s - loss: -5.5849e+01 - acc: 0.2088 - poisson: 0.9034 - val_loss: -6.0899e+01 - val_acc: 0.1806 - val_poisson: 0.9006
  Epoch 26/1000
• 0s - loss: -5.5847e+01 - acc: 0.2088 - poisson: 0.9033 - val_loss: -6.0847e+01 - val_acc: 0.1806 - val_poisson: 0.8993
  Epoch 27/1000
• 0s - loss: -5.5871e+01 - acc: 0.2097 - poisson: 0.9025 - val_loss: -6.0812e+01 - val_acc: 0.1806 - val_poisson: 0.8993
  Epoch 28/1000
• 0s - loss: -5.5850e+01 - acc: 0.2097 - poisson: 0.9031 - val_loss: -6.1007e+01 - val_acc: 0.1759 - val_poisson: 0.9025
  Epoch 29/1000
• 0s - loss: -5.5869e+01 - acc: 0.2097 - poisson: 0.9038 - val_loss: -6.0891e+01 - val_acc: 0.1806 - val_poisson: 0.8994
  Epoch 30/1000
• 0s - loss: -5.5854e+01 - acc: 0.2105 - poisson: 0.9018 - val_loss: -6.0920e+01 - val_acc: 0.1759 - val_poisson: 0.9013
  Epoch 31/1000
• 0s - loss: -5.5868e+01 - acc: 0.2097 - poisson: 0.9026 - val_loss: -6.0976e+01 - val_acc: 0.1759 - val_poisson: 0.9024
  Epoch 32/1000
• 0s - loss: -5.5874e+01 - acc: 0.2113 - poisson: 0.9016 - val_loss: -6.0884e+01 - val_acc: 0.1759 - val_poisson: 0.9011
  Epoch 33/1000
• 0s - loss: -5.5866e+01 - acc: 0.2105 - poisson: 0.9021 - val_loss: -6.0895e+01 - val_acc: 0.1759 - val_poisson: 0.9024
  Epoch 34/1000
• 0s - loss: -5.5874e+01 - acc: 0.2105 - poisson: 0.9026 - val_loss: -6.0990e+01 - val_acc: 0.1759 - val_poisson: 0.9028
  Epoch 35/1000
• 0s - loss: -5.5878e+01 - acc: 0.2105 - poisson: 0.9031 - val_loss: -6.0889e+01 - val_acc: 0.1759 - val_poisson: 0.9020
  Epoch 36/1000
• 0s - loss: -5.5883e+01 - acc: 0.2097 - poisson: 0.9027 - val_loss: -6.0912e+01 - val_acc: 0.1759 - val_poisson: 0.9018
  Epoch 37/1000
• 0s - loss: -5.5884e+01 - acc: 0.2105 - poisson: 0.9023 - val_loss: -6.0930e+01 - val_acc: 0.1759 - val_poisson: 0.9017
  Epoch 38/1000
• 0s - loss: -5.5835e+01 - acc: 0.2097 - poisson: 0.9027 - val_loss: -6.0907e+01 - val_acc: 0.1759 - val_poisson: 0.9008
  Epoch 39/1000
• 0s - loss: -5.5894e+01 - acc: 0.2105 - poisson: 0.9024 - val_loss: -6.0671e+01 - val_acc: 0.1806 - val_poisson: 0.9073
  Epoch 40/1000
• 0s - loss: -5.5888e+01 - acc: 0.2097 - poisson: 0.9023 - val_loss: -6.0811e+01 - val_acc: 0.1806 - val_poisson: 0.8993
  Epoch 00040: early stopping
  Finished training the pipeline!
  Total training time:
  0:00:11
  Calculating feature responses, for advanced analytics.
  Traceback (most recent call last):
  File "stanley_auto_ml.py", line 20, in
  ml_predictor.score(df_test, df_test.lable)
  File "/home/stanley/Projects/auto_ml/auto_ml/auto_ml/predictor.py", line 1758, in score
  return self.trained_pipeline.score(X_test, y_test)
  File "/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/metaestimators.py", line 115, in
  out = lambda *args, **kwargs: self.fn(obj, *args, **kwargs)
  File "/home/stanley/.local/lib/python2.7/site-packages/sklearn/pipeline.py", line 490, in score
  return self.steps[-1][-1].score(Xt, y, **score_params)
  File "/home/stanley/Projects/auto_ml/auto_ml/auto_ml/utils_model_training.py", line 447, in score
  return self.model.score(X, y)
  AttributeError: 'Sequential' object has no attribute 'score'

#error log for Deep Learning end

#log for default classifier begin, as code change to ml_predictor.train(df_train)

home/stanley/.local/lib/python2.7/site-packages/pandas/_libs/init.py:4: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .tslib import iNaT, NaT, Timestamp, Timedelta, OutOfBoundsDatetime
/home/stanley/.local/lib/python2.7/site-packages/pandas/init.py:26: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import (hashtable as _hashtable,
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/dtypes/common.py:6: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import algos, lib
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/util/hashing.py:7: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import hashing, tslib
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/indexes/base.py:7: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import (lib, index as libindex, tslib as libts,
/home/stanley/.local/lib/python2.7/site-packages/pandas/tseries/offsets.py:21: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
import pandas._libs.tslibs.offsets as liboffsets
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/ops.py:16: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import algos as libalgos, ops as libops
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/indexes/interval.py:32: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs.interval import (
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/internals.py:14: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import internals as libinternals
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/sparse/array.py:33: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
import pandas._libs.sparse as splib
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/window.py:36: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
import pandas._libs.window as _window
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/groupby/groupby.py:68: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import (lib, reduction,
/home/stanley/.local/lib/python2.7/site-packages/pandas/core/reshape/reshape.py:30: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import algos as _algos, reshape as _reshape
/home/stanley/.local/lib/python2.7/site-packages/pandas/io/parsers.py:45: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
import pandas._libs.parsers as parsers
/home/stanley/.local/lib/python2.7/site-packages/pandas/io/pytables.py:50: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from pandas._libs import algos, lib, writers as libwriters
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/lil.py:19: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _csparsetools
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/csgraph/init.py:165: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._shortest_path import shortest_path, floyd_warshall, dijkstra,
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/csgraph/_validation.py:5: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._tools import csgraph_to_dense, csgraph_from_dense,
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/csgraph/init.py:167: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._traversal import breadth_first_order, depth_first_order,
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/csgraph/init.py:169: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._min_spanning_tree import minimum_spanning_tree
/home/stanley/.local/lib/python2.7/site-packages/scipy/sparse/csgraph/init.py:170: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._reordering import reverse_cuthill_mckee, maximum_bipartite_matching,
/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/init.py:9: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .murmurhash import murmurhash3_32
/home/stanley/.local/lib/python2.7/site-packages/scipy/linalg/basic.py:17: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._solve_toeplitz import levinson
/home/stanley/.local/lib/python2.7/site-packages/scipy/linalg/init.py:207: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._decomp_update import *
/home/stanley/.local/lib/python2.7/site-packages/scipy/special/init.py:640: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._ufuncs import *
/home/stanley/.local/lib/python2.7/site-packages/scipy/special/_ellip_harm.py:7: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._ellip_harm_2 import _ellipsoid, _ellipsoid_norm
/home/stanley/.local/lib/python2.7/site-packages/scipy/optimize/_trlib/init.py:1: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._trlib import TRLIBQuadraticSubproblem
/home/stanley/.local/lib/python2.7/site-packages/scipy/optimize/_numdiff.py:10: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._group_columns import group_dense, group_sparse
/home/stanley/.local/lib/python2.7/site-packages/scipy/interpolate/_bsplines.py:10: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _bspl
/home/stanley/.local/lib/python2.7/site-packages/scipy/spatial/init.py:95: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .ckdtree import *
/home/stanley/.local/lib/python2.7/site-packages/scipy/spatial/init.py:96: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .qhull import *
/home/stanley/.local/lib/python2.7/site-packages/scipy/spatial/_spherical_voronoi.py:18: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _voronoi
/home/stanley/.local/lib/python2.7/site-packages/scipy/spatial/distance.py:122: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _hausdorff
/home/stanley/.local/lib/python2.7/site-packages/scipy/stats/_continuous_distns.py:18: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _stats
/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/extmath.py:24: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._logistic_sigmoid import _log_logistic_sigmoid
/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/extmath.py:26: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .sparsefuncs_fast import csr_row_norms
/home/stanley/.local/lib/python2.7/site-packages/sklearn/isotonic.py:12: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._isotonic import _inplace_contiguous_isotonic_regression, _make_unique
/home/stanley/.local/lib/python2.7/site-packages/sklearn/svm/base.py:8: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import libsvm, liblinear
/home/stanley/.local/lib/python2.7/site-packages/sklearn/svm/base.py:9: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import libsvm_sparse
/home/stanley/.local/lib/python2.7/site-packages/sklearn/linear_model/base.py:35: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ..utils.seq_dataset import ArrayDataset, CSRDataset
/home/stanley/.local/lib/python2.7/site-packages/sklearn/linear_model/least_angle.py:23: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ..utils import arrayfuncs, as_float_array, check_X_y, deprecated
/home/stanley/.local/lib/python2.7/site-packages/sklearn/metrics/cluster/supervised.py:23: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .expected_mutual_info_fast import expected_mutual_information
/home/stanley/.local/lib/python2.7/site-packages/sklearn/metrics/pairwise.py:30: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .pairwise_fast import _chi2_kernel_fast, _sparse_manhattan
/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/random.py:10: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._random import sample_without_replacement
/home/stanley/.local/lib/python2.7/site-packages/sklearn/linear_model/coordinate_descent.py:29: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import cd_fast
/home/stanley/.local/lib/python2.7/site-packages/sklearn/linear_model/init.py:22: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .sgd_fast import Hinge, Log, ModifiedHuber, SquaredLoss, Huber
/home/stanley/.local/lib/python2.7/site-packages/sklearn/linear_model/sag.py:12: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .sag_fast import sag
/home/stanley/.local/lib/python2.7/site-packages/sklearn/neighbors/init.py:6: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .ball_tree import BallTree
/home/stanley/.local/lib/python2.7/site-packages/sklearn/neighbors/init.py:7: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .kd_tree import KDTree
/home/stanley/.local/lib/python2.7/site-packages/sklearn/feature_extraction/hashing.py:10: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _hashing
/home/stanley/.local/lib/python2.7/site-packages/scipy/io/matlab/mio4.py:18: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .mio_utils import squeeze_element, chars_to_strings
/home/stanley/.local/lib/python2.7/site-packages/scipy/io/matlab/mio5.py:98: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .mio5_utils import VarReader5
/home/stanley/.local/lib/python2.7/site-packages/sklearn/datasets/svmlight_format.py:25: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._svmlight_format import _load_svmlight_file
/home/stanley/.local/lib/python2.7/site-packages/sklearn/tree/tree.py:40: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._criterion import Criterion
/home/stanley/.local/lib/python2.7/site-packages/sklearn/ensemble/gradient_boosting.py:34: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._gradient_boosting import predict_stages
/home/stanley/.local/lib/python2.7/site-packages/sklearn/utils/graph.py:15: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from .graph_shortest_path import graph_shortest_path # noqa
/home/stanley/.local/lib/python2.7/site-packages/sklearn/decomposition/online_lda.py:28: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._online_lda import (mean_change, _dirichlet_expectation_1d,
/home/stanley/.local/lib/python2.7/site-packages/sklearn/manifold/t_sne.py:24: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import _utils
/home/stanley/.local/lib/python2.7/site-packages/sklearn/manifold/t_sne.py:25: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import barnes_hut_tsne
/home/stanley/.local/lib/python2.7/site-packages/sklearn/cluster/k_means.py:35: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import k_means
/home/stanley/.local/lib/python2.7/site-packages/sklearn/cluster/k_means.py:36: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._k_means_elkan import k_means_elkan
/home/stanley/.local/lib/python2.7/site-packages/sklearn/cluster/hierarchical.py:23: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from . import hierarchical
/home/stanley/.local/lib/python2.7/site-packages/sklearn/cluster/dbscan.py:19: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88
from ._dbscan_inner import dbscan_inner
Welcome to auto_ml! We're about to go through and make sense of your data using machine learning, and give you a production-ready pipeline to get predictions with.

If you have any issues, or new feature ideas, let us know at http://auto.ml
You are running on version 2.9.10
Now using the model training_params that you passed in:
{}
After overwriting our defaults with your values, here are the final params that will be used to initialize the model:
{'presort': False, 'warm_start': True, 'learning_rate': 0.1}
Running basic data cleaning
Fitting DataFrameVectorizer
Now using the model training_params that you passed in:
{}
After overwriting our defaults with your values, here are the final params that will be used to initialize the model:
{'presort': False, 'warm_start': True, 'learning_rate': 0.1}

---

About to fit the pipeline for the model GradientBoostingClassifier to predict lable
Started at:
2018-08-01 03:14:40
[1] random_holdout_set_from_training_data's score is: 0.824
[2] random_holdout_set_from_training_data's score is: 0.833
[3] random_holdout_set_from_training_data's score is: 0.856
[4] random_holdout_set_from_training_data's score is: 0.847
[5] random_holdout_set_from_training_data's score is: 0.856
[6] random_holdout_set_from_training_data's score is: 0.87
[7] random_holdout_set_from_training_data's score is: 0.866
[8] random_holdout_set_from_training_data's score is: 0.87
[9] random_holdout_set_from_training_data's score is: 0.87
[10] random_holdout_set_from_training_data's score is: 0.875
[11] random_holdout_set_from_training_data's score is: 0.88
[12] random_holdout_set_from_training_data's score is: 0.884
[13] random_holdout_set_from_training_data's score is: 0.875
[14] random_holdout_set_from_training_data's score is: 0.88
[15] random_holdout_set_from_training_data's score is: 0.894
[16] random_holdout_set_from_training_data's score is: 0.894
[17] random_holdout_set_from_training_data's score is: 0.894
[18] random_holdout_set_from_training_data's score is: 0.898
[19] random_holdout_set_from_training_data's score is: 0.898
[20] random_holdout_set_from_training_data's score is: 0.907
[21] random_holdout_set_from_training_data's score is: 0.921
[22] random_holdout_set_from_training_data's score is: 0.912
[23] random_holdout_set_from_training_data's score is: 0.917
[24] random_holdout_set_from_training_data's score is: 0.917
[25] random_holdout_set_from_training_data's score is: 0.921
[26] random_holdout_set_from_training_data's score is: 0.917
[27] random_holdout_set_from_training_data's score is: 0.921
[28] random_holdout_set_from_training_data's score is: 0.926
[29] random_holdout_set_from_training_data's score is: 0.926
[30] random_holdout_set_from_training_data's score is: 0.926
[31] random_holdout_set_from_training_data's score is: 0.921
[32] random_holdout_set_from_training_data's score is: 0.926
[33] random_holdout_set_from_training_data's score is: 0.931
[34] random_holdout_set_from_training_data's score is: 0.931
[35] random_holdout_set_from_training_data's score is: 0.926
[36] random_holdout_set_from_training_data's score is: 0.931
[37] random_holdout_set_from_training_data's score is: 0.931
[38] random_holdout_set_from_training_data's score is: 0.931
[39] random_holdout_set_from_training_data's score is: 0.935
[40] random_holdout_set_from_training_data's score is: 0.935
[41] random_holdout_set_from_training_data's score is: 0.935
[42] random_holdout_set_from_training_data's score is: 0.935
[43] random_holdout_set_from_training_data's score is: 0.935
[44] random_holdout_set_from_training_data's score is: 0.935
[45] random_holdout_set_from_training_data's score is: 0.935
[46] random_holdout_set_from_training_data's score is: 0.931
[47] random_holdout_set_from_training_data's score is: 0.931
[48] random_holdout_set_from_training_data's score is: 0.931
[49] random_holdout_set_from_training_data's score is: 0.931
[50] random_holdout_set_from_training_data's score is: 0.931
[52] random_holdout_set_from_training_data's score is: 0.931
[54] random_holdout_set_from_training_data's score is: 0.931
[56] random_holdout_set_from_training_data's score is: 0.935
[58] random_holdout_set_from_training_data's score is: 0.935
[60] random_holdout_set_from_training_data's score is: 0.935
[62] random_holdout_set_from_training_data's score is: 0.94
[64] random_holdout_set_from_training_data's score is: 0.94
[66] random_holdout_set_from_training_data's score is: 0.944
[68] random_holdout_set_from_training_data's score is: 0.949
[70] random_holdout_set_from_training_data's score is: 0.949
[72] random_holdout_set_from_training_data's score is: 0.949
[74] random_holdout_set_from_training_data's score is: 0.949
[76] random_holdout_set_from_training_data's score is: 0.949
[78] random_holdout_set_from_training_data's score is: 0.944
[80] random_holdout_set_from_training_data's score is: 0.944
[82] random_holdout_set_from_training_data's score is: 0.944
[84] random_holdout_set_from_training_data's score is: 0.944
[86] random_holdout_set_from_training_data's score is: 0.949
[88] random_holdout_set_from_training_data's score is: 0.944
[90] random_holdout_set_from_training_data's score is: 0.944
[92] random_holdout_set_from_training_data's score is: 0.949
[94] random_holdout_set_from_training_data's score is: 0.949
[96] random_holdout_set_from_training_data's score is: 0.949
[98] random_holdout_set_from_training_data's score is: 0.949
[100] random_holdout_set_from_training_data's score is: 0.949
[103] random_holdout_set_from_training_data's score is: 0.949
[106] random_holdout_set_from_training_data's score is: 0.949
[109] random_holdout_set_from_training_data's score is: 0.949
[112] random_holdout_set_from_training_data's score is: 0.949
The number of estimators that were the best for this training dataset: 68
The best score on the holdout set: 0.9490740740740741
Finished training the pipeline!
Total training time:
0:00:11

Here are the results from our GradientBoostingClassifier
predicting lable
Calculating feature responses, for advanced analytics.

#log for default classifier end