CPU info:
    CPU Model Name: Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz
    Hardware threads: 12
    Total Memory: 264106968 kB
-------------------------------------------------------------------
=== Running mpiexec -n 2 /home/philly/jenkins/workspace/CNTK-Test-Linux-W1/build/gpu/release/bin/cntk configFile=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling/cntk.cntk currentDirectory=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data RunDir=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu DataDir=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data ConfigDir=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling OutputDir=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu DeviceId=0 timestamping=true numCPUThreads=6 stderr=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu/stderr
CNTK 2.0rc2+ (HEAD 887a3f, May 18 2017 11:14:18) on e194dc3d16bc at 2017/05/18 11:19:56

/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/build/gpu/release/bin/cntk  configFile=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling/cntk.cntkCNTK 2.0rc2+ (HEAD 887a3f, May 18 2017 11:14:18) on e194dc3d16bc at 2017/05/18 11:19:56

/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/build/gpu/release/bin/cntk  configFile=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling/cntk.cntk  currentDirectory=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data  RunDir=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu  DataDir=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data  ConfigDir=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling  OutputDir=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu  DeviceId=0  timestamping=true  numCPUThreads=6  stderr=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu/stderr
  currentDirectory=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data  RunDir=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu  DataDir=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data  ConfigDir=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling  OutputDir=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu  DeviceId=0  timestamping=true  numCPUThreads=6  stderr=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu/stderr
Changed current directory to /home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data
Changed current directory to /home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data
ping [requestnodes (before change)]: 2 nodes pinging each other
ping [requestnodes (before change)]: 2 nodes pinging each other
ping [requestnodes (after change)]: 2 nodes pinging each other
ping [requestnodes (after change)]: 2 nodes pinging each other
requestnodes [MPIWrapperMpi]: using 2 out of 2 MPI nodes on a single host (2 requested); we (0) are in (participating)
ping [mpihelper]: 2 nodes pinging each other
requestnodes [MPIWrapperMpi]: using 2 out of 2 MPI nodes on a single host (2 requested); we (1) are in (participating)
ping [mpihelper]: 2 nodes pinging each other
05/18/2017 11:19:56: Redirecting stderr to file /tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu/stderr_speechTrain.logrank0
05/18/2017 11:19:57: Redirecting stderr to file /tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu/stderr_speechTrain.logrank1
MPI Rank 0: CNTK 2.0rc2+ (HEAD 887a3f, May 18 2017 11:14:18) on e194dc3d16bc at 2017/05/18 11:19:56
MPI Rank 0: 
MPI Rank 0: /home/philly/jenkins/workspace/CNTK-Test-Linux-W1/build/gpu/release/bin/cntk  configFile=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling/cntk.cntk  currentDirectory=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data  RunDir=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu  DataDir=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data  ConfigDir=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling  OutputDir=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu  DeviceId=0  timestamping=true  numCPUThreads=6  stderr=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu/stderr
MPI Rank 0: 05/18/2017 11:19:56: -------------------------------------------------------------------
MPI Rank 0: 05/18/2017 11:19:56: Build info: 
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:56: 		Built time: May 18 2017 11:12:05
MPI Rank 0: 05/18/2017 11:19:56: 		Last modified date: Wed May 17 10:27:13 2017
MPI Rank 0: 05/18/2017 11:19:56: 		Build type: release
MPI Rank 0: 05/18/2017 11:19:56: 		Build target: GPU
MPI Rank 0: 05/18/2017 11:19:56: 		With ASGD: yes
MPI Rank 0: 05/18/2017 11:19:56: 		Math lib: mkl
MPI Rank 0: 05/18/2017 11:19:56: 		CUDA_PATH: /usr/local/cuda-8.0
MPI Rank 0: 05/18/2017 11:19:56: 		CUB_PATH: /usr/local/cub-1.4.1
MPI Rank 0: 05/18/2017 11:19:56: 		CUDNN_PATH: /usr/local/cudnn-5.1
MPI Rank 0: 05/18/2017 11:19:56: 		Build Branch: HEAD
MPI Rank 0: 05/18/2017 11:19:56: 		Build SHA1: 887a3fe8101d5d7dd7b004252936ff2828e1be96
MPI Rank 0: 05/18/2017 11:19:56: 		Built by Source/CNTK/buildinfo.h$$0 on 9fde1097d4ae
MPI Rank 0: 05/18/2017 11:19:56: 		Build Path: /home/philly/jenkins/workspace/CNTK-Build-Linux_2
MPI Rank 0: 05/18/2017 11:19:56: 		MPI distribution: Open MPI
MPI Rank 0: 05/18/2017 11:19:56: 		MPI version: 1.10.3
MPI Rank 0: 05/18/2017 11:19:56: -------------------------------------------------------------------
MPI Rank 0: 05/18/2017 11:19:56: -------------------------------------------------------------------
MPI Rank 0: 05/18/2017 11:19:56: GPU info:
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:56: 		Device[0]: cores = 2880; computeCapability = 3.5; type = "GeForce GTX 780 Ti"; total memory = 3020 MB; free memory = 3018 MB
MPI Rank 0: 05/18/2017 11:19:56: -------------------------------------------------------------------
MPI Rank 0: 05/18/2017 11:19:56: Using 6 CPU threads.
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:56: ##############################################################################
MPI Rank 0: 05/18/2017 11:19:56: #                                                                            #
MPI Rank 0: 05/18/2017 11:19:56: # speechTrain command (train action)                                         #
MPI Rank 0: 05/18/2017 11:19:56: #                                                                            #
MPI Rank 0: 05/18/2017 11:19:56: ##############################################################################
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:56: WARNING: 'numMiniBatch4LRSearch' is deprecated, please remove it and use 'numSamples4Search' instead.
MPI Rank 0: 05/18/2017 11:19:56: 
MPI Rank 0: Creating virgin network.
MPI Rank 0: SimpleNetworkBuilder Using GPU 0
MPI Rank 0: reading script file glob_0000.scp ... 948 entries
MPI Rank 0: total 132 state names in state list /home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data/state.list
MPI Rank 0: htkmlfreader: reading MLF file /home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data/glob_0000.mlf ... total 948 entries
MPI Rank 0: ...............................................................................................feature set 0: 252734 frames in 948 out of 948 utterances
MPI Rank 0: label set 0: 129 classes
MPI Rank 0: minibatchutterancesource: 948 utterances grouped into 3 chunks, av. chunk size: 316.0 utterances, 84244.7 frames
MPI Rank 0: 05/18/2017 11:19:56: 
MPI Rank 0: Model has 25 nodes. Using GPU 0.
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:56: Training criterion:   CrossEntropyWithSoftmax = CrossEntropyWithSoftmax
MPI Rank 0: 05/18/2017 11:19:56: Evaluation criterion: EvalClassificationError = ClassificationError
MPI Rank 0: 
MPI Rank 0: 
MPI Rank 0: Allocating matrices for forward and/or backward propagation.
MPI Rank 0: 
MPI Rank 0: Memory Sharing: Out of 40 matrices, 22 are shared as 6, and 18 are not shared.
MPI Rank 0: 
MPI Rank 0: Here are the ones that share memory:
MPI Rank 0: 	{ PosteriorProb : [132 x 1 x *]
MPI Rank 0: 	  ScaledLogLikelihood : [132 x 1 x *] }
MPI Rank 0: 	{ HLast : [132 x 1 x *]
MPI Rank 0: 	  W2 : [132 x 512] (gradient) }
MPI Rank 0: 	{ B0 : [512 x 1] (gradient)
MPI Rank 0: 	  H1 : [512 x 1 x *] }
MPI Rank 0: 	{ H2 : [512 x 1 x *]
MPI Rank 0: 	  W1 : [512 x 512] (gradient) }
MPI Rank 0: 	{ H1 : [512 x 1 x *] (gradient)
MPI Rank 0: 	  W0*features : [512 x *]
MPI Rank 0: 	  W0*features : [512 x *] (gradient)
MPI Rank 0: 	  W1*H1+B1 : [512 x 1 x *]
MPI Rank 0: 	  W1*H1+B1 : [512 x 1 x *] (gradient)
MPI Rank 0: 	  W2*H1 : [132 x 1 x *] (gradient) }
MPI Rank 0: 	{ H2 : [512 x 1 x *] (gradient)
MPI Rank 0: 	  HLast : [132 x 1 x *] (gradient)
MPI Rank 0: 	  W0 : [512 x 363] (gradient)
MPI Rank 0: 	  W0*features+B0 : [512 x 1 x *]
MPI Rank 0: 	  W0*features+B0 : [512 x 1 x *] (gradient)
MPI Rank 0: 	  W1*H1 : [512 x 1 x *]
MPI Rank 0: 	  W1*H1 : [512 x 1 x *] (gradient)
MPI Rank 0: 	  W2*H1 : [132 x 1 x *] }
MPI Rank 0: 
MPI Rank 0: Here are the ones that don't share memory:
MPI Rank 0: 	{features : [363 x *]}
MPI Rank 0: 	{MeanOfFeatures : [363]}
MPI Rank 0: 	{InvStdOfFeatures : [363]}
MPI Rank 0: 	{W0 : [512 x 363]}
MPI Rank 0: 	{B0 : [512 x 1]}
MPI Rank 0: 	{W1 : [512 x 512]}
MPI Rank 0: 	{B1 : [512 x 1]}
MPI Rank 0: 	{W2 : [132 x 512]}
MPI Rank 0: 	{B2 : [132 x 1]}
MPI Rank 0: 	{labels : [132 x *]}
MPI Rank 0: 	{Prior : [132]}
MPI Rank 0: 	{MVNormalizedFeatures : [363 x *]}
MPI Rank 0: 	{B2 : [132 x 1] (gradient)}
MPI Rank 0: 	{B1 : [512 x 1] (gradient)}
MPI Rank 0: 	{EvalClassificationError : [1]}
MPI Rank 0: 	{CrossEntropyWithSoftmax : [1] (gradient)}
MPI Rank 0: 	{CrossEntropyWithSoftmax : [1]}
MPI Rank 0: 	{LogOfPrior : [132]}
MPI Rank 0: 
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:56: Training 516740 parameters in 6 out of 6 parameter tensors and 15 nodes with gradient:
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:56: 	Node 'B0' (LearnableParameter operation) : [512 x 1]
MPI Rank 0: 05/18/2017 11:19:56: 	Node 'B1' (LearnableParameter operation) : [512 x 1]
MPI Rank 0: 05/18/2017 11:19:56: 	Node 'B2' (LearnableParameter operation) : [132 x 1]
MPI Rank 0: 05/18/2017 11:19:56: 	Node 'W0' (LearnableParameter operation) : [512 x 363]
MPI Rank 0: 05/18/2017 11:19:56: 	Node 'W1' (LearnableParameter operation) : [512 x 512]
MPI Rank 0: 05/18/2017 11:19:56: 	Node 'W2' (LearnableParameter operation) : [132 x 512]
MPI Rank 0: 
MPI Rank 0: Initializing dataParallelSGD for 2-bit quantization.
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:56: Precomputing --> 3 PreCompute nodes found.
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:56: 	MeanOfFeatures = Mean()
MPI Rank 0: 05/18/2017 11:19:56: 	InvStdOfFeatures = InvStdDev()
MPI Rank 0: 05/18/2017 11:19:56: 	Prior = Mean()
MPI Rank 0: minibatchiterator: epoch 0: frames [0..252734] (first utterance at frame 0), data subset 0 of 1, with 1 datapasses
MPI Rank 0: requiredata: determined feature kind as 33-dimensional 'USER' with frame shift 10.0 ms
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:59: Precomputing --> Completed.
MPI Rank 0: 
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:59: Starting Epoch 1: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 0: minibatchiterator: epoch 0: frames [0..81920] (first utterance at frame 0), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:19:59: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 05/18/2017 11:19:59:  Epoch[ 1 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 4.73732304 * 640; EvalClassificationError = 0.96718750 * 640; time = 0.0760s; samplesPerSecond = 8416.6
MPI Rank 0: 05/18/2017 11:19:59:  Epoch[ 1 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 4.37245658 * 640; EvalClassificationError = 0.92187500 * 640; time = 0.0713s; samplesPerSecond = 8970.3
MPI Rank 0: 05/18/2017 11:19:59:  Epoch[ 1 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 4.17410438 * 640; EvalClassificationError = 0.95937500 * 640; time = 0.0708s; samplesPerSecond = 9037.1
MPI Rank 0: 05/18/2017 11:19:59:  Epoch[ 1 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 3.88445939 * 640; EvalClassificationError = 0.86093750 * 640; time = 0.0712s; samplesPerSecond = 8983.7
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 4.05583056 * 640; EvalClassificationError = 0.89375000 * 640; time = 0.0710s; samplesPerSecond = 9011.0
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 3.94301179 * 640; EvalClassificationError = 0.86250000 * 640; time = 0.0714s; samplesPerSecond = 8960.1
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 3.80690392 * 640; EvalClassificationError = 0.85937500 * 640; time = 0.0709s; samplesPerSecond = 9028.5
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 3.92014544 * 640; EvalClassificationError = 0.87812500 * 640; time = 0.0710s; samplesPerSecond = 9011.4
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 3.97161496 * 640; EvalClassificationError = 0.87968750 * 640; time = 0.0709s; samplesPerSecond = 9026.1
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 3.93678341 * 640; EvalClassificationError = 0.90937500 * 640; time = 0.0710s; samplesPerSecond = 9019.0
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 4.05170333 * 640; EvalClassificationError = 0.92187500 * 640; time = 0.0710s; samplesPerSecond = 9018.1
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 3.89920006 * 640; EvalClassificationError = 0.86406250 * 640; time = 0.0713s; samplesPerSecond = 8972.5
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 3.87251780 * 640; EvalClassificationError = 0.89218750 * 640; time = 0.0710s; samplesPerSecond = 9020.1
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 3.81997328 * 640; EvalClassificationError = 0.88281250 * 640; time = 0.0712s; samplesPerSecond = 8982.7
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 3.80473823 * 640; EvalClassificationError = 0.88125000 * 640; time = 0.0712s; samplesPerSecond = 8994.7
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 3.94101364 * 640; EvalClassificationError = 0.88750000 * 640; time = 0.0712s; samplesPerSecond = 8993.3
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 3.82130368 * 640; EvalClassificationError = 0.87656250 * 640; time = 0.0708s; samplesPerSecond = 9033.3
MPI Rank 0: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 3.75236005 * 640; EvalClassificationError = 0.85312500 * 640; time = 0.0711s; samplesPerSecond = 8997.0
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 3.79661132 * 640; EvalClassificationError = 0.86562500 * 640; time = 0.0710s; samplesPerSecond = 9014.8
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 3.73922363 * 640; EvalClassificationError = 0.87343750 * 640; time = 0.0712s; samplesPerSecond = 8984.0
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 3.73517402 * 640; EvalClassificationError = 0.86406250 * 640; time = 0.0713s; samplesPerSecond = 8979.1
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 3.72398663 * 640; EvalClassificationError = 0.85625000 * 640; time = 0.0710s; samplesPerSecond = 9018.7
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 3.71595086 * 640; EvalClassificationError = 0.84062500 * 640; time = 0.0711s; samplesPerSecond = 9001.5
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 3.75562845 * 640; EvalClassificationError = 0.83281250 * 640; time = 0.0713s; samplesPerSecond = 8981.6
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 3.72052883 * 640; EvalClassificationError = 0.85468750 * 640; time = 0.0711s; samplesPerSecond = 8996.0
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 3.66417431 * 640; EvalClassificationError = 0.83906250 * 640; time = 0.0709s; samplesPerSecond = 9028.1
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 3.58440175 * 640; EvalClassificationError = 0.77812500 * 640; time = 0.0709s; samplesPerSecond = 9023.6
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 3.69427679 * 640; EvalClassificationError = 0.80781250 * 640; time = 0.0714s; samplesPerSecond = 8968.6
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 3.57769881 * 640; EvalClassificationError = 0.79062500 * 640; time = 0.0708s; samplesPerSecond = 9039.6
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 3.52797012 * 640; EvalClassificationError = 0.82031250 * 640; time = 0.0709s; samplesPerSecond = 9026.8
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 3.53498040 * 640; EvalClassificationError = 0.81718750 * 640; time = 0.0709s; samplesPerSecond = 9023.8
MPI Rank 0: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 3.50005340 * 640; EvalClassificationError = 0.79375000 * 640; time = 0.0714s; samplesPerSecond = 8965.3
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 3.37848051 * 640; EvalClassificationError = 0.79687500 * 640; time = 0.0712s; samplesPerSecond = 8991.8
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 3.44203869 * 640; EvalClassificationError = 0.78906250 * 640; time = 0.0712s; samplesPerSecond = 8994.9
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 3.49473674 * 640; EvalClassificationError = 0.80156250 * 640; time = 0.0714s; samplesPerSecond = 8960.8
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 3.42678273 * 640; EvalClassificationError = 0.80468750 * 640; time = 0.0707s; samplesPerSecond = 9055.8
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 3.49825811 * 640; EvalClassificationError = 0.82656250 * 640; time = 0.0710s; samplesPerSecond = 9013.2
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 3.18570771 * 640; EvalClassificationError = 0.75156250 * 640; time = 0.0712s; samplesPerSecond = 8989.6
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 3.31483570 * 640; EvalClassificationError = 0.79218750 * 640; time = 0.0712s; samplesPerSecond = 8989.6
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 3.27794269 * 640; EvalClassificationError = 0.77656250 * 640; time = 0.0710s; samplesPerSecond = 9013.4
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 3.42283181 * 640; EvalClassificationError = 0.80312500 * 640; time = 0.0709s; samplesPerSecond = 9029.5
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 3.28013444 * 640; EvalClassificationError = 0.75937500 * 640; time = 0.0713s; samplesPerSecond = 8981.4
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 3.23863079 * 640; EvalClassificationError = 0.78281250 * 640; time = 0.0712s; samplesPerSecond = 8993.7
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 3.13381567 * 640; EvalClassificationError = 0.75937500 * 640; time = 0.0711s; samplesPerSecond = 9006.5
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 3.18522093 * 640; EvalClassificationError = 0.74062500 * 640; time = 0.0709s; samplesPerSecond = 9026.6
MPI Rank 0: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 3.23487402 * 640; EvalClassificationError = 0.77187500 * 640; time = 0.0712s; samplesPerSecond = 8983.5
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 3.19165708 * 640; EvalClassificationError = 0.77812500 * 640; time = 0.0709s; samplesPerSecond = 9027.7
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 3.16584445 * 640; EvalClassificationError = 0.73906250 * 640; time = 0.0711s; samplesPerSecond = 9003.6
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 3.24961355 * 640; EvalClassificationError = 0.77187500 * 640; time = 0.0711s; samplesPerSecond = 9006.2
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 3.18529030 * 640; EvalClassificationError = 0.76406250 * 640; time = 0.0713s; samplesPerSecond = 8975.4
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 2.98383964 * 640; EvalClassificationError = 0.72187500 * 640; time = 0.0711s; samplesPerSecond = 8999.1
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 3.14703955 * 640; EvalClassificationError = 0.73281250 * 640; time = 0.0710s; samplesPerSecond = 9012.6
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 3.08217829 * 640; EvalClassificationError = 0.72656250 * 640; time = 0.0710s; samplesPerSecond = 9009.0
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 2.93980468 * 640; EvalClassificationError = 0.70625000 * 640; time = 0.0710s; samplesPerSecond = 9010.4
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 3.02220321 * 640; EvalClassificationError = 0.72968750 * 640; time = 0.0708s; samplesPerSecond = 9034.8
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 2.95530875 * 640; EvalClassificationError = 0.71250000 * 640; time = 0.0710s; samplesPerSecond = 9012.4
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 2.95808434 * 640; EvalClassificationError = 0.72812500 * 640; time = 0.0710s; samplesPerSecond = 9011.8
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 3.00790105 * 640; EvalClassificationError = 0.72656250 * 640; time = 0.0710s; samplesPerSecond = 9017.0
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 3.00108989 * 640; EvalClassificationError = 0.72968750 * 640; time = 0.0709s; samplesPerSecond = 9023.6
MPI Rank 0: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 2.91919650 * 640; EvalClassificationError = 0.70468750 * 640; time = 0.0709s; samplesPerSecond = 9030.2
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 3.00591973 * 640; EvalClassificationError = 0.73750000 * 640; time = 0.0711s; samplesPerSecond = 9003.6
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 2.93801198 * 640; EvalClassificationError = 0.70937500 * 640; time = 0.0708s; samplesPerSecond = 9034.6
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 2.97078954 * 640; EvalClassificationError = 0.74531250 * 640; time = 0.0711s; samplesPerSecond = 8995.7
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 2.86114904 * 640; EvalClassificationError = 0.67812500 * 640; time = 0.0712s; samplesPerSecond = 8984.3
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 2.88072070 * 640; EvalClassificationError = 0.71562500 * 640; time = 0.0710s; samplesPerSecond = 9012.4
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 2.90403961 * 640; EvalClassificationError = 0.71875000 * 640; time = 0.0712s; samplesPerSecond = 8984.6
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 2.82605150 * 640; EvalClassificationError = 0.70937500 * 640; time = 0.0711s; samplesPerSecond = 8998.5
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 2.86512788 * 640; EvalClassificationError = 0.67187500 * 640; time = 0.0712s; samplesPerSecond = 8990.4
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 2.82675637 * 640; EvalClassificationError = 0.70312500 * 640; time = 0.0710s; samplesPerSecond = 9015.2
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 2.69768964 * 640; EvalClassificationError = 0.68281250 * 640; time = 0.0714s; samplesPerSecond = 8959.2
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 2.74295251 * 640; EvalClassificationError = 0.66562500 * 640; time = 0.0714s; samplesPerSecond = 8968.6
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 2.79704092 * 640; EvalClassificationError = 0.71093750 * 640; time = 0.0709s; samplesPerSecond = 9029.1
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 2.68799813 * 640; EvalClassificationError = 0.67968750 * 640; time = 0.0711s; samplesPerSecond = 9000.9
MPI Rank 0: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 2.76492372 * 640; EvalClassificationError = 0.68281250 * 640; time = 0.0711s; samplesPerSecond = 9006.2
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 2.77331134 * 640; EvalClassificationError = 0.67656250 * 640; time = 0.0712s; samplesPerSecond = 8990.8
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 2.71057680 * 640; EvalClassificationError = 0.68437500 * 640; time = 0.0710s; samplesPerSecond = 9017.2
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 2.78835610 * 640; EvalClassificationError = 0.65937500 * 640; time = 0.0709s; samplesPerSecond = 9032.8
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 2.78407908 * 640; EvalClassificationError = 0.68125000 * 640; time = 0.0711s; samplesPerSecond = 9000.0
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 2.72041183 * 640; EvalClassificationError = 0.67031250 * 640; time = 0.0710s; samplesPerSecond = 9019.4
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 2.70357516 * 640; EvalClassificationError = 0.64062500 * 640; time = 0.0708s; samplesPerSecond = 9035.3
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 2.70911783 * 640; EvalClassificationError = 0.66875000 * 640; time = 0.0706s; samplesPerSecond = 9059.9
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 2.67625457 * 640; EvalClassificationError = 0.66406250 * 640; time = 0.0709s; samplesPerSecond = 9032.3
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 2.53164780 * 640; EvalClassificationError = 0.62812500 * 640; time = 0.0710s; samplesPerSecond = 9010.2
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 2.63327435 * 640; EvalClassificationError = 0.66406250 * 640; time = 0.0712s; samplesPerSecond = 8994.2
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 2.65919476 * 640; EvalClassificationError = 0.65312500 * 640; time = 0.0711s; samplesPerSecond = 9005.3
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 2.58937546 * 640; EvalClassificationError = 0.66718750 * 640; time = 0.0709s; samplesPerSecond = 9022.9
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 2.72922100 * 640; EvalClassificationError = 0.67968750 * 640; time = 0.0710s; samplesPerSecond = 9017.2
MPI Rank 0: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 2.66272632 * 640; EvalClassificationError = 0.66093750 * 640; time = 0.0712s; samplesPerSecond = 8991.5
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 2.52903186 * 640; EvalClassificationError = 0.65781250 * 640; time = 0.0710s; samplesPerSecond = 9008.7
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 2.62197376 * 640; EvalClassificationError = 0.65625000 * 640; time = 0.0710s; samplesPerSecond = 9013.0
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 2.55515259 * 640; EvalClassificationError = 0.66093750 * 640; time = 0.0707s; samplesPerSecond = 9058.1
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 2.55061458 * 640; EvalClassificationError = 0.64531250 * 640; time = 0.0709s; samplesPerSecond = 9026.4
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 2.59909361 * 640; EvalClassificationError = 0.65625000 * 640; time = 0.0711s; samplesPerSecond = 8999.3
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 2.54354716 * 640; EvalClassificationError = 0.62343750 * 640; time = 0.0713s; samplesPerSecond = 8979.9
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 2.48492488 * 640; EvalClassificationError = 0.63593750 * 640; time = 0.0711s; samplesPerSecond = 8995.3
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 2.53033570 * 640; EvalClassificationError = 0.63750000 * 640; time = 0.0712s; samplesPerSecond = 8987.3
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 2.35351888 * 640; EvalClassificationError = 0.60468750 * 640; time = 0.0711s; samplesPerSecond = 9007.5
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 2.54703608 * 640; EvalClassificationError = 0.64218750 * 640; time = 0.0712s; samplesPerSecond = 8994.3
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 2.45432789 * 640; EvalClassificationError = 0.63750000 * 640; time = 0.0711s; samplesPerSecond = 9004.5
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 2.42561109 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0711s; samplesPerSecond = 8996.2
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 2.37543454 * 640; EvalClassificationError = 0.61250000 * 640; time = 0.0711s; samplesPerSecond = 9002.2
MPI Rank 0: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 2.35908547 * 640; EvalClassificationError = 0.59062500 * 640; time = 0.0710s; samplesPerSecond = 9018.7
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 2.36149370 * 640; EvalClassificationError = 0.60781250 * 640; time = 0.0710s; samplesPerSecond = 9020.1
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 2.33347331 * 640; EvalClassificationError = 0.57187500 * 640; time = 0.0711s; samplesPerSecond = 8998.7
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 2.44891571 * 640; EvalClassificationError = 0.61875000 * 640; time = 0.0710s; samplesPerSecond = 9011.2
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 2.31631465 * 640; EvalClassificationError = 0.58125000 * 640; time = 0.0712s; samplesPerSecond = 8993.4
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 2.32131369 * 640; EvalClassificationError = 0.60937500 * 640; time = 0.0710s; samplesPerSecond = 9016.0
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 2.48493949 * 640; EvalClassificationError = 0.63437500 * 640; time = 0.0710s; samplesPerSecond = 9012.1
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 2.35487208 * 640; EvalClassificationError = 0.61406250 * 640; time = 0.0710s; samplesPerSecond = 9014.8
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 2.37970920 * 640; EvalClassificationError = 0.62500000 * 640; time = 0.0710s; samplesPerSecond = 9010.4
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 2.38320104 * 640; EvalClassificationError = 0.62031250 * 640; time = 0.0711s; samplesPerSecond = 9002.7
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 2.49962565 * 640; EvalClassificationError = 0.63437500 * 640; time = 0.0712s; samplesPerSecond = 8994.6
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 2.19814538 * 640; EvalClassificationError = 0.63125000 * 640; time = 0.0709s; samplesPerSecond = 9031.1
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 2.27133493 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.0712s; samplesPerSecond = 8994.6
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 2.20500156 * 640; EvalClassificationError = 0.60000000 * 640; time = 0.0710s; samplesPerSecond = 9011.4
MPI Rank 0: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 2.33060032 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0710s; samplesPerSecond = 9009.3
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 2.29741317 * 640; EvalClassificationError = 0.57656250 * 640; time = 0.0710s; samplesPerSecond = 9019.9
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 2.29300853 * 640; EvalClassificationError = 0.60156250 * 640; time = 0.0711s; samplesPerSecond = 9003.0
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 2.29940468 * 640; EvalClassificationError = 0.60781250 * 640; time = 0.0708s; samplesPerSecond = 9037.7
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 2.21838646 * 640; EvalClassificationError = 0.60156250 * 640; time = 0.0710s; samplesPerSecond = 9017.5
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 2.23688837 * 640; EvalClassificationError = 0.60468750 * 640; time = 0.0711s; samplesPerSecond = 9000.5
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 2.25579344 * 640; EvalClassificationError = 0.60625000 * 640; time = 0.0709s; samplesPerSecond = 9021.3
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 2.39626359 * 640; EvalClassificationError = 0.62031250 * 640; time = 0.0711s; samplesPerSecond = 9004.6
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 2.29742943 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0709s; samplesPerSecond = 9027.7
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 2.25004394 * 640; EvalClassificationError = 0.61718750 * 640; time = 0.0708s; samplesPerSecond = 9045.8
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 2.27782830 * 640; EvalClassificationError = 0.56718750 * 640; time = 0.0713s; samplesPerSecond = 8981.4
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 2.22271881 * 640; EvalClassificationError = 0.61250000 * 640; time = 0.0713s; samplesPerSecond = 8982.3
MPI Rank 0: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 2.30667131 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.0712s; samplesPerSecond = 8986.5
MPI Rank 0: 05/18/2017 11:20:08: Finished Epoch[ 1 of 3]: [Training] CrossEntropyWithSoftmax = 3.00757982 * 81920; EvalClassificationError = 0.72386475 * 81920; totalSamplesSeen = 81920; learningRatePerSample = 0.001953125; epochTime=9.11243s
MPI Rank 0: 05/18/2017 11:20:08: SGD: Saving checkpoint model '/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu/models/cntkSpeech.dnn.1'
MPI Rank 0: 05/18/2017 11:20:08:  Before Epoch[2], previous minibatchSize 64 is considered invalid -> resetting.
MPI Rank 0: 05/18/2017 11:20:08:  AdaptiveMinibatchSearch Epoch[2]: Evaluating minibatchSizes 64..8192
MPI Rank 0: 05/18/2017 11:20:08:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=64 (search range: 64..8192)...
MPI Rank 0: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:08: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 05/18/2017 11:20:08:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24452546 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0713s; samplesPerSecond = 8977.0
MPI Rank 0: 05/18/2017 11:20:08:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.11895537 * 640; EvalClassificationError = 0.53593750 * 640; time = 0.0712s; samplesPerSecond = 8994.2
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24541348 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0709s; samplesPerSecond = 9032.7
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06171132 * 640; EvalClassificationError = 0.57187500 * 640; time = 0.0712s; samplesPerSecond = 8983.9
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23423145 * 640; EvalClassificationError = 0.61093750 * 640; time = 0.0710s; samplesPerSecond = 9011.6
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15141392 * 640; EvalClassificationError = 0.58281250 * 640; time = 0.0710s; samplesPerSecond = 9010.2
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.23595333 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.0709s; samplesPerSecond = 9022.2
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.08959197 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0710s; samplesPerSecond = 9008.4
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11528859 * 640; EvalClassificationError = 0.56718750 * 640; time = 0.0710s; samplesPerSecond = 9009.6
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13442654 * 640; EvalClassificationError = 0.55468750 * 640; time = 0.0709s; samplesPerSecond = 9025.4
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10490506 * 640; EvalClassificationError = 0.60781250 * 640; time = 0.0711s; samplesPerSecond = 9003.1
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.03299349 * 640; EvalClassificationError = 0.57031250 * 640; time = 0.0711s; samplesPerSecond = 8996.3
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10076314 * 640; EvalClassificationError = 0.59687500 * 640; time = 0.0710s; samplesPerSecond = 9010.2
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.08921883 * 640; EvalClassificationError = 0.55937500 * 640; time = 0.0712s; samplesPerSecond = 8993.0
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.11193971 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0707s; samplesPerSecond = 9055.1
MPI Rank 0: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.14099190 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0711s; samplesPerSecond = 8996.2
MPI Rank 0: 05/18/2017 11:20:10:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.13967704 * 10304; EvalClassificationError = 0.57899845 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:10:  AdaptiveMinibatchSearch Epoch[2]: Computed baseCriterion 2.13967704 for minibatchSize=64
MPI Rank 0: 05/18/2017 11:20:10:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=64 (search range: 64..8192)...
MPI Rank 0: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:10: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24452546 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0713s; samplesPerSecond = 8982.2
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.11895537 * 640; EvalClassificationError = 0.53593750 * 640; time = 0.0710s; samplesPerSecond = 9018.6
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24541348 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0709s; samplesPerSecond = 9024.9
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06171132 * 640; EvalClassificationError = 0.57187500 * 640; time = 0.0709s; samplesPerSecond = 9031.7
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23423145 * 640; EvalClassificationError = 0.61093750 * 640; time = 0.0711s; samplesPerSecond = 8998.1
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15141392 * 640; EvalClassificationError = 0.58281250 * 640; time = 0.0711s; samplesPerSecond = 9005.2
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.23595333 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.0711s; samplesPerSecond = 8999.5
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.08959197 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0711s; samplesPerSecond = 8996.9
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11528859 * 640; EvalClassificationError = 0.56718750 * 640; time = 0.0708s; samplesPerSecond = 9037.5
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13442654 * 640; EvalClassificationError = 0.55468750 * 640; time = 0.0712s; samplesPerSecond = 8988.1
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10490506 * 640; EvalClassificationError = 0.60781250 * 640; time = 0.0712s; samplesPerSecond = 8993.9
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.03299349 * 640; EvalClassificationError = 0.57031250 * 640; time = 0.0710s; samplesPerSecond = 9011.7
MPI Rank 0: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10076314 * 640; EvalClassificationError = 0.59687500 * 640; time = 0.0710s; samplesPerSecond = 9012.2
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.08921883 * 640; EvalClassificationError = 0.55937500 * 640; time = 0.0712s; samplesPerSecond = 8990.9
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.11193971 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0710s; samplesPerSecond = 9012.7
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.14099190 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0711s; samplesPerSecond = 8997.6
MPI Rank 0: 05/18/2017 11:20:11:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.13967704 * 10304; EvalClassificationError = 0.57899845 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:11:  AdaptiveMinibatchSearch Epoch[2]: Keep searching... epochCriterion = 2.13967704 vs. baseCriterion = 2.13967704
MPI Rank 0: 05/18/2017 11:20:11:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=128 (search range: 64..8192)...
MPI Rank 0: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:11: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 1.56%]: CrossEntropyWithSoftmax = 2.18191866 * 1280; EvalClassificationError = 0.55546875 * 1280; time = 0.0786s; samplesPerSecond = 16287.0
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 3.12%]: CrossEntropyWithSoftmax = 2.16689676 * 1280; EvalClassificationError = 0.59218750 * 1280; time = 0.0774s; samplesPerSecond = 16532.3
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 4.69%]: CrossEntropyWithSoftmax = 2.24005467 * 1280; EvalClassificationError = 0.60468750 * 1280; time = 0.0778s; samplesPerSecond = 16455.9
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 6.25%]: CrossEntropyWithSoftmax = 2.25440418 * 1280; EvalClassificationError = 0.60703125 * 1280; time = 0.0774s; samplesPerSecond = 16536.7
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 7.81%]: CrossEntropyWithSoftmax = 2.12505792 * 1280; EvalClassificationError = 0.56171875 * 1280; time = 0.0776s; samplesPerSecond = 16499.9
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 9.38%]: CrossEntropyWithSoftmax = 2.09343914 * 1280; EvalClassificationError = 0.58281250 * 1280; time = 0.0776s; samplesPerSecond = 16493.3
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 10.94%]: CrossEntropyWithSoftmax = 2.12298289 * 1280; EvalClassificationError = 0.58750000 * 1280; time = 0.0775s; samplesPerSecond = 16515.0
MPI Rank 0: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 12.50%]: CrossEntropyWithSoftmax = 2.15056438 * 1280; EvalClassificationError = 0.57265625 * 1280; time = 0.0776s; samplesPerSecond = 16497.4
MPI Rank 0: 05/18/2017 11:20:11:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.16782779 * 10368; EvalClassificationError = 0.58285108 * 10368; learningRatePerSample = 0.001953125; minibatchSize = 128
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:11:  AdaptiveMinibatchSearch Epoch[2]: Search successful. New minibatchSize is 64. epochCriterion = 2.13967704 vs baseCriterion = 2.13967704
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:11: Starting Epoch 2: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 0: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:11: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 05/18/2017 11:20:11:  Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24452546 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0711s; samplesPerSecond = 9000.5
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.11895537 * 640; EvalClassificationError = 0.53593750 * 640; time = 0.0711s; samplesPerSecond = 9005.4
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24541348 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0711s; samplesPerSecond = 9003.2
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06171132 * 640; EvalClassificationError = 0.57187500 * 640; time = 0.0711s; samplesPerSecond = 9001.9
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23423145 * 640; EvalClassificationError = 0.61093750 * 640; time = 0.0709s; samplesPerSecond = 9025.4
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15141392 * 640; EvalClassificationError = 0.58281250 * 640; time = 0.0710s; samplesPerSecond = 9009.9
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.23595333 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.0710s; samplesPerSecond = 9014.7
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.08959197 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0711s; samplesPerSecond = 9005.3
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11528859 * 640; EvalClassificationError = 0.56718750 * 640; time = 0.0708s; samplesPerSecond = 9035.4
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13442654 * 640; EvalClassificationError = 0.55468750 * 640; time = 0.0708s; samplesPerSecond = 9039.2
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10490506 * 640; EvalClassificationError = 0.60781250 * 640; time = 0.0709s; samplesPerSecond = 9029.2
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.03299349 * 640; EvalClassificationError = 0.57031250 * 640; time = 0.0711s; samplesPerSecond = 8996.3
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10076314 * 640; EvalClassificationError = 0.59687500 * 640; time = 0.0710s; samplesPerSecond = 9017.0
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.08921883 * 640; EvalClassificationError = 0.55937500 * 640; time = 0.0709s; samplesPerSecond = 9028.2
MPI Rank 0: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.11193971 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0707s; samplesPerSecond = 9058.2
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.14099190 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0710s; samplesPerSecond = 9016.0
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 2.03794535 * 640; EvalClassificationError = 0.52968750 * 640; time = 0.0712s; samplesPerSecond = 8994.3
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 2.08811824 * 640; EvalClassificationError = 0.56875000 * 640; time = 0.0711s; samplesPerSecond = 9002.1
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 2.11230408 * 640; EvalClassificationError = 0.57031250 * 640; time = 0.0709s; samplesPerSecond = 9027.3
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 2.05236903 * 640; EvalClassificationError = 0.55000000 * 640; time = 0.0710s; samplesPerSecond = 9011.6
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 2.00510201 * 640; EvalClassificationError = 0.57031250 * 640; time = 0.0711s; samplesPerSecond = 9006.5
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 1.92081398 * 640; EvalClassificationError = 0.52343750 * 640; time = 0.0706s; samplesPerSecond = 9070.8
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 1.94572433 * 640; EvalClassificationError = 0.51562500 * 640; time = 0.0708s; samplesPerSecond = 9044.1
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 2.01158892 * 640; EvalClassificationError = 0.52968750 * 640; time = 0.0712s; samplesPerSecond = 8993.6
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 2.05074999 * 640; EvalClassificationError = 0.55937500 * 640; time = 0.0711s; samplesPerSecond = 9005.8
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 2.06324493 * 640; EvalClassificationError = 0.52187500 * 640; time = 0.0711s; samplesPerSecond = 9006.0
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 1.99450627 * 640; EvalClassificationError = 0.53281250 * 640; time = 0.0709s; samplesPerSecond = 9022.7
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 1.97134281 * 640; EvalClassificationError = 0.55156250 * 640; time = 0.0708s; samplesPerSecond = 9033.9
MPI Rank 0: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 2.05843180 * 640; EvalClassificationError = 0.56093750 * 640; time = 0.0710s; samplesPerSecond = 9014.2
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 2.09965488 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0706s; samplesPerSecond = 9066.5
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 1.94968722 * 640; EvalClassificationError = 0.53437500 * 640; time = 0.0710s; samplesPerSecond = 9014.1
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 1.89541292 * 640; EvalClassificationError = 0.54375000 * 640; time = 0.0708s; samplesPerSecond = 9039.0
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 2.08378806 * 640; EvalClassificationError = 0.58281250 * 640; time = 0.0708s; samplesPerSecond = 9044.9
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 1.99608869 * 640; EvalClassificationError = 0.54687500 * 640; time = 0.0708s; samplesPerSecond = 9041.7
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 1.97710423 * 640; EvalClassificationError = 0.54062500 * 640; time = 0.0709s; samplesPerSecond = 9031.4
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 1.93995996 * 640; EvalClassificationError = 0.53125000 * 640; time = 0.0709s; samplesPerSecond = 9027.9
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 1.96527830 * 640; EvalClassificationError = 0.55937500 * 640; time = 0.0707s; samplesPerSecond = 9054.8
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 1.94655805 * 640; EvalClassificationError = 0.54062500 * 640; time = 0.0710s; samplesPerSecond = 9014.1
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 2.03999925 * 640; EvalClassificationError = 0.56875000 * 640; time = 0.0709s; samplesPerSecond = 9024.1
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 2.06761698 * 640; EvalClassificationError = 0.58750000 * 640; time = 0.0711s; samplesPerSecond = 9006.7
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 1.89247397 * 640; EvalClassificationError = 0.52968750 * 640; time = 0.0710s; samplesPerSecond = 9014.1
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 1.96354166 * 640; EvalClassificationError = 0.54687500 * 640; time = 0.0710s; samplesPerSecond = 9017.9
MPI Rank 0: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 1.77985604 * 640; EvalClassificationError = 0.49218750 * 640; time = 0.0707s; samplesPerSecond = 9046.7
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 2.00857384 * 640; EvalClassificationError = 0.55156250 * 640; time = 0.0709s; samplesPerSecond = 9031.2
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 1.85918426 * 640; EvalClassificationError = 0.50625000 * 640; time = 0.0709s; samplesPerSecond = 9025.0
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 1.94765538 * 640; EvalClassificationError = 0.53593750 * 640; time = 0.0711s; samplesPerSecond = 9006.3
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 1.90992052 * 640; EvalClassificationError = 0.50468750 * 640; time = 0.0712s; samplesPerSecond = 8993.2
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 1.89666608 * 640; EvalClassificationError = 0.52812500 * 640; time = 0.0708s; samplesPerSecond = 9036.7
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 1.83342367 * 640; EvalClassificationError = 0.52812500 * 640; time = 0.0709s; samplesPerSecond = 9033.0
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 1.93804681 * 640; EvalClassificationError = 0.51875000 * 640; time = 0.0711s; samplesPerSecond = 9006.7
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 1.89632598 * 640; EvalClassificationError = 0.51250000 * 640; time = 0.0711s; samplesPerSecond = 9006.8
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 1.84849419 * 640; EvalClassificationError = 0.53281250 * 640; time = 0.0712s; samplesPerSecond = 8991.9
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 1.78912223 * 640; EvalClassificationError = 0.50781250 * 640; time = 0.0709s; samplesPerSecond = 9025.7
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 1.83952360 * 640; EvalClassificationError = 0.54531250 * 640; time = 0.0709s; samplesPerSecond = 9033.1
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 1.93770729 * 640; EvalClassificationError = 0.53125000 * 640; time = 0.0710s; samplesPerSecond = 9015.1
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 1.82155165 * 640; EvalClassificationError = 0.50468750 * 640; time = 0.0708s; samplesPerSecond = 9045.7
MPI Rank 0: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 1.82655546 * 640; EvalClassificationError = 0.48281250 * 640; time = 0.0708s; samplesPerSecond = 9034.6
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 1.85789778 * 640; EvalClassificationError = 0.50312500 * 640; time = 0.0710s; samplesPerSecond = 9016.7
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 1.81129094 * 640; EvalClassificationError = 0.52031250 * 640; time = 0.0710s; samplesPerSecond = 9014.0
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 1.75389091 * 640; EvalClassificationError = 0.48750000 * 640; time = 0.0711s; samplesPerSecond = 9001.1
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 1.78544725 * 640; EvalClassificationError = 0.51875000 * 640; time = 0.0711s; samplesPerSecond = 9001.4
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 1.85118920 * 640; EvalClassificationError = 0.51093750 * 640; time = 0.0709s; samplesPerSecond = 9032.2
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 1.70199411 * 640; EvalClassificationError = 0.46875000 * 640; time = 0.0710s; samplesPerSecond = 9010.3
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 1.82835107 * 640; EvalClassificationError = 0.51718750 * 640; time = 0.0707s; samplesPerSecond = 9048.0
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 1.84736003 * 640; EvalClassificationError = 0.52187500 * 640; time = 0.0710s; samplesPerSecond = 9011.6
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 1.77140144 * 640; EvalClassificationError = 0.51093750 * 640; time = 0.0707s; samplesPerSecond = 9052.6
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 1.85247283 * 640; EvalClassificationError = 0.51875000 * 640; time = 0.0711s; samplesPerSecond = 9002.1
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 1.76495149 * 640; EvalClassificationError = 0.51406250 * 640; time = 0.0709s; samplesPerSecond = 9020.6
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 1.80603502 * 640; EvalClassificationError = 0.51562500 * 640; time = 0.0711s; samplesPerSecond = 9004.5
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 1.77663139 * 640; EvalClassificationError = 0.51093750 * 640; time = 0.0709s; samplesPerSecond = 9020.7
MPI Rank 0: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 1.80503452 * 640; EvalClassificationError = 0.49687500 * 640; time = 0.0714s; samplesPerSecond = 8962.4
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 1.74058595 * 640; EvalClassificationError = 0.47656250 * 640; time = 0.0707s; samplesPerSecond = 9050.4
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 1.74414311 * 640; EvalClassificationError = 0.50625000 * 640; time = 0.0710s; samplesPerSecond = 9019.9
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 1.82071734 * 640; EvalClassificationError = 0.52343750 * 640; time = 0.0712s; samplesPerSecond = 8988.6
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 1.72750386 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0711s; samplesPerSecond = 8997.5
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 1.74787156 * 640; EvalClassificationError = 0.50625000 * 640; time = 0.0710s; samplesPerSecond = 9013.9
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 1.75394227 * 640; EvalClassificationError = 0.48437500 * 640; time = 0.0712s; samplesPerSecond = 8985.0
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 1.66462933 * 640; EvalClassificationError = 0.45468750 * 640; time = 0.0710s; samplesPerSecond = 9010.4
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 1.70626874 * 640; EvalClassificationError = 0.47500000 * 640; time = 0.0719s; samplesPerSecond = 8901.6
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 1.80531225 * 640; EvalClassificationError = 0.50937500 * 640; time = 0.0711s; samplesPerSecond = 9003.3
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 1.75140112 * 640; EvalClassificationError = 0.50312500 * 640; time = 0.0708s; samplesPerSecond = 9042.6
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 1.77447142 * 640; EvalClassificationError = 0.51093750 * 640; time = 0.0711s; samplesPerSecond = 9003.3
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 1.79489417 * 640; EvalClassificationError = 0.49687500 * 640; time = 0.0709s; samplesPerSecond = 9025.8
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 1.76492415 * 640; EvalClassificationError = 0.48593750 * 640; time = 0.0708s; samplesPerSecond = 9041.1
MPI Rank 0: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 1.68898560 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0710s; samplesPerSecond = 9009.7
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 1.76965122 * 640; EvalClassificationError = 0.52031250 * 640; time = 0.0708s; samplesPerSecond = 9041.6
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 1.71022909 * 640; EvalClassificationError = 0.49687500 * 640; time = 0.0708s; samplesPerSecond = 9034.5
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 1.75330096 * 640; EvalClassificationError = 0.48750000 * 640; time = 0.0712s; samplesPerSecond = 8985.5
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 1.80812599 * 640; EvalClassificationError = 0.52812500 * 640; time = 0.0711s; samplesPerSecond = 9000.6
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 1.66747206 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0711s; samplesPerSecond = 8997.0
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 1.64717125 * 640; EvalClassificationError = 0.49062500 * 640; time = 0.0709s; samplesPerSecond = 9032.4
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 1.62476293 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0709s; samplesPerSecond = 9027.3
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 1.74657781 * 640; EvalClassificationError = 0.50937500 * 640; time = 0.0710s; samplesPerSecond = 9017.3
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 1.66677585 * 640; EvalClassificationError = 0.48906250 * 640; time = 0.0710s; samplesPerSecond = 9017.0
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 1.74562939 * 640; EvalClassificationError = 0.50312500 * 640; time = 0.0709s; samplesPerSecond = 9033.0
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 1.74365548 * 640; EvalClassificationError = 0.48750000 * 640; time = 0.0712s; samplesPerSecond = 8993.0
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 1.70489601 * 640; EvalClassificationError = 0.48750000 * 640; time = 0.0709s; samplesPerSecond = 9030.1
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 1.62783331 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0710s; samplesPerSecond = 9008.7
MPI Rank 0: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 1.71071160 * 640; EvalClassificationError = 0.50468750 * 640; time = 0.0713s; samplesPerSecond = 8982.4
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 1.64233094 * 640; EvalClassificationError = 0.47656250 * 640; time = 0.0709s; samplesPerSecond = 9022.6
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 1.67306025 * 640; EvalClassificationError = 0.46250000 * 640; time = 0.0709s; samplesPerSecond = 9031.6
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 1.57546355 * 640; EvalClassificationError = 0.41406250 * 640; time = 0.0708s; samplesPerSecond = 9036.9
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 1.68265112 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0711s; samplesPerSecond = 9000.6
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 1.65074435 * 640; EvalClassificationError = 0.48125000 * 640; time = 0.0709s; samplesPerSecond = 9020.6
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 1.62080173 * 640; EvalClassificationError = 0.45625000 * 640; time = 0.0706s; samplesPerSecond = 9064.3
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 1.66091455 * 640; EvalClassificationError = 0.46718750 * 640; time = 0.0708s; samplesPerSecond = 9039.9
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 1.67834581 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0709s; samplesPerSecond = 9022.7
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 1.62603165 * 640; EvalClassificationError = 0.46875000 * 640; time = 0.0711s; samplesPerSecond = 8995.6
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 1.63042903 * 640; EvalClassificationError = 0.45625000 * 640; time = 0.0709s; samplesPerSecond = 9031.7
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 1.73934936 * 640; EvalClassificationError = 0.50156250 * 640; time = 0.0710s; samplesPerSecond = 9009.1
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 1.62487143 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0710s; samplesPerSecond = 9019.9
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 1.69205097 * 640; EvalClassificationError = 0.49687500 * 640; time = 0.0707s; samplesPerSecond = 9054.3
MPI Rank 0: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 1.69563130 * 640; EvalClassificationError = 0.48281250 * 640; time = 0.0710s; samplesPerSecond = 9012.2
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 1.64531303 * 640; EvalClassificationError = 0.47656250 * 640; time = 0.0711s; samplesPerSecond = 9001.6
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 1.60021363 * 640; EvalClassificationError = 0.45781250 * 640; time = 0.0710s; samplesPerSecond = 9019.2
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 1.67695254 * 640; EvalClassificationError = 0.48437500 * 640; time = 0.0710s; samplesPerSecond = 9017.5
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 1.54504004 * 640; EvalClassificationError = 0.47656250 * 640; time = 0.0709s; samplesPerSecond = 9022.2
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 1.68604931 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0708s; samplesPerSecond = 9038.5
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 1.63160791 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0710s; samplesPerSecond = 9015.2
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 1.54289047 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.0707s; samplesPerSecond = 9051.1
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 1.60284986 * 640; EvalClassificationError = 0.48125000 * 640; time = 0.0708s; samplesPerSecond = 9039.3
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 1.67337501 * 640; EvalClassificationError = 0.50312500 * 640; time = 0.0707s; samplesPerSecond = 9051.7
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 1.52889813 * 640; EvalClassificationError = 0.43125000 * 640; time = 0.0710s; samplesPerSecond = 9014.9
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 1.54819833 * 640; EvalClassificationError = 0.45468750 * 640; time = 0.0711s; samplesPerSecond = 9003.5
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 1.52668717 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.0711s; samplesPerSecond = 9001.7
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 1.58543380 * 640; EvalClassificationError = 0.47343750 * 640; time = 0.0709s; samplesPerSecond = 9029.8
MPI Rank 0: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 1.61389061 * 640; EvalClassificationError = 0.46875000 * 640; time = 0.0707s; samplesPerSecond = 9048.7
MPI Rank 0: 05/18/2017 11:20:21:  Epoch[ 2 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 1.69489542 * 640; EvalClassificationError = 0.47500000 * 640; time = 0.0715s; samplesPerSecond = 8946.9
MPI Rank 0: 05/18/2017 11:20:21: Finished Epoch[ 2 of 3]: [Training] CrossEntropyWithSoftmax = 1.83902890 * 81920; EvalClassificationError = 0.51396484 * 81920; totalSamplesSeen = 163840; learningRatePerSample = 0.001953125; epochTime=12.1573s
MPI Rank 0: 05/18/2017 11:20:21: SGD: Saving checkpoint model '/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu/models/cntkSpeech.dnn.2'
MPI Rank 0: 05/18/2017 11:20:21:  AdaptiveMinibatchSearch Epoch[3]: Evaluating minibatchSizes 64..128
MPI Rank 0: 05/18/2017 11:20:21:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=64 (search range: 64..128)...
MPI Rank 0: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:21: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47574155 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.0711s; samplesPerSecond = 9004.6
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65297932 * 640; EvalClassificationError = 0.49843750 * 640; time = 0.0709s; samplesPerSecond = 9025.5
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47188226 * 640; EvalClassificationError = 0.40625000 * 640; time = 0.0710s; samplesPerSecond = 9013.9
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59761080 * 640; EvalClassificationError = 0.47500000 * 640; time = 0.0710s; samplesPerSecond = 9013.8
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52638871 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0709s; samplesPerSecond = 9027.7
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62435294 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0706s; samplesPerSecond = 9069.4
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.59857812 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0709s; samplesPerSecond = 9021.4
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.56242471 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0709s; samplesPerSecond = 9031.8
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60797573 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0710s; samplesPerSecond = 9012.6
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.68022905 * 640; EvalClassificationError = 0.50000000 * 640; time = 0.0710s; samplesPerSecond = 9017.4
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56460519 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0712s; samplesPerSecond = 8991.1
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66500836 * 640; EvalClassificationError = 0.47968750 * 640; time = 0.0707s; samplesPerSecond = 9055.6
MPI Rank 0: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.56991557 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0708s; samplesPerSecond = 9034.9
MPI Rank 0: 05/18/2017 11:20:22:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.45437317 * 640; EvalClassificationError = 0.38906250 * 640; time = 0.0708s; samplesPerSecond = 9042.5
MPI Rank 0: 05/18/2017 11:20:22:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.54998771 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0708s; samplesPerSecond = 9041.4
MPI Rank 0: 05/18/2017 11:20:22:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.58609751 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0707s; samplesPerSecond = 9048.0
MPI Rank 0: 05/18/2017 11:20:22:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.57443367 * 10304; EvalClassificationError = 0.45458075 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:22:  AdaptiveMinibatchSearch Epoch[3]: Computed baseCriterion 1.57443367 for minibatchSize=64
MPI Rank 0: 05/18/2017 11:20:22:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=64 (search range: 64..128)...
MPI Rank 0: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:22: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47574155 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.0709s; samplesPerSecond = 9032.0
MPI Rank 0: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65297932 * 640; EvalClassificationError = 0.49843750 * 640; time = 0.0709s; samplesPerSecond = 9026.1
MPI Rank 0: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47188226 * 640; EvalClassificationError = 0.40625000 * 640; time = 0.0709s; samplesPerSecond = 9025.0
MPI Rank 0: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59761080 * 640; EvalClassificationError = 0.47500000 * 640; time = 0.0709s; samplesPerSecond = 9029.2
MPI Rank 0: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52638871 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0710s; samplesPerSecond = 9012.9
MPI Rank 0: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62435294 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0707s; samplesPerSecond = 9056.1
MPI Rank 0: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.59857812 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0710s; samplesPerSecond = 9015.4
MPI Rank 0: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.56242471 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0709s; samplesPerSecond = 9025.0
MPI Rank 0: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60797573 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0708s; samplesPerSecond = 9035.7
MPI Rank 0: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.68022905 * 640; EvalClassificationError = 0.50000000 * 640; time = 0.0708s; samplesPerSecond = 9037.6
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56460519 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0709s; samplesPerSecond = 9022.2
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66500836 * 640; EvalClassificationError = 0.47968750 * 640; time = 0.0709s; samplesPerSecond = 9033.1
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.56991557 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0707s; samplesPerSecond = 9055.6
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.45437317 * 640; EvalClassificationError = 0.38906250 * 640; time = 0.0708s; samplesPerSecond = 9039.0
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.54998771 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0706s; samplesPerSecond = 9063.2
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.58609751 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0707s; samplesPerSecond = 9051.4
MPI Rank 0: 05/18/2017 11:20:23:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.57443367 * 10304; EvalClassificationError = 0.45458075 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:23:  AdaptiveMinibatchSearch Epoch[3]: Keep searching... epochCriterion = 1.57443367 vs. baseCriterion = 1.57443367
MPI Rank 0: 05/18/2017 11:20:23:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=128 (search range: 64..128)...
MPI Rank 0: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:23: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 1.56%]: CrossEntropyWithSoftmax = 1.56361473 * 1280; EvalClassificationError = 0.46640625 * 1280; time = 0.0777s; samplesPerSecond = 16474.4
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 3.12%]: CrossEntropyWithSoftmax = 1.53899072 * 1280; EvalClassificationError = 0.45234375 * 1280; time = 0.0774s; samplesPerSecond = 16531.7
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 4.69%]: CrossEntropyWithSoftmax = 1.58573210 * 1280; EvalClassificationError = 0.44609375 * 1280; time = 0.0775s; samplesPerSecond = 16520.8
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 6.25%]: CrossEntropyWithSoftmax = 1.59001601 * 1280; EvalClassificationError = 0.46328125 * 1280; time = 0.0773s; samplesPerSecond = 16556.5
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 7.81%]: CrossEntropyWithSoftmax = 1.66527522 * 1280; EvalClassificationError = 0.48671875 * 1280; time = 0.0780s; samplesPerSecond = 16416.8
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 9.38%]: CrossEntropyWithSoftmax = 1.64789265 * 1280; EvalClassificationError = 0.47578125 * 1280; time = 0.0775s; samplesPerSecond = 16517.7
MPI Rank 0: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 10.94%]: CrossEntropyWithSoftmax = 1.60105749 * 1280; EvalClassificationError = 0.44921875 * 1280; time = 0.0775s; samplesPerSecond = 16507.1
MPI Rank 0: 05/18/2017 11:20:24:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 12.50%]: CrossEntropyWithSoftmax = 1.65896720 * 1280; EvalClassificationError = 0.46796875 * 1280; time = 0.0777s; samplesPerSecond = 16479.9
MPI Rank 0: 05/18/2017 11:20:24:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.60772332 * 10368; EvalClassificationError = 0.46421682 * 10368; learningRatePerSample = 0.001953125; minibatchSize = 128
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:24:  AdaptiveMinibatchSearch Epoch[3]: Search successful. New minibatchSize is 64. epochCriterion = 1.57443367 vs baseCriterion = 1.57443367
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:24: Starting Epoch 3: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 0: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:24: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47574155 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.0708s; samplesPerSecond = 9041.9
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65297932 * 640; EvalClassificationError = 0.49843750 * 640; time = 0.0710s; samplesPerSecond = 9019.6
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47188226 * 640; EvalClassificationError = 0.40625000 * 640; time = 0.0709s; samplesPerSecond = 9027.0
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59761080 * 640; EvalClassificationError = 0.47500000 * 640; time = 0.0709s; samplesPerSecond = 9028.9
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52638871 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0709s; samplesPerSecond = 9021.9
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62435294 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0707s; samplesPerSecond = 9054.1
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.59857812 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0708s; samplesPerSecond = 9045.9
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.56242471 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0708s; samplesPerSecond = 9037.8
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60797573 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0710s; samplesPerSecond = 9016.2
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.68022905 * 640; EvalClassificationError = 0.50000000 * 640; time = 0.0708s; samplesPerSecond = 9036.4
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56460519 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0708s; samplesPerSecond = 9034.1
MPI Rank 0: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66500836 * 640; EvalClassificationError = 0.47968750 * 640; time = 0.0710s; samplesPerSecond = 9011.6
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.56991557 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0708s; samplesPerSecond = 9038.6
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.45437317 * 640; EvalClassificationError = 0.38906250 * 640; time = 0.0708s; samplesPerSecond = 9044.9
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.54998771 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0709s; samplesPerSecond = 9032.2
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.58609751 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0708s; samplesPerSecond = 9044.0
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 1.58496713 * 640; EvalClassificationError = 0.48125000 * 640; time = 0.0711s; samplesPerSecond = 8998.1
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 1.51015976 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0708s; samplesPerSecond = 9040.3
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 1.60065218 * 640; EvalClassificationError = 0.47968750 * 640; time = 0.0705s; samplesPerSecond = 9073.7
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 1.52573519 * 640; EvalClassificationError = 0.45625000 * 640; time = 0.0708s; samplesPerSecond = 9034.1
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 1.54107550 * 640; EvalClassificationError = 0.46718750 * 640; time = 0.0709s; samplesPerSecond = 9022.2
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 1.54599117 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0709s; samplesPerSecond = 9025.6
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 1.47641221 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.0709s; samplesPerSecond = 9029.9
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 1.56643257 * 640; EvalClassificationError = 0.46562500 * 640; time = 0.0709s; samplesPerSecond = 9025.4
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 1.47729166 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0708s; samplesPerSecond = 9044.2
MPI Rank 0: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 1.60991841 * 640; EvalClassificationError = 0.45468750 * 640; time = 0.0709s; samplesPerSecond = 9024.7
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 1.62338406 * 640; EvalClassificationError = 0.46718750 * 640; time = 0.0708s; samplesPerSecond = 9045.1
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 1.44890369 * 640; EvalClassificationError = 0.42500000 * 640; time = 0.0708s; samplesPerSecond = 9039.2
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 1.60029332 * 640; EvalClassificationError = 0.48906250 * 640; time = 0.0709s; samplesPerSecond = 9022.1
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 1.52963287 * 640; EvalClassificationError = 0.45468750 * 640; time = 0.0706s; samplesPerSecond = 9064.2
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 1.50387765 * 640; EvalClassificationError = 0.42031250 * 640; time = 0.0709s; samplesPerSecond = 9028.9
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 1.53521925 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0707s; samplesPerSecond = 9049.1
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 1.50796862 * 640; EvalClassificationError = 0.44062500 * 640; time = 0.0708s; samplesPerSecond = 9033.4
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 1.58919805 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0707s; samplesPerSecond = 9054.7
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 1.47816378 * 640; EvalClassificationError = 0.42812500 * 640; time = 0.0704s; samplesPerSecond = 9085.9
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 1.59773652 * 640; EvalClassificationError = 0.45468750 * 640; time = 0.0708s; samplesPerSecond = 9038.9
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 1.51149262 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0708s; samplesPerSecond = 9037.4
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 1.52533096 * 640; EvalClassificationError = 0.46562500 * 640; time = 0.0709s; samplesPerSecond = 9029.4
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 1.59753668 * 640; EvalClassificationError = 0.44843750 * 640; time = 0.0707s; samplesPerSecond = 9049.8
MPI Rank 0: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 1.51499579 * 640; EvalClassificationError = 0.40937500 * 640; time = 0.0710s; samplesPerSecond = 9016.3
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 1.47924883 * 640; EvalClassificationError = 0.42656250 * 640; time = 0.0708s; samplesPerSecond = 9042.8
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 1.60917997 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0709s; samplesPerSecond = 9023.7
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 1.63635723 * 640; EvalClassificationError = 0.48281250 * 640; time = 0.0707s; samplesPerSecond = 9046.4
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 1.48886028 * 640; EvalClassificationError = 0.44218750 * 640; time = 0.0711s; samplesPerSecond = 9003.2
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 1.48224978 * 640; EvalClassificationError = 0.44218750 * 640; time = 0.0711s; samplesPerSecond = 9001.9
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 1.65845184 * 640; EvalClassificationError = 0.48906250 * 640; time = 0.0710s; samplesPerSecond = 9016.5
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 1.46110566 * 640; EvalClassificationError = 0.42656250 * 640; time = 0.0710s; samplesPerSecond = 9012.6
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 1.55035801 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.0707s; samplesPerSecond = 9047.5
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 1.43324101 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0709s; samplesPerSecond = 9027.5
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 1.56441297 * 640; EvalClassificationError = 0.44843750 * 640; time = 0.0710s; samplesPerSecond = 9014.2
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 1.52645140 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0710s; samplesPerSecond = 9010.6
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 1.29957479 * 640; EvalClassificationError = 0.38437500 * 640; time = 0.0708s; samplesPerSecond = 9040.8
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 1.50003462 * 640; EvalClassificationError = 0.46562500 * 640; time = 0.0707s; samplesPerSecond = 9055.5
MPI Rank 0: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 1.59309925 * 640; EvalClassificationError = 0.46562500 * 640; time = 0.0706s; samplesPerSecond = 9070.5
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 1.38171997 * 640; EvalClassificationError = 0.40781250 * 640; time = 0.0710s; samplesPerSecond = 9020.0
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 1.55160848 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0709s; samplesPerSecond = 9029.7
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 1.47430193 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0712s; samplesPerSecond = 8992.4
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 1.57465311 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0710s; samplesPerSecond = 9010.5
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 1.43990494 * 640; EvalClassificationError = 0.42187500 * 640; time = 0.0709s; samplesPerSecond = 9031.0
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 1.52507182 * 640; EvalClassificationError = 0.45156250 * 640; time = 0.0710s; samplesPerSecond = 9019.4
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 1.42557617 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.0709s; samplesPerSecond = 9030.4
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 1.46460882 * 640; EvalClassificationError = 0.43437500 * 640; time = 0.0707s; samplesPerSecond = 9051.9
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 1.42519263 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0706s; samplesPerSecond = 9059.0
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 1.47671055 * 640; EvalClassificationError = 0.43437500 * 640; time = 0.0710s; samplesPerSecond = 9009.4
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 1.53511688 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.0711s; samplesPerSecond = 9000.9
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 1.58790676 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0709s; samplesPerSecond = 9026.7
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 1.50995734 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0708s; samplesPerSecond = 9037.0
MPI Rank 0: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 1.44992144 * 640; EvalClassificationError = 0.41250000 * 640; time = 0.0710s; samplesPerSecond = 9018.2
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 1.46801840 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0709s; samplesPerSecond = 9024.1
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 1.57007256 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.0707s; samplesPerSecond = 9055.9
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 1.42113850 * 640; EvalClassificationError = 0.40000000 * 640; time = 0.0708s; samplesPerSecond = 9035.9
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 1.43815754 * 640; EvalClassificationError = 0.44062500 * 640; time = 0.0707s; samplesPerSecond = 9048.3
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 1.43789139 * 640; EvalClassificationError = 0.41250000 * 640; time = 0.0709s; samplesPerSecond = 9028.3
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 1.42666947 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0707s; samplesPerSecond = 9048.0
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 1.46565822 * 640; EvalClassificationError = 0.43125000 * 640; time = 0.0709s; samplesPerSecond = 9031.0
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 1.49344406 * 640; EvalClassificationError = 0.44218750 * 640; time = 0.0708s; samplesPerSecond = 9037.5
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 1.33678786 * 640; EvalClassificationError = 0.40781250 * 640; time = 0.0707s; samplesPerSecond = 9056.6
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 1.45606437 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0710s; samplesPerSecond = 9016.2
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 1.36980109 * 640; EvalClassificationError = 0.40312500 * 640; time = 0.0710s; samplesPerSecond = 9010.7
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 1.48431699 * 640; EvalClassificationError = 0.45156250 * 640; time = 0.0712s; samplesPerSecond = 8989.2
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 1.34086079 * 640; EvalClassificationError = 0.40312500 * 640; time = 0.0710s; samplesPerSecond = 9019.2
MPI Rank 0: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 1.44159039 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0710s; samplesPerSecond = 9020.2
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 1.51037591 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0710s; samplesPerSecond = 9009.1
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 1.49227044 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.0710s; samplesPerSecond = 9008.1
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 1.51017233 * 640; EvalClassificationError = 0.44843750 * 640; time = 0.0709s; samplesPerSecond = 9033.0
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 1.41215254 * 640; EvalClassificationError = 0.41093750 * 640; time = 0.0710s; samplesPerSecond = 9013.7
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 1.50909438 * 640; EvalClassificationError = 0.43281250 * 640; time = 0.0709s; samplesPerSecond = 9029.0
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 1.50639399 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.0710s; samplesPerSecond = 9011.1
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 1.44043979 * 640; EvalClassificationError = 0.41875000 * 640; time = 0.0708s; samplesPerSecond = 9045.3
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 1.51346596 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.0707s; samplesPerSecond = 9058.4
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 1.45549368 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0710s; samplesPerSecond = 9011.2
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 1.42412411 * 640; EvalClassificationError = 0.40468750 * 640; time = 0.0711s; samplesPerSecond = 9003.0
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 1.36861492 * 640; EvalClassificationError = 0.40156250 * 640; time = 0.0710s; samplesPerSecond = 9015.2
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 1.48388297 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0712s; samplesPerSecond = 8989.0
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 1.45206648 * 640; EvalClassificationError = 0.41093750 * 640; time = 0.0713s; samplesPerSecond = 8975.9
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 1.37504334 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0706s; samplesPerSecond = 9065.9
MPI Rank 0: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 1.34271091 * 640; EvalClassificationError = 0.40000000 * 640; time = 0.0710s; samplesPerSecond = 9011.7
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 1.44829546 * 640; EvalClassificationError = 0.43281250 * 640; time = 0.0708s; samplesPerSecond = 9043.6
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 1.39906716 * 640; EvalClassificationError = 0.40781250 * 640; time = 0.0711s; samplesPerSecond = 9006.6
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 1.43031734 * 640; EvalClassificationError = 0.42656250 * 640; time = 0.0711s; samplesPerSecond = 9003.4
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 1.44054394 * 640; EvalClassificationError = 0.43437500 * 640; time = 0.0708s; samplesPerSecond = 9044.0
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 1.42952754 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0705s; samplesPerSecond = 9072.1
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 1.41089053 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0708s; samplesPerSecond = 9041.2
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 1.49744196 * 640; EvalClassificationError = 0.44218750 * 640; time = 0.0709s; samplesPerSecond = 9023.2
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 1.47769042 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0709s; samplesPerSecond = 9025.3
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 1.34230122 * 640; EvalClassificationError = 0.39531250 * 640; time = 0.0710s; samplesPerSecond = 9016.3
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 1.45080084 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0708s; samplesPerSecond = 9034.8
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 1.39645697 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.0708s; samplesPerSecond = 9039.2
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 1.45648259 * 640; EvalClassificationError = 0.43125000 * 640; time = 0.0710s; samplesPerSecond = 9013.2
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 1.48435206 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0710s; samplesPerSecond = 9017.9
MPI Rank 0: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 1.45560228 * 640; EvalClassificationError = 0.45625000 * 640; time = 0.0708s; samplesPerSecond = 9044.6
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 1.41066685 * 640; EvalClassificationError = 0.41093750 * 640; time = 0.0709s; samplesPerSecond = 9032.6
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 1.46349358 * 640; EvalClassificationError = 0.43437500 * 640; time = 0.0712s; samplesPerSecond = 8993.7
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 1.39279154 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0707s; samplesPerSecond = 9050.4
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 1.35355811 * 640; EvalClassificationError = 0.40468750 * 640; time = 0.0709s; samplesPerSecond = 9029.6
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 1.33072196 * 640; EvalClassificationError = 0.41406250 * 640; time = 0.0709s; samplesPerSecond = 9023.1
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 1.39876284 * 640; EvalClassificationError = 0.40937500 * 640; time = 0.0709s; samplesPerSecond = 9027.5
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 1.32921736 * 640; EvalClassificationError = 0.39375000 * 640; time = 0.0710s; samplesPerSecond = 9019.7
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 1.40769856 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0707s; samplesPerSecond = 9050.2
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 1.40908068 * 640; EvalClassificationError = 0.39375000 * 640; time = 0.0708s; samplesPerSecond = 9041.2
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 1.23080402 * 640; EvalClassificationError = 0.39375000 * 640; time = 0.0710s; samplesPerSecond = 9018.8
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 1.38302706 * 640; EvalClassificationError = 0.42812500 * 640; time = 0.0708s; samplesPerSecond = 9044.6
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 1.49486128 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.0709s; samplesPerSecond = 9023.9
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 1.45573536 * 640; EvalClassificationError = 0.44375000 * 640; time = 0.0708s; samplesPerSecond = 9039.3
MPI Rank 0: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 1.39251298 * 640; EvalClassificationError = 0.41875000 * 640; time = 0.0710s; samplesPerSecond = 9010.1
MPI Rank 0: 05/18/2017 11:20:33:  Epoch[ 3 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 1.34887186 * 640; EvalClassificationError = 0.41250000 * 640; time = 0.0709s; samplesPerSecond = 9032.7
MPI Rank 0: 05/18/2017 11:20:33:  Epoch[ 3 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 1.41531394 * 640; EvalClassificationError = 0.43125000 * 640; time = 0.0711s; samplesPerSecond = 9007.3
MPI Rank 0: 05/18/2017 11:20:33:  Epoch[ 3 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 1.40662736 * 640; EvalClassificationError = 0.43125000 * 640; time = 0.0710s; samplesPerSecond = 9018.8
MPI Rank 0: 05/18/2017 11:20:33: Finished Epoch[ 3 of 3]: [Training] CrossEntropyWithSoftmax = 1.48426317 * 81920; EvalClassificationError = 0.43706055 * 81920; totalSamplesSeen = 245760; learningRatePerSample = 0.001953125; epochTime=12.1389s
MPI Rank 0: 05/18/2017 11:20:33: SGD: Saving checkpoint model '/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu/models/cntkSpeech.dnn'
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:33: Action "train" complete.
MPI Rank 0: 
MPI Rank 0: 05/18/2017 11:20:33: __COMPLETED__
MPI Rank 1: CNTK 2.0rc2+ (HEAD 887a3f, May 18 2017 11:14:18) on e194dc3d16bc at 2017/05/18 11:19:56
MPI Rank 1: 
MPI Rank 1: /home/philly/jenkins/workspace/CNTK-Test-Linux-W1/build/gpu/release/bin/cntk  configFile=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling/cntk.cntk  currentDirectory=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data  RunDir=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu  DataDir=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data  ConfigDir=/home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling  OutputDir=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu  DeviceId=0  timestamping=true  numCPUThreads=6  stderr=/tmp/cntk-test-20170518111955.45168/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_gpu/stderr
MPI Rank 1: 05/18/2017 11:19:57: -------------------------------------------------------------------
MPI Rank 1: 05/18/2017 11:19:57: Build info: 
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:57: 		Built time: May 18 2017 11:12:05
MPI Rank 1: 05/18/2017 11:19:57: 		Last modified date: Wed May 17 10:27:13 2017
MPI Rank 1: 05/18/2017 11:19:57: 		Build type: release
MPI Rank 1: 05/18/2017 11:19:57: 		Build target: GPU
MPI Rank 1: 05/18/2017 11:19:57: 		With ASGD: yes
MPI Rank 1: 05/18/2017 11:19:57: 		Math lib: mkl
MPI Rank 1: 05/18/2017 11:19:57: 		CUDA_PATH: /usr/local/cuda-8.0
MPI Rank 1: 05/18/2017 11:19:57: 		CUB_PATH: /usr/local/cub-1.4.1
MPI Rank 1: 05/18/2017 11:19:57: 		CUDNN_PATH: /usr/local/cudnn-5.1
MPI Rank 1: 05/18/2017 11:19:57: 		Build Branch: HEAD
MPI Rank 1: 05/18/2017 11:19:57: 		Build SHA1: 887a3fe8101d5d7dd7b004252936ff2828e1be96
MPI Rank 1: 05/18/2017 11:19:57: 		Built by Source/CNTK/buildinfo.h$$0 on 9fde1097d4ae
MPI Rank 1: 05/18/2017 11:19:57: 		Build Path: /home/philly/jenkins/workspace/CNTK-Build-Linux_2
MPI Rank 1: 05/18/2017 11:19:57: 		MPI distribution: Open MPI
MPI Rank 1: 05/18/2017 11:19:57: 		MPI version: 1.10.3
MPI Rank 1: 05/18/2017 11:19:57: -------------------------------------------------------------------
MPI Rank 1: 05/18/2017 11:19:57: -------------------------------------------------------------------
MPI Rank 1: 05/18/2017 11:19:57: GPU info:
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:57: 		Device[0]: cores = 2880; computeCapability = 3.5; type = "GeForce GTX 780 Ti"; total memory = 3020 MB; free memory = 2915 MB
MPI Rank 1: 05/18/2017 11:19:57: -------------------------------------------------------------------
MPI Rank 1: 05/18/2017 11:19:57: Using 6 CPU threads.
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:57: ##############################################################################
MPI Rank 1: 05/18/2017 11:19:57: #                                                                            #
MPI Rank 1: 05/18/2017 11:19:57: # speechTrain command (train action)                                         #
MPI Rank 1: 05/18/2017 11:19:57: #                                                                            #
MPI Rank 1: 05/18/2017 11:19:57: ##############################################################################
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:57: WARNING: 'numMiniBatch4LRSearch' is deprecated, please remove it and use 'numSamples4Search' instead.
MPI Rank 1: 05/18/2017 11:19:57: 
MPI Rank 1: Creating virgin network.
MPI Rank 1: SimpleNetworkBuilder Using GPU 0
MPI Rank 1: reading script file glob_0000.scp ... 948 entries
MPI Rank 1: total 132 state names in state list /home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data/state.list
MPI Rank 1: htkmlfreader: reading MLF file /home/philly/jenkins/workspace/CNTK-Test-Linux-W1/Tests/EndToEndTests/Speech/Data/glob_0000.mlf ... total 948 entries
MPI Rank 1: ...............................................................................................feature set 0: 252734 frames in 948 out of 948 utterances
MPI Rank 1: label set 0: 129 classes
MPI Rank 1: minibatchutterancesource: 948 utterances grouped into 3 chunks, av. chunk size: 316.0 utterances, 84244.7 frames
MPI Rank 1: 05/18/2017 11:19:57: 
MPI Rank 1: Model has 25 nodes. Using GPU 0.
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:57: Training criterion:   CrossEntropyWithSoftmax = CrossEntropyWithSoftmax
MPI Rank 1: 05/18/2017 11:19:57: Evaluation criterion: EvalClassificationError = ClassificationError
MPI Rank 1: 
MPI Rank 1: 
MPI Rank 1: Allocating matrices for forward and/or backward propagation.
MPI Rank 1: 
MPI Rank 1: Memory Sharing: Out of 40 matrices, 22 are shared as 6, and 18 are not shared.
MPI Rank 1: 
MPI Rank 1: Here are the ones that share memory:
MPI Rank 1: 	{ PosteriorProb : [132 x 1 x *]
MPI Rank 1: 	  ScaledLogLikelihood : [132 x 1 x *] }
MPI Rank 1: 	{ H2 : [512 x 1 x *]
MPI Rank 1: 	  W1 : [512 x 512] (gradient) }
MPI Rank 1: 	{ B0 : [512 x 1] (gradient)
MPI Rank 1: 	  H1 : [512 x 1 x *] }
MPI Rank 1: 	{ H2 : [512 x 1 x *] (gradient)
MPI Rank 1: 	  HLast : [132 x 1 x *] (gradient)
MPI Rank 1: 	  W0 : [512 x 363] (gradient)
MPI Rank 1: 	  W0*features+B0 : [512 x 1 x *]
MPI Rank 1: 	  W0*features+B0 : [512 x 1 x *] (gradient)
MPI Rank 1: 	  W1*H1 : [512 x 1 x *]
MPI Rank 1: 	  W1*H1 : [512 x 1 x *] (gradient)
MPI Rank 1: 	  W2*H1 : [132 x 1 x *] }
MPI Rank 1: 	{ H1 : [512 x 1 x *] (gradient)
MPI Rank 1: 	  W0*features : [512 x *]
MPI Rank 1: 	  W0*features : [512 x *] (gradient)
MPI Rank 1: 	  W1*H1+B1 : [512 x 1 x *]
MPI Rank 1: 	  W1*H1+B1 : [512 x 1 x *] (gradient)
MPI Rank 1: 	  W2*H1 : [132 x 1 x *] (gradient) }
MPI Rank 1: 	{ HLast : [132 x 1 x *]
MPI Rank 1: 	  W2 : [132 x 512] (gradient) }
MPI Rank 1: 
MPI Rank 1: Here are the ones that don't share memory:
MPI Rank 1: 	{features : [363 x *]}
MPI Rank 1: 	{MeanOfFeatures : [363]}
MPI Rank 1: 	{InvStdOfFeatures : [363]}
MPI Rank 1: 	{W0 : [512 x 363]}
MPI Rank 1: 	{labels : [132 x *]}
MPI Rank 1: 	{Prior : [132]}
MPI Rank 1: 	{B0 : [512 x 1]}
MPI Rank 1: 	{W1 : [512 x 512]}
MPI Rank 1: 	{B1 : [512 x 1]}
MPI Rank 1: 	{W2 : [132 x 512]}
MPI Rank 1: 	{B2 : [132 x 1]}
MPI Rank 1: 	{LogOfPrior : [132]}
MPI Rank 1: 	{B1 : [512 x 1] (gradient)}
MPI Rank 1: 	{CrossEntropyWithSoftmax : [1]}
MPI Rank 1: 	{MVNormalizedFeatures : [363 x *]}
MPI Rank 1: 	{B2 : [132 x 1] (gradient)}
MPI Rank 1: 	{EvalClassificationError : [1]}
MPI Rank 1: 	{CrossEntropyWithSoftmax : [1] (gradient)}
MPI Rank 1: 
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:57: Training 516740 parameters in 6 out of 6 parameter tensors and 15 nodes with gradient:
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:57: 	Node 'B0' (LearnableParameter operation) : [512 x 1]
MPI Rank 1: 05/18/2017 11:19:57: 	Node 'B1' (LearnableParameter operation) : [512 x 1]
MPI Rank 1: 05/18/2017 11:19:57: 	Node 'B2' (LearnableParameter operation) : [132 x 1]
MPI Rank 1: 05/18/2017 11:19:57: 	Node 'W0' (LearnableParameter operation) : [512 x 363]
MPI Rank 1: 05/18/2017 11:19:57: 	Node 'W1' (LearnableParameter operation) : [512 x 512]
MPI Rank 1: 05/18/2017 11:19:57: 	Node 'W2' (LearnableParameter operation) : [132 x 512]
MPI Rank 1: 
MPI Rank 1: Initializing dataParallelSGD for 2-bit quantization.
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:57: Precomputing --> 3 PreCompute nodes found.
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:57: 	MeanOfFeatures = Mean()
MPI Rank 1: 05/18/2017 11:19:57: 	InvStdOfFeatures = InvStdDev()
MPI Rank 1: 05/18/2017 11:19:57: 	Prior = Mean()
MPI Rank 1: minibatchiterator: epoch 0: frames [0..252734] (first utterance at frame 0), data subset 0 of 1, with 1 datapasses
MPI Rank 1: requiredata: determined feature kind as 33-dimensional 'USER' with frame shift 10.0 ms
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:59: Precomputing --> Completed.
MPI Rank 1: 
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:59: Starting Epoch 1: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 1: minibatchiterator: epoch 0: frames [0..81920] (first utterance at frame 0), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:19:59: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 05/18/2017 11:19:59:  Epoch[ 1 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 4.73732304 * 640; EvalClassificationError = 0.96718750 * 640; time = 0.0761s; samplesPerSecond = 8414.0
MPI Rank 1: 05/18/2017 11:19:59:  Epoch[ 1 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 4.37245658 * 640; EvalClassificationError = 0.92187500 * 640; time = 0.0713s; samplesPerSecond = 8974.0
MPI Rank 1: 05/18/2017 11:19:59:  Epoch[ 1 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 4.17410438 * 640; EvalClassificationError = 0.95937500 * 640; time = 0.0708s; samplesPerSecond = 9033.3
MPI Rank 1: 05/18/2017 11:19:59:  Epoch[ 1 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 3.88445939 * 640; EvalClassificationError = 0.86093750 * 640; time = 0.0712s; samplesPerSecond = 8984.8
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 4.05583056 * 640; EvalClassificationError = 0.89375000 * 640; time = 0.0710s; samplesPerSecond = 9013.6
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 3.94301179 * 640; EvalClassificationError = 0.86250000 * 640; time = 0.0714s; samplesPerSecond = 8964.0
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 3.80690392 * 640; EvalClassificationError = 0.85937500 * 640; time = 0.0709s; samplesPerSecond = 9029.4
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 3.92014544 * 640; EvalClassificationError = 0.87812500 * 640; time = 0.0717s; samplesPerSecond = 8921.8
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 3.97161496 * 640; EvalClassificationError = 0.87968750 * 640; time = 0.0709s; samplesPerSecond = 9026.6
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 3.93678341 * 640; EvalClassificationError = 0.90937500 * 640; time = 0.0710s; samplesPerSecond = 9019.3
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 4.05170333 * 640; EvalClassificationError = 0.92187500 * 640; time = 0.0710s; samplesPerSecond = 9018.2
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 3.89920006 * 640; EvalClassificationError = 0.86406250 * 640; time = 0.0713s; samplesPerSecond = 8972.4
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 3.87251780 * 640; EvalClassificationError = 0.89218750 * 640; time = 0.0711s; samplesPerSecond = 8998.2
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 3.81997328 * 640; EvalClassificationError = 0.88281250 * 640; time = 0.0711s; samplesPerSecond = 9002.3
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 3.80473823 * 640; EvalClassificationError = 0.88125000 * 640; time = 0.0712s; samplesPerSecond = 8994.7
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 3.94101364 * 640; EvalClassificationError = 0.88750000 * 640; time = 0.0711s; samplesPerSecond = 8996.4
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 3.82130368 * 640; EvalClassificationError = 0.87656250 * 640; time = 0.0709s; samplesPerSecond = 9030.3
MPI Rank 1: 05/18/2017 11:20:00:  Epoch[ 1 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 3.75236005 * 640; EvalClassificationError = 0.85312500 * 640; time = 0.0711s; samplesPerSecond = 8995.3
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 3.79661132 * 640; EvalClassificationError = 0.86562500 * 640; time = 0.0710s; samplesPerSecond = 9013.6
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 3.73922363 * 640; EvalClassificationError = 0.87343750 * 640; time = 0.0712s; samplesPerSecond = 8987.1
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 3.73517402 * 640; EvalClassificationError = 0.86406250 * 640; time = 0.0713s; samplesPerSecond = 8980.2
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 3.72398663 * 640; EvalClassificationError = 0.85625000 * 640; time = 0.0710s; samplesPerSecond = 9018.6
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 3.71595086 * 640; EvalClassificationError = 0.84062500 * 640; time = 0.0713s; samplesPerSecond = 8981.9
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 3.75562845 * 640; EvalClassificationError = 0.83281250 * 640; time = 0.0711s; samplesPerSecond = 9001.4
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 3.72052883 * 640; EvalClassificationError = 0.85468750 * 640; time = 0.0711s; samplesPerSecond = 8995.6
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 3.66417431 * 640; EvalClassificationError = 0.83906250 * 640; time = 0.0709s; samplesPerSecond = 9027.6
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 3.58440175 * 640; EvalClassificationError = 0.77812500 * 640; time = 0.0709s; samplesPerSecond = 9021.0
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 3.69427679 * 640; EvalClassificationError = 0.80781250 * 640; time = 0.0713s; samplesPerSecond = 8971.7
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 3.57769881 * 640; EvalClassificationError = 0.79062500 * 640; time = 0.0708s; samplesPerSecond = 9038.2
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 3.52797012 * 640; EvalClassificationError = 0.82031250 * 640; time = 0.0709s; samplesPerSecond = 9026.9
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 3.53498040 * 640; EvalClassificationError = 0.81718750 * 640; time = 0.0709s; samplesPerSecond = 9025.8
MPI Rank 1: 05/18/2017 11:20:01:  Epoch[ 1 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 3.50005340 * 640; EvalClassificationError = 0.79375000 * 640; time = 0.0714s; samplesPerSecond = 8966.7
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 3.37848051 * 640; EvalClassificationError = 0.79687500 * 640; time = 0.0712s; samplesPerSecond = 8991.6
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 3.44203869 * 640; EvalClassificationError = 0.78906250 * 640; time = 0.0711s; samplesPerSecond = 8995.2
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 3.49473674 * 640; EvalClassificationError = 0.80156250 * 640; time = 0.0714s; samplesPerSecond = 8959.3
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 3.42678273 * 640; EvalClassificationError = 0.80468750 * 640; time = 0.0708s; samplesPerSecond = 9037.7
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 3.49825811 * 640; EvalClassificationError = 0.82656250 * 640; time = 0.0710s; samplesPerSecond = 9015.3
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 3.18570771 * 640; EvalClassificationError = 0.75156250 * 640; time = 0.0712s; samplesPerSecond = 8992.3
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 3.31483570 * 640; EvalClassificationError = 0.79218750 * 640; time = 0.0711s; samplesPerSecond = 9006.4
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 3.27794269 * 640; EvalClassificationError = 0.77656250 * 640; time = 0.0710s; samplesPerSecond = 9013.5
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 3.42283181 * 640; EvalClassificationError = 0.80312500 * 640; time = 0.0709s; samplesPerSecond = 9028.6
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 3.28013444 * 640; EvalClassificationError = 0.75937500 * 640; time = 0.0713s; samplesPerSecond = 8982.4
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 3.23863079 * 640; EvalClassificationError = 0.78281250 * 640; time = 0.0711s; samplesPerSecond = 8997.3
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 3.13381567 * 640; EvalClassificationError = 0.75937500 * 640; time = 0.0711s; samplesPerSecond = 9003.2
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 3.18522093 * 640; EvalClassificationError = 0.74062500 * 640; time = 0.0709s; samplesPerSecond = 9028.1
MPI Rank 1: 05/18/2017 11:20:02:  Epoch[ 1 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 3.23487402 * 640; EvalClassificationError = 0.77187500 * 640; time = 0.0712s; samplesPerSecond = 8984.4
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 3.19165708 * 640; EvalClassificationError = 0.77812500 * 640; time = 0.0709s; samplesPerSecond = 9030.8
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 3.16584445 * 640; EvalClassificationError = 0.73906250 * 640; time = 0.0712s; samplesPerSecond = 8983.9
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 3.24961355 * 640; EvalClassificationError = 0.77187500 * 640; time = 0.0709s; samplesPerSecond = 9024.2
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 3.18529030 * 640; EvalClassificationError = 0.76406250 * 640; time = 0.0713s; samplesPerSecond = 8979.4
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 2.98383964 * 640; EvalClassificationError = 0.72187500 * 640; time = 0.0711s; samplesPerSecond = 8998.5
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 3.14703955 * 640; EvalClassificationError = 0.73281250 * 640; time = 0.0712s; samplesPerSecond = 8993.2
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 3.08217829 * 640; EvalClassificationError = 0.72656250 * 640; time = 0.0709s; samplesPerSecond = 9027.4
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 2.93980468 * 640; EvalClassificationError = 0.70625000 * 640; time = 0.0710s; samplesPerSecond = 9008.9
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 3.02220321 * 640; EvalClassificationError = 0.72968750 * 640; time = 0.0708s; samplesPerSecond = 9034.7
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 2.95530875 * 640; EvalClassificationError = 0.71250000 * 640; time = 0.0710s; samplesPerSecond = 9013.0
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 2.95808434 * 640; EvalClassificationError = 0.72812500 * 640; time = 0.0710s; samplesPerSecond = 9011.8
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 3.00790105 * 640; EvalClassificationError = 0.72656250 * 640; time = 0.0710s; samplesPerSecond = 9017.4
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 3.00108989 * 640; EvalClassificationError = 0.72968750 * 640; time = 0.0709s; samplesPerSecond = 9023.9
MPI Rank 1: 05/18/2017 11:20:03:  Epoch[ 1 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 2.91919650 * 640; EvalClassificationError = 0.70468750 * 640; time = 0.0709s; samplesPerSecond = 9031.9
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 3.00591973 * 640; EvalClassificationError = 0.73750000 * 640; time = 0.0711s; samplesPerSecond = 9003.8
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 2.93801198 * 640; EvalClassificationError = 0.70937500 * 640; time = 0.0708s; samplesPerSecond = 9037.9
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 2.97078954 * 640; EvalClassificationError = 0.74531250 * 640; time = 0.0711s; samplesPerSecond = 8998.4
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 2.86114904 * 640; EvalClassificationError = 0.67812500 * 640; time = 0.0712s; samplesPerSecond = 8984.8
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 2.88072070 * 640; EvalClassificationError = 0.71562500 * 640; time = 0.0710s; samplesPerSecond = 9009.7
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 2.90403961 * 640; EvalClassificationError = 0.71875000 * 640; time = 0.0712s; samplesPerSecond = 8985.5
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 2.82605150 * 640; EvalClassificationError = 0.70937500 * 640; time = 0.0711s; samplesPerSecond = 9000.8
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 2.86512788 * 640; EvalClassificationError = 0.67187500 * 640; time = 0.0712s; samplesPerSecond = 8990.6
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 2.82675637 * 640; EvalClassificationError = 0.70312500 * 640; time = 0.0710s; samplesPerSecond = 9015.9
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 2.69768964 * 640; EvalClassificationError = 0.68281250 * 640; time = 0.0715s; samplesPerSecond = 8956.6
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 2.74295251 * 640; EvalClassificationError = 0.66562500 * 640; time = 0.0713s; samplesPerSecond = 8970.7
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 2.79704092 * 640; EvalClassificationError = 0.71093750 * 640; time = 0.0709s; samplesPerSecond = 9026.8
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 2.68799813 * 640; EvalClassificationError = 0.67968750 * 640; time = 0.0711s; samplesPerSecond = 9003.0
MPI Rank 1: 05/18/2017 11:20:04:  Epoch[ 1 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 2.76492372 * 640; EvalClassificationError = 0.68281250 * 640; time = 0.0711s; samplesPerSecond = 9006.9
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 2.77331134 * 640; EvalClassificationError = 0.67656250 * 640; time = 0.0712s; samplesPerSecond = 8989.6
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 2.71057680 * 640; EvalClassificationError = 0.68437500 * 640; time = 0.0710s; samplesPerSecond = 9017.4
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 2.78835610 * 640; EvalClassificationError = 0.65937500 * 640; time = 0.0708s; samplesPerSecond = 9035.3
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 2.78407908 * 640; EvalClassificationError = 0.68125000 * 640; time = 0.0711s; samplesPerSecond = 9000.3
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 2.72041183 * 640; EvalClassificationError = 0.67031250 * 640; time = 0.0710s; samplesPerSecond = 9020.1
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 2.70357516 * 640; EvalClassificationError = 0.64062500 * 640; time = 0.0708s; samplesPerSecond = 9035.5
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 2.70911783 * 640; EvalClassificationError = 0.66875000 * 640; time = 0.0706s; samplesPerSecond = 9059.9
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 2.67625457 * 640; EvalClassificationError = 0.66406250 * 640; time = 0.0709s; samplesPerSecond = 9032.0
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 2.53164780 * 640; EvalClassificationError = 0.62812500 * 640; time = 0.0710s; samplesPerSecond = 9010.3
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 2.63327435 * 640; EvalClassificationError = 0.66406250 * 640; time = 0.0712s; samplesPerSecond = 8994.8
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 2.65919476 * 640; EvalClassificationError = 0.65312500 * 640; time = 0.0711s; samplesPerSecond = 9006.7
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 2.58937546 * 640; EvalClassificationError = 0.66718750 * 640; time = 0.0711s; samplesPerSecond = 9002.6
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 2.72922100 * 640; EvalClassificationError = 0.67968750 * 640; time = 0.0708s; samplesPerSecond = 9035.7
MPI Rank 1: 05/18/2017 11:20:05:  Epoch[ 1 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 2.66272632 * 640; EvalClassificationError = 0.66093750 * 640; time = 0.0712s; samplesPerSecond = 8992.9
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 2.52903186 * 640; EvalClassificationError = 0.65781250 * 640; time = 0.0710s; samplesPerSecond = 9009.0
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 2.62197376 * 640; EvalClassificationError = 0.65625000 * 640; time = 0.0710s; samplesPerSecond = 9011.5
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 2.55515259 * 640; EvalClassificationError = 0.66093750 * 640; time = 0.0707s; samplesPerSecond = 9058.5
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 2.55061458 * 640; EvalClassificationError = 0.64531250 * 640; time = 0.0709s; samplesPerSecond = 9026.9
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 2.59909361 * 640; EvalClassificationError = 0.65625000 * 640; time = 0.0711s; samplesPerSecond = 8999.4
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 2.54354716 * 640; EvalClassificationError = 0.62343750 * 640; time = 0.0714s; samplesPerSecond = 8961.6
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 2.48492488 * 640; EvalClassificationError = 0.63593750 * 640; time = 0.0710s; samplesPerSecond = 9013.4
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 2.53033570 * 640; EvalClassificationError = 0.63750000 * 640; time = 0.0712s; samplesPerSecond = 8988.6
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 2.35351888 * 640; EvalClassificationError = 0.60468750 * 640; time = 0.0710s; samplesPerSecond = 9007.9
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 2.54703608 * 640; EvalClassificationError = 0.64218750 * 640; time = 0.0711s; samplesPerSecond = 8997.9
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 2.45432789 * 640; EvalClassificationError = 0.63750000 * 640; time = 0.0711s; samplesPerSecond = 9002.0
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 2.42561109 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0711s; samplesPerSecond = 8997.0
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 2.37543454 * 640; EvalClassificationError = 0.61250000 * 640; time = 0.0711s; samplesPerSecond = 9002.8
MPI Rank 1: 05/18/2017 11:20:06:  Epoch[ 1 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 2.35908547 * 640; EvalClassificationError = 0.59062500 * 640; time = 0.0710s; samplesPerSecond = 9019.8
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 2.36149370 * 640; EvalClassificationError = 0.60781250 * 640; time = 0.0710s; samplesPerSecond = 9020.4
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 2.33347331 * 640; EvalClassificationError = 0.57187500 * 640; time = 0.0711s; samplesPerSecond = 8998.7
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 2.44891571 * 640; EvalClassificationError = 0.61875000 * 640; time = 0.0710s; samplesPerSecond = 9011.1
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 2.31631465 * 640; EvalClassificationError = 0.58125000 * 640; time = 0.0712s; samplesPerSecond = 8994.2
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 2.32131369 * 640; EvalClassificationError = 0.60937500 * 640; time = 0.0710s; samplesPerSecond = 9013.7
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 2.48493949 * 640; EvalClassificationError = 0.63437500 * 640; time = 0.0710s; samplesPerSecond = 9013.7
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 2.35487208 * 640; EvalClassificationError = 0.61406250 * 640; time = 0.0712s; samplesPerSecond = 8993.9
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 2.37970920 * 640; EvalClassificationError = 0.62500000 * 640; time = 0.0709s; samplesPerSecond = 9028.7
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 2.38320104 * 640; EvalClassificationError = 0.62031250 * 640; time = 0.0711s; samplesPerSecond = 9002.8
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 2.49962565 * 640; EvalClassificationError = 0.63437500 * 640; time = 0.0711s; samplesPerSecond = 8996.1
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 2.19814538 * 640; EvalClassificationError = 0.63125000 * 640; time = 0.0709s; samplesPerSecond = 9029.2
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 2.27133493 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.0712s; samplesPerSecond = 8994.4
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 2.20500156 * 640; EvalClassificationError = 0.60000000 * 640; time = 0.0710s; samplesPerSecond = 9010.9
MPI Rank 1: 05/18/2017 11:20:07:  Epoch[ 1 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 2.33060032 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0711s; samplesPerSecond = 9007.3
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 2.29741317 * 640; EvalClassificationError = 0.57656250 * 640; time = 0.0709s; samplesPerSecond = 9022.5
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 2.29300853 * 640; EvalClassificationError = 0.60156250 * 640; time = 0.0711s; samplesPerSecond = 9004.6
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 2.29940468 * 640; EvalClassificationError = 0.60781250 * 640; time = 0.0708s; samplesPerSecond = 9036.7
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 2.21838646 * 640; EvalClassificationError = 0.60156250 * 640; time = 0.0710s; samplesPerSecond = 9017.4
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 2.23688837 * 640; EvalClassificationError = 0.60468750 * 640; time = 0.0711s; samplesPerSecond = 9001.2
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 2.25579344 * 640; EvalClassificationError = 0.60625000 * 640; time = 0.0709s; samplesPerSecond = 9021.5
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 2.39626359 * 640; EvalClassificationError = 0.62031250 * 640; time = 0.0711s; samplesPerSecond = 9003.9
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 2.29742943 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0709s; samplesPerSecond = 9028.9
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 2.25004394 * 640; EvalClassificationError = 0.61718750 * 640; time = 0.0709s; samplesPerSecond = 9027.6
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 2.27782830 * 640; EvalClassificationError = 0.56718750 * 640; time = 0.0711s; samplesPerSecond = 8998.0
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 2.22271881 * 640; EvalClassificationError = 0.61250000 * 640; time = 0.0712s; samplesPerSecond = 8983.7
MPI Rank 1: 05/18/2017 11:20:08:  Epoch[ 1 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 2.30667131 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.0714s; samplesPerSecond = 8963.1
MPI Rank 1: 05/18/2017 11:20:08: Finished Epoch[ 1 of 3]: [Training] CrossEntropyWithSoftmax = 3.00757982 * 81920; EvalClassificationError = 0.72386475 * 81920; totalSamplesSeen = 81920; learningRatePerSample = 0.001953125; epochTime=9.11231s
MPI Rank 1: 05/18/2017 11:20:08:  Before Epoch[2], previous minibatchSize 64 is considered invalid -> resetting.
MPI Rank 1: 05/18/2017 11:20:08:  AdaptiveMinibatchSearch Epoch[2]: Evaluating minibatchSizes 64..8192
MPI Rank 1: 05/18/2017 11:20:08:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=64 (search range: 64..8192)...
MPI Rank 1: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:08: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 05/18/2017 11:20:08:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24452546 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0712s; samplesPerSecond = 8986.1
MPI Rank 1: 05/18/2017 11:20:08:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.11895537 * 640; EvalClassificationError = 0.53593750 * 640; time = 0.0711s; samplesPerSecond = 8996.4
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24541348 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0708s; samplesPerSecond = 9033.6
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06171132 * 640; EvalClassificationError = 0.57187500 * 640; time = 0.0712s; samplesPerSecond = 8987.3
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23423145 * 640; EvalClassificationError = 0.61093750 * 640; time = 0.0710s; samplesPerSecond = 9010.5
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15141392 * 640; EvalClassificationError = 0.58281250 * 640; time = 0.0710s; samplesPerSecond = 9013.4
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.23595333 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.0709s; samplesPerSecond = 9020.5
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.08959197 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0710s; samplesPerSecond = 9008.5
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11528859 * 640; EvalClassificationError = 0.56718750 * 640; time = 0.0710s; samplesPerSecond = 9008.4
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13442654 * 640; EvalClassificationError = 0.55468750 * 640; time = 0.0709s; samplesPerSecond = 9024.4
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10490506 * 640; EvalClassificationError = 0.60781250 * 640; time = 0.0712s; samplesPerSecond = 8986.6
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.03299349 * 640; EvalClassificationError = 0.57031250 * 640; time = 0.0710s; samplesPerSecond = 9015.0
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10076314 * 640; EvalClassificationError = 0.59687500 * 640; time = 0.0710s; samplesPerSecond = 9010.5
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.08921883 * 640; EvalClassificationError = 0.55937500 * 640; time = 0.0712s; samplesPerSecond = 8992.2
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.11193971 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0707s; samplesPerSecond = 9056.2
MPI Rank 1: 05/18/2017 11:20:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.14099190 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0711s; samplesPerSecond = 8999.1
MPI Rank 1: 05/18/2017 11:20:10:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.13967704 * 10304; EvalClassificationError = 0.57899845 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:10:  AdaptiveMinibatchSearch Epoch[2]: Computed baseCriterion 2.13967704 for minibatchSize=64
MPI Rank 1: 05/18/2017 11:20:10:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=64 (search range: 64..8192)...
MPI Rank 1: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:10: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24452546 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0712s; samplesPerSecond = 8990.7
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.11895537 * 640; EvalClassificationError = 0.53593750 * 640; time = 0.0710s; samplesPerSecond = 9019.5
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24541348 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0709s; samplesPerSecond = 9025.4
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06171132 * 640; EvalClassificationError = 0.57187500 * 640; time = 0.0711s; samplesPerSecond = 8998.7
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23423145 * 640; EvalClassificationError = 0.61093750 * 640; time = 0.0711s; samplesPerSecond = 8998.1
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15141392 * 640; EvalClassificationError = 0.58281250 * 640; time = 0.0711s; samplesPerSecond = 9003.2
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.23595333 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.0711s; samplesPerSecond = 8999.8
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.08959197 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0711s; samplesPerSecond = 8997.1
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11528859 * 640; EvalClassificationError = 0.56718750 * 640; time = 0.0710s; samplesPerSecond = 9018.7
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13442654 * 640; EvalClassificationError = 0.55468750 * 640; time = 0.0711s; samplesPerSecond = 9007.2
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10490506 * 640; EvalClassificationError = 0.60781250 * 640; time = 0.0712s; samplesPerSecond = 8992.7
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.03299349 * 640; EvalClassificationError = 0.57031250 * 640; time = 0.0710s; samplesPerSecond = 9013.2
MPI Rank 1: 05/18/2017 11:20:10:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10076314 * 640; EvalClassificationError = 0.59687500 * 640; time = 0.0711s; samplesPerSecond = 8995.6
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.08921883 * 640; EvalClassificationError = 0.55937500 * 640; time = 0.0710s; samplesPerSecond = 9016.7
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.11193971 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0712s; samplesPerSecond = 8987.0
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.14099190 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0710s; samplesPerSecond = 9014.5
MPI Rank 1: 05/18/2017 11:20:11:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.13967704 * 10304; EvalClassificationError = 0.57899845 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:11:  AdaptiveMinibatchSearch Epoch[2]: Keep searching... epochCriterion = 2.13967704 vs. baseCriterion = 2.13967704
MPI Rank 1: 05/18/2017 11:20:11:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=128 (search range: 64..8192)...
MPI Rank 1: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:11: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 1.56%]: CrossEntropyWithSoftmax = 2.18191866 * 1280; EvalClassificationError = 0.55546875 * 1280; time = 0.0786s; samplesPerSecond = 16285.5
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 3.12%]: CrossEntropyWithSoftmax = 2.16689676 * 1280; EvalClassificationError = 0.59218750 * 1280; time = 0.0774s; samplesPerSecond = 16534.9
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 4.69%]: CrossEntropyWithSoftmax = 2.24005467 * 1280; EvalClassificationError = 0.60468750 * 1280; time = 0.0778s; samplesPerSecond = 16453.6
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 6.25%]: CrossEntropyWithSoftmax = 2.25440418 * 1280; EvalClassificationError = 0.60703125 * 1280; time = 0.0774s; samplesPerSecond = 16541.5
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 7.81%]: CrossEntropyWithSoftmax = 2.12505792 * 1280; EvalClassificationError = 0.56171875 * 1280; time = 0.0777s; samplesPerSecond = 16465.0
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 9.38%]: CrossEntropyWithSoftmax = 2.09343914 * 1280; EvalClassificationError = 0.58281250 * 1280; time = 0.0776s; samplesPerSecond = 16494.9
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 10.94%]: CrossEntropyWithSoftmax = 2.12298289 * 1280; EvalClassificationError = 0.58750000 * 1280; time = 0.0774s; samplesPerSecond = 16544.2
MPI Rank 1: 05/18/2017 11:20:11:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 12.50%]: CrossEntropyWithSoftmax = 2.15056438 * 1280; EvalClassificationError = 0.57265625 * 1280; time = 0.0776s; samplesPerSecond = 16495.2
MPI Rank 1: 05/18/2017 11:20:11:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.16782779 * 10368; EvalClassificationError = 0.58285108 * 10368; learningRatePerSample = 0.001953125; minibatchSize = 128
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:11:  AdaptiveMinibatchSearch Epoch[2]: Search successful. New minibatchSize is 64. epochCriterion = 2.13967704 vs baseCriterion = 2.13967704
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:11: Starting Epoch 2: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 1: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:11: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 05/18/2017 11:20:11:  Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24452546 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0714s; samplesPerSecond = 8959.8
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.11895537 * 640; EvalClassificationError = 0.53593750 * 640; time = 0.0710s; samplesPerSecond = 9009.9
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24541348 * 640; EvalClassificationError = 0.60312500 * 640; time = 0.0711s; samplesPerSecond = 9003.4
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06171132 * 640; EvalClassificationError = 0.57187500 * 640; time = 0.0711s; samplesPerSecond = 9002.2
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23423145 * 640; EvalClassificationError = 0.61093750 * 640; time = 0.0709s; samplesPerSecond = 9025.3
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15141392 * 640; EvalClassificationError = 0.58281250 * 640; time = 0.0710s; samplesPerSecond = 9010.1
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.23595333 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.0710s; samplesPerSecond = 9015.2
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.08959197 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0711s; samplesPerSecond = 9003.6
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11528859 * 640; EvalClassificationError = 0.56718750 * 640; time = 0.0708s; samplesPerSecond = 9039.7
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13442654 * 640; EvalClassificationError = 0.55468750 * 640; time = 0.0708s; samplesPerSecond = 9037.5
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10490506 * 640; EvalClassificationError = 0.60781250 * 640; time = 0.0710s; samplesPerSecond = 9008.1
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.03299349 * 640; EvalClassificationError = 0.57031250 * 640; time = 0.0710s; samplesPerSecond = 9019.3
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10076314 * 640; EvalClassificationError = 0.59687500 * 640; time = 0.0710s; samplesPerSecond = 9017.1
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.08921883 * 640; EvalClassificationError = 0.55937500 * 640; time = 0.0709s; samplesPerSecond = 9028.0
MPI Rank 1: 05/18/2017 11:20:12:  Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.11193971 * 640; EvalClassificationError = 0.57500000 * 640; time = 0.0706s; samplesPerSecond = 9060.7
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.14099190 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0710s; samplesPerSecond = 9015.3
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 2.03794535 * 640; EvalClassificationError = 0.52968750 * 640; time = 0.0711s; samplesPerSecond = 8997.0
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 2.08811824 * 640; EvalClassificationError = 0.56875000 * 640; time = 0.0711s; samplesPerSecond = 9001.9
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 2.11230408 * 640; EvalClassificationError = 0.57031250 * 640; time = 0.0709s; samplesPerSecond = 9025.1
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 2.05236903 * 640; EvalClassificationError = 0.55000000 * 640; time = 0.0712s; samplesPerSecond = 8994.3
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 2.00510201 * 640; EvalClassificationError = 0.57031250 * 640; time = 0.0709s; samplesPerSecond = 9025.0
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 1.92081398 * 640; EvalClassificationError = 0.52343750 * 640; time = 0.0706s; samplesPerSecond = 9071.1
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 1.94572433 * 640; EvalClassificationError = 0.51562500 * 640; time = 0.0708s; samplesPerSecond = 9044.5
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 2.01158892 * 640; EvalClassificationError = 0.52968750 * 640; time = 0.0711s; samplesPerSecond = 8996.9
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 2.05074999 * 640; EvalClassificationError = 0.55937500 * 640; time = 0.0711s; samplesPerSecond = 9004.0
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 2.06324493 * 640; EvalClassificationError = 0.52187500 * 640; time = 0.0712s; samplesPerSecond = 8989.1
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 1.99450627 * 640; EvalClassificationError = 0.53281250 * 640; time = 0.0708s; samplesPerSecond = 9041.1
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 1.97134281 * 640; EvalClassificationError = 0.55156250 * 640; time = 0.0708s; samplesPerSecond = 9033.9
MPI Rank 1: 05/18/2017 11:20:13:  Epoch[ 2 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 2.05843180 * 640; EvalClassificationError = 0.56093750 * 640; time = 0.0711s; samplesPerSecond = 8999.0
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 2.09965488 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.0705s; samplesPerSecond = 9082.8
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 1.94968722 * 640; EvalClassificationError = 0.53437500 * 640; time = 0.0710s; samplesPerSecond = 9016.7
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 1.89541292 * 640; EvalClassificationError = 0.54375000 * 640; time = 0.0708s; samplesPerSecond = 9041.4
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 2.08378806 * 640; EvalClassificationError = 0.58281250 * 640; time = 0.0708s; samplesPerSecond = 9044.8
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 1.99608869 * 640; EvalClassificationError = 0.54687500 * 640; time = 0.0708s; samplesPerSecond = 9042.1
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 1.97710423 * 640; EvalClassificationError = 0.54062500 * 640; time = 0.0709s; samplesPerSecond = 9031.4
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 1.93995996 * 640; EvalClassificationError = 0.53125000 * 640; time = 0.0709s; samplesPerSecond = 9026.3
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 1.96527830 * 640; EvalClassificationError = 0.55937500 * 640; time = 0.0707s; samplesPerSecond = 9054.6
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 1.94655805 * 640; EvalClassificationError = 0.54062500 * 640; time = 0.0710s; samplesPerSecond = 9014.9
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 2.03999925 * 640; EvalClassificationError = 0.56875000 * 640; time = 0.0709s; samplesPerSecond = 9025.2
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 2.06761698 * 640; EvalClassificationError = 0.58750000 * 640; time = 0.0711s; samplesPerSecond = 9006.2
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 1.89247397 * 640; EvalClassificationError = 0.52968750 * 640; time = 0.0710s; samplesPerSecond = 9012.5
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 1.96354166 * 640; EvalClassificationError = 0.54687500 * 640; time = 0.0709s; samplesPerSecond = 9020.5
MPI Rank 1: 05/18/2017 11:20:14:  Epoch[ 2 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 1.77985604 * 640; EvalClassificationError = 0.49218750 * 640; time = 0.0709s; samplesPerSecond = 9028.5
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 2.00857384 * 640; EvalClassificationError = 0.55156250 * 640; time = 0.0707s; samplesPerSecond = 9050.6
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 1.85918426 * 640; EvalClassificationError = 0.50625000 * 640; time = 0.0709s; samplesPerSecond = 9024.4
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 1.94765538 * 640; EvalClassificationError = 0.53593750 * 640; time = 0.0712s; samplesPerSecond = 8989.3
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 1.90992052 * 640; EvalClassificationError = 0.50468750 * 640; time = 0.0712s; samplesPerSecond = 8993.3
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 1.89666608 * 640; EvalClassificationError = 0.52812500 * 640; time = 0.0707s; samplesPerSecond = 9054.0
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 1.83342367 * 640; EvalClassificationError = 0.52812500 * 640; time = 0.0708s; samplesPerSecond = 9034.3
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 1.93804681 * 640; EvalClassificationError = 0.51875000 * 640; time = 0.0711s; samplesPerSecond = 9005.6
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 1.89632598 * 640; EvalClassificationError = 0.51250000 * 640; time = 0.0712s; samplesPerSecond = 8990.3
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 1.84849419 * 640; EvalClassificationError = 0.53281250 * 640; time = 0.0710s; samplesPerSecond = 9009.1
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 1.78912223 * 640; EvalClassificationError = 0.50781250 * 640; time = 0.0709s; samplesPerSecond = 9026.8
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 1.83952360 * 640; EvalClassificationError = 0.54531250 * 640; time = 0.0708s; samplesPerSecond = 9033.6
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 1.93770729 * 640; EvalClassificationError = 0.53125000 * 640; time = 0.0710s; samplesPerSecond = 9015.2
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 1.82155165 * 640; EvalClassificationError = 0.50468750 * 640; time = 0.0708s; samplesPerSecond = 9045.7
MPI Rank 1: 05/18/2017 11:20:15:  Epoch[ 2 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 1.82655546 * 640; EvalClassificationError = 0.48281250 * 640; time = 0.0708s; samplesPerSecond = 9034.1
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 1.85789778 * 640; EvalClassificationError = 0.50312500 * 640; time = 0.0710s; samplesPerSecond = 9019.2
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 1.81129094 * 640; EvalClassificationError = 0.52031250 * 640; time = 0.0712s; samplesPerSecond = 8994.0
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 1.75389091 * 640; EvalClassificationError = 0.48750000 * 640; time = 0.0710s; samplesPerSecond = 9020.1
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 1.78544725 * 640; EvalClassificationError = 0.51875000 * 640; time = 0.0711s; samplesPerSecond = 9001.8
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 1.85118920 * 640; EvalClassificationError = 0.51093750 * 640; time = 0.0709s; samplesPerSecond = 9028.5
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 1.70199411 * 640; EvalClassificationError = 0.46875000 * 640; time = 0.0710s; samplesPerSecond = 9011.4
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 1.82835107 * 640; EvalClassificationError = 0.51718750 * 640; time = 0.0707s; samplesPerSecond = 9046.1
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 1.84736003 * 640; EvalClassificationError = 0.52187500 * 640; time = 0.0710s; samplesPerSecond = 9012.9
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 1.77140144 * 640; EvalClassificationError = 0.51093750 * 640; time = 0.0707s; samplesPerSecond = 9052.5
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 1.85247283 * 640; EvalClassificationError = 0.51875000 * 640; time = 0.0713s; samplesPerSecond = 8982.4
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 1.76495149 * 640; EvalClassificationError = 0.51406250 * 640; time = 0.0708s; samplesPerSecond = 9039.0
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 1.80603502 * 640; EvalClassificationError = 0.51562500 * 640; time = 0.0711s; samplesPerSecond = 9004.5
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 1.77663139 * 640; EvalClassificationError = 0.51093750 * 640; time = 0.0710s; samplesPerSecond = 9019.9
MPI Rank 1: 05/18/2017 11:20:16:  Epoch[ 2 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 1.80503452 * 640; EvalClassificationError = 0.49687500 * 640; time = 0.0714s; samplesPerSecond = 8960.6
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 1.74058595 * 640; EvalClassificationError = 0.47656250 * 640; time = 0.0707s; samplesPerSecond = 9051.5
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 1.74414311 * 640; EvalClassificationError = 0.50625000 * 640; time = 0.0710s; samplesPerSecond = 9020.2
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 1.82071734 * 640; EvalClassificationError = 0.52343750 * 640; time = 0.0712s; samplesPerSecond = 8986.6
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 1.72750386 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0711s; samplesPerSecond = 8996.1
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 1.74787156 * 640; EvalClassificationError = 0.50625000 * 640; time = 0.0710s; samplesPerSecond = 9015.9
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 1.75394227 * 640; EvalClassificationError = 0.48437500 * 640; time = 0.0712s; samplesPerSecond = 8989.4
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 1.66462933 * 640; EvalClassificationError = 0.45468750 * 640; time = 0.0711s; samplesPerSecond = 9007.4
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 1.70626874 * 640; EvalClassificationError = 0.47500000 * 640; time = 0.0719s; samplesPerSecond = 8902.0
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 1.80531225 * 640; EvalClassificationError = 0.50937500 * 640; time = 0.0711s; samplesPerSecond = 9004.9
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 1.75140112 * 640; EvalClassificationError = 0.50312500 * 640; time = 0.0708s; samplesPerSecond = 9040.3
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 1.77447142 * 640; EvalClassificationError = 0.51093750 * 640; time = 0.0711s; samplesPerSecond = 9004.9
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 1.79489417 * 640; EvalClassificationError = 0.49687500 * 640; time = 0.0711s; samplesPerSecond = 9007.5
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 1.76492415 * 640; EvalClassificationError = 0.48593750 * 640; time = 0.0706s; samplesPerSecond = 9059.0
MPI Rank 1: 05/18/2017 11:20:17:  Epoch[ 2 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 1.68898560 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0710s; samplesPerSecond = 9010.3
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 1.76965122 * 640; EvalClassificationError = 0.52031250 * 640; time = 0.0707s; samplesPerSecond = 9047.1
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 1.71022909 * 640; EvalClassificationError = 0.49687500 * 640; time = 0.0708s; samplesPerSecond = 9033.7
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 1.75330096 * 640; EvalClassificationError = 0.48750000 * 640; time = 0.0714s; samplesPerSecond = 8962.4
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 1.80812599 * 640; EvalClassificationError = 0.52812500 * 640; time = 0.0710s; samplesPerSecond = 9018.5
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 1.66747206 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0711s; samplesPerSecond = 8999.9
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 1.64717125 * 640; EvalClassificationError = 0.49062500 * 640; time = 0.0710s; samplesPerSecond = 9016.4
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 1.62476293 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0708s; samplesPerSecond = 9043.8
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 1.74657781 * 640; EvalClassificationError = 0.50937500 * 640; time = 0.0711s; samplesPerSecond = 8997.1
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 1.66677585 * 640; EvalClassificationError = 0.48906250 * 640; time = 0.0708s; samplesPerSecond = 9040.7
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 1.74562939 * 640; EvalClassificationError = 0.50312500 * 640; time = 0.0709s; samplesPerSecond = 9032.6
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 1.74365548 * 640; EvalClassificationError = 0.48750000 * 640; time = 0.0712s; samplesPerSecond = 8993.3
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 1.70489601 * 640; EvalClassificationError = 0.48750000 * 640; time = 0.0709s; samplesPerSecond = 9030.3
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 1.62783331 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0710s; samplesPerSecond = 9008.8
MPI Rank 1: 05/18/2017 11:20:18:  Epoch[ 2 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 1.71071160 * 640; EvalClassificationError = 0.50468750 * 640; time = 0.0712s; samplesPerSecond = 8982.6
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 1.64233094 * 640; EvalClassificationError = 0.47656250 * 640; time = 0.0709s; samplesPerSecond = 9021.8
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 1.67306025 * 640; EvalClassificationError = 0.46250000 * 640; time = 0.0708s; samplesPerSecond = 9037.0
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 1.57546355 * 640; EvalClassificationError = 0.41406250 * 640; time = 0.0708s; samplesPerSecond = 9038.7
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 1.68265112 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0711s; samplesPerSecond = 9000.6
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 1.65074435 * 640; EvalClassificationError = 0.48125000 * 640; time = 0.0710s; samplesPerSecond = 9019.6
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 1.62080173 * 640; EvalClassificationError = 0.45625000 * 640; time = 0.0706s; samplesPerSecond = 9064.5
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 1.66091455 * 640; EvalClassificationError = 0.46718750 * 640; time = 0.0708s; samplesPerSecond = 9040.0
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 1.67834581 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0709s; samplesPerSecond = 9023.8
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 1.62603165 * 640; EvalClassificationError = 0.46875000 * 640; time = 0.0711s; samplesPerSecond = 8995.6
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 1.63042903 * 640; EvalClassificationError = 0.45625000 * 640; time = 0.0709s; samplesPerSecond = 9031.8
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 1.73934936 * 640; EvalClassificationError = 0.50156250 * 640; time = 0.0710s; samplesPerSecond = 9009.2
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 1.62487143 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0710s; samplesPerSecond = 9019.7
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 1.69205097 * 640; EvalClassificationError = 0.49687500 * 640; time = 0.0707s; samplesPerSecond = 9054.3
MPI Rank 1: 05/18/2017 11:20:19:  Epoch[ 2 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 1.69563130 * 640; EvalClassificationError = 0.48281250 * 640; time = 0.0710s; samplesPerSecond = 9013.2
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 1.64531303 * 640; EvalClassificationError = 0.47656250 * 640; time = 0.0711s; samplesPerSecond = 9001.6
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 1.60021363 * 640; EvalClassificationError = 0.45781250 * 640; time = 0.0710s; samplesPerSecond = 9019.5
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 1.67695254 * 640; EvalClassificationError = 0.48437500 * 640; time = 0.0710s; samplesPerSecond = 9017.6
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 1.54504004 * 640; EvalClassificationError = 0.47656250 * 640; time = 0.0710s; samplesPerSecond = 9019.9
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 1.68604931 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0708s; samplesPerSecond = 9038.5
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 1.63160791 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0713s; samplesPerSecond = 8982.3
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 1.54289047 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.0707s; samplesPerSecond = 9053.1
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 1.60284986 * 640; EvalClassificationError = 0.48125000 * 640; time = 0.0708s; samplesPerSecond = 9039.6
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 1.67337501 * 640; EvalClassificationError = 0.50312500 * 640; time = 0.0707s; samplesPerSecond = 9051.9
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 1.52889813 * 640; EvalClassificationError = 0.43125000 * 640; time = 0.0711s; samplesPerSecond = 8996.3
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 1.54819833 * 640; EvalClassificationError = 0.45468750 * 640; time = 0.0709s; samplesPerSecond = 9022.1
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 1.52668717 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.0711s; samplesPerSecond = 9001.5
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 1.58543380 * 640; EvalClassificationError = 0.47343750 * 640; time = 0.0709s; samplesPerSecond = 9028.3
MPI Rank 1: 05/18/2017 11:20:20:  Epoch[ 2 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 1.61389061 * 640; EvalClassificationError = 0.46875000 * 640; time = 0.0707s; samplesPerSecond = 9049.8
MPI Rank 1: 05/18/2017 11:20:21:  Epoch[ 2 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 1.69489542 * 640; EvalClassificationError = 0.47500000 * 640; time = 0.0715s; samplesPerSecond = 8948.2
MPI Rank 1: 05/18/2017 11:20:21: Finished Epoch[ 2 of 3]: [Training] CrossEntropyWithSoftmax = 1.83902890 * 81920; EvalClassificationError = 0.51396484 * 81920; totalSamplesSeen = 163840; learningRatePerSample = 0.001953125; epochTime=12.1572s
MPI Rank 1: 05/18/2017 11:20:21:  AdaptiveMinibatchSearch Epoch[3]: Evaluating minibatchSizes 64..128
MPI Rank 1: 05/18/2017 11:20:21:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=64 (search range: 64..128)...
MPI Rank 1: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:21: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47574155 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.0710s; samplesPerSecond = 9015.4
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65297932 * 640; EvalClassificationError = 0.49843750 * 640; time = 0.0709s; samplesPerSecond = 9026.7
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47188226 * 640; EvalClassificationError = 0.40625000 * 640; time = 0.0710s; samplesPerSecond = 9011.6
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59761080 * 640; EvalClassificationError = 0.47500000 * 640; time = 0.0710s; samplesPerSecond = 9016.5
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52638871 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0709s; samplesPerSecond = 9025.4
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62435294 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0705s; samplesPerSecond = 9071.9
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.59857812 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0709s; samplesPerSecond = 9021.2
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.56242471 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0709s; samplesPerSecond = 9032.4
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60797573 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0710s; samplesPerSecond = 9013.6
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.68022905 * 640; EvalClassificationError = 0.50000000 * 640; time = 0.0710s; samplesPerSecond = 9016.6
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56460519 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0711s; samplesPerSecond = 8995.7
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66500836 * 640; EvalClassificationError = 0.47968750 * 640; time = 0.0707s; samplesPerSecond = 9053.7
MPI Rank 1: 05/18/2017 11:20:21:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.56991557 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0710s; samplesPerSecond = 9015.3
MPI Rank 1: 05/18/2017 11:20:22:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.45437317 * 640; EvalClassificationError = 0.38906250 * 640; time = 0.0706s; samplesPerSecond = 9061.7
MPI Rank 1: 05/18/2017 11:20:22:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.54998771 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0708s; samplesPerSecond = 9040.1
MPI Rank 1: 05/18/2017 11:20:22:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.58609751 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0709s; samplesPerSecond = 9029.5
MPI Rank 1: 05/18/2017 11:20:22:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.57443367 * 10304; EvalClassificationError = 0.45458075 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:22:  AdaptiveMinibatchSearch Epoch[3]: Computed baseCriterion 1.57443367 for minibatchSize=64
MPI Rank 1: 05/18/2017 11:20:22:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=64 (search range: 64..128)...
MPI Rank 1: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:22: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47574155 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.0708s; samplesPerSecond = 9038.3
MPI Rank 1: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65297932 * 640; EvalClassificationError = 0.49843750 * 640; time = 0.0709s; samplesPerSecond = 9029.7
MPI Rank 1: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47188226 * 640; EvalClassificationError = 0.40625000 * 640; time = 0.0709s; samplesPerSecond = 9028.0
MPI Rank 1: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59761080 * 640; EvalClassificationError = 0.47500000 * 640; time = 0.0709s; samplesPerSecond = 9025.5
MPI Rank 1: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52638871 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0710s; samplesPerSecond = 9014.2
MPI Rank 1: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62435294 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0707s; samplesPerSecond = 9054.2
MPI Rank 1: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.59857812 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0710s; samplesPerSecond = 9016.1
MPI Rank 1: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.56242471 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0709s; samplesPerSecond = 9024.8
MPI Rank 1: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60797573 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0708s; samplesPerSecond = 9035.8
MPI Rank 1: 05/18/2017 11:20:22:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.68022905 * 640; EvalClassificationError = 0.50000000 * 640; time = 0.0708s; samplesPerSecond = 9038.2
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56460519 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0709s; samplesPerSecond = 9021.8
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66500836 * 640; EvalClassificationError = 0.47968750 * 640; time = 0.0709s; samplesPerSecond = 9032.4
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.56991557 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0707s; samplesPerSecond = 9057.8
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.45437317 * 640; EvalClassificationError = 0.38906250 * 640; time = 0.0708s; samplesPerSecond = 9036.4
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.54998771 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0706s; samplesPerSecond = 9064.7
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.58609751 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0709s; samplesPerSecond = 9033.0
MPI Rank 1: 05/18/2017 11:20:23:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.57443367 * 10304; EvalClassificationError = 0.45458075 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:23:  AdaptiveMinibatchSearch Epoch[3]: Keep searching... epochCriterion = 1.57443367 vs. baseCriterion = 1.57443367
MPI Rank 1: 05/18/2017 11:20:23:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=128 (search range: 64..128)...
MPI Rank 1: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:23: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 1.56%]: CrossEntropyWithSoftmax = 1.56361473 * 1280; EvalClassificationError = 0.46640625 * 1280; time = 0.0777s; samplesPerSecond = 16464.3
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 3.12%]: CrossEntropyWithSoftmax = 1.53899072 * 1280; EvalClassificationError = 0.45234375 * 1280; time = 0.0774s; samplesPerSecond = 16537.0
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 4.69%]: CrossEntropyWithSoftmax = 1.58573210 * 1280; EvalClassificationError = 0.44609375 * 1280; time = 0.0775s; samplesPerSecond = 16515.8
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 6.25%]: CrossEntropyWithSoftmax = 1.59001601 * 1280; EvalClassificationError = 0.46328125 * 1280; time = 0.0775s; samplesPerSecond = 16526.7
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 7.81%]: CrossEntropyWithSoftmax = 1.66527522 * 1280; EvalClassificationError = 0.48671875 * 1280; time = 0.0778s; samplesPerSecond = 16450.5
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 9.38%]: CrossEntropyWithSoftmax = 1.64789265 * 1280; EvalClassificationError = 0.47578125 * 1280; time = 0.0775s; samplesPerSecond = 16514.8
MPI Rank 1: 05/18/2017 11:20:23:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 10.94%]: CrossEntropyWithSoftmax = 1.60105749 * 1280; EvalClassificationError = 0.44921875 * 1280; time = 0.0775s; samplesPerSecond = 16512.7
MPI Rank 1: 05/18/2017 11:20:24:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 12.50%]: CrossEntropyWithSoftmax = 1.65896720 * 1280; EvalClassificationError = 0.46796875 * 1280; time = 0.0776s; samplesPerSecond = 16492.8
MPI Rank 1: 05/18/2017 11:20:24:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.60772332 * 10368; EvalClassificationError = 0.46421682 * 10368; learningRatePerSample = 0.001953125; minibatchSize = 128
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].05/18/2017 11:20:24:  AdaptiveMinibatchSearch Epoch[3]: Search successful. New minibatchSize is 64. epochCriterion = 1.57443367 vs baseCriterion = 1.57443367
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:24: Starting Epoch 3: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 1: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:24: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47574155 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.0711s; samplesPerSecond = 9004.9
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65297932 * 640; EvalClassificationError = 0.49843750 * 640; time = 0.0710s; samplesPerSecond = 9019.9
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47188226 * 640; EvalClassificationError = 0.40625000 * 640; time = 0.0709s; samplesPerSecond = 9031.2
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59761080 * 640; EvalClassificationError = 0.47500000 * 640; time = 0.0709s; samplesPerSecond = 9029.7
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52638871 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0709s; samplesPerSecond = 9023.7
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62435294 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0707s; samplesPerSecond = 9054.0
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.59857812 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0709s; samplesPerSecond = 9026.6
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.56242471 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0707s; samplesPerSecond = 9054.8
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60797573 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0710s; samplesPerSecond = 9018.0
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.68022905 * 640; EvalClassificationError = 0.50000000 * 640; time = 0.0708s; samplesPerSecond = 9035.9
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56460519 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0710s; samplesPerSecond = 9016.0
MPI Rank 1: 05/18/2017 11:20:24:  Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66500836 * 640; EvalClassificationError = 0.47968750 * 640; time = 0.0709s; samplesPerSecond = 9029.0
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.56991557 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0708s; samplesPerSecond = 9038.6
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.45437317 * 640; EvalClassificationError = 0.38906250 * 640; time = 0.0708s; samplesPerSecond = 9044.3
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.54998771 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0708s; samplesPerSecond = 9034.6
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.58609751 * 640; EvalClassificationError = 0.47187500 * 640; time = 0.0708s; samplesPerSecond = 9041.2
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 1.58496713 * 640; EvalClassificationError = 0.48125000 * 640; time = 0.0711s; samplesPerSecond = 9003.7
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 1.51015976 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0708s; samplesPerSecond = 9039.6
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 1.60065218 * 640; EvalClassificationError = 0.47968750 * 640; time = 0.0709s; samplesPerSecond = 9027.2
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 1.52573519 * 640; EvalClassificationError = 0.45625000 * 640; time = 0.0708s; samplesPerSecond = 9034.5
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 1.54107550 * 640; EvalClassificationError = 0.46718750 * 640; time = 0.0709s; samplesPerSecond = 9022.3
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 1.54599117 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0709s; samplesPerSecond = 9023.6
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 1.47641221 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.0709s; samplesPerSecond = 9032.3
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 1.56643257 * 640; EvalClassificationError = 0.46562500 * 640; time = 0.0709s; samplesPerSecond = 9025.2
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 1.47729166 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0708s; samplesPerSecond = 9044.5
MPI Rank 1: 05/18/2017 11:20:25:  Epoch[ 3 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 1.60991841 * 640; EvalClassificationError = 0.45468750 * 640; time = 0.0709s; samplesPerSecond = 9025.0
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 1.62338406 * 640; EvalClassificationError = 0.46718750 * 640; time = 0.0709s; samplesPerSecond = 9026.9
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 1.44890369 * 640; EvalClassificationError = 0.42500000 * 640; time = 0.0707s; samplesPerSecond = 9056.0
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 1.60029332 * 640; EvalClassificationError = 0.48906250 * 640; time = 0.0709s; samplesPerSecond = 9020.7
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 1.52963287 * 640; EvalClassificationError = 0.45468750 * 640; time = 0.0706s; samplesPerSecond = 9067.9
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 1.50387765 * 640; EvalClassificationError = 0.42031250 * 640; time = 0.0709s; samplesPerSecond = 9029.2
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 1.53521925 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0709s; samplesPerSecond = 9030.7
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 1.50796862 * 640; EvalClassificationError = 0.44062500 * 640; time = 0.0707s; samplesPerSecond = 9050.8
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 1.58919805 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0707s; samplesPerSecond = 9055.7
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 1.47816378 * 640; EvalClassificationError = 0.42812500 * 640; time = 0.0704s; samplesPerSecond = 9086.1
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 1.59773652 * 640; EvalClassificationError = 0.45468750 * 640; time = 0.0708s; samplesPerSecond = 9039.4
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 1.51149262 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0708s; samplesPerSecond = 9036.0
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 1.52533096 * 640; EvalClassificationError = 0.46562500 * 640; time = 0.0709s; samplesPerSecond = 9029.6
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 1.59753668 * 640; EvalClassificationError = 0.44843750 * 640; time = 0.0707s; samplesPerSecond = 9051.0
MPI Rank 1: 05/18/2017 11:20:26:  Epoch[ 3 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 1.51499579 * 640; EvalClassificationError = 0.40937500 * 640; time = 0.0710s; samplesPerSecond = 9018.4
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 1.47924883 * 640; EvalClassificationError = 0.42656250 * 640; time = 0.0708s; samplesPerSecond = 9041.6
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 1.60917997 * 640; EvalClassificationError = 0.46093750 * 640; time = 0.0709s; samplesPerSecond = 9024.2
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 1.63635723 * 640; EvalClassificationError = 0.48281250 * 640; time = 0.0707s; samplesPerSecond = 9046.3
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 1.48886028 * 640; EvalClassificationError = 0.44218750 * 640; time = 0.0711s; samplesPerSecond = 9006.8
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 1.48224978 * 640; EvalClassificationError = 0.44218750 * 640; time = 0.0711s; samplesPerSecond = 9000.8
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 1.65845184 * 640; EvalClassificationError = 0.48906250 * 640; time = 0.0710s; samplesPerSecond = 9016.7
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 1.46110566 * 640; EvalClassificationError = 0.42656250 * 640; time = 0.0710s; samplesPerSecond = 9011.1
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 1.55035801 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.0708s; samplesPerSecond = 9044.4
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 1.43324101 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0709s; samplesPerSecond = 9031.0
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 1.56441297 * 640; EvalClassificationError = 0.44843750 * 640; time = 0.0710s; samplesPerSecond = 9012.8
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 1.52645140 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0710s; samplesPerSecond = 9012.2
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 1.29957479 * 640; EvalClassificationError = 0.38437500 * 640; time = 0.0708s; samplesPerSecond = 9039.8
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 1.50003462 * 640; EvalClassificationError = 0.46562500 * 640; time = 0.0707s; samplesPerSecond = 9055.5
MPI Rank 1: 05/18/2017 11:20:27:  Epoch[ 3 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 1.59309925 * 640; EvalClassificationError = 0.46562500 * 640; time = 0.0706s; samplesPerSecond = 9070.0
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 1.38171997 * 640; EvalClassificationError = 0.40781250 * 640; time = 0.0709s; samplesPerSecond = 9021.1
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 1.55160848 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0709s; samplesPerSecond = 9028.8
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 1.47430193 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0711s; samplesPerSecond = 8995.1
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 1.57465311 * 640; EvalClassificationError = 0.46406250 * 640; time = 0.0710s; samplesPerSecond = 9009.2
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 1.43990494 * 640; EvalClassificationError = 0.42187500 * 640; time = 0.0709s; samplesPerSecond = 9031.3
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 1.52507182 * 640; EvalClassificationError = 0.45156250 * 640; time = 0.0710s; samplesPerSecond = 9020.1
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 1.42557617 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.0709s; samplesPerSecond = 9030.7
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 1.46460882 * 640; EvalClassificationError = 0.43437500 * 640; time = 0.0707s; samplesPerSecond = 9051.6
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 1.42519263 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0707s; samplesPerSecond = 9055.9
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 1.47671055 * 640; EvalClassificationError = 0.43437500 * 640; time = 0.0710s; samplesPerSecond = 9011.8
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 1.53511688 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.0711s; samplesPerSecond = 8997.7
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 1.58790676 * 640; EvalClassificationError = 0.47031250 * 640; time = 0.0709s; samplesPerSecond = 9030.0
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 1.50995734 * 640; EvalClassificationError = 0.44531250 * 640; time = 0.0708s; samplesPerSecond = 9037.4
MPI Rank 1: 05/18/2017 11:20:28:  Epoch[ 3 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 1.44992144 * 640; EvalClassificationError = 0.41250000 * 640; time = 0.0710s; samplesPerSecond = 9019.4
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 1.46801840 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.0709s; samplesPerSecond = 9024.3
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 1.57007256 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.0707s; samplesPerSecond = 9057.4
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 1.42113850 * 640; EvalClassificationError = 0.40000000 * 640; time = 0.0708s; samplesPerSecond = 9038.9
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 1.43815754 * 640; EvalClassificationError = 0.44062500 * 640; time = 0.0707s; samplesPerSecond = 9050.1
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 1.43789139 * 640; EvalClassificationError = 0.41250000 * 640; time = 0.0709s; samplesPerSecond = 9022.0
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 1.42666947 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0707s; samplesPerSecond = 9048.4
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 1.46565822 * 640; EvalClassificationError = 0.43125000 * 640; time = 0.0709s; samplesPerSecond = 9031.4
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 1.49344406 * 640; EvalClassificationError = 0.44218750 * 640; time = 0.0708s; samplesPerSecond = 9037.8
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 1.33678786 * 640; EvalClassificationError = 0.40781250 * 640; time = 0.0706s; samplesPerSecond = 9058.9
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 1.45606437 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0710s; samplesPerSecond = 9016.6
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 1.36980109 * 640; EvalClassificationError = 0.40312500 * 640; time = 0.0710s; samplesPerSecond = 9009.1
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 1.48431699 * 640; EvalClassificationError = 0.45156250 * 640; time = 0.0712s; samplesPerSecond = 8988.1
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 1.34086079 * 640; EvalClassificationError = 0.40312500 * 640; time = 0.0710s; samplesPerSecond = 9019.8
MPI Rank 1: 05/18/2017 11:20:29:  Epoch[ 3 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 1.44159039 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0709s; samplesPerSecond = 9020.6
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 1.51037591 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0710s; samplesPerSecond = 9014.6
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 1.49227044 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.0710s; samplesPerSecond = 9008.5
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 1.51017233 * 640; EvalClassificationError = 0.44843750 * 640; time = 0.0710s; samplesPerSecond = 9014.7
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 1.41215254 * 640; EvalClassificationError = 0.41093750 * 640; time = 0.0709s; samplesPerSecond = 9032.1
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 1.50909438 * 640; EvalClassificationError = 0.43281250 * 640; time = 0.0710s; samplesPerSecond = 9010.9
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 1.50639399 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.0709s; samplesPerSecond = 9029.6
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 1.44043979 * 640; EvalClassificationError = 0.41875000 * 640; time = 0.0708s; samplesPerSecond = 9044.8
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 1.51346596 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.0709s; samplesPerSecond = 9029.7
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 1.45549368 * 640; EvalClassificationError = 0.44687500 * 640; time = 0.0710s; samplesPerSecond = 9011.8
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 1.42412411 * 640; EvalClassificationError = 0.40468750 * 640; time = 0.0712s; samplesPerSecond = 8984.8
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 1.36861492 * 640; EvalClassificationError = 0.40156250 * 640; time = 0.0708s; samplesPerSecond = 9035.5
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 1.48388297 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0712s; samplesPerSecond = 8989.9
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 1.45206648 * 640; EvalClassificationError = 0.41093750 * 640; time = 0.0713s; samplesPerSecond = 8975.5
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 1.37504334 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0706s; samplesPerSecond = 9069.2
MPI Rank 1: 05/18/2017 11:20:30:  Epoch[ 3 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 1.34271091 * 640; EvalClassificationError = 0.40000000 * 640; time = 0.0710s; samplesPerSecond = 9011.2
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 1.44829546 * 640; EvalClassificationError = 0.43281250 * 640; time = 0.0707s; samplesPerSecond = 9047.5
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 1.39906716 * 640; EvalClassificationError = 0.40781250 * 640; time = 0.0711s; samplesPerSecond = 9004.5
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 1.43031734 * 640; EvalClassificationError = 0.42656250 * 640; time = 0.0711s; samplesPerSecond = 9001.9
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 1.44054394 * 640; EvalClassificationError = 0.43437500 * 640; time = 0.0708s; samplesPerSecond = 9044.0
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 1.42952754 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0705s; samplesPerSecond = 9071.6
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 1.41089053 * 640; EvalClassificationError = 0.41718750 * 640; time = 0.0708s; samplesPerSecond = 9041.1
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 1.49744196 * 640; EvalClassificationError = 0.44218750 * 640; time = 0.0709s; samplesPerSecond = 9023.4
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 1.47769042 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0709s; samplesPerSecond = 9025.8
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 1.34230122 * 640; EvalClassificationError = 0.39531250 * 640; time = 0.0710s; samplesPerSecond = 9016.0
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 1.45080084 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0708s; samplesPerSecond = 9033.7
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 1.39645697 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.0709s; samplesPerSecond = 9022.4
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 1.45648259 * 640; EvalClassificationError = 0.43125000 * 640; time = 0.0709s; samplesPerSecond = 9031.6
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 1.48435206 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0710s; samplesPerSecond = 9018.3
MPI Rank 1: 05/18/2017 11:20:31:  Epoch[ 3 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 1.45560228 * 640; EvalClassificationError = 0.45625000 * 640; time = 0.0709s; samplesPerSecond = 9026.4
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 1.41066685 * 640; EvalClassificationError = 0.41093750 * 640; time = 0.0709s; samplesPerSecond = 9032.2
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 1.46349358 * 640; EvalClassificationError = 0.43437500 * 640; time = 0.0710s; samplesPerSecond = 9012.9
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 1.39279154 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.0707s; samplesPerSecond = 9049.1
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 1.35355811 * 640; EvalClassificationError = 0.40468750 * 640; time = 0.0709s; samplesPerSecond = 9029.6
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 1.33072196 * 640; EvalClassificationError = 0.41406250 * 640; time = 0.0709s; samplesPerSecond = 9024.9
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 1.39876284 * 640; EvalClassificationError = 0.40937500 * 640; time = 0.0709s; samplesPerSecond = 9028.8
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 1.32921736 * 640; EvalClassificationError = 0.39375000 * 640; time = 0.0710s; samplesPerSecond = 9019.5
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 1.40769856 * 640; EvalClassificationError = 0.43906250 * 640; time = 0.0707s; samplesPerSecond = 9050.5
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 1.40908068 * 640; EvalClassificationError = 0.39375000 * 640; time = 0.0708s; samplesPerSecond = 9040.0
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 1.23080402 * 640; EvalClassificationError = 0.39375000 * 640; time = 0.0710s; samplesPerSecond = 9019.0
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 1.38302706 * 640; EvalClassificationError = 0.42812500 * 640; time = 0.0708s; samplesPerSecond = 9045.7
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 1.49486128 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.0711s; samplesPerSecond = 9005.3
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 1.45573536 * 640; EvalClassificationError = 0.44375000 * 640; time = 0.0707s; samplesPerSecond = 9057.4
MPI Rank 1: 05/18/2017 11:20:32:  Epoch[ 3 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 1.39251298 * 640; EvalClassificationError = 0.41875000 * 640; time = 0.0710s; samplesPerSecond = 9014.0
MPI Rank 1: 05/18/2017 11:20:33:  Epoch[ 3 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 1.34887186 * 640; EvalClassificationError = 0.41250000 * 640; time = 0.0709s; samplesPerSecond = 9028.6
MPI Rank 1: 05/18/2017 11:20:33:  Epoch[ 3 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 1.41531394 * 640; EvalClassificationError = 0.43125000 * 640; time = 0.0710s; samplesPerSecond = 9012.0
MPI Rank 1: 05/18/2017 11:20:33:  Epoch[ 3 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 1.40662736 * 640; EvalClassificationError = 0.43125000 * 640; time = 0.0710s; samplesPerSecond = 9019.0
MPI Rank 1: 05/18/2017 11:20:33: Finished Epoch[ 3 of 3]: [Training] CrossEntropyWithSoftmax = 1.48426317 * 81920; EvalClassificationError = 0.43706055 * 81920; totalSamplesSeen = 245760; learningRatePerSample = 0.001953125; epochTime=12.1387s
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:33: Action "train" complete.
MPI Rank 1: 
MPI Rank 1: 05/18/2017 11:20:33: __COMPLETED__