CPU info:
    CPU Model Name: Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz
    Hardware threads: 12
    Total Memory: 57700428 kB
-------------------------------------------------------------------
=== Running mpiexec -n 2 /home/ubuntu/workspace/build/gpu/release/bin/cntk configFile=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling/cntk.cntk currentDirectory=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data RunDir=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu DataDir=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data ConfigDir=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling OutputDir=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu DeviceId=-1 timestamping=true numCPUThreads=6 stderr=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu/stderr
CNTK 2.3.1+ (HEAD f4f0f8, Dec 11 2017 18:34:12) at 2017/12/12 15:08:18

/home/ubuntu/workspace/build/gpu/release/bin/cntk  configFile=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling/cntk.cntk  currentDirectory=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data  RunDir=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu  DataDir=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data  ConfigDir=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling  OutputDir=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu  DeviceId=-1  timestamping=true  numCPUThreads=6  stderr=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu/stderr
CNTK 2.3.1+ (HEAD f4f0f8, Dec 11 2017 18:34:12) at 2017/12/12 15:08:18

/home/ubuntu/workspace/build/gpu/release/bin/cntk  configFile=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling/cntk.cntk  currentDirectory=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data  RunDir=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu  DataDir=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data  ConfigDir=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling  OutputDir=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu  DeviceId=-1  timestamping=true  numCPUThreads=6  stderr=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu/stderr
Changed current directory to /home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data
Changed current directory to /home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data
--------------------------------------------------------------------------
[[36435,1],1]: A high-performance Open MPI point-to-point messaging module
was unable to find any relevant network interfaces:

Module: OpenFabrics (openib)
  Host: fdb4dbbde386

Another transport will be used instead, although this may result in
lower performance.
--------------------------------------------------------------------------
ping [requestnodes (before change)]: 2 nodes pinging each other
ping [requestnodes (before change)]: 2 nodes pinging each other
ping [requestnodes (after change)]: 2 nodes pinging each other
ping [requestnodes (after change)]: 2 nodes pinging each other
requestnodes [MPIWrapperMpi]: using 2 out of 2 MPI nodes on a single host (2 requested); we (1) are in (participating)
ping [mpihelper]: 2 nodes pinging each other
requestnodes [MPIWrapperMpi]: using 2 out of 2 MPI nodes on a single host (2 requested); we (0) are in (participating)
ping [mpihelper]: 2 nodes pinging each other
12/12/2017 15:08:18: Redirecting stderr to file /tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu/stderr_speechTrain.logrank0
12/12/2017 15:08:19: Redirecting stderr to file /tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu/stderr_speechTrain.logrank1
[fdb4dbbde386:77932] 1 more process has sent help message help-mpi-btl-base.txt / btl:no-nics
[fdb4dbbde386:77932] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
MPI Rank 0: CNTK 2.3.1+ (HEAD f4f0f8, Dec 11 2017 18:34:12) at 2017/12/12 15:08:18
MPI Rank 0: 
MPI Rank 0: /home/ubuntu/workspace/build/gpu/release/bin/cntk  configFile=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling/cntk.cntk  currentDirectory=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data  RunDir=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu  DataDir=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data  ConfigDir=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling  OutputDir=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu  DeviceId=-1  timestamping=true  numCPUThreads=6  stderr=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu/stderr
MPI Rank 0: 12/12/2017 15:08:18: -------------------------------------------------------------------
MPI Rank 0: 12/12/2017 15:08:18: Build info: 
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:18: 		Built time: Dec 11 2017 18:28:39
MPI Rank 0: 12/12/2017 15:08:18: 		Last modified date: Wed Nov 15 09:27:10 2017
MPI Rank 0: 12/12/2017 15:08:18: 		Build type: release
MPI Rank 0: 12/12/2017 15:08:18: 		Build target: GPU
MPI Rank 0: 12/12/2017 15:08:18: 		With ASGD: yes
MPI Rank 0: 12/12/2017 15:08:18: 		Math lib: mkl
MPI Rank 0: 12/12/2017 15:08:18: 		CUDA version: 9.0.0
MPI Rank 0: 12/12/2017 15:08:18: 		CUDNN version: 7.0.4
MPI Rank 0: 12/12/2017 15:08:18: 		Build Branch: HEAD
MPI Rank 0: 12/12/2017 15:08:18: 		Build SHA1: f4f0f82eabcc482dbd03af1f946a44ae2b8b97bf
MPI Rank 0: 12/12/2017 15:08:18: 		MPI distribution: Open MPI
MPI Rank 0: 12/12/2017 15:08:18: 		MPI version: 1.10.7
MPI Rank 0: 12/12/2017 15:08:18: -------------------------------------------------------------------
MPI Rank 0: 12/12/2017 15:08:18: -------------------------------------------------------------------
MPI Rank 0: 12/12/2017 15:08:18: GPU info:
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:18: 		Device[0]: cores = 3072; computeCapability = 5.2; type = "Tesla M60"; total memory = 8123 MB; free memory = 8112 MB
MPI Rank 0: 12/12/2017 15:08:18: -------------------------------------------------------------------
MPI Rank 0: 12/12/2017 15:08:18: Using 6 CPU threads.
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:18: ##############################################################################
MPI Rank 0: 12/12/2017 15:08:18: #                                                                            #
MPI Rank 0: 12/12/2017 15:08:18: # speechTrain command (train action)                                         #
MPI Rank 0: 12/12/2017 15:08:18: #                                                                            #
MPI Rank 0: 12/12/2017 15:08:18: ##############################################################################
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:18: WARNING: 'numMiniBatch4LRSearch' is deprecated, please remove it and use 'numSamples4Search' instead.
MPI Rank 0: 12/12/2017 15:08:18: 
MPI Rank 0: Creating virgin network.
MPI Rank 0: SimpleNetworkBuilder Using CPU
MPI Rank 0: reading script file glob_0000.scp ... 948 entries
MPI Rank 0: total 132 state names in state list /home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data/state.list
MPI Rank 0: htkmlfreader: reading MLF file /home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data/glob_0000.mlf ... total 948 entries
MPI Rank 0: ...............................................................................................feature set 0: 252734 frames in 948 out of 948 utterances
MPI Rank 0: label set 0: 129 classes
MPI Rank 0: minibatchutterancesource: 948 utterances grouped into 3 chunks, av. chunk size: 316.0 utterances, 84244.7 frames
MPI Rank 0: 12/12/2017 15:08:19: 
MPI Rank 0: Model has 25 nodes. Using CPU.
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:19: Training criterion:   CrossEntropyWithSoftmax = CrossEntropyWithSoftmax
MPI Rank 0: 12/12/2017 15:08:19: Evaluation criterion: EvalClassificationError = ClassificationError
MPI Rank 0: 
MPI Rank 0: 
MPI Rank 0: Allocating matrices for forward and/or backward propagation.
MPI Rank 0: 
MPI Rank 0: Gradient Memory Aliasing: 4 are aliased.
MPI Rank 0: 	W2*H1 (gradient) reuses HLast (gradient)
MPI Rank 0: 	W1*H1 (gradient) reuses W1*H1+B1 (gradient)
MPI Rank 0: 
MPI Rank 0: Memory Sharing: Out of 40 matrices, 21 are shared as 5, and 19 are not shared.
MPI Rank 0: 
MPI Rank 0: Here are the ones that share memory:
MPI Rank 0: 	{ PosteriorProb : [132 x 1 x *]
MPI Rank 0: 	  ScaledLogLikelihood : [132 x 1 x *] }
MPI Rank 0: 	{ HLast : [132 x 1 x *] (gradient)
MPI Rank 0: 	  W0 : [512 x 363] (gradient)
MPI Rank 0: 	  W0*features+B0 : [512 x 1 x *] (gradient)
MPI Rank 0: 	  W1*H1 : [512 x 1 x *] (gradient)
MPI Rank 0: 	  W1*H1+B1 : [512 x 1 x *]
MPI Rank 0: 	  W1*H1+B1 : [512 x 1 x *] (gradient)
MPI Rank 0: 	  W2*H1 : [132 x 1 x *]
MPI Rank 0: 	  W2*H1 : [132 x 1 x *] (gradient) }
MPI Rank 0: 	{ B0 : [512 x 1] (gradient)
MPI Rank 0: 	  H1 : [512 x 1 x *] }
MPI Rank 0: 	{ H1 : [512 x 1 x *] (gradient)
MPI Rank 0: 	  H2 : [512 x 1 x *] (gradient)
MPI Rank 0: 	  HLast : [132 x 1 x *]
MPI Rank 0: 	  W0*features : [512 x *]
MPI Rank 0: 	  W0*features : [512 x *] (gradient) }
MPI Rank 0: 	{ H2 : [512 x 1 x *]
MPI Rank 0: 	  W0*features+B0 : [512 x 1 x *]
MPI Rank 0: 	  W1 : [512 x 512] (gradient)
MPI Rank 0: 	  W1*H1 : [512 x 1 x *] }
MPI Rank 0: 
MPI Rank 0: Here are the ones that don't share memory:
MPI Rank 0: 	{features : [363 x *]}
MPI Rank 0: 	{InvStdOfFeatures : [363]}
MPI Rank 0: 	{MeanOfFeatures : [363]}
MPI Rank 0: 	{W0 : [512 x 363]}
MPI Rank 0: 	{B0 : [512 x 1]}
MPI Rank 0: 	{W1 : [512 x 512]}
MPI Rank 0: 	{B1 : [512 x 1]}
MPI Rank 0: 	{W2 : [132 x 512]}
MPI Rank 0: 	{B2 : [132 x 1]}
MPI Rank 0: 	{labels : [132 x *]}
MPI Rank 0: 	{Prior : [132]}
MPI Rank 0: 	{LogOfPrior : [132]}
MPI Rank 0: 	{EvalClassificationError : [1]}
MPI Rank 0: 	{B1 : [512 x 1] (gradient)}
MPI Rank 0: 	{MVNormalizedFeatures : [363 x *]}
MPI Rank 0: 	{B2 : [132 x 1] (gradient)}
MPI Rank 0: 	{CrossEntropyWithSoftmax : [1] (gradient)}
MPI Rank 0: 	{W2 : [132 x 512] (gradient)}
MPI Rank 0: 	{CrossEntropyWithSoftmax : [1]}
MPI Rank 0: 
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:19: Training 516740 parameters in 6 out of 6 parameter tensors and 15 nodes with gradient:
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:19: 	Node 'B0' (LearnableParameter operation) : [512 x 1]
MPI Rank 0: 12/12/2017 15:08:19: 	Node 'B1' (LearnableParameter operation) : [512 x 1]
MPI Rank 0: 12/12/2017 15:08:19: 	Node 'B2' (LearnableParameter operation) : [132 x 1]
MPI Rank 0: 12/12/2017 15:08:19: 	Node 'W0' (LearnableParameter operation) : [512 x 363]
MPI Rank 0: 12/12/2017 15:08:19: 	Node 'W1' (LearnableParameter operation) : [512 x 512]
MPI Rank 0: 12/12/2017 15:08:19: 	Node 'W2' (LearnableParameter operation) : [132 x 512]
MPI Rank 0: 
MPI Rank 0: Initializing dataParallelSGD for 2-bit quantization.
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:19: Precomputing --> 3 PreCompute nodes found.
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:19: 	MeanOfFeatures = Mean()
MPI Rank 0: 12/12/2017 15:08:19: 	InvStdOfFeatures = InvStdDev()
MPI Rank 0: 12/12/2017 15:08:19: 	Prior = Mean()
MPI Rank 0: minibatchiterator: epoch 0: frames [0..252734] (first utterance at frame 0), data subset 0 of 1, with 1 datapasses
MPI Rank 0: requiredata: determined feature kind as 33-dimensional 'USER' with frame shift 10.0 ms
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:24: Precomputing --> Completed.
MPI Rank 0: 
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:25: Starting Epoch 1: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 0: minibatchiterator: epoch 0: frames [0..81920] (first utterance at frame 0), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:08:25: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 12/12/2017 15:08:26:  Epoch[ 1 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 4.70051279 * 640; EvalClassificationError = 0.95468750 * 640; time = 1.3682s; samplesPerSecond = 467.8
MPI Rank 0: 12/12/2017 15:08:28:  Epoch[ 1 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 4.35695012 * 640; EvalClassificationError = 0.91406250 * 640; time = 1.5996s; samplesPerSecond = 400.1
MPI Rank 0: 12/12/2017 15:08:29:  Epoch[ 1 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 4.20074123 * 640; EvalClassificationError = 0.97031250 * 640; time = 1.2765s; samplesPerSecond = 501.4
MPI Rank 0: 12/12/2017 15:08:30:  Epoch[ 1 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 3.89629380 * 640; EvalClassificationError = 0.86250000 * 640; time = 1.5350s; samplesPerSecond = 416.9
MPI Rank 0: 12/12/2017 15:08:32:  Epoch[ 1 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 4.06033372 * 640; EvalClassificationError = 0.90312500 * 640; time = 1.2374s; samplesPerSecond = 517.2
MPI Rank 0: 12/12/2017 15:08:33:  Epoch[ 1 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 3.95010414 * 640; EvalClassificationError = 0.86250000 * 640; time = 0.9993s; samplesPerSecond = 640.4
MPI Rank 0: 12/12/2017 15:08:34:  Epoch[ 1 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 3.81166462 * 640; EvalClassificationError = 0.87031250 * 640; time = 1.3043s; samplesPerSecond = 490.7
MPI Rank 0: 12/12/2017 15:08:35:  Epoch[ 1 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 3.91820337 * 640; EvalClassificationError = 0.89531250 * 640; time = 1.3444s; samplesPerSecond = 476.1
MPI Rank 0: 12/12/2017 15:08:37:  Epoch[ 1 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 3.96815573 * 640; EvalClassificationError = 0.87968750 * 640; time = 1.4175s; samplesPerSecond = 451.5
MPI Rank 0: 12/12/2017 15:08:38:  Epoch[ 1 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 3.93874337 * 640; EvalClassificationError = 0.91406250 * 640; time = 1.5428s; samplesPerSecond = 414.8
MPI Rank 0: 12/12/2017 15:08:40:  Epoch[ 1 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 4.05343565 * 640; EvalClassificationError = 0.92812500 * 640; time = 1.3725s; samplesPerSecond = 466.3
MPI Rank 0: 12/12/2017 15:08:41:  Epoch[ 1 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 3.89785021 * 640; EvalClassificationError = 0.86250000 * 640; time = 1.3013s; samplesPerSecond = 491.8
MPI Rank 0: 12/12/2017 15:08:42:  Epoch[ 1 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 3.87613785 * 640; EvalClassificationError = 0.89218750 * 640; time = 1.2355s; samplesPerSecond = 518.0
MPI Rank 0: 12/12/2017 15:08:43:  Epoch[ 1 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 3.82499847 * 640; EvalClassificationError = 0.89531250 * 640; time = 1.2076s; samplesPerSecond = 530.0
MPI Rank 0: 12/12/2017 15:08:45:  Epoch[ 1 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 3.80816934 * 640; EvalClassificationError = 0.88281250 * 640; time = 1.2639s; samplesPerSecond = 506.4
MPI Rank 0: 12/12/2017 15:08:46:  Epoch[ 1 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 3.94753941 * 640; EvalClassificationError = 0.89375000 * 640; time = 1.1833s; samplesPerSecond = 540.8
MPI Rank 0: 12/12/2017 15:08:47:  Epoch[ 1 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 3.82870557 * 640; EvalClassificationError = 0.87812500 * 640; time = 1.3278s; samplesPerSecond = 482.0
MPI Rank 0: 12/12/2017 15:08:48:  Epoch[ 1 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 3.76141165 * 640; EvalClassificationError = 0.86093750 * 640; time = 1.2613s; samplesPerSecond = 507.4
MPI Rank 0: 12/12/2017 15:08:50:  Epoch[ 1 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 3.80313722 * 640; EvalClassificationError = 0.86562500 * 640; time = 1.1522s; samplesPerSecond = 555.5
MPI Rank 0: 12/12/2017 15:08:51:  Epoch[ 1 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 3.74406797 * 640; EvalClassificationError = 0.88125000 * 640; time = 1.2104s; samplesPerSecond = 528.8
MPI Rank 0: 12/12/2017 15:08:52:  Epoch[ 1 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 3.74280095 * 640; EvalClassificationError = 0.86562500 * 640; time = 1.1663s; samplesPerSecond = 548.8
MPI Rank 0: 12/12/2017 15:08:53:  Epoch[ 1 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 3.73038743 * 640; EvalClassificationError = 0.85937500 * 640; time = 1.5567s; samplesPerSecond = 411.1
MPI Rank 0: 12/12/2017 15:08:55:  Epoch[ 1 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 3.72374993 * 640; EvalClassificationError = 0.85312500 * 640; time = 1.2783s; samplesPerSecond = 500.6
MPI Rank 0: 12/12/2017 15:08:56:  Epoch[ 1 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 3.75930638 * 640; EvalClassificationError = 0.83750000 * 640; time = 1.1571s; samplesPerSecond = 553.1
MPI Rank 0: 12/12/2017 15:08:57:  Epoch[ 1 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 3.72550280 * 640; EvalClassificationError = 0.87031250 * 640; time = 1.3695s; samplesPerSecond = 467.3
MPI Rank 0: 12/12/2017 15:08:58:  Epoch[ 1 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 3.67204081 * 640; EvalClassificationError = 0.84531250 * 640; time = 1.1384s; samplesPerSecond = 562.2
MPI Rank 0: 12/12/2017 15:09:00:  Epoch[ 1 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 3.58954002 * 640; EvalClassificationError = 0.78281250 * 640; time = 1.3058s; samplesPerSecond = 490.1
MPI Rank 0: 12/12/2017 15:09:01:  Epoch[ 1 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 3.69883456 * 640; EvalClassificationError = 0.81093750 * 640; time = 1.1163s; samplesPerSecond = 573.3
MPI Rank 0: 12/12/2017 15:09:02:  Epoch[ 1 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 3.58199775 * 640; EvalClassificationError = 0.79531250 * 640; time = 1.3864s; samplesPerSecond = 461.6
MPI Rank 0: 12/12/2017 15:09:03:  Epoch[ 1 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 3.53081690 * 640; EvalClassificationError = 0.82187500 * 640; time = 0.8897s; samplesPerSecond = 719.4
MPI Rank 0: 12/12/2017 15:09:04:  Epoch[ 1 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 3.53654818 * 640; EvalClassificationError = 0.82187500 * 640; time = 1.3698s; samplesPerSecond = 467.2
MPI Rank 0: 12/12/2017 15:09:06:  Epoch[ 1 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 3.50379349 * 640; EvalClassificationError = 0.79375000 * 640; time = 1.1868s; samplesPerSecond = 539.3
MPI Rank 0: 12/12/2017 15:09:07:  Epoch[ 1 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 3.38919585 * 640; EvalClassificationError = 0.79531250 * 640; time = 1.2922s; samplesPerSecond = 495.3
MPI Rank 0: 12/12/2017 15:09:08:  Epoch[ 1 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 3.44880368 * 640; EvalClassificationError = 0.79218750 * 640; time = 1.5048s; samplesPerSecond = 425.3
MPI Rank 0: 12/12/2017 15:09:09:  Epoch[ 1 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 3.50079753 * 640; EvalClassificationError = 0.80937500 * 640; time = 0.9673s; samplesPerSecond = 661.6
MPI Rank 0: 12/12/2017 15:09:11:  Epoch[ 1 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 3.43660658 * 640; EvalClassificationError = 0.81562500 * 640; time = 1.5436s; samplesPerSecond = 414.6
MPI Rank 0: 12/12/2017 15:09:12:  Epoch[ 1 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 3.50379887 * 640; EvalClassificationError = 0.82968750 * 640; time = 1.2490s; samplesPerSecond = 512.4
MPI Rank 0: 12/12/2017 15:09:13:  Epoch[ 1 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 3.19963124 * 640; EvalClassificationError = 0.75625000 * 640; time = 1.2289s; samplesPerSecond = 520.8
MPI Rank 0: 12/12/2017 15:09:15:  Epoch[ 1 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 3.32425813 * 640; EvalClassificationError = 0.80312500 * 640; time = 1.2129s; samplesPerSecond = 527.6
MPI Rank 0: 12/12/2017 15:09:16:  Epoch[ 1 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 3.29798060 * 640; EvalClassificationError = 0.79843750 * 640; time = 1.1517s; samplesPerSecond = 555.7
MPI Rank 0: 12/12/2017 15:09:17:  Epoch[ 1 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 3.44474182 * 640; EvalClassificationError = 0.80937500 * 640; time = 1.3708s; samplesPerSecond = 466.9
MPI Rank 0: 12/12/2017 15:09:18:  Epoch[ 1 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 3.30266974 * 640; EvalClassificationError = 0.76718750 * 640; time = 1.0272s; samplesPerSecond = 623.1
MPI Rank 0: 12/12/2017 15:09:19:  Epoch[ 1 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 3.25681831 * 640; EvalClassificationError = 0.77968750 * 640; time = 1.2802s; samplesPerSecond = 499.9
MPI Rank 0: 12/12/2017 15:09:21:  Epoch[ 1 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 3.15820779 * 640; EvalClassificationError = 0.77031250 * 640; time = 1.0523s; samplesPerSecond = 608.2
MPI Rank 0: 12/12/2017 15:09:22:  Epoch[ 1 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 3.20898105 * 640; EvalClassificationError = 0.76093750 * 640; time = 1.2800s; samplesPerSecond = 500.0
MPI Rank 0: 12/12/2017 15:09:23:  Epoch[ 1 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 3.25787725 * 640; EvalClassificationError = 0.77656250 * 640; time = 1.2283s; samplesPerSecond = 521.1
MPI Rank 0: 12/12/2017 15:09:24:  Epoch[ 1 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 3.21639002 * 640; EvalClassificationError = 0.78437500 * 640; time = 1.0868s; samplesPerSecond = 588.9
MPI Rank 0: 12/12/2017 15:09:25:  Epoch[ 1 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 3.19755041 * 640; EvalClassificationError = 0.74375000 * 640; time = 1.1028s; samplesPerSecond = 580.3
MPI Rank 0: 12/12/2017 15:09:26:  Epoch[ 1 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 3.27740296 * 640; EvalClassificationError = 0.78125000 * 640; time = 1.1185s; samplesPerSecond = 572.2
MPI Rank 0: 12/12/2017 15:09:28:  Epoch[ 1 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 3.21731028 * 640; EvalClassificationError = 0.77812500 * 640; time = 1.1931s; samplesPerSecond = 536.4
MPI Rank 0: 12/12/2017 15:09:29:  Epoch[ 1 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 3.01272049 * 640; EvalClassificationError = 0.74531250 * 640; time = 1.0246s; samplesPerSecond = 624.6
MPI Rank 0: 12/12/2017 15:09:30:  Epoch[ 1 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 3.17478059 * 640; EvalClassificationError = 0.73281250 * 640; time = 1.5745s; samplesPerSecond = 406.5
MPI Rank 0: 12/12/2017 15:09:31:  Epoch[ 1 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 3.12103830 * 640; EvalClassificationError = 0.73437500 * 640; time = 1.1701s; samplesPerSecond = 547.0
MPI Rank 0: 12/12/2017 15:09:33:  Epoch[ 1 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 2.98082432 * 640; EvalClassificationError = 0.70937500 * 640; time = 1.3691s; samplesPerSecond = 467.4
MPI Rank 0: 12/12/2017 15:09:34:  Epoch[ 1 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 3.05007165 * 640; EvalClassificationError = 0.74375000 * 640; time = 1.2092s; samplesPerSecond = 529.3
MPI Rank 0: 12/12/2017 15:09:35:  Epoch[ 1 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 2.98743951 * 640; EvalClassificationError = 0.72031250 * 640; time = 1.2781s; samplesPerSecond = 500.8
MPI Rank 0: 12/12/2017 15:09:37:  Epoch[ 1 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 2.99403918 * 640; EvalClassificationError = 0.73906250 * 640; time = 1.4652s; samplesPerSecond = 436.8
MPI Rank 0: 12/12/2017 15:09:38:  Epoch[ 1 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 3.04396582 * 640; EvalClassificationError = 0.73906250 * 640; time = 1.1837s; samplesPerSecond = 540.7
MPI Rank 0: 12/12/2017 15:09:39:  Epoch[ 1 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 3.03754796 * 640; EvalClassificationError = 0.73593750 * 640; time = 1.1827s; samplesPerSecond = 541.2
MPI Rank 0: 12/12/2017 15:09:40:  Epoch[ 1 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 2.95866099 * 640; EvalClassificationError = 0.72031250 * 640; time = 1.3540s; samplesPerSecond = 472.7
MPI Rank 0: 12/12/2017 15:09:42:  Epoch[ 1 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 3.04394473 * 640; EvalClassificationError = 0.74218750 * 640; time = 1.3988s; samplesPerSecond = 457.5
MPI Rank 0: 12/12/2017 15:09:43:  Epoch[ 1 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 2.97533739 * 640; EvalClassificationError = 0.72500000 * 640; time = 1.4076s; samplesPerSecond = 454.7
MPI Rank 0: 12/12/2017 15:09:44:  Epoch[ 1 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 3.00702677 * 640; EvalClassificationError = 0.75000000 * 640; time = 1.1065s; samplesPerSecond = 578.4
MPI Rank 0: 12/12/2017 15:09:46:  Epoch[ 1 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 2.90058629 * 640; EvalClassificationError = 0.68750000 * 640; time = 1.2198s; samplesPerSecond = 524.7
MPI Rank 0: 12/12/2017 15:09:47:  Epoch[ 1 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 2.91110312 * 640; EvalClassificationError = 0.71718750 * 640; time = 1.0644s; samplesPerSecond = 601.3
MPI Rank 0: 12/12/2017 15:09:48:  Epoch[ 1 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 2.93752100 * 640; EvalClassificationError = 0.72656250 * 640; time = 1.3862s; samplesPerSecond = 461.7
MPI Rank 0: 12/12/2017 15:09:49:  Epoch[ 1 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 2.85819988 * 640; EvalClassificationError = 0.70468750 * 640; time = 1.1517s; samplesPerSecond = 555.7
MPI Rank 0: 12/12/2017 15:09:50:  Epoch[ 1 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 2.89007925 * 640; EvalClassificationError = 0.68281250 * 640; time = 1.0520s; samplesPerSecond = 608.3
MPI Rank 0: 12/12/2017 15:09:51:  Epoch[ 1 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 2.85100598 * 640; EvalClassificationError = 0.70937500 * 640; time = 1.2379s; samplesPerSecond = 517.0
MPI Rank 0: 12/12/2017 15:09:53:  Epoch[ 1 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 2.72432774 * 640; EvalClassificationError = 0.68750000 * 640; time = 1.2380s; samplesPerSecond = 517.0
MPI Rank 0: 12/12/2017 15:09:54:  Epoch[ 1 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 2.77593685 * 640; EvalClassificationError = 0.65781250 * 640; time = 1.3866s; samplesPerSecond = 461.6
MPI Rank 0: 12/12/2017 15:09:55:  Epoch[ 1 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 2.82559717 * 640; EvalClassificationError = 0.71406250 * 640; time = 1.1513s; samplesPerSecond = 555.9
MPI Rank 0: 12/12/2017 15:09:56:  Epoch[ 1 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 2.71976197 * 640; EvalClassificationError = 0.67656250 * 640; time = 1.1989s; samplesPerSecond = 533.8
MPI Rank 0: 12/12/2017 15:09:57:  Epoch[ 1 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 2.79910616 * 640; EvalClassificationError = 0.68125000 * 640; time = 1.1168s; samplesPerSecond = 573.1
MPI Rank 0: 12/12/2017 15:09:59:  Epoch[ 1 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 2.79788837 * 640; EvalClassificationError = 0.67500000 * 640; time = 1.4188s; samplesPerSecond = 451.1
MPI Rank 0: 12/12/2017 15:10:00:  Epoch[ 1 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 2.73739884 * 640; EvalClassificationError = 0.69375000 * 640; time = 1.1284s; samplesPerSecond = 567.2
MPI Rank 0: 12/12/2017 15:10:01:  Epoch[ 1 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 2.81372110 * 640; EvalClassificationError = 0.66406250 * 640; time = 1.2404s; samplesPerSecond = 516.0
MPI Rank 0: 12/12/2017 15:10:02:  Epoch[ 1 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 2.81083861 * 640; EvalClassificationError = 0.67968750 * 640; time = 1.0303s; samplesPerSecond = 621.2
MPI Rank 0: 12/12/2017 15:10:03:  Epoch[ 1 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 2.74256603 * 640; EvalClassificationError = 0.67500000 * 640; time = 1.0504s; samplesPerSecond = 609.3
MPI Rank 0: 12/12/2017 15:10:04:  Epoch[ 1 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 2.72576795 * 640; EvalClassificationError = 0.64531250 * 640; time = 1.0980s; samplesPerSecond = 582.9
MPI Rank 0: 12/12/2017 15:10:06:  Epoch[ 1 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 2.73651534 * 640; EvalClassificationError = 0.67187500 * 640; time = 1.4610s; samplesPerSecond = 438.1
MPI Rank 0: 12/12/2017 15:10:07:  Epoch[ 1 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 2.69794578 * 640; EvalClassificationError = 0.67500000 * 640; time = 1.4538s; samplesPerSecond = 440.2
MPI Rank 0: 12/12/2017 15:10:09:  Epoch[ 1 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 2.55353550 * 640; EvalClassificationError = 0.63593750 * 640; time = 1.2399s; samplesPerSecond = 516.2
MPI Rank 0: 12/12/2017 15:10:10:  Epoch[ 1 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 2.64451539 * 640; EvalClassificationError = 0.66562500 * 640; time = 1.1492s; samplesPerSecond = 556.9
MPI Rank 0: 12/12/2017 15:10:11:  Epoch[ 1 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 2.67392485 * 640; EvalClassificationError = 0.66250000 * 640; time = 1.1097s; samplesPerSecond = 576.7
MPI Rank 0: 12/12/2017 15:10:12:  Epoch[ 1 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 2.60373406 * 640; EvalClassificationError = 0.67031250 * 640; time = 1.2372s; samplesPerSecond = 517.3
MPI Rank 0: 12/12/2017 15:10:13:  Epoch[ 1 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 2.74048558 * 640; EvalClassificationError = 0.67968750 * 640; time = 1.2361s; samplesPerSecond = 517.7
MPI Rank 0: 12/12/2017 15:10:14:  Epoch[ 1 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 2.67928549 * 640; EvalClassificationError = 0.67656250 * 640; time = 1.0496s; samplesPerSecond = 609.7
MPI Rank 0: 12/12/2017 15:10:15:  Epoch[ 1 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 2.54491073 * 640; EvalClassificationError = 0.64531250 * 640; time = 1.0141s; samplesPerSecond = 631.1
MPI Rank 0: 12/12/2017 15:10:16:  Epoch[ 1 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 2.63487186 * 640; EvalClassificationError = 0.66562500 * 640; time = 1.0655s; samplesPerSecond = 600.6
MPI Rank 0: 12/12/2017 15:10:18:  Epoch[ 1 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 2.56022382 * 640; EvalClassificationError = 0.65312500 * 640; time = 1.1639s; samplesPerSecond = 549.9
MPI Rank 0: 12/12/2017 15:10:19:  Epoch[ 1 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 2.55775022 * 640; EvalClassificationError = 0.64375000 * 640; time = 1.1183s; samplesPerSecond = 572.3
MPI Rank 0: 12/12/2017 15:10:20:  Epoch[ 1 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 2.59909130 * 640; EvalClassificationError = 0.66250000 * 640; time = 1.1088s; samplesPerSecond = 577.2
MPI Rank 0: 12/12/2017 15:10:21:  Epoch[ 1 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 2.55362505 * 640; EvalClassificationError = 0.61093750 * 640; time = 1.1713s; samplesPerSecond = 546.4
MPI Rank 0: 12/12/2017 15:10:22:  Epoch[ 1 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 2.49326706 * 640; EvalClassificationError = 0.64062500 * 640; time = 1.2272s; samplesPerSecond = 521.5
MPI Rank 0: 12/12/2017 15:10:23:  Epoch[ 1 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 2.53499203 * 640; EvalClassificationError = 0.63593750 * 640; time = 1.1510s; samplesPerSecond = 556.0
MPI Rank 0: 12/12/2017 15:10:25:  Epoch[ 1 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 2.36068970 * 640; EvalClassificationError = 0.61562500 * 640; time = 1.4883s; samplesPerSecond = 430.0
MPI Rank 0: 12/12/2017 15:10:26:  Epoch[ 1 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 2.55381060 * 640; EvalClassificationError = 0.64531250 * 640; time = 1.3159s; samplesPerSecond = 486.4
MPI Rank 0: 12/12/2017 15:10:27:  Epoch[ 1 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 2.45870461 * 640; EvalClassificationError = 0.63750000 * 640; time = 1.1063s; samplesPerSecond = 578.5
MPI Rank 0: 12/12/2017 15:10:28:  Epoch[ 1 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 2.42961548 * 640; EvalClassificationError = 0.60000000 * 640; time = 1.1437s; samplesPerSecond = 559.6
MPI Rank 0: 12/12/2017 15:10:30:  Epoch[ 1 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 2.38149933 * 640; EvalClassificationError = 0.61250000 * 640; time = 1.4005s; samplesPerSecond = 457.0
MPI Rank 0: 12/12/2017 15:10:31:  Epoch[ 1 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 2.36476734 * 640; EvalClassificationError = 0.59062500 * 640; time = 1.5568s; samplesPerSecond = 411.1
MPI Rank 0: 12/12/2017 15:10:33:  Epoch[ 1 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 2.37532815 * 640; EvalClassificationError = 0.60625000 * 640; time = 1.2530s; samplesPerSecond = 510.8
MPI Rank 0: 12/12/2017 15:10:34:  Epoch[ 1 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 2.33424631 * 640; EvalClassificationError = 0.57812500 * 640; time = 1.2672s; samplesPerSecond = 505.1
MPI Rank 0: 12/12/2017 15:10:35:  Epoch[ 1 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 2.45361955 * 640; EvalClassificationError = 0.62031250 * 640; time = 1.1168s; samplesPerSecond = 573.1
MPI Rank 0: 12/12/2017 15:10:36:  Epoch[ 1 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 2.31527067 * 640; EvalClassificationError = 0.58750000 * 640; time = 1.0632s; samplesPerSecond = 601.9
MPI Rank 0: 12/12/2017 15:10:38:  Epoch[ 1 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 2.33012291 * 640; EvalClassificationError = 0.60781250 * 640; time = 1.4453s; samplesPerSecond = 442.8
MPI Rank 0: 12/12/2017 15:10:39:  Epoch[ 1 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 2.50052464 * 640; EvalClassificationError = 0.64687500 * 640; time = 1.0163s; samplesPerSecond = 629.8
MPI Rank 0: 12/12/2017 15:10:40:  Epoch[ 1 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 2.35689176 * 640; EvalClassificationError = 0.61250000 * 640; time = 1.4269s; samplesPerSecond = 448.5
MPI Rank 0: 12/12/2017 15:10:41:  Epoch[ 1 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 2.38314636 * 640; EvalClassificationError = 0.62343750 * 640; time = 1.2326s; samplesPerSecond = 519.2
MPI Rank 0: 12/12/2017 15:10:42:  Epoch[ 1 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 2.37926942 * 640; EvalClassificationError = 0.63125000 * 640; time = 1.0167s; samplesPerSecond = 629.5
MPI Rank 0: 12/12/2017 15:10:43:  Epoch[ 1 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 2.50061255 * 640; EvalClassificationError = 0.63593750 * 640; time = 1.1459s; samplesPerSecond = 558.5
MPI Rank 0: 12/12/2017 15:10:44:  Epoch[ 1 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 2.19571284 * 640; EvalClassificationError = 0.62656250 * 640; time = 0.9423s; samplesPerSecond = 679.2
MPI Rank 0: 12/12/2017 15:10:46:  Epoch[ 1 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 2.27062074 * 640; EvalClassificationError = 0.60625000 * 640; time = 1.2514s; samplesPerSecond = 511.4
MPI Rank 0: 12/12/2017 15:10:47:  Epoch[ 1 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 2.20732695 * 640; EvalClassificationError = 0.61250000 * 640; time = 1.2211s; samplesPerSecond = 524.1
MPI Rank 0: 12/12/2017 15:10:48:  Epoch[ 1 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 2.33449956 * 640; EvalClassificationError = 0.60937500 * 640; time = 1.2124s; samplesPerSecond = 527.9
MPI Rank 0: 12/12/2017 15:10:49:  Epoch[ 1 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 2.30425129 * 640; EvalClassificationError = 0.57968750 * 640; time = 1.3025s; samplesPerSecond = 491.4
MPI Rank 0: 12/12/2017 15:10:51:  Epoch[ 1 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 2.30580641 * 640; EvalClassificationError = 0.60156250 * 640; time = 1.4185s; samplesPerSecond = 451.2
MPI Rank 0: 12/12/2017 15:10:52:  Epoch[ 1 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 2.31398523 * 640; EvalClassificationError = 0.61875000 * 640; time = 1.0603s; samplesPerSecond = 603.6
MPI Rank 0: 12/12/2017 15:10:53:  Epoch[ 1 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 2.22057775 * 640; EvalClassificationError = 0.60625000 * 640; time = 1.1427s; samplesPerSecond = 560.1
MPI Rank 0: 12/12/2017 15:10:54:  Epoch[ 1 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 2.23501826 * 640; EvalClassificationError = 0.59843750 * 640; time = 0.9884s; samplesPerSecond = 647.5
MPI Rank 0: 12/12/2017 15:10:55:  Epoch[ 1 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 2.25912276 * 640; EvalClassificationError = 0.61406250 * 640; time = 1.3997s; samplesPerSecond = 457.2
MPI Rank 0: 12/12/2017 15:10:57:  Epoch[ 1 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 2.40758652 * 640; EvalClassificationError = 0.63750000 * 640; time = 1.2109s; samplesPerSecond = 528.5
MPI Rank 0: 12/12/2017 15:10:58:  Epoch[ 1 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 2.30217561 * 640; EvalClassificationError = 0.60937500 * 640; time = 1.0725s; samplesPerSecond = 596.7
MPI Rank 0: 12/12/2017 15:10:59:  Epoch[ 1 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 2.24440474 * 640; EvalClassificationError = 0.62343750 * 640; time = 1.2376s; samplesPerSecond = 517.1
MPI Rank 0: 12/12/2017 15:11:00:  Epoch[ 1 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 2.25952033 * 640; EvalClassificationError = 0.56562500 * 640; time = 1.1916s; samplesPerSecond = 537.1
MPI Rank 0: 12/12/2017 15:11:01:  Epoch[ 1 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 2.21633741 * 640; EvalClassificationError = 0.60468750 * 640; time = 1.3098s; samplesPerSecond = 488.6
MPI Rank 0: 12/12/2017 15:11:02:  Epoch[ 1 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 2.30360513 * 640; EvalClassificationError = 0.60625000 * 640; time = 0.9398s; samplesPerSecond = 681.0
MPI Rank 0: 12/12/2017 15:11:02: Finished Epoch[ 1 of 3]: [Training] CrossEntropyWithSoftmax = 3.02076286 * 81920; EvalClassificationError = 0.72858887 * 81920; totalSamplesSeen = 81920; learningRatePerSample = 0.001953125; epochTime=157.781s
MPI Rank 0: 12/12/2017 15:11:02: SGD: Saving checkpoint model '/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu/models/cntkSpeech.dnn.1'
MPI Rank 0: 12/12/2017 15:11:03:  Before Epoch[2], previous minibatchSize 64 is considered invalid -> resetting.
MPI Rank 0: 12/12/2017 15:11:03:  AdaptiveMinibatchSearch Epoch[2]: Evaluating minibatchSizes 64..8192
MPI Rank 0: 12/12/2017 15:11:03:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=64 (search range: 64..8192)...
MPI Rank 0: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:11:03: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 12/12/2017 15:11:04:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24406520 * 640; EvalClassificationError = 0.57500000 * 640; time = 1.4446s; samplesPerSecond = 443.0
MPI Rank 0: 12/12/2017 15:11:05:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.12025872 * 640; EvalClassificationError = 0.54218750 * 640; time = 1.1858s; samplesPerSecond = 539.7
MPI Rank 0: 12/12/2017 15:11:06:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24828172 * 640; EvalClassificationError = 0.60937500 * 640; time = 1.1995s; samplesPerSecond = 533.6
MPI Rank 0: 12/12/2017 15:11:07:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06004589 * 640; EvalClassificationError = 0.57031250 * 640; time = 1.0824s; samplesPerSecond = 591.3
MPI Rank 0: 12/12/2017 15:11:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23539626 * 640; EvalClassificationError = 0.61406250 * 640; time = 1.1303s; samplesPerSecond = 566.2
MPI Rank 0: 12/12/2017 15:11:10:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15090807 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.0854s; samplesPerSecond = 589.7
MPI Rank 0: 12/12/2017 15:11:11:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.22819509 * 640; EvalClassificationError = 0.58750000 * 640; time = 1.2119s; samplesPerSecond = 528.1
MPI Rank 0: 12/12/2017 15:11:12:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.10290113 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.3604s; samplesPerSecond = 470.5
MPI Rank 0: 12/12/2017 15:11:13:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11563741 * 640; EvalClassificationError = 0.57187500 * 640; time = 1.0467s; samplesPerSecond = 611.5
MPI Rank 0: 12/12/2017 15:11:15:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13568211 * 640; EvalClassificationError = 0.55156250 * 640; time = 1.4769s; samplesPerSecond = 433.3
MPI Rank 0: 12/12/2017 15:11:16:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10708006 * 640; EvalClassificationError = 0.59531250 * 640; time = 1.2024s; samplesPerSecond = 532.3
MPI Rank 0: 12/12/2017 15:11:17:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.04020009 * 640; EvalClassificationError = 0.56250000 * 640; time = 1.0223s; samplesPerSecond = 626.0
MPI Rank 0: 12/12/2017 15:11:18:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10129234 * 640; EvalClassificationError = 0.58906250 * 640; time = 1.1992s; samplesPerSecond = 533.7
MPI Rank 0: 12/12/2017 15:11:19:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.09623744 * 640; EvalClassificationError = 0.55625000 * 640; time = 1.0817s; samplesPerSecond = 591.6
MPI Rank 0: 12/12/2017 15:11:20:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.12505980 * 640; EvalClassificationError = 0.57968750 * 640; time = 1.1082s; samplesPerSecond = 577.5
MPI Rank 0: 12/12/2017 15:11:22:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.15263867 * 640; EvalClassificationError = 0.57812500 * 640; time = 1.3027s; samplesPerSecond = 491.3
MPI Rank 0: 12/12/2017 15:11:22:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.14296839 * 10304; EvalClassificationError = 0.57822205 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:11:22:  AdaptiveMinibatchSearch Epoch[2]: Computed baseCriterion 2.14296839 for minibatchSize=64
MPI Rank 0: 12/12/2017 15:11:22:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=64 (search range: 64..8192)...
MPI Rank 0: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:11:22: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 12/12/2017 15:11:23:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24406520 * 640; EvalClassificationError = 0.57500000 * 640; time = 1.4144s; samplesPerSecond = 452.5
MPI Rank 0: 12/12/2017 15:11:25:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.12025872 * 640; EvalClassificationError = 0.54218750 * 640; time = 1.2035s; samplesPerSecond = 531.8
MPI Rank 0: 12/12/2017 15:11:26:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24828172 * 640; EvalClassificationError = 0.60937500 * 640; time = 0.8933s; samplesPerSecond = 716.4
MPI Rank 0: 12/12/2017 15:11:27:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06004589 * 640; EvalClassificationError = 0.57031250 * 640; time = 1.0416s; samplesPerSecond = 614.5
MPI Rank 0: 12/12/2017 15:11:28:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23539626 * 640; EvalClassificationError = 0.61406250 * 640; time = 1.3107s; samplesPerSecond = 488.3
MPI Rank 0: 12/12/2017 15:11:29:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15090807 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.0988s; samplesPerSecond = 582.5
MPI Rank 0: 12/12/2017 15:11:31:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.22819509 * 640; EvalClassificationError = 0.58750000 * 640; time = 1.6851s; samplesPerSecond = 379.8
MPI Rank 0: 12/12/2017 15:11:32:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.10290113 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.3485s; samplesPerSecond = 474.6
MPI Rank 0: 12/12/2017 15:11:33:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11563741 * 640; EvalClassificationError = 0.57187500 * 640; time = 1.0952s; samplesPerSecond = 584.4
MPI Rank 0: 12/12/2017 15:11:34:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13568211 * 640; EvalClassificationError = 0.55156250 * 640; time = 1.2485s; samplesPerSecond = 512.6
MPI Rank 0: 12/12/2017 15:11:36:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10708006 * 640; EvalClassificationError = 0.59531250 * 640; time = 1.1373s; samplesPerSecond = 562.8
MPI Rank 0: 12/12/2017 15:11:37:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.04020009 * 640; EvalClassificationError = 0.56250000 * 640; time = 1.2422s; samplesPerSecond = 515.2
MPI Rank 0: 12/12/2017 15:11:38:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10129234 * 640; EvalClassificationError = 0.58906250 * 640; time = 1.3288s; samplesPerSecond = 481.7
MPI Rank 0: 12/12/2017 15:11:39:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.09623744 * 640; EvalClassificationError = 0.55625000 * 640; time = 1.2545s; samplesPerSecond = 510.2
MPI Rank 0: 12/12/2017 15:11:41:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.12505980 * 640; EvalClassificationError = 0.57968750 * 640; time = 1.3899s; samplesPerSecond = 460.5
MPI Rank 0: 12/12/2017 15:11:42:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.15263867 * 640; EvalClassificationError = 0.57812500 * 640; time = 1.0409s; samplesPerSecond = 614.9
MPI Rank 0: 12/12/2017 15:11:42:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.14296839 * 10304; EvalClassificationError = 0.57822205 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:11:42:  AdaptiveMinibatchSearch Epoch[2]: Keep searching... epochCriterion = 2.14296839 vs. baseCriterion = 2.14296839
MPI Rank 0: 12/12/2017 15:11:42:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=128 (search range: 64..8192)...
MPI Rank 0: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:11:42: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 12/12/2017 15:11:44:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 1.56%]: CrossEntropyWithSoftmax = 2.18052003 * 1280; EvalClassificationError = 0.55859375 * 1280; time = 1.3723s; samplesPerSecond = 932.8
MPI Rank 0: 12/12/2017 15:11:45:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 3.12%]: CrossEntropyWithSoftmax = 2.16092560 * 1280; EvalClassificationError = 0.58984375 * 1280; time = 1.3879s; samplesPerSecond = 922.3
MPI Rank 0: 12/12/2017 15:11:46:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 4.69%]: CrossEntropyWithSoftmax = 2.22443554 * 1280; EvalClassificationError = 0.60312500 * 1280; time = 1.3698s; samplesPerSecond = 934.5
MPI Rank 0: 12/12/2017 15:11:48:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 6.25%]: CrossEntropyWithSoftmax = 2.22884967 * 1280; EvalClassificationError = 0.60078125 * 1280; time = 1.2990s; samplesPerSecond = 985.4
MPI Rank 0: 12/12/2017 15:11:49:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 7.81%]: CrossEntropyWithSoftmax = 2.13448612 * 1280; EvalClassificationError = 0.57578125 * 1280; time = 1.4945s; samplesPerSecond = 856.5
MPI Rank 0: 12/12/2017 15:11:50:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 9.38%]: CrossEntropyWithSoftmax = 2.09717408 * 1280; EvalClassificationError = 0.58750000 * 1280; time = 1.0877s; samplesPerSecond = 1176.8
MPI Rank 0: 12/12/2017 15:11:52:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 10.94%]: CrossEntropyWithSoftmax = 2.12784498 * 1280; EvalClassificationError = 0.58359375 * 1280; time = 1.4565s; samplesPerSecond = 878.8
MPI Rank 0: 12/12/2017 15:11:53:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 12.50%]: CrossEntropyWithSoftmax = 2.17108666 * 1280; EvalClassificationError = 0.57500000 * 1280; time = 1.1761s; samplesPerSecond = 1088.3
MPI Rank 0: 12/12/2017 15:11:53:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.16665035 * 10368; EvalClassificationError = 0.58410494 * 10368; learningRatePerSample = 0.001953125; minibatchSize = 128
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:11:53:  AdaptiveMinibatchSearch Epoch[2]: Search successful. New minibatchSize is 64. epochCriterion = 2.14296839 vs baseCriterion = 2.14296839
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:11:53: Starting Epoch 2: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 0: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:11:53: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 12/12/2017 15:11:54:  Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24406520 * 640; EvalClassificationError = 0.57500000 * 640; time = 1.2787s; samplesPerSecond = 500.5
MPI Rank 0: 12/12/2017 15:11:56:  Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.12025872 * 640; EvalClassificationError = 0.54218750 * 640; time = 1.3555s; samplesPerSecond = 472.2
MPI Rank 0: 12/12/2017 15:11:57:  Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24828172 * 640; EvalClassificationError = 0.60937500 * 640; time = 1.1086s; samplesPerSecond = 577.3
MPI Rank 0: 12/12/2017 15:11:58:  Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06004589 * 640; EvalClassificationError = 0.57031250 * 640; time = 1.3467s; samplesPerSecond = 475.2
MPI Rank 0: 12/12/2017 15:11:59:  Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23539626 * 640; EvalClassificationError = 0.61406250 * 640; time = 0.9211s; samplesPerSecond = 694.8
MPI Rank 0: 12/12/2017 15:12:01:  Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15090807 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.3700s; samplesPerSecond = 467.1
MPI Rank 0: 12/12/2017 15:12:02:  Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.22819509 * 640; EvalClassificationError = 0.58750000 * 640; time = 1.2205s; samplesPerSecond = 524.4
MPI Rank 0: 12/12/2017 15:12:03:  Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.10290113 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.0726s; samplesPerSecond = 596.7
MPI Rank 0: 12/12/2017 15:12:04:  Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11563741 * 640; EvalClassificationError = 0.57187500 * 640; time = 1.2254s; samplesPerSecond = 522.3
MPI Rank 0: 12/12/2017 15:12:05:  Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13568211 * 640; EvalClassificationError = 0.55156250 * 640; time = 1.1193s; samplesPerSecond = 571.8
MPI Rank 0: 12/12/2017 15:12:06:  Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10708006 * 640; EvalClassificationError = 0.59531250 * 640; time = 0.9824s; samplesPerSecond = 651.4
MPI Rank 0: 12/12/2017 15:12:07:  Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.04020009 * 640; EvalClassificationError = 0.56250000 * 640; time = 1.2723s; samplesPerSecond = 503.0
MPI Rank 0: 12/12/2017 15:12:09:  Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10129234 * 640; EvalClassificationError = 0.58906250 * 640; time = 1.3706s; samplesPerSecond = 467.0
MPI Rank 0: 12/12/2017 15:12:10:  Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.09623744 * 640; EvalClassificationError = 0.55625000 * 640; time = 1.0401s; samplesPerSecond = 615.3
MPI Rank 0: 12/12/2017 15:12:11:  Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.12505980 * 640; EvalClassificationError = 0.57968750 * 640; time = 1.2257s; samplesPerSecond = 522.1
MPI Rank 0: 12/12/2017 15:12:12:  Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.15263867 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.9647s; samplesPerSecond = 663.4
MPI Rank 0: 12/12/2017 15:12:13:  Epoch[ 2 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 2.05587937 * 640; EvalClassificationError = 0.54531250 * 640; time = 1.3218s; samplesPerSecond = 484.2
MPI Rank 0: 12/12/2017 15:12:15:  Epoch[ 2 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 2.10819503 * 640; EvalClassificationError = 0.57656250 * 640; time = 1.2461s; samplesPerSecond = 513.6
MPI Rank 0: 12/12/2017 15:12:16:  Epoch[ 2 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 2.12865202 * 640; EvalClassificationError = 0.56562500 * 640; time = 1.1889s; samplesPerSecond = 538.3
MPI Rank 0: 12/12/2017 15:12:17:  Epoch[ 2 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 2.06628059 * 640; EvalClassificationError = 0.56406250 * 640; time = 1.2947s; samplesPerSecond = 494.3
MPI Rank 0: 12/12/2017 15:12:18:  Epoch[ 2 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 2.00805315 * 640; EvalClassificationError = 0.57500000 * 640; time = 1.1127s; samplesPerSecond = 575.2
MPI Rank 0: 12/12/2017 15:12:19:  Epoch[ 2 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 1.91689278 * 640; EvalClassificationError = 0.51562500 * 640; time = 1.1428s; samplesPerSecond = 560.0
MPI Rank 0: 12/12/2017 15:12:21:  Epoch[ 2 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 1.95414216 * 640; EvalClassificationError = 0.51718750 * 640; time = 1.2090s; samplesPerSecond = 529.4
MPI Rank 0: 12/12/2017 15:12:22:  Epoch[ 2 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 2.01854875 * 640; EvalClassificationError = 0.52656250 * 640; time = 1.2808s; samplesPerSecond = 499.7
MPI Rank 0: 12/12/2017 15:12:23:  Epoch[ 2 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 2.05836408 * 640; EvalClassificationError = 0.55000000 * 640; time = 1.0619s; samplesPerSecond = 602.7
MPI Rank 0: 12/12/2017 15:12:24:  Epoch[ 2 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 2.06750676 * 640; EvalClassificationError = 0.52500000 * 640; time = 1.3777s; samplesPerSecond = 464.5
MPI Rank 0: 12/12/2017 15:12:25:  Epoch[ 2 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 2.00537595 * 640; EvalClassificationError = 0.53125000 * 640; time = 0.9079s; samplesPerSecond = 705.0
MPI Rank 0: 12/12/2017 15:12:26:  Epoch[ 2 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 1.97651530 * 640; EvalClassificationError = 0.55156250 * 640; time = 1.2974s; samplesPerSecond = 493.3
MPI Rank 0: 12/12/2017 15:12:28:  Epoch[ 2 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 2.05821780 * 640; EvalClassificationError = 0.55937500 * 640; time = 1.2372s; samplesPerSecond = 517.3
MPI Rank 0: 12/12/2017 15:12:29:  Epoch[ 2 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 2.10469909 * 640; EvalClassificationError = 0.57500000 * 640; time = 1.5254s; samplesPerSecond = 419.6
MPI Rank 0: 12/12/2017 15:12:31:  Epoch[ 2 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 1.95014695 * 640; EvalClassificationError = 0.53906250 * 640; time = 1.6428s; samplesPerSecond = 389.6
MPI Rank 0: 12/12/2017 15:12:32:  Epoch[ 2 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 1.89832324 * 640; EvalClassificationError = 0.52812500 * 640; time = 1.1071s; samplesPerSecond = 578.1
MPI Rank 0: 12/12/2017 15:12:33:  Epoch[ 2 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 2.08061747 * 640; EvalClassificationError = 0.58281250 * 640; time = 1.2538s; samplesPerSecond = 510.5
MPI Rank 0: 12/12/2017 15:12:34:  Epoch[ 2 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 1.99681024 * 640; EvalClassificationError = 0.54375000 * 640; time = 1.1966s; samplesPerSecond = 534.8
MPI Rank 0: 12/12/2017 15:12:36:  Epoch[ 2 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 1.96934769 * 640; EvalClassificationError = 0.52812500 * 640; time = 1.1518s; samplesPerSecond = 555.7
MPI Rank 0: 12/12/2017 15:12:37:  Epoch[ 2 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 1.94326866 * 640; EvalClassificationError = 0.52343750 * 640; time = 1.4555s; samplesPerSecond = 439.7
MPI Rank 0: 12/12/2017 15:12:38:  Epoch[ 2 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 1.96389540 * 640; EvalClassificationError = 0.55312500 * 640; time = 1.1139s; samplesPerSecond = 574.6
MPI Rank 0: 12/12/2017 15:12:39:  Epoch[ 2 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 1.93880446 * 640; EvalClassificationError = 0.53437500 * 640; time = 1.2532s; samplesPerSecond = 510.7
MPI Rank 0: 12/12/2017 15:12:40:  Epoch[ 2 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 2.05454684 * 640; EvalClassificationError = 0.56875000 * 640; time = 0.9884s; samplesPerSecond = 647.5
MPI Rank 0: 12/12/2017 15:12:42:  Epoch[ 2 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 2.07650311 * 640; EvalClassificationError = 0.58281250 * 640; time = 1.3599s; samplesPerSecond = 470.6
MPI Rank 0: 12/12/2017 15:12:43:  Epoch[ 2 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 1.90309828 * 640; EvalClassificationError = 0.54843750 * 640; time = 1.2788s; samplesPerSecond = 500.5
MPI Rank 0: 12/12/2017 15:12:44:  Epoch[ 2 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 1.96886078 * 640; EvalClassificationError = 0.53750000 * 640; time = 1.1814s; samplesPerSecond = 541.7
MPI Rank 0: 12/12/2017 15:12:45:  Epoch[ 2 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 1.78937533 * 640; EvalClassificationError = 0.50156250 * 640; time = 1.1844s; samplesPerSecond = 540.3
MPI Rank 0: 12/12/2017 15:12:47:  Epoch[ 2 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 2.00661757 * 640; EvalClassificationError = 0.56250000 * 640; time = 1.3437s; samplesPerSecond = 476.3
MPI Rank 0: 12/12/2017 15:12:48:  Epoch[ 2 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 1.86844940 * 640; EvalClassificationError = 0.49687500 * 640; time = 1.4374s; samplesPerSecond = 445.2
MPI Rank 0: 12/12/2017 15:12:49:  Epoch[ 2 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 1.93771444 * 640; EvalClassificationError = 0.53437500 * 640; time = 1.1619s; samplesPerSecond = 550.8
MPI Rank 0: 12/12/2017 15:12:51:  Epoch[ 2 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 1.91579489 * 640; EvalClassificationError = 0.50000000 * 640; time = 1.1565s; samplesPerSecond = 553.4
MPI Rank 0: 12/12/2017 15:12:52:  Epoch[ 2 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 1.90873778 * 640; EvalClassificationError = 0.53281250 * 640; time = 1.2850s; samplesPerSecond = 498.0
MPI Rank 0: 12/12/2017 15:12:53:  Epoch[ 2 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 1.84148334 * 640; EvalClassificationError = 0.52656250 * 640; time = 1.0847s; samplesPerSecond = 590.0
MPI Rank 0: 12/12/2017 15:12:54:  Epoch[ 2 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 1.95277749 * 640; EvalClassificationError = 0.52968750 * 640; time = 1.0878s; samplesPerSecond = 588.3
MPI Rank 0: 12/12/2017 15:12:55:  Epoch[ 2 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 1.90510598 * 640; EvalClassificationError = 0.52343750 * 640; time = 1.0413s; samplesPerSecond = 614.6
MPI Rank 0: 12/12/2017 15:12:56:  Epoch[ 2 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 1.86406932 * 640; EvalClassificationError = 0.53750000 * 640; time = 1.1964s; samplesPerSecond = 534.9
MPI Rank 0: 12/12/2017 15:12:58:  Epoch[ 2 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 1.79901003 * 640; EvalClassificationError = 0.51093750 * 640; time = 1.2995s; samplesPerSecond = 492.5
MPI Rank 0: 12/12/2017 15:12:59:  Epoch[ 2 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 1.84271586 * 640; EvalClassificationError = 0.54375000 * 640; time = 1.3983s; samplesPerSecond = 457.7
MPI Rank 0: 12/12/2017 15:13:00:  Epoch[ 2 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 1.94342376 * 640; EvalClassificationError = 0.53750000 * 640; time = 1.0221s; samplesPerSecond = 626.1
MPI Rank 0: 12/12/2017 15:13:01:  Epoch[ 2 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 1.82340960 * 640; EvalClassificationError = 0.51093750 * 640; time = 1.3649s; samplesPerSecond = 468.9
MPI Rank 0: 12/12/2017 15:13:03:  Epoch[ 2 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 1.84100225 * 640; EvalClassificationError = 0.50312500 * 640; time = 1.2119s; samplesPerSecond = 528.1
MPI Rank 0: 12/12/2017 15:13:04:  Epoch[ 2 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 1.86702935 * 640; EvalClassificationError = 0.50937500 * 640; time = 1.1749s; samplesPerSecond = 544.7
MPI Rank 0: 12/12/2017 15:13:05:  Epoch[ 2 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 1.82416914 * 640; EvalClassificationError = 0.51093750 * 640; time = 1.1050s; samplesPerSecond = 579.2
MPI Rank 0: 12/12/2017 15:13:06:  Epoch[ 2 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 1.76276326 * 640; EvalClassificationError = 0.48750000 * 640; time = 1.1330s; samplesPerSecond = 564.9
MPI Rank 0: 12/12/2017 15:13:07:  Epoch[ 2 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 1.78909213 * 640; EvalClassificationError = 0.52343750 * 640; time = 1.1730s; samplesPerSecond = 545.6
MPI Rank 0: 12/12/2017 15:13:08:  Epoch[ 2 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 1.85574070 * 640; EvalClassificationError = 0.50468750 * 640; time = 1.2311s; samplesPerSecond = 519.8
MPI Rank 0: 12/12/2017 15:13:10:  Epoch[ 2 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 1.71771209 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.2154s; samplesPerSecond = 526.6
MPI Rank 0: 12/12/2017 15:13:11:  Epoch[ 2 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 1.83145821 * 640; EvalClassificationError = 0.52187500 * 640; time = 1.2658s; samplesPerSecond = 505.6
MPI Rank 0: 12/12/2017 15:13:12:  Epoch[ 2 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 1.84680472 * 640; EvalClassificationError = 0.51562500 * 640; time = 1.4318s; samplesPerSecond = 447.0
MPI Rank 0: 12/12/2017 15:13:14:  Epoch[ 2 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 1.76771219 * 640; EvalClassificationError = 0.50468750 * 640; time = 1.3037s; samplesPerSecond = 490.9
MPI Rank 0: 12/12/2017 15:13:15:  Epoch[ 2 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 1.86036179 * 640; EvalClassificationError = 0.52500000 * 640; time = 1.1894s; samplesPerSecond = 538.1
MPI Rank 0: 12/12/2017 15:13:16:  Epoch[ 2 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 1.76394582 * 640; EvalClassificationError = 0.51562500 * 640; time = 1.3802s; samplesPerSecond = 463.7
MPI Rank 0: 12/12/2017 15:13:17:  Epoch[ 2 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 1.79961750 * 640; EvalClassificationError = 0.51562500 * 640; time = 0.9801s; samplesPerSecond = 653.0
MPI Rank 0: 12/12/2017 15:13:18:  Epoch[ 2 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 1.77695582 * 640; EvalClassificationError = 0.50312500 * 640; time = 1.3574s; samplesPerSecond = 471.5
MPI Rank 0: 12/12/2017 15:13:20:  Epoch[ 2 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 1.80388288 * 640; EvalClassificationError = 0.49531250 * 640; time = 1.3946s; samplesPerSecond = 458.9
MPI Rank 0: 12/12/2017 15:13:21:  Epoch[ 2 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 1.73741415 * 640; EvalClassificationError = 0.49375000 * 640; time = 1.1317s; samplesPerSecond = 565.5
MPI Rank 0: 12/12/2017 15:13:23:  Epoch[ 2 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 1.74488749 * 640; EvalClassificationError = 0.50312500 * 640; time = 1.6038s; samplesPerSecond = 399.1
MPI Rank 0: 12/12/2017 15:13:24:  Epoch[ 2 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 1.83199026 * 640; EvalClassificationError = 0.52031250 * 640; time = 1.0756s; samplesPerSecond = 595.0
MPI Rank 0: 12/12/2017 15:13:25:  Epoch[ 2 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 1.73039433 * 640; EvalClassificationError = 0.46718750 * 640; time = 1.2509s; samplesPerSecond = 511.6
MPI Rank 0: 12/12/2017 15:13:26:  Epoch[ 2 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 1.75318483 * 640; EvalClassificationError = 0.51718750 * 640; time = 1.0221s; samplesPerSecond = 626.2
MPI Rank 0: 12/12/2017 15:13:27:  Epoch[ 2 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 1.75181081 * 640; EvalClassificationError = 0.48125000 * 640; time = 1.3844s; samplesPerSecond = 462.3
MPI Rank 0: 12/12/2017 15:13:29:  Epoch[ 2 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 1.67498368 * 640; EvalClassificationError = 0.46406250 * 640; time = 1.2575s; samplesPerSecond = 509.0
MPI Rank 0: 12/12/2017 15:13:30:  Epoch[ 2 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 1.71239884 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.3505s; samplesPerSecond = 473.9
MPI Rank 0: 12/12/2017 15:13:31:  Epoch[ 2 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 1.80154487 * 640; EvalClassificationError = 0.50156250 * 640; time = 1.5661s; samplesPerSecond = 408.7
MPI Rank 0: 12/12/2017 15:13:33:  Epoch[ 2 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 1.75771192 * 640; EvalClassificationError = 0.50781250 * 640; time = 1.3204s; samplesPerSecond = 484.7
MPI Rank 0: 12/12/2017 15:13:34:  Epoch[ 2 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 1.77726593 * 640; EvalClassificationError = 0.52812500 * 640; time = 1.1987s; samplesPerSecond = 533.9
MPI Rank 0: 12/12/2017 15:13:35:  Epoch[ 2 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 1.79806401 * 640; EvalClassificationError = 0.50312500 * 640; time = 1.1894s; samplesPerSecond = 538.1
MPI Rank 0: 12/12/2017 15:13:36:  Epoch[ 2 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 1.76751084 * 640; EvalClassificationError = 0.49687500 * 640; time = 1.2174s; samplesPerSecond = 525.7
MPI Rank 0: 12/12/2017 15:13:38:  Epoch[ 2 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 1.68622035 * 640; EvalClassificationError = 0.46875000 * 640; time = 1.1043s; samplesPerSecond = 579.5
MPI Rank 0: 12/12/2017 15:13:39:  Epoch[ 2 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 1.76818307 * 640; EvalClassificationError = 0.52500000 * 640; time = 1.2183s; samplesPerSecond = 525.3
MPI Rank 0: 12/12/2017 15:13:40:  Epoch[ 2 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 1.72762869 * 640; EvalClassificationError = 0.50156250 * 640; time = 1.2159s; samplesPerSecond = 526.4
MPI Rank 0: 12/12/2017 15:13:41:  Epoch[ 2 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 1.75327519 * 640; EvalClassificationError = 0.48906250 * 640; time = 0.9885s; samplesPerSecond = 647.4
MPI Rank 0: 12/12/2017 15:13:42:  Epoch[ 2 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 1.81252992 * 640; EvalClassificationError = 0.53281250 * 640; time = 1.3715s; samplesPerSecond = 466.6
MPI Rank 0: 12/12/2017 15:13:43:  Epoch[ 2 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 1.67586020 * 640; EvalClassificationError = 0.47500000 * 640; time = 1.0123s; samplesPerSecond = 632.2
MPI Rank 0: 12/12/2017 15:13:45:  Epoch[ 2 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 1.65736153 * 640; EvalClassificationError = 0.48281250 * 640; time = 1.4031s; samplesPerSecond = 456.1
MPI Rank 0: 12/12/2017 15:13:46:  Epoch[ 2 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 1.62426574 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.1683s; samplesPerSecond = 547.8
MPI Rank 0: 12/12/2017 15:13:47:  Epoch[ 2 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 1.74449030 * 640; EvalClassificationError = 0.50937500 * 640; time = 1.1782s; samplesPerSecond = 543.2
MPI Rank 0: 12/12/2017 15:13:48:  Epoch[ 2 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 1.67156510 * 640; EvalClassificationError = 0.49375000 * 640; time = 1.2272s; samplesPerSecond = 521.5
MPI Rank 0: 12/12/2017 15:13:49:  Epoch[ 2 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 1.74597436 * 640; EvalClassificationError = 0.49687500 * 640; time = 1.1568s; samplesPerSecond = 553.3
MPI Rank 0: 12/12/2017 15:13:51:  Epoch[ 2 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 1.74758767 * 640; EvalClassificationError = 0.50156250 * 640; time = 1.1509s; samplesPerSecond = 556.1
MPI Rank 0: 12/12/2017 15:13:52:  Epoch[ 2 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 1.70180785 * 640; EvalClassificationError = 0.49375000 * 640; time = 1.2330s; samplesPerSecond = 519.0
MPI Rank 0: 12/12/2017 15:13:53:  Epoch[ 2 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 1.63308195 * 640; EvalClassificationError = 0.46406250 * 640; time = 1.4132s; samplesPerSecond = 452.9
MPI Rank 0: 12/12/2017 15:13:54:  Epoch[ 2 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 1.71083838 * 640; EvalClassificationError = 0.49531250 * 640; time = 1.0365s; samplesPerSecond = 617.4
MPI Rank 0: 12/12/2017 15:13:56:  Epoch[ 2 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 1.63971265 * 640; EvalClassificationError = 0.46562500 * 640; time = 1.3327s; samplesPerSecond = 480.2
MPI Rank 0: 12/12/2017 15:13:57:  Epoch[ 2 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 1.67149404 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.1613s; samplesPerSecond = 551.1
MPI Rank 0: 12/12/2017 15:13:58:  Epoch[ 2 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 1.58195471 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.1928s; samplesPerSecond = 536.5
MPI Rank 0: 12/12/2017 15:13:59:  Epoch[ 2 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 1.69231155 * 640; EvalClassificationError = 0.47968750 * 640; time = 1.1869s; samplesPerSecond = 539.2
MPI Rank 0: 12/12/2017 15:14:00:  Epoch[ 2 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 1.64889734 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.1372s; samplesPerSecond = 562.8
MPI Rank 0: 12/12/2017 15:14:01:  Epoch[ 2 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 1.63176428 * 640; EvalClassificationError = 0.46562500 * 640; time = 1.1471s; samplesPerSecond = 557.9
MPI Rank 0: 12/12/2017 15:14:03:  Epoch[ 2 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 1.67374331 * 640; EvalClassificationError = 0.47031250 * 640; time = 1.3108s; samplesPerSecond = 488.2
MPI Rank 0: 12/12/2017 15:14:04:  Epoch[ 2 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 1.68498411 * 640; EvalClassificationError = 0.47031250 * 640; time = 1.3973s; samplesPerSecond = 458.0
MPI Rank 0: 12/12/2017 15:14:05:  Epoch[ 2 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 1.62657971 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.2322s; samplesPerSecond = 519.4
MPI Rank 0: 12/12/2017 15:14:07:  Epoch[ 2 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 1.63289543 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.1945s; samplesPerSecond = 535.8
MPI Rank 0: 12/12/2017 15:14:08:  Epoch[ 2 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 1.73718554 * 640; EvalClassificationError = 0.50937500 * 640; time = 1.1608s; samplesPerSecond = 551.3
MPI Rank 0: 12/12/2017 15:14:09:  Epoch[ 2 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 1.62632933 * 640; EvalClassificationError = 0.47031250 * 640; time = 1.1410s; samplesPerSecond = 560.9
MPI Rank 0: 12/12/2017 15:14:10:  Epoch[ 2 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 1.69410792 * 640; EvalClassificationError = 0.50625000 * 640; time = 1.1167s; samplesPerSecond = 573.1
MPI Rank 0: 12/12/2017 15:14:11:  Epoch[ 2 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 1.69136466 * 640; EvalClassificationError = 0.48125000 * 640; time = 1.2051s; samplesPerSecond = 531.1
MPI Rank 0: 12/12/2017 15:14:13:  Epoch[ 2 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 1.64519939 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.3281s; samplesPerSecond = 481.9
MPI Rank 0: 12/12/2017 15:14:14:  Epoch[ 2 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 1.59899012 * 640; EvalClassificationError = 0.46093750 * 640; time = 1.0766s; samplesPerSecond = 594.5
MPI Rank 0: 12/12/2017 15:14:15:  Epoch[ 2 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 1.67662786 * 640; EvalClassificationError = 0.48593750 * 640; time = 1.3192s; samplesPerSecond = 485.1
MPI Rank 0: 12/12/2017 15:14:16:  Epoch[ 2 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 1.54173823 * 640; EvalClassificationError = 0.47500000 * 640; time = 1.0384s; samplesPerSecond = 616.3
MPI Rank 0: 12/12/2017 15:14:17:  Epoch[ 2 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 1.68708734 * 640; EvalClassificationError = 0.45468750 * 640; time = 1.3451s; samplesPerSecond = 475.8
MPI Rank 0: 12/12/2017 15:14:18:  Epoch[ 2 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 1.63433268 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.1081s; samplesPerSecond = 577.6
MPI Rank 0: 12/12/2017 15:14:20:  Epoch[ 2 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 1.54172544 * 640; EvalClassificationError = 0.44687500 * 640; time = 1.3635s; samplesPerSecond = 469.4
MPI Rank 0: 12/12/2017 15:14:21:  Epoch[ 2 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 1.59671999 * 640; EvalClassificationError = 0.48750000 * 640; time = 1.2735s; samplesPerSecond = 502.6
MPI Rank 0: 12/12/2017 15:14:22:  Epoch[ 2 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 1.67252430 * 640; EvalClassificationError = 0.51406250 * 640; time = 1.1869s; samplesPerSecond = 539.2
MPI Rank 0: 12/12/2017 15:14:24:  Epoch[ 2 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 1.52668310 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.3699s; samplesPerSecond = 467.2
MPI Rank 0: 12/12/2017 15:14:25:  Epoch[ 2 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 1.54751628 * 640; EvalClassificationError = 0.45156250 * 640; time = 1.3600s; samplesPerSecond = 470.6
MPI Rank 0: 12/12/2017 15:14:26:  Epoch[ 2 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 1.52823962 * 640; EvalClassificationError = 0.45625000 * 640; time = 1.2527s; samplesPerSecond = 510.9
MPI Rank 0: 12/12/2017 15:14:27:  Epoch[ 2 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 1.59498562 * 640; EvalClassificationError = 0.46562500 * 640; time = 1.1494s; samplesPerSecond = 556.8
MPI Rank 0: 12/12/2017 15:14:29:  Epoch[ 2 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 1.61145758 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.2114s; samplesPerSecond = 528.3
MPI Rank 0: 12/12/2017 15:14:30:  Epoch[ 2 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 1.69241622 * 640; EvalClassificationError = 0.48125000 * 640; time = 1.3394s; samplesPerSecond = 477.8
MPI Rank 0: 12/12/2017 15:14:30: Finished Epoch[ 2 of 3]: [Training] CrossEntropyWithSoftmax = 1.84274812 * 81920; EvalClassificationError = 0.51525879 * 81920; totalSamplesSeen = 163840; learningRatePerSample = 0.001953125; epochTime=207.536s
MPI Rank 0: 12/12/2017 15:14:30: SGD: Saving checkpoint model '/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu/models/cntkSpeech.dnn.2'
MPI Rank 0: 12/12/2017 15:14:30:  AdaptiveMinibatchSearch Epoch[3]: Evaluating minibatchSizes 64..128
MPI Rank 0: 12/12/2017 15:14:30:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=64 (search range: 64..128)...
MPI Rank 0: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:14:30: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 12/12/2017 15:14:32:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47476759 * 640; EvalClassificationError = 0.44062500 * 640; time = 1.9515s; samplesPerSecond = 327.9
MPI Rank 0: 12/12/2017 15:14:33:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65203361 * 640; EvalClassificationError = 0.50468750 * 640; time = 0.9536s; samplesPerSecond = 671.1
MPI Rank 0: 12/12/2017 15:14:35:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47013512 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.5001s; samplesPerSecond = 426.6
MPI Rank 0: 12/12/2017 15:14:36:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59084089 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.2266s; samplesPerSecond = 521.8
MPI Rank 0: 12/12/2017 15:14:37:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52690074 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.2981s; samplesPerSecond = 493.0
MPI Rank 0: 12/12/2017 15:14:39:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62275425 * 640; EvalClassificationError = 0.45156250 * 640; time = 1.5030s; samplesPerSecond = 425.8
MPI Rank 0: 12/12/2017 15:14:40:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.60682579 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.0633s; samplesPerSecond = 601.9
MPI Rank 0: 12/12/2017 15:14:41:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.57448117 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.3637s; samplesPerSecond = 469.3
MPI Rank 0: 12/12/2017 15:14:42:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60198560 * 640; EvalClassificationError = 0.46250000 * 640; time = 0.9650s; samplesPerSecond = 663.2
MPI Rank 0: 12/12/2017 15:14:43:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.67573179 * 640; EvalClassificationError = 0.50000000 * 640; time = 1.3383s; samplesPerSecond = 478.2
MPI Rank 0: 12/12/2017 15:14:45:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56876209 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.2256s; samplesPerSecond = 522.2
MPI Rank 0: 12/12/2017 15:14:46:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66496434 * 640; EvalClassificationError = 0.47656250 * 640; time = 1.2722s; samplesPerSecond = 503.1
MPI Rank 0: 12/12/2017 15:14:47:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.58498947 * 640; EvalClassificationError = 0.47343750 * 640; time = 1.1846s; samplesPerSecond = 540.3
MPI Rank 0: 12/12/2017 15:14:48:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.44821249 * 640; EvalClassificationError = 0.39687500 * 640; time = 1.3053s; samplesPerSecond = 490.3
MPI Rank 0: 12/12/2017 15:14:50:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.55596510 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.2365s; samplesPerSecond = 517.6
MPI Rank 0: 12/12/2017 15:14:51:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.59321105 * 640; EvalClassificationError = 0.49218750 * 640; time = 1.0845s; samplesPerSecond = 590.1
MPI Rank 0: 12/12/2017 15:14:51:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.57585658 * 10304; EvalClassificationError = 0.46011258 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:14:51:  AdaptiveMinibatchSearch Epoch[3]: Computed baseCriterion 1.57585658 for minibatchSize=64
MPI Rank 0: 12/12/2017 15:14:51:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=64 (search range: 64..128)...
MPI Rank 0: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:14:51: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 12/12/2017 15:14:52:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47476759 * 640; EvalClassificationError = 0.44062500 * 640; time = 1.2520s; samplesPerSecond = 511.2
MPI Rank 0: 12/12/2017 15:14:53:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65203361 * 640; EvalClassificationError = 0.50468750 * 640; time = 1.1290s; samplesPerSecond = 566.9
MPI Rank 0: 12/12/2017 15:14:55:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47013512 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.1307s; samplesPerSecond = 566.0
MPI Rank 0: 12/12/2017 15:14:56:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59084089 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.1954s; samplesPerSecond = 535.4
MPI Rank 0: 12/12/2017 15:14:57:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52690074 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.4618s; samplesPerSecond = 437.8
MPI Rank 0: 12/12/2017 15:14:59:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62275425 * 640; EvalClassificationError = 0.45156250 * 640; time = 1.4308s; samplesPerSecond = 447.3
MPI Rank 0: 12/12/2017 15:15:00:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.60682579 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.1129s; samplesPerSecond = 575.1
MPI Rank 0: 12/12/2017 15:15:01:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.57448117 * 640; EvalClassificationError = 0.45312500 * 640; time = 0.9618s; samplesPerSecond = 665.4
MPI Rank 0: 12/12/2017 15:15:02:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60198560 * 640; EvalClassificationError = 0.46250000 * 640; time = 1.2055s; samplesPerSecond = 530.9
MPI Rank 0: 12/12/2017 15:15:03:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.67573179 * 640; EvalClassificationError = 0.50000000 * 640; time = 1.4203s; samplesPerSecond = 450.6
MPI Rank 0: 12/12/2017 15:15:05:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56876209 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.3464s; samplesPerSecond = 475.3
MPI Rank 0: 12/12/2017 15:15:06:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66496434 * 640; EvalClassificationError = 0.47656250 * 640; time = 1.0500s; samplesPerSecond = 609.5
MPI Rank 0: 12/12/2017 15:15:07:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.58498947 * 640; EvalClassificationError = 0.47343750 * 640; time = 1.3321s; samplesPerSecond = 480.4
MPI Rank 0: 12/12/2017 15:15:08:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.44821249 * 640; EvalClassificationError = 0.39687500 * 640; time = 1.0543s; samplesPerSecond = 607.0
MPI Rank 0: 12/12/2017 15:15:09:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.55596510 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.2630s; samplesPerSecond = 506.7
MPI Rank 0: 12/12/2017 15:15:11:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.59321105 * 640; EvalClassificationError = 0.49218750 * 640; time = 1.2275s; samplesPerSecond = 521.4
MPI Rank 0: 12/12/2017 15:15:11:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.57585658 * 10304; EvalClassificationError = 0.46011258 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:15:11:  AdaptiveMinibatchSearch Epoch[3]: Keep searching... epochCriterion = 1.57585658 vs. baseCriterion = 1.57585658
MPI Rank 0: 12/12/2017 15:15:11:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=128 (search range: 64..128)...
MPI Rank 0: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:15:11: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 12/12/2017 15:15:12:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 1.56%]: CrossEntropyWithSoftmax = 1.56408601 * 1280; EvalClassificationError = 0.46640625 * 1280; time = 1.4306s; samplesPerSecond = 894.8
MPI Rank 0: 12/12/2017 15:15:14:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 3.12%]: CrossEntropyWithSoftmax = 1.53650004 * 1280; EvalClassificationError = 0.45078125 * 1280; time = 1.3554s; samplesPerSecond = 944.4
MPI Rank 0: 12/12/2017 15:15:15:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 4.69%]: CrossEntropyWithSoftmax = 1.58612640 * 1280; EvalClassificationError = 0.45000000 * 1280; time = 1.2674s; samplesPerSecond = 1009.9
MPI Rank 0: 12/12/2017 15:15:16:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 6.25%]: CrossEntropyWithSoftmax = 1.59967631 * 1280; EvalClassificationError = 0.46796875 * 1280; time = 1.2048s; samplesPerSecond = 1062.4
MPI Rank 0: 12/12/2017 15:15:17:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 7.81%]: CrossEntropyWithSoftmax = 1.66883413 * 1280; EvalClassificationError = 0.48750000 * 1280; time = 1.2964s; samplesPerSecond = 987.4
MPI Rank 0: 12/12/2017 15:15:19:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 9.38%]: CrossEntropyWithSoftmax = 1.65747310 * 1280; EvalClassificationError = 0.47734375 * 1280; time = 1.3322s; samplesPerSecond = 960.8
MPI Rank 0: 12/12/2017 15:15:20:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 10.94%]: CrossEntropyWithSoftmax = 1.62037708 * 1280; EvalClassificationError = 0.45781250 * 1280; time = 1.5153s; samplesPerSecond = 844.7
MPI Rank 0: 12/12/2017 15:15:21:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 12.50%]: CrossEntropyWithSoftmax = 1.69746709 * 1280; EvalClassificationError = 0.48984375 * 1280; time = 1.1666s; samplesPerSecond = 1097.2
MPI Rank 0: 12/12/2017 15:15:22:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.61779559 * 10368; EvalClassificationError = 0.46913580 * 10368; learningRatePerSample = 0.001953125; minibatchSize = 128
MPI Rank 0: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:15:22:  AdaptiveMinibatchSearch Epoch[3]: Search successful. New minibatchSize is 64. epochCriterion = 1.57585658 vs baseCriterion = 1.57585658
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:15:22: Starting Epoch 3: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 0: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 0 of 2, with 1 datapasses
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:15:22: Starting minibatch loop, DataParallelSGD training (myRank = 0, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 0: 12/12/2017 15:15:23:  Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47476759 * 640; EvalClassificationError = 0.44062500 * 640; time = 1.1597s; samplesPerSecond = 551.9
MPI Rank 0: 12/12/2017 15:15:24:  Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65203361 * 640; EvalClassificationError = 0.50468750 * 640; time = 1.3569s; samplesPerSecond = 471.7
MPI Rank 0: 12/12/2017 15:15:25:  Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47013512 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.0853s; samplesPerSecond = 589.7
MPI Rank 0: 12/12/2017 15:15:27:  Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59084089 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.3157s; samplesPerSecond = 486.4
MPI Rank 0: 12/12/2017 15:15:28:  Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52690074 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.0602s; samplesPerSecond = 603.6
MPI Rank 0: 12/12/2017 15:15:29:  Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62275425 * 640; EvalClassificationError = 0.45156250 * 640; time = 1.2937s; samplesPerSecond = 494.7
MPI Rank 0: 12/12/2017 15:15:30:  Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.60682579 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.1829s; samplesPerSecond = 541.0
MPI Rank 0: 12/12/2017 15:15:32:  Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.57448117 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.4678s; samplesPerSecond = 436.0
MPI Rank 0: 12/12/2017 15:15:33:  Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60198560 * 640; EvalClassificationError = 0.46250000 * 640; time = 1.4047s; samplesPerSecond = 455.6
MPI Rank 0: 12/12/2017 15:15:34:  Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.67573179 * 640; EvalClassificationError = 0.50000000 * 640; time = 0.9567s; samplesPerSecond = 669.0
MPI Rank 0: 12/12/2017 15:15:35:  Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56876209 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.4647s; samplesPerSecond = 436.9
MPI Rank 0: 12/12/2017 15:15:37:  Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66496434 * 640; EvalClassificationError = 0.47656250 * 640; time = 1.2046s; samplesPerSecond = 531.3
MPI Rank 0: 12/12/2017 15:15:38:  Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.58498947 * 640; EvalClassificationError = 0.47343750 * 640; time = 1.2855s; samplesPerSecond = 497.9
MPI Rank 0: 12/12/2017 15:15:39:  Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.44821249 * 640; EvalClassificationError = 0.39687500 * 640; time = 1.1727s; samplesPerSecond = 545.8
MPI Rank 0: 12/12/2017 15:15:40:  Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.55596510 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.1576s; samplesPerSecond = 552.9
MPI Rank 0: 12/12/2017 15:15:42:  Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.59321105 * 640; EvalClassificationError = 0.49218750 * 640; time = 1.3224s; samplesPerSecond = 484.0
MPI Rank 0: 12/12/2017 15:15:43:  Epoch[ 3 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 1.58558110 * 640; EvalClassificationError = 0.48281250 * 640; time = 1.0359s; samplesPerSecond = 617.8
MPI Rank 0: 12/12/2017 15:15:44:  Epoch[ 3 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 1.50779792 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.4456s; samplesPerSecond = 442.7
MPI Rank 0: 12/12/2017 15:15:45:  Epoch[ 3 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 1.60664651 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.2906s; samplesPerSecond = 495.9
MPI Rank 0: 12/12/2017 15:15:47:  Epoch[ 3 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 1.53184518 * 640; EvalClassificationError = 0.45156250 * 640; time = 1.2859s; samplesPerSecond = 497.7
MPI Rank 0: 12/12/2017 15:15:48:  Epoch[ 3 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 1.54559012 * 640; EvalClassificationError = 0.46875000 * 640; time = 1.1825s; samplesPerSecond = 541.2
MPI Rank 0: 12/12/2017 15:15:49:  Epoch[ 3 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 1.55510900 * 640; EvalClassificationError = 0.47343750 * 640; time = 1.1425s; samplesPerSecond = 560.2
MPI Rank 0: 12/12/2017 15:15:50:  Epoch[ 3 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 1.47156965 * 640; EvalClassificationError = 0.42656250 * 640; time = 1.2931s; samplesPerSecond = 494.9
MPI Rank 0: 12/12/2017 15:15:51:  Epoch[ 3 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 1.57361962 * 640; EvalClassificationError = 0.46562500 * 640; time = 1.0572s; samplesPerSecond = 605.4
MPI Rank 0: 12/12/2017 15:15:53:  Epoch[ 3 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 1.47393717 * 640; EvalClassificationError = 0.42812500 * 640; time = 1.4210s; samplesPerSecond = 450.4
MPI Rank 0: 12/12/2017 15:15:54:  Epoch[ 3 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 1.60361602 * 640; EvalClassificationError = 0.45781250 * 640; time = 0.9889s; samplesPerSecond = 647.2
MPI Rank 0: 12/12/2017 15:15:55:  Epoch[ 3 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 1.62318418 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.1684s; samplesPerSecond = 547.8
MPI Rank 0: 12/12/2017 15:15:56:  Epoch[ 3 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 1.44941986 * 640; EvalClassificationError = 0.43281250 * 640; time = 1.2474s; samplesPerSecond = 513.1
MPI Rank 0: 12/12/2017 15:15:57:  Epoch[ 3 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 1.60425367 * 640; EvalClassificationError = 0.49062500 * 640; time = 1.1207s; samplesPerSecond = 571.1
MPI Rank 0: 12/12/2017 15:15:58:  Epoch[ 3 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 1.52839810 * 640; EvalClassificationError = 0.46406250 * 640; time = 1.1930s; samplesPerSecond = 536.4
MPI Rank 0: 12/12/2017 15:16:00:  Epoch[ 3 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 1.51581284 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.1014s; samplesPerSecond = 581.1
MPI Rank 0: 12/12/2017 15:16:01:  Epoch[ 3 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 1.54632435 * 640; EvalClassificationError = 0.44375000 * 640; time = 0.9969s; samplesPerSecond = 642.0
MPI Rank 0: 12/12/2017 15:16:02:  Epoch[ 3 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 1.51517575 * 640; EvalClassificationError = 0.43750000 * 640; time = 1.2022s; samplesPerSecond = 532.3
MPI Rank 0: 12/12/2017 15:16:03:  Epoch[ 3 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 1.60369287 * 640; EvalClassificationError = 0.46875000 * 640; time = 1.2179s; samplesPerSecond = 525.5
MPI Rank 0: 12/12/2017 15:16:04:  Epoch[ 3 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 1.47326330 * 640; EvalClassificationError = 0.44218750 * 640; time = 1.2348s; samplesPerSecond = 518.3
MPI Rank 0: 12/12/2017 15:16:06:  Epoch[ 3 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 1.61175205 * 640; EvalClassificationError = 0.46250000 * 640; time = 1.5266s; samplesPerSecond = 419.2
MPI Rank 0: 12/12/2017 15:16:07:  Epoch[ 3 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 1.53030127 * 640; EvalClassificationError = 0.44687500 * 640; time = 1.2695s; samplesPerSecond = 504.1
MPI Rank 0: 12/12/2017 15:16:08:  Epoch[ 3 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 1.53453730 * 640; EvalClassificationError = 0.47968750 * 640; time = 1.2933s; samplesPerSecond = 494.9
MPI Rank 0: 12/12/2017 15:16:09:  Epoch[ 3 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 1.59778376 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.0638s; samplesPerSecond = 601.6
MPI Rank 0: 12/12/2017 15:16:11:  Epoch[ 3 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 1.50381349 * 640; EvalClassificationError = 0.40625000 * 640; time = 1.2480s; samplesPerSecond = 512.8
MPI Rank 0: 12/12/2017 15:16:12:  Epoch[ 3 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 1.47868865 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.3909s; samplesPerSecond = 460.1
MPI Rank 0: 12/12/2017 15:16:13:  Epoch[ 3 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 1.59931512 * 640; EvalClassificationError = 0.46406250 * 640; time = 1.0793s; samplesPerSecond = 593.0
MPI Rank 0: 12/12/2017 15:16:14:  Epoch[ 3 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 1.63250429 * 640; EvalClassificationError = 0.47031250 * 640; time = 1.2610s; samplesPerSecond = 507.5
MPI Rank 0: 12/12/2017 15:16:15:  Epoch[ 3 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 1.49853807 * 640; EvalClassificationError = 0.44218750 * 640; time = 1.0554s; samplesPerSecond = 606.4
MPI Rank 0: 12/12/2017 15:16:17:  Epoch[ 3 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 1.48667596 * 640; EvalClassificationError = 0.44531250 * 640; time = 1.3141s; samplesPerSecond = 487.0
MPI Rank 0: 12/12/2017 15:16:18:  Epoch[ 3 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 1.65617302 * 640; EvalClassificationError = 0.49531250 * 640; time = 1.1536s; samplesPerSecond = 554.8
MPI Rank 0: 12/12/2017 15:16:19:  Epoch[ 3 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 1.46898744 * 640; EvalClassificationError = 0.42031250 * 640; time = 1.2046s; samplesPerSecond = 531.3
MPI Rank 0: 12/12/2017 15:16:20:  Epoch[ 3 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 1.54734642 * 640; EvalClassificationError = 0.46093750 * 640; time = 1.2431s; samplesPerSecond = 514.8
MPI Rank 0: 12/12/2017 15:16:22:  Epoch[ 3 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 1.43416148 * 640; EvalClassificationError = 0.42187500 * 640; time = 1.2402s; samplesPerSecond = 516.0
MPI Rank 0: 12/12/2017 15:16:23:  Epoch[ 3 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 1.56624483 * 640; EvalClassificationError = 0.44843750 * 640; time = 1.2884s; samplesPerSecond = 496.7
MPI Rank 0: 12/12/2017 15:16:24:  Epoch[ 3 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 1.52464832 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.9419s; samplesPerSecond = 679.4
MPI Rank 0: 12/12/2017 15:16:25:  Epoch[ 3 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 1.30943399 * 640; EvalClassificationError = 0.38281250 * 640; time = 1.3795s; samplesPerSecond = 463.9
MPI Rank 0: 12/12/2017 15:16:26:  Epoch[ 3 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 1.50544335 * 640; EvalClassificationError = 0.46718750 * 640; time = 0.9473s; samplesPerSecond = 675.6
MPI Rank 0: 12/12/2017 15:16:28:  Epoch[ 3 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 1.60015038 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.3889s; samplesPerSecond = 460.8
MPI Rank 0: 12/12/2017 15:16:29:  Epoch[ 3 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 1.38509585 * 640; EvalClassificationError = 0.40781250 * 640; time = 1.2279s; samplesPerSecond = 521.2
MPI Rank 0: 12/12/2017 15:16:30:  Epoch[ 3 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 1.54075585 * 640; EvalClassificationError = 0.45000000 * 640; time = 1.2357s; samplesPerSecond = 517.9
MPI Rank 0: 12/12/2017 15:16:32:  Epoch[ 3 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 1.47883913 * 640; EvalClassificationError = 0.42812500 * 640; time = 1.6584s; samplesPerSecond = 385.9
MPI Rank 0: 12/12/2017 15:16:33:  Epoch[ 3 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 1.56904501 * 640; EvalClassificationError = 0.46406250 * 640; time = 1.1431s; samplesPerSecond = 559.9
MPI Rank 0: 12/12/2017 15:16:34:  Epoch[ 3 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 1.43381650 * 640; EvalClassificationError = 0.41875000 * 640; time = 1.4248s; samplesPerSecond = 449.2
MPI Rank 0: 12/12/2017 15:16:35:  Epoch[ 3 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 1.52029729 * 640; EvalClassificationError = 0.45000000 * 640; time = 1.1368s; samplesPerSecond = 563.0
MPI Rank 0: 12/12/2017 15:16:37:  Epoch[ 3 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 1.43772599 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.2011s; samplesPerSecond = 532.8
MPI Rank 0: 12/12/2017 15:16:38:  Epoch[ 3 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 1.46138787 * 640; EvalClassificationError = 0.43750000 * 640; time = 1.2081s; samplesPerSecond = 529.7
MPI Rank 0: 12/12/2017 15:16:39:  Epoch[ 3 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 1.42613409 * 640; EvalClassificationError = 0.43750000 * 640; time = 1.1616s; samplesPerSecond = 551.0
MPI Rank 0: 12/12/2017 15:16:40:  Epoch[ 3 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 1.46340343 * 640; EvalClassificationError = 0.43906250 * 640; time = 1.4017s; samplesPerSecond = 456.6
MPI Rank 0: 12/12/2017 15:16:41:  Epoch[ 3 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 1.53686246 * 640; EvalClassificationError = 0.42187500 * 640; time = 1.0083s; samplesPerSecond = 634.7
MPI Rank 0: 12/12/2017 15:16:43:  Epoch[ 3 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 1.59556144 * 640; EvalClassificationError = 0.47656250 * 640; time = 1.2886s; samplesPerSecond = 496.7
MPI Rank 0: 12/12/2017 15:16:44:  Epoch[ 3 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 1.51150023 * 640; EvalClassificationError = 0.45468750 * 640; time = 1.3325s; samplesPerSecond = 480.3
MPI Rank 0: 12/12/2017 15:16:45:  Epoch[ 3 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 1.44456911 * 640; EvalClassificationError = 0.42500000 * 640; time = 0.9992s; samplesPerSecond = 640.5
MPI Rank 0: 12/12/2017 15:16:46:  Epoch[ 3 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 1.45832784 * 640; EvalClassificationError = 0.45468750 * 640; time = 1.2422s; samplesPerSecond = 515.2
MPI Rank 0: 12/12/2017 15:16:47:  Epoch[ 3 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 1.57553892 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.0314s; samplesPerSecond = 620.5
MPI Rank 0: 12/12/2017 15:16:48:  Epoch[ 3 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 1.42915991 * 640; EvalClassificationError = 0.39687500 * 640; time = 1.1261s; samplesPerSecond = 568.3
MPI Rank 0: 12/12/2017 15:16:49:  Epoch[ 3 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 1.43923172 * 640; EvalClassificationError = 0.42656250 * 640; time = 1.0862s; samplesPerSecond = 589.2
MPI Rank 0: 12/12/2017 15:16:51:  Epoch[ 3 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 1.43711429 * 640; EvalClassificationError = 0.42031250 * 640; time = 1.1168s; samplesPerSecond = 573.1
MPI Rank 0: 12/12/2017 15:16:52:  Epoch[ 3 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 1.42376466 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.1678s; samplesPerSecond = 548.0
MPI Rank 0: 12/12/2017 15:16:53:  Epoch[ 3 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 1.46373212 * 640; EvalClassificationError = 0.42812500 * 640; time = 1.1981s; samplesPerSecond = 534.2
MPI Rank 0: 12/12/2017 15:16:54:  Epoch[ 3 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 1.48734009 * 640; EvalClassificationError = 0.44531250 * 640; time = 1.0757s; samplesPerSecond = 594.9
MPI Rank 0: 12/12/2017 15:16:55:  Epoch[ 3 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 1.33492865 * 640; EvalClassificationError = 0.40937500 * 640; time = 1.1622s; samplesPerSecond = 550.7
MPI Rank 0: 12/12/2017 15:16:57:  Epoch[ 3 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 1.45062139 * 640; EvalClassificationError = 0.43281250 * 640; time = 1.3560s; samplesPerSecond = 472.0
MPI Rank 0: 12/12/2017 15:16:58:  Epoch[ 3 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 1.36885165 * 640; EvalClassificationError = 0.40625000 * 640; time = 1.3233s; samplesPerSecond = 483.6
MPI Rank 0: 12/12/2017 15:16:59:  Epoch[ 3 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 1.48323648 * 640; EvalClassificationError = 0.45781250 * 640; time = 0.9179s; samplesPerSecond = 697.2
MPI Rank 0: 12/12/2017 15:17:00:  Epoch[ 3 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 1.33848948 * 640; EvalClassificationError = 0.41093750 * 640; time = 1.3627s; samplesPerSecond = 469.7
MPI Rank 0: 12/12/2017 15:17:01:  Epoch[ 3 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 1.43713565 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.8875s; samplesPerSecond = 721.1
MPI Rank 0: 12/12/2017 15:17:03:  Epoch[ 3 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 1.51660478 * 640; EvalClassificationError = 0.43281250 * 640; time = 1.4933s; samplesPerSecond = 428.6
MPI Rank 0: 12/12/2017 15:17:04:  Epoch[ 3 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 1.48694605 * 640; EvalClassificationError = 0.43281250 * 640; time = 1.1294s; samplesPerSecond = 566.7
MPI Rank 0: 12/12/2017 15:17:05:  Epoch[ 3 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 1.50715727 * 640; EvalClassificationError = 0.44218750 * 640; time = 1.1240s; samplesPerSecond = 569.4
MPI Rank 0: 12/12/2017 15:17:06:  Epoch[ 3 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 1.40272164 * 640; EvalClassificationError = 0.39687500 * 640; time = 1.2199s; samplesPerSecond = 524.6
MPI Rank 0: 12/12/2017 15:17:07:  Epoch[ 3 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 1.50124672 * 640; EvalClassificationError = 0.43437500 * 640; time = 1.2997s; samplesPerSecond = 492.4
MPI Rank 0: 12/12/2017 15:17:09:  Epoch[ 3 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 1.49536744 * 640; EvalClassificationError = 0.44687500 * 640; time = 1.5184s; samplesPerSecond = 421.5
MPI Rank 0: 12/12/2017 15:17:10:  Epoch[ 3 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 1.43536357 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.2311s; samplesPerSecond = 519.9
MPI Rank 0: 12/12/2017 15:17:11:  Epoch[ 3 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 1.51852426 * 640; EvalClassificationError = 0.44843750 * 640; time = 1.1173s; samplesPerSecond = 572.8
MPI Rank 0: 12/12/2017 15:17:12:  Epoch[ 3 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 1.46455974 * 640; EvalClassificationError = 0.45000000 * 640; time = 1.2626s; samplesPerSecond = 506.9
MPI Rank 0: 12/12/2017 15:17:14:  Epoch[ 3 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 1.42139152 * 640; EvalClassificationError = 0.40156250 * 640; time = 1.2456s; samplesPerSecond = 513.8
MPI Rank 0: 12/12/2017 15:17:15:  Epoch[ 3 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 1.37289030 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.3824s; samplesPerSecond = 463.0
MPI Rank 0: 12/12/2017 15:17:16:  Epoch[ 3 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 1.48403103 * 640; EvalClassificationError = 0.44531250 * 640; time = 1.0655s; samplesPerSecond = 600.7
MPI Rank 0: 12/12/2017 15:17:18:  Epoch[ 3 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 1.45404988 * 640; EvalClassificationError = 0.41562500 * 640; time = 1.4062s; samplesPerSecond = 455.1
MPI Rank 0: 12/12/2017 15:17:19:  Epoch[ 3 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 1.36486848 * 640; EvalClassificationError = 0.42187500 * 640; time = 1.2060s; samplesPerSecond = 530.7
MPI Rank 0: 12/12/2017 15:17:20:  Epoch[ 3 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 1.33833342 * 640; EvalClassificationError = 0.40000000 * 640; time = 1.1081s; samplesPerSecond = 577.6
MPI Rank 0: 12/12/2017 15:17:21:  Epoch[ 3 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 1.45630697 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.0695s; samplesPerSecond = 598.4
MPI Rank 0: 12/12/2017 15:17:22:  Epoch[ 3 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 1.39637189 * 640; EvalClassificationError = 0.40625000 * 640; time = 1.0392s; samplesPerSecond = 615.9
MPI Rank 0: 12/12/2017 15:17:23:  Epoch[ 3 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 1.42767318 * 640; EvalClassificationError = 0.42656250 * 640; time = 1.2077s; samplesPerSecond = 529.9
MPI Rank 0: 12/12/2017 15:17:24:  Epoch[ 3 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 1.43782335 * 640; EvalClassificationError = 0.43281250 * 640; time = 1.1538s; samplesPerSecond = 554.7
MPI Rank 0: 12/12/2017 15:17:26:  Epoch[ 3 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 1.43327475 * 640; EvalClassificationError = 0.41718750 * 640; time = 1.2579s; samplesPerSecond = 508.8
MPI Rank 0: 12/12/2017 15:17:27:  Epoch[ 3 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 1.41761283 * 640; EvalClassificationError = 0.41562500 * 640; time = 1.1829s; samplesPerSecond = 541.1
MPI Rank 0: 12/12/2017 15:17:28:  Epoch[ 3 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 1.48752040 * 640; EvalClassificationError = 0.44218750 * 640; time = 1.4610s; samplesPerSecond = 438.0
MPI Rank 0: 12/12/2017 15:17:29:  Epoch[ 3 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 1.46948032 * 640; EvalClassificationError = 0.44531250 * 640; time = 1.0470s; samplesPerSecond = 611.3
MPI Rank 0: 12/12/2017 15:17:30:  Epoch[ 3 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 1.34891898 * 640; EvalClassificationError = 0.40312500 * 640; time = 1.0776s; samplesPerSecond = 593.9
MPI Rank 0: 12/12/2017 15:17:32:  Epoch[ 3 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 1.45118836 * 640; EvalClassificationError = 0.43437500 * 640; time = 1.6523s; samplesPerSecond = 387.3
MPI Rank 0: 12/12/2017 15:17:33:  Epoch[ 3 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 1.38543708 * 640; EvalClassificationError = 0.42343750 * 640; time = 1.3794s; samplesPerSecond = 464.0
MPI Rank 0: 12/12/2017 15:17:35:  Epoch[ 3 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 1.45996370 * 640; EvalClassificationError = 0.43437500 * 640; time = 1.3211s; samplesPerSecond = 484.4
MPI Rank 0: 12/12/2017 15:17:36:  Epoch[ 3 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 1.48223623 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.9254s; samplesPerSecond = 691.6
MPI Rank 0: 12/12/2017 15:17:37:  Epoch[ 3 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 1.45381259 * 640; EvalClassificationError = 0.44531250 * 640; time = 1.3213s; samplesPerSecond = 484.4
MPI Rank 0: 12/12/2017 15:17:38:  Epoch[ 3 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 1.40590782 * 640; EvalClassificationError = 0.40937500 * 640; time = 1.0203s; samplesPerSecond = 627.2
MPI Rank 0: 12/12/2017 15:17:39:  Epoch[ 3 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 1.46130102 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.3138s; samplesPerSecond = 487.1
MPI Rank 0: 12/12/2017 15:17:40:  Epoch[ 3 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 1.39530065 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.8932s; samplesPerSecond = 716.5
MPI Rank 0: 12/12/2017 15:17:41:  Epoch[ 3 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 1.35419083 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.1770s; samplesPerSecond = 543.8
MPI Rank 0: 12/12/2017 15:17:43:  Epoch[ 3 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 1.33073646 * 640; EvalClassificationError = 0.41250000 * 640; time = 1.4648s; samplesPerSecond = 436.9
MPI Rank 0: 12/12/2017 15:17:44:  Epoch[ 3 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 1.38949160 * 640; EvalClassificationError = 0.41093750 * 640; time = 1.2026s; samplesPerSecond = 532.2
MPI Rank 0: 12/12/2017 15:17:45:  Epoch[ 3 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 1.32880727 * 640; EvalClassificationError = 0.39062500 * 640; time = 1.2048s; samplesPerSecond = 531.2
MPI Rank 0: 12/12/2017 15:17:46:  Epoch[ 3 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 1.40184500 * 640; EvalClassificationError = 0.43750000 * 640; time = 1.1079s; samplesPerSecond = 577.7
MPI Rank 0: 12/12/2017 15:17:47:  Epoch[ 3 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 1.40949007 * 640; EvalClassificationError = 0.39531250 * 640; time = 1.0220s; samplesPerSecond = 626.2
MPI Rank 0: 12/12/2017 15:17:49:  Epoch[ 3 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 1.23195500 * 640; EvalClassificationError = 0.38437500 * 640; time = 1.2792s; samplesPerSecond = 500.3
MPI Rank 0: 12/12/2017 15:17:50:  Epoch[ 3 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 1.38284649 * 640; EvalClassificationError = 0.42343750 * 640; time = 1.2763s; samplesPerSecond = 501.5
MPI Rank 0: 12/12/2017 15:17:51:  Epoch[ 3 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 1.48791262 * 640; EvalClassificationError = 0.42031250 * 640; time = 1.4681s; samplesPerSecond = 435.9
MPI Rank 0: 12/12/2017 15:17:53:  Epoch[ 3 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 1.44552472 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.2115s; samplesPerSecond = 528.3
MPI Rank 0: 12/12/2017 15:17:54:  Epoch[ 3 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 1.39650699 * 640; EvalClassificationError = 0.42187500 * 640; time = 1.1418s; samplesPerSecond = 560.5
MPI Rank 0: 12/12/2017 15:17:55:  Epoch[ 3 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 1.34393857 * 640; EvalClassificationError = 0.40781250 * 640; time = 1.1247s; samplesPerSecond = 569.0
MPI Rank 0: 12/12/2017 15:17:56:  Epoch[ 3 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 1.40896873 * 640; EvalClassificationError = 0.43593750 * 640; time = 1.0860s; samplesPerSecond = 589.3
MPI Rank 0: 12/12/2017 15:17:57:  Epoch[ 3 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 1.39640866 * 640; EvalClassificationError = 0.43750000 * 640; time = 1.2528s; samplesPerSecond = 510.9
MPI Rank 0: 12/12/2017 15:17:57: Finished Epoch[ 3 of 3]: [Training] CrossEntropyWithSoftmax = 1.48429042 * 81920; EvalClassificationError = 0.43870850 * 81920; totalSamplesSeen = 245760; learningRatePerSample = 0.001953125; epochTime=207.092s
MPI Rank 0: 12/12/2017 15:17:57: SGD: Saving checkpoint model '/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu/models/cntkSpeech.dnn'
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:17:57: Action "train" complete.
MPI Rank 0: 
MPI Rank 0: 12/12/2017 15:17:57: __COMPLETED__
MPI Rank 1: CNTK 2.3.1+ (HEAD f4f0f8, Dec 11 2017 18:34:12) at 2017/12/12 15:08:18
MPI Rank 1: 
MPI Rank 1: /home/ubuntu/workspace/build/gpu/release/bin/cntk  configFile=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling/cntk.cntk  currentDirectory=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data  RunDir=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu  DataDir=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data  ConfigDir=/home/ubuntu/workspace/Tests/EndToEndTests/Speech/DNN/Parallel1BitQuantizationWithAutoMBScaling  OutputDir=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu  DeviceId=-1  timestamping=true  numCPUThreads=6  stderr=/tmp/cntk-test-20171211223423.932710/Speech/DNN_Parallel1BitQuantizationWithAutoMBScaling@release_cpu/stderr
MPI Rank 1: 12/12/2017 15:08:19: -------------------------------------------------------------------
MPI Rank 1: 12/12/2017 15:08:19: Build info: 
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:19: 		Built time: Dec 11 2017 18:28:39
MPI Rank 1: 12/12/2017 15:08:19: 		Last modified date: Wed Nov 15 09:27:10 2017
MPI Rank 1: 12/12/2017 15:08:19: 		Build type: release
MPI Rank 1: 12/12/2017 15:08:19: 		Build target: GPU
MPI Rank 1: 12/12/2017 15:08:19: 		With ASGD: yes
MPI Rank 1: 12/12/2017 15:08:19: 		Math lib: mkl
MPI Rank 1: 12/12/2017 15:08:19: 		CUDA version: 9.0.0
MPI Rank 1: 12/12/2017 15:08:19: 		CUDNN version: 7.0.4
MPI Rank 1: 12/12/2017 15:08:19: 		Build Branch: HEAD
MPI Rank 1: 12/12/2017 15:08:19: 		Build SHA1: f4f0f82eabcc482dbd03af1f946a44ae2b8b97bf
MPI Rank 1: 12/12/2017 15:08:19: 		MPI distribution: Open MPI
MPI Rank 1: 12/12/2017 15:08:19: 		MPI version: 1.10.7
MPI Rank 1: 12/12/2017 15:08:19: -------------------------------------------------------------------
MPI Rank 1: 12/12/2017 15:08:19: -------------------------------------------------------------------
MPI Rank 1: 12/12/2017 15:08:19: GPU info:
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:19: 		Device[0]: cores = 3072; computeCapability = 5.2; type = "Tesla M60"; total memory = 8123 MB; free memory = 8112 MB
MPI Rank 1: 12/12/2017 15:08:19: -------------------------------------------------------------------
MPI Rank 1: 12/12/2017 15:08:19: Using 6 CPU threads.
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:19: ##############################################################################
MPI Rank 1: 12/12/2017 15:08:19: #                                                                            #
MPI Rank 1: 12/12/2017 15:08:19: # speechTrain command (train action)                                         #
MPI Rank 1: 12/12/2017 15:08:19: #                                                                            #
MPI Rank 1: 12/12/2017 15:08:19: ##############################################################################
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:19: WARNING: 'numMiniBatch4LRSearch' is deprecated, please remove it and use 'numSamples4Search' instead.
MPI Rank 1: 12/12/2017 15:08:19: 
MPI Rank 1: Creating virgin network.
MPI Rank 1: SimpleNetworkBuilder Using CPU
MPI Rank 1: reading script file glob_0000.scp ... 948 entries
MPI Rank 1: total 132 state names in state list /home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data/state.list
MPI Rank 1: htkmlfreader: reading MLF file /home/ubuntu/workspace/Tests/EndToEndTests/Speech/Data/glob_0000.mlf ... total 948 entries
MPI Rank 1: ...............................................................................................feature set 0: 252734 frames in 948 out of 948 utterances
MPI Rank 1: label set 0: 129 classes
MPI Rank 1: minibatchutterancesource: 948 utterances grouped into 3 chunks, av. chunk size: 316.0 utterances, 84244.7 frames
MPI Rank 1: 12/12/2017 15:08:19: 
MPI Rank 1: Model has 25 nodes. Using CPU.
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:19: Training criterion:   CrossEntropyWithSoftmax = CrossEntropyWithSoftmax
MPI Rank 1: 12/12/2017 15:08:19: Evaluation criterion: EvalClassificationError = ClassificationError
MPI Rank 1: 
MPI Rank 1: 
MPI Rank 1: Allocating matrices for forward and/or backward propagation.
MPI Rank 1: 
MPI Rank 1: Gradient Memory Aliasing: 4 are aliased.
MPI Rank 1: 	W2*H1 (gradient) reuses HLast (gradient)
MPI Rank 1: 	W1*H1 (gradient) reuses W1*H1+B1 (gradient)
MPI Rank 1: 
MPI Rank 1: Memory Sharing: Out of 40 matrices, 21 are shared as 5, and 19 are not shared.
MPI Rank 1: 
MPI Rank 1: Here are the ones that share memory:
MPI Rank 1: 	{ PosteriorProb : [132 x 1 x *]
MPI Rank 1: 	  ScaledLogLikelihood : [132 x 1 x *] }
MPI Rank 1: 	{ HLast : [132 x 1 x *] (gradient)
MPI Rank 1: 	  W0 : [512 x 363] (gradient)
MPI Rank 1: 	  W0*features+B0 : [512 x 1 x *] (gradient)
MPI Rank 1: 	  W1*H1 : [512 x 1 x *] (gradient)
MPI Rank 1: 	  W1*H1+B1 : [512 x 1 x *]
MPI Rank 1: 	  W1*H1+B1 : [512 x 1 x *] (gradient)
MPI Rank 1: 	  W2*H1 : [132 x 1 x *]
MPI Rank 1: 	  W2*H1 : [132 x 1 x *] (gradient) }
MPI Rank 1: 	{ H2 : [512 x 1 x *]
MPI Rank 1: 	  W0*features+B0 : [512 x 1 x *]
MPI Rank 1: 	  W1 : [512 x 512] (gradient)
MPI Rank 1: 	  W1*H1 : [512 x 1 x *] }
MPI Rank 1: 	{ H1 : [512 x 1 x *] (gradient)
MPI Rank 1: 	  H2 : [512 x 1 x *] (gradient)
MPI Rank 1: 	  HLast : [132 x 1 x *]
MPI Rank 1: 	  W0*features : [512 x *]
MPI Rank 1: 	  W0*features : [512 x *] (gradient) }
MPI Rank 1: 	{ B0 : [512 x 1] (gradient)
MPI Rank 1: 	  H1 : [512 x 1 x *] }
MPI Rank 1: 
MPI Rank 1: Here are the ones that don't share memory:
MPI Rank 1: 	{features : [363 x *]}
MPI Rank 1: 	{InvStdOfFeatures : [363]}
MPI Rank 1: 	{MeanOfFeatures : [363]}
MPI Rank 1: 	{W0 : [512 x 363]}
MPI Rank 1: 	{B0 : [512 x 1]}
MPI Rank 1: 	{W1 : [512 x 512]}
MPI Rank 1: 	{B1 : [512 x 1]}
MPI Rank 1: 	{W2 : [132 x 512]}
MPI Rank 1: 	{B2 : [132 x 1]}
MPI Rank 1: 	{labels : [132 x *]}
MPI Rank 1: 	{Prior : [132]}
MPI Rank 1: 	{CrossEntropyWithSoftmax : [1] (gradient)}
MPI Rank 1: 	{MVNormalizedFeatures : [363 x *]}
MPI Rank 1: 	{B1 : [512 x 1] (gradient)}
MPI Rank 1: 	{EvalClassificationError : [1]}
MPI Rank 1: 	{LogOfPrior : [132]}
MPI Rank 1: 	{W2 : [132 x 512] (gradient)}
MPI Rank 1: 	{CrossEntropyWithSoftmax : [1]}
MPI Rank 1: 	{B2 : [132 x 1] (gradient)}
MPI Rank 1: 
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:19: Training 516740 parameters in 6 out of 6 parameter tensors and 15 nodes with gradient:
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:19: 	Node 'B0' (LearnableParameter operation) : [512 x 1]
MPI Rank 1: 12/12/2017 15:08:19: 	Node 'B1' (LearnableParameter operation) : [512 x 1]
MPI Rank 1: 12/12/2017 15:08:19: 	Node 'B2' (LearnableParameter operation) : [132 x 1]
MPI Rank 1: 12/12/2017 15:08:19: 	Node 'W0' (LearnableParameter operation) : [512 x 363]
MPI Rank 1: 12/12/2017 15:08:19: 	Node 'W1' (LearnableParameter operation) : [512 x 512]
MPI Rank 1: 12/12/2017 15:08:19: 	Node 'W2' (LearnableParameter operation) : [132 x 512]
MPI Rank 1: 
MPI Rank 1: Initializing dataParallelSGD for 2-bit quantization.
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:19: Precomputing --> 3 PreCompute nodes found.
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:19: 	MeanOfFeatures = Mean()
MPI Rank 1: 12/12/2017 15:08:19: 	InvStdOfFeatures = InvStdDev()
MPI Rank 1: 12/12/2017 15:08:19: 	Prior = Mean()
MPI Rank 1: minibatchiterator: epoch 0: frames [0..252734] (first utterance at frame 0), data subset 0 of 1, with 1 datapasses
MPI Rank 1: requiredata: determined feature kind as 33-dimensional 'USER' with frame shift 10.0 ms
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:25: Precomputing --> Completed.
MPI Rank 1: 
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:25: Starting Epoch 1: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 1: minibatchiterator: epoch 0: frames [0..81920] (first utterance at frame 0), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:08:25: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 12/12/2017 15:08:26:  Epoch[ 1 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 4.70051279 * 640; EvalClassificationError = 0.95468750 * 640; time = 1.3507s; samplesPerSecond = 473.8
MPI Rank 1: 12/12/2017 15:08:28:  Epoch[ 1 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 4.35695012 * 640; EvalClassificationError = 0.91406250 * 640; time = 1.6043s; samplesPerSecond = 398.9
MPI Rank 1: 12/12/2017 15:08:29:  Epoch[ 1 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 4.20074123 * 640; EvalClassificationError = 0.97031250 * 640; time = 1.2775s; samplesPerSecond = 501.0
MPI Rank 1: 12/12/2017 15:08:30:  Epoch[ 1 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 3.89629380 * 640; EvalClassificationError = 0.86250000 * 640; time = 1.5648s; samplesPerSecond = 409.0
MPI Rank 1: 12/12/2017 15:08:32:  Epoch[ 1 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 4.06033372 * 640; EvalClassificationError = 0.90312500 * 640; time = 1.2105s; samplesPerSecond = 528.7
MPI Rank 1: 12/12/2017 15:08:33:  Epoch[ 1 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 3.95010414 * 640; EvalClassificationError = 0.86250000 * 640; time = 1.0244s; samplesPerSecond = 624.8
MPI Rank 1: 12/12/2017 15:08:34:  Epoch[ 1 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 3.81166462 * 640; EvalClassificationError = 0.87031250 * 640; time = 1.3048s; samplesPerSecond = 490.5
MPI Rank 1: 12/12/2017 15:08:35:  Epoch[ 1 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 3.91820337 * 640; EvalClassificationError = 0.89531250 * 640; time = 1.3468s; samplesPerSecond = 475.2
MPI Rank 1: 12/12/2017 15:08:37:  Epoch[ 1 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 3.96815573 * 640; EvalClassificationError = 0.87968750 * 640; time = 1.4154s; samplesPerSecond = 452.2
MPI Rank 1: 12/12/2017 15:08:38:  Epoch[ 1 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 3.93874337 * 640; EvalClassificationError = 0.91406250 * 640; time = 1.5351s; samplesPerSecond = 416.9
MPI Rank 1: 12/12/2017 15:08:40:  Epoch[ 1 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 4.05343565 * 640; EvalClassificationError = 0.92812500 * 640; time = 1.4003s; samplesPerSecond = 457.0
MPI Rank 1: 12/12/2017 15:08:41:  Epoch[ 1 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 3.89785021 * 640; EvalClassificationError = 0.86250000 * 640; time = 1.2638s; samplesPerSecond = 506.4
MPI Rank 1: 12/12/2017 15:08:42:  Epoch[ 1 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 3.87613785 * 640; EvalClassificationError = 0.89218750 * 640; time = 1.3455s; samplesPerSecond = 475.6
MPI Rank 1: 12/12/2017 15:08:43:  Epoch[ 1 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 3.82499847 * 640; EvalClassificationError = 0.89531250 * 640; time = 1.1082s; samplesPerSecond = 577.5
MPI Rank 1: 12/12/2017 15:08:45:  Epoch[ 1 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 3.80816934 * 640; EvalClassificationError = 0.88281250 * 640; time = 1.2663s; samplesPerSecond = 505.4
MPI Rank 1: 12/12/2017 15:08:46:  Epoch[ 1 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 3.94753941 * 640; EvalClassificationError = 0.89375000 * 640; time = 1.1864s; samplesPerSecond = 539.5
MPI Rank 1: 12/12/2017 15:08:47:  Epoch[ 1 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 3.82870557 * 640; EvalClassificationError = 0.87812500 * 640; time = 1.3189s; samplesPerSecond = 485.2
MPI Rank 1: 12/12/2017 15:08:48:  Epoch[ 1 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 3.76141165 * 640; EvalClassificationError = 0.86093750 * 640; time = 1.2615s; samplesPerSecond = 507.3
MPI Rank 1: 12/12/2017 15:08:50:  Epoch[ 1 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 3.80313722 * 640; EvalClassificationError = 0.86562500 * 640; time = 1.1445s; samplesPerSecond = 559.2
MPI Rank 1: 12/12/2017 15:08:51:  Epoch[ 1 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 3.74406797 * 640; EvalClassificationError = 0.88125000 * 640; time = 1.4091s; samplesPerSecond = 454.2
MPI Rank 1: 12/12/2017 15:08:52:  Epoch[ 1 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 3.74280095 * 640; EvalClassificationError = 0.86562500 * 640; time = 0.9721s; samplesPerSecond = 658.4
MPI Rank 1: 12/12/2017 15:08:53:  Epoch[ 1 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 3.73038743 * 640; EvalClassificationError = 0.85937500 * 640; time = 1.5520s; samplesPerSecond = 412.4
MPI Rank 1: 12/12/2017 15:08:55:  Epoch[ 1 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 3.72374993 * 640; EvalClassificationError = 0.85312500 * 640; time = 1.0758s; samplesPerSecond = 594.9
MPI Rank 1: 12/12/2017 15:08:56:  Epoch[ 1 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 3.75930638 * 640; EvalClassificationError = 0.83750000 * 640; time = 1.3573s; samplesPerSecond = 471.5
MPI Rank 1: 12/12/2017 15:08:57:  Epoch[ 1 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 3.72550280 * 640; EvalClassificationError = 0.87031250 * 640; time = 1.5578s; samplesPerSecond = 410.8
MPI Rank 1: 12/12/2017 15:08:58:  Epoch[ 1 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 3.67204081 * 640; EvalClassificationError = 0.84531250 * 640; time = 0.9569s; samplesPerSecond = 668.9
MPI Rank 1: 12/12/2017 15:09:00:  Epoch[ 1 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 3.58954002 * 640; EvalClassificationError = 0.78281250 * 640; time = 1.2828s; samplesPerSecond = 498.9
MPI Rank 1: 12/12/2017 15:09:01:  Epoch[ 1 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 3.69883456 * 640; EvalClassificationError = 0.81093750 * 640; time = 1.1447s; samplesPerSecond = 559.1
MPI Rank 1: 12/12/2017 15:09:02:  Epoch[ 1 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 3.58199775 * 640; EvalClassificationError = 0.79531250 * 640; time = 1.3793s; samplesPerSecond = 464.0
MPI Rank 1: 12/12/2017 15:09:03:  Epoch[ 1 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 3.53081690 * 640; EvalClassificationError = 0.82187500 * 640; time = 0.8871s; samplesPerSecond = 721.4
MPI Rank 1: 12/12/2017 15:09:04:  Epoch[ 1 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 3.53654818 * 640; EvalClassificationError = 0.82187500 * 640; time = 1.3514s; samplesPerSecond = 473.6
MPI Rank 1: 12/12/2017 15:09:06:  Epoch[ 1 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 3.50379349 * 640; EvalClassificationError = 0.79375000 * 640; time = 1.2192s; samplesPerSecond = 524.9
MPI Rank 1: 12/12/2017 15:09:07:  Epoch[ 1 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 3.38919585 * 640; EvalClassificationError = 0.79531250 * 640; time = 1.2621s; samplesPerSecond = 507.1
MPI Rank 1: 12/12/2017 15:09:08:  Epoch[ 1 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 3.44880368 * 640; EvalClassificationError = 0.79218750 * 640; time = 1.5066s; samplesPerSecond = 424.8
MPI Rank 1: 12/12/2017 15:09:09:  Epoch[ 1 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 3.50079753 * 640; EvalClassificationError = 0.80937500 * 640; time = 0.9771s; samplesPerSecond = 655.0
MPI Rank 1: 12/12/2017 15:09:11:  Epoch[ 1 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 3.43660658 * 640; EvalClassificationError = 0.81562500 * 640; time = 1.5517s; samplesPerSecond = 412.5
MPI Rank 1: 12/12/2017 15:09:12:  Epoch[ 1 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 3.50379887 * 640; EvalClassificationError = 0.82968750 * 640; time = 1.3063s; samplesPerSecond = 489.9
MPI Rank 1: 12/12/2017 15:09:13:  Epoch[ 1 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 3.19963124 * 640; EvalClassificationError = 0.75625000 * 640; time = 1.1504s; samplesPerSecond = 556.3
MPI Rank 1: 12/12/2017 15:09:15:  Epoch[ 1 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 3.32425813 * 640; EvalClassificationError = 0.80312500 * 640; time = 1.3963s; samplesPerSecond = 458.3
MPI Rank 1: 12/12/2017 15:09:16:  Epoch[ 1 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 3.29798060 * 640; EvalClassificationError = 0.79843750 * 640; time = 0.9989s; samplesPerSecond = 640.7
MPI Rank 1: 12/12/2017 15:09:17:  Epoch[ 1 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 3.44474182 * 640; EvalClassificationError = 0.80937500 * 640; time = 1.3604s; samplesPerSecond = 470.4
MPI Rank 1: 12/12/2017 15:09:18:  Epoch[ 1 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 3.30266974 * 640; EvalClassificationError = 0.76718750 * 640; time = 1.0367s; samplesPerSecond = 617.3
MPI Rank 1: 12/12/2017 15:09:20:  Epoch[ 1 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 3.25681831 * 640; EvalClassificationError = 0.77968750 * 640; time = 1.2758s; samplesPerSecond = 501.6
MPI Rank 1: 12/12/2017 15:09:21:  Epoch[ 1 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 3.15820779 * 640; EvalClassificationError = 0.77031250 * 640; time = 1.0520s; samplesPerSecond = 608.4
MPI Rank 1: 12/12/2017 15:09:22:  Epoch[ 1 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 3.20898105 * 640; EvalClassificationError = 0.76093750 * 640; time = 1.2830s; samplesPerSecond = 498.8
MPI Rank 1: 12/12/2017 15:09:23:  Epoch[ 1 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 3.25787725 * 640; EvalClassificationError = 0.77656250 * 640; time = 1.2304s; samplesPerSecond = 520.2
MPI Rank 1: 12/12/2017 15:09:24:  Epoch[ 1 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 3.21639002 * 640; EvalClassificationError = 0.78437500 * 640; time = 1.0866s; samplesPerSecond = 589.0
MPI Rank 1: 12/12/2017 15:09:25:  Epoch[ 1 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 3.19755041 * 640; EvalClassificationError = 0.74375000 * 640; time = 1.1267s; samplesPerSecond = 568.0
MPI Rank 1: 12/12/2017 15:09:26:  Epoch[ 1 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 3.27740296 * 640; EvalClassificationError = 0.78125000 * 640; time = 1.0780s; samplesPerSecond = 593.7
MPI Rank 1: 12/12/2017 15:09:28:  Epoch[ 1 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 3.21731028 * 640; EvalClassificationError = 0.77812500 * 640; time = 1.2128s; samplesPerSecond = 527.7
MPI Rank 1: 12/12/2017 15:09:29:  Epoch[ 1 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 3.01272049 * 640; EvalClassificationError = 0.74531250 * 640; time = 1.0052s; samplesPerSecond = 636.7
MPI Rank 1: 12/12/2017 15:09:30:  Epoch[ 1 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 3.17478059 * 640; EvalClassificationError = 0.73281250 * 640; time = 1.5733s; samplesPerSecond = 406.8
MPI Rank 1: 12/12/2017 15:09:31:  Epoch[ 1 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 3.12103830 * 640; EvalClassificationError = 0.73437500 * 640; time = 1.1841s; samplesPerSecond = 540.5
MPI Rank 1: 12/12/2017 15:09:33:  Epoch[ 1 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 2.98082432 * 640; EvalClassificationError = 0.70937500 * 640; time = 1.3459s; samplesPerSecond = 475.5
MPI Rank 1: 12/12/2017 15:09:34:  Epoch[ 1 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 3.05007165 * 640; EvalClassificationError = 0.74375000 * 640; time = 1.2503s; samplesPerSecond = 511.9
MPI Rank 1: 12/12/2017 15:09:35:  Epoch[ 1 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 2.98743951 * 640; EvalClassificationError = 0.72031250 * 640; time = 1.2622s; samplesPerSecond = 507.0
MPI Rank 1: 12/12/2017 15:09:37:  Epoch[ 1 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 2.99403918 * 640; EvalClassificationError = 0.73906250 * 640; time = 1.4247s; samplesPerSecond = 449.2
MPI Rank 1: 12/12/2017 15:09:38:  Epoch[ 1 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 3.04396582 * 640; EvalClassificationError = 0.73906250 * 640; time = 1.1935s; samplesPerSecond = 536.2
MPI Rank 1: 12/12/2017 15:09:39:  Epoch[ 1 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 3.03754796 * 640; EvalClassificationError = 0.73593750 * 640; time = 1.2006s; samplesPerSecond = 533.1
MPI Rank 1: 12/12/2017 15:09:40:  Epoch[ 1 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 2.95866099 * 640; EvalClassificationError = 0.72031250 * 640; time = 1.1553s; samplesPerSecond = 554.0
MPI Rank 1: 12/12/2017 15:09:42:  Epoch[ 1 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 3.04394473 * 640; EvalClassificationError = 0.74218750 * 640; time = 1.5720s; samplesPerSecond = 407.1
MPI Rank 1: 12/12/2017 15:09:43:  Epoch[ 1 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 2.97533739 * 640; EvalClassificationError = 0.72500000 * 640; time = 1.4069s; samplesPerSecond = 454.9
MPI Rank 1: 12/12/2017 15:09:44:  Epoch[ 1 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 3.00702677 * 640; EvalClassificationError = 0.75000000 * 640; time = 1.1165s; samplesPerSecond = 573.2
MPI Rank 1: 12/12/2017 15:09:46:  Epoch[ 1 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 2.90058629 * 640; EvalClassificationError = 0.68750000 * 640; time = 1.2408s; samplesPerSecond = 515.8
MPI Rank 1: 12/12/2017 15:09:47:  Epoch[ 1 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 2.91110312 * 640; EvalClassificationError = 0.71718750 * 640; time = 1.0595s; samplesPerSecond = 604.1
MPI Rank 1: 12/12/2017 15:09:48:  Epoch[ 1 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 2.93752100 * 640; EvalClassificationError = 0.72656250 * 640; time = 1.3790s; samplesPerSecond = 464.1
MPI Rank 1: 12/12/2017 15:09:49:  Epoch[ 1 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 2.85819988 * 640; EvalClassificationError = 0.70468750 * 640; time = 1.2010s; samplesPerSecond = 532.9
MPI Rank 1: 12/12/2017 15:09:50:  Epoch[ 1 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 2.89007925 * 640; EvalClassificationError = 0.68281250 * 640; time = 1.0072s; samplesPerSecond = 635.5
MPI Rank 1: 12/12/2017 15:09:51:  Epoch[ 1 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 2.85100598 * 640; EvalClassificationError = 0.70937500 * 640; time = 1.2588s; samplesPerSecond = 508.4
MPI Rank 1: 12/12/2017 15:09:53:  Epoch[ 1 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 2.72432774 * 640; EvalClassificationError = 0.68750000 * 640; time = 1.2210s; samplesPerSecond = 524.2
MPI Rank 1: 12/12/2017 15:09:54:  Epoch[ 1 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 2.77593685 * 640; EvalClassificationError = 0.65781250 * 640; time = 1.3956s; samplesPerSecond = 458.6
MPI Rank 1: 12/12/2017 15:09:55:  Epoch[ 1 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 2.82559717 * 640; EvalClassificationError = 0.71406250 * 640; time = 1.1313s; samplesPerSecond = 565.7
MPI Rank 1: 12/12/2017 15:09:56:  Epoch[ 1 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 2.71976197 * 640; EvalClassificationError = 0.67656250 * 640; time = 1.2369s; samplesPerSecond = 517.4
MPI Rank 1: 12/12/2017 15:09:57:  Epoch[ 1 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 2.79910616 * 640; EvalClassificationError = 0.68125000 * 640; time = 1.0736s; samplesPerSecond = 596.1
MPI Rank 1: 12/12/2017 15:09:59:  Epoch[ 1 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 2.79788837 * 640; EvalClassificationError = 0.67500000 * 640; time = 1.4417s; samplesPerSecond = 443.9
MPI Rank 1: 12/12/2017 15:10:00:  Epoch[ 1 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 2.73739884 * 640; EvalClassificationError = 0.69375000 * 640; time = 1.1619s; samplesPerSecond = 550.8
MPI Rank 1: 12/12/2017 15:10:01:  Epoch[ 1 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 2.81372110 * 640; EvalClassificationError = 0.66406250 * 640; time = 1.1965s; samplesPerSecond = 534.9
MPI Rank 1: 12/12/2017 15:10:02:  Epoch[ 1 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 2.81083861 * 640; EvalClassificationError = 0.67968750 * 640; time = 1.0417s; samplesPerSecond = 614.4
MPI Rank 1: 12/12/2017 15:10:03:  Epoch[ 1 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 2.74256603 * 640; EvalClassificationError = 0.67500000 * 640; time = 1.0455s; samplesPerSecond = 612.2
MPI Rank 1: 12/12/2017 15:10:04:  Epoch[ 1 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 2.72576795 * 640; EvalClassificationError = 0.64531250 * 640; time = 1.1095s; samplesPerSecond = 576.8
MPI Rank 1: 12/12/2017 15:10:06:  Epoch[ 1 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 2.73651534 * 640; EvalClassificationError = 0.67187500 * 640; time = 1.4674s; samplesPerSecond = 436.1
MPI Rank 1: 12/12/2017 15:10:07:  Epoch[ 1 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 2.69794578 * 640; EvalClassificationError = 0.67500000 * 640; time = 1.4387s; samplesPerSecond = 444.9
MPI Rank 1: 12/12/2017 15:10:08:  Epoch[ 1 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 2.55353550 * 640; EvalClassificationError = 0.63593750 * 640; time = 1.0806s; samplesPerSecond = 592.3
MPI Rank 1: 12/12/2017 15:10:10:  Epoch[ 1 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 2.64451539 * 640; EvalClassificationError = 0.66562500 * 640; time = 1.3038s; samplesPerSecond = 490.9
MPI Rank 1: 12/12/2017 15:10:11:  Epoch[ 1 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 2.67392485 * 640; EvalClassificationError = 0.66250000 * 640; time = 1.1469s; samplesPerSecond = 558.0
MPI Rank 1: 12/12/2017 15:10:12:  Epoch[ 1 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 2.60373406 * 640; EvalClassificationError = 0.67031250 * 640; time = 1.1882s; samplesPerSecond = 538.6
MPI Rank 1: 12/12/2017 15:10:13:  Epoch[ 1 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 2.74048558 * 640; EvalClassificationError = 0.67968750 * 640; time = 1.3962s; samplesPerSecond = 458.4
MPI Rank 1: 12/12/2017 15:10:14:  Epoch[ 1 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 2.67928549 * 640; EvalClassificationError = 0.67656250 * 640; time = 0.8937s; samplesPerSecond = 716.1
MPI Rank 1: 12/12/2017 15:10:15:  Epoch[ 1 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 2.54491073 * 640; EvalClassificationError = 0.64531250 * 640; time = 1.0071s; samplesPerSecond = 635.5
MPI Rank 1: 12/12/2017 15:10:16:  Epoch[ 1 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 2.63487186 * 640; EvalClassificationError = 0.66562500 * 640; time = 1.0993s; samplesPerSecond = 582.2
MPI Rank 1: 12/12/2017 15:10:18:  Epoch[ 1 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 2.56022382 * 640; EvalClassificationError = 0.65312500 * 640; time = 1.3417s; samplesPerSecond = 477.0
MPI Rank 1: 12/12/2017 15:10:19:  Epoch[ 1 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 2.55775022 * 640; EvalClassificationError = 0.64375000 * 640; time = 0.9202s; samplesPerSecond = 695.5
MPI Rank 1: 12/12/2017 15:10:20:  Epoch[ 1 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 2.59909130 * 640; EvalClassificationError = 0.66250000 * 640; time = 1.2580s; samplesPerSecond = 508.7
MPI Rank 1: 12/12/2017 15:10:21:  Epoch[ 1 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 2.55362505 * 640; EvalClassificationError = 0.61093750 * 640; time = 1.0289s; samplesPerSecond = 622.0
MPI Rank 1: 12/12/2017 15:10:22:  Epoch[ 1 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 2.49326706 * 640; EvalClassificationError = 0.64062500 * 640; time = 1.1910s; samplesPerSecond = 537.3
MPI Rank 1: 12/12/2017 15:10:23:  Epoch[ 1 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 2.53499203 * 640; EvalClassificationError = 0.63593750 * 640; time = 1.1719s; samplesPerSecond = 546.1
MPI Rank 1: 12/12/2017 15:10:25:  Epoch[ 1 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 2.36068970 * 640; EvalClassificationError = 0.61562500 * 640; time = 1.4929s; samplesPerSecond = 428.7
MPI Rank 1: 12/12/2017 15:10:26:  Epoch[ 1 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 2.55381060 * 640; EvalClassificationError = 0.64531250 * 640; time = 1.2961s; samplesPerSecond = 493.8
MPI Rank 1: 12/12/2017 15:10:27:  Epoch[ 1 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 2.45870461 * 640; EvalClassificationError = 0.63750000 * 640; time = 1.1264s; samplesPerSecond = 568.2
MPI Rank 1: 12/12/2017 15:10:29:  Epoch[ 1 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 2.42961548 * 640; EvalClassificationError = 0.60000000 * 640; time = 1.3747s; samplesPerSecond = 465.6
MPI Rank 1: 12/12/2017 15:10:30:  Epoch[ 1 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 2.38149933 * 640; EvalClassificationError = 0.61250000 * 640; time = 1.1724s; samplesPerSecond = 545.9
MPI Rank 1: 12/12/2017 15:10:31:  Epoch[ 1 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 2.36476734 * 640; EvalClassificationError = 0.59062500 * 640; time = 1.5495s; samplesPerSecond = 413.0
MPI Rank 1: 12/12/2017 15:10:33:  Epoch[ 1 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 2.37532815 * 640; EvalClassificationError = 0.60625000 * 640; time = 1.2486s; samplesPerSecond = 512.6
MPI Rank 1: 12/12/2017 15:10:34:  Epoch[ 1 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 2.33424631 * 640; EvalClassificationError = 0.57812500 * 640; time = 1.2796s; samplesPerSecond = 500.1
MPI Rank 1: 12/12/2017 15:10:35:  Epoch[ 1 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 2.45361955 * 640; EvalClassificationError = 0.62031250 * 640; time = 1.2668s; samplesPerSecond = 505.2
MPI Rank 1: 12/12/2017 15:10:36:  Epoch[ 1 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 2.31527067 * 640; EvalClassificationError = 0.58750000 * 640; time = 0.9086s; samplesPerSecond = 704.4
MPI Rank 1: 12/12/2017 15:10:38:  Epoch[ 1 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 2.33012291 * 640; EvalClassificationError = 0.60781250 * 640; time = 1.4403s; samplesPerSecond = 444.4
MPI Rank 1: 12/12/2017 15:10:39:  Epoch[ 1 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 2.50052464 * 640; EvalClassificationError = 0.64687500 * 640; time = 1.0067s; samplesPerSecond = 635.8
MPI Rank 1: 12/12/2017 15:10:40:  Epoch[ 1 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 2.35689176 * 640; EvalClassificationError = 0.61250000 * 640; time = 1.4544s; samplesPerSecond = 440.0
MPI Rank 1: 12/12/2017 15:10:41:  Epoch[ 1 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 2.38314636 * 640; EvalClassificationError = 0.62343750 * 640; time = 1.2330s; samplesPerSecond = 519.1
MPI Rank 1: 12/12/2017 15:10:42:  Epoch[ 1 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 2.37926942 * 640; EvalClassificationError = 0.63125000 * 640; time = 0.9732s; samplesPerSecond = 657.6
MPI Rank 1: 12/12/2017 15:10:43:  Epoch[ 1 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 2.50061255 * 640; EvalClassificationError = 0.63593750 * 640; time = 1.1800s; samplesPerSecond = 542.4
MPI Rank 1: 12/12/2017 15:10:44:  Epoch[ 1 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 2.19571284 * 640; EvalClassificationError = 0.62656250 * 640; time = 0.9340s; samplesPerSecond = 685.2
MPI Rank 1: 12/12/2017 15:10:46:  Epoch[ 1 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 2.27062074 * 640; EvalClassificationError = 0.60625000 * 640; time = 1.2876s; samplesPerSecond = 497.1
MPI Rank 1: 12/12/2017 15:10:47:  Epoch[ 1 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 2.20732695 * 640; EvalClassificationError = 0.61250000 * 640; time = 1.2071s; samplesPerSecond = 530.2
MPI Rank 1: 12/12/2017 15:10:48:  Epoch[ 1 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 2.33449956 * 640; EvalClassificationError = 0.60937500 * 640; time = 1.4142s; samplesPerSecond = 452.5
MPI Rank 1: 12/12/2017 15:10:49:  Epoch[ 1 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 2.30425129 * 640; EvalClassificationError = 0.57968750 * 640; time = 1.0965s; samplesPerSecond = 583.7
MPI Rank 1: 12/12/2017 15:10:51:  Epoch[ 1 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 2.30580641 * 640; EvalClassificationError = 0.60156250 * 640; time = 1.4140s; samplesPerSecond = 452.6
MPI Rank 1: 12/12/2017 15:10:52:  Epoch[ 1 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 2.31398523 * 640; EvalClassificationError = 0.61875000 * 640; time = 1.0593s; samplesPerSecond = 604.2
MPI Rank 1: 12/12/2017 15:10:53:  Epoch[ 1 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 2.22057775 * 640; EvalClassificationError = 0.60625000 * 640; time = 1.1362s; samplesPerSecond = 563.3
MPI Rank 1: 12/12/2017 15:10:54:  Epoch[ 1 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 2.23501826 * 640; EvalClassificationError = 0.59843750 * 640; time = 1.0050s; samplesPerSecond = 636.8
MPI Rank 1: 12/12/2017 15:10:55:  Epoch[ 1 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 2.25912276 * 640; EvalClassificationError = 0.61406250 * 640; time = 1.4045s; samplesPerSecond = 455.7
MPI Rank 1: 12/12/2017 15:10:57:  Epoch[ 1 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 2.40758652 * 640; EvalClassificationError = 0.63750000 * 640; time = 1.2062s; samplesPerSecond = 530.6
MPI Rank 1: 12/12/2017 15:10:58:  Epoch[ 1 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 2.30217561 * 640; EvalClassificationError = 0.60937500 * 640; time = 1.0733s; samplesPerSecond = 596.3
MPI Rank 1: 12/12/2017 15:10:59:  Epoch[ 1 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 2.24440474 * 640; EvalClassificationError = 0.62343750 * 640; time = 1.2134s; samplesPerSecond = 527.5
MPI Rank 1: 12/12/2017 15:11:00:  Epoch[ 1 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 2.25952033 * 640; EvalClassificationError = 0.56562500 * 640; time = 1.2229s; samplesPerSecond = 523.4
MPI Rank 1: 12/12/2017 15:11:01:  Epoch[ 1 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 2.21633741 * 640; EvalClassificationError = 0.60468750 * 640; time = 1.2751s; samplesPerSecond = 501.9
MPI Rank 1: 12/12/2017 15:11:02:  Epoch[ 1 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 2.30360513 * 640; EvalClassificationError = 0.60625000 * 640; time = 0.9562s; samplesPerSecond = 669.3
MPI Rank 1: 12/12/2017 15:11:02: Finished Epoch[ 1 of 3]: [Training] CrossEntropyWithSoftmax = 3.02076286 * 81920; EvalClassificationError = 0.72858887 * 81920; totalSamplesSeen = 81920; learningRatePerSample = 0.001953125; epochTime=157.752s
MPI Rank 1: 12/12/2017 15:11:03:  Before Epoch[2], previous minibatchSize 64 is considered invalid -> resetting.
MPI Rank 1: 12/12/2017 15:11:03:  AdaptiveMinibatchSearch Epoch[2]: Evaluating minibatchSizes 64..8192
MPI Rank 1: 12/12/2017 15:11:03:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=64 (search range: 64..8192)...
MPI Rank 1: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:11:03: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 12/12/2017 15:11:04:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24406520 * 640; EvalClassificationError = 0.57500000 * 640; time = 1.4375s; samplesPerSecond = 445.2
MPI Rank 1: 12/12/2017 15:11:05:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.12025872 * 640; EvalClassificationError = 0.54218750 * 640; time = 1.2212s; samplesPerSecond = 524.1
MPI Rank 1: 12/12/2017 15:11:06:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24828172 * 640; EvalClassificationError = 0.60937500 * 640; time = 1.1730s; samplesPerSecond = 545.6
MPI Rank 1: 12/12/2017 15:11:07:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06004589 * 640; EvalClassificationError = 0.57031250 * 640; time = 1.0596s; samplesPerSecond = 604.0
MPI Rank 1: 12/12/2017 15:11:09:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23539626 * 640; EvalClassificationError = 0.61406250 * 640; time = 1.1691s; samplesPerSecond = 547.5
MPI Rank 1: 12/12/2017 15:11:10:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15090807 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.0681s; samplesPerSecond = 599.2
MPI Rank 1: 12/12/2017 15:11:11:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.22819509 * 640; EvalClassificationError = 0.58750000 * 640; time = 1.1957s; samplesPerSecond = 535.2
MPI Rank 1: 12/12/2017 15:11:12:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.10290113 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.3447s; samplesPerSecond = 475.9
MPI Rank 1: 12/12/2017 15:11:13:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11563741 * 640; EvalClassificationError = 0.57187500 * 640; time = 1.0567s; samplesPerSecond = 605.6
MPI Rank 1: 12/12/2017 15:11:15:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13568211 * 640; EvalClassificationError = 0.55156250 * 640; time = 1.5076s; samplesPerSecond = 424.5
MPI Rank 1: 12/12/2017 15:11:16:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10708006 * 640; EvalClassificationError = 0.59531250 * 640; time = 1.0575s; samplesPerSecond = 605.2
MPI Rank 1: 12/12/2017 15:11:17:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.04020009 * 640; EvalClassificationError = 0.56250000 * 640; time = 1.1470s; samplesPerSecond = 558.0
MPI Rank 1: 12/12/2017 15:11:18:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10129234 * 640; EvalClassificationError = 0.58906250 * 640; time = 1.2169s; samplesPerSecond = 525.9
MPI Rank 1: 12/12/2017 15:11:19:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.09623744 * 640; EvalClassificationError = 0.55625000 * 640; time = 1.0503s; samplesPerSecond = 609.3
MPI Rank 1: 12/12/2017 15:11:20:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.12505980 * 640; EvalClassificationError = 0.57968750 * 640; time = 1.1616s; samplesPerSecond = 551.0
MPI Rank 1: 12/12/2017 15:11:22:   BaseAdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.15263867 * 640; EvalClassificationError = 0.57812500 * 640; time = 1.2750s; samplesPerSecond = 502.0
MPI Rank 1: 12/12/2017 15:11:22:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.14296839 * 10304; EvalClassificationError = 0.57822205 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:11:22:  AdaptiveMinibatchSearch Epoch[2]: Computed baseCriterion 2.14296839 for minibatchSize=64
MPI Rank 1: 12/12/2017 15:11:22:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=64 (search range: 64..8192)...
MPI Rank 1: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:11:22: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 12/12/2017 15:11:23:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24406520 * 640; EvalClassificationError = 0.57500000 * 640; time = 1.3984s; samplesPerSecond = 457.7
MPI Rank 1: 12/12/2017 15:11:25:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.12025872 * 640; EvalClassificationError = 0.54218750 * 640; time = 1.1056s; samplesPerSecond = 578.8
MPI Rank 1: 12/12/2017 15:11:26:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24828172 * 640; EvalClassificationError = 0.60937500 * 640; time = 0.9930s; samplesPerSecond = 644.5
MPI Rank 1: 12/12/2017 15:11:27:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06004589 * 640; EvalClassificationError = 0.57031250 * 640; time = 1.0629s; samplesPerSecond = 602.1
MPI Rank 1: 12/12/2017 15:11:28:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23539626 * 640; EvalClassificationError = 0.61406250 * 640; time = 1.3121s; samplesPerSecond = 487.8
MPI Rank 1: 12/12/2017 15:11:29:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15090807 * 640; EvalClassificationError = 0.58437500 * 640; time = 0.9437s; samplesPerSecond = 678.2
MPI Rank 1: 12/12/2017 15:11:31:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.22819509 * 640; EvalClassificationError = 0.58750000 * 640; time = 1.8598s; samplesPerSecond = 344.1
MPI Rank 1: 12/12/2017 15:11:32:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.10290113 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.3103s; samplesPerSecond = 488.5
MPI Rank 1: 12/12/2017 15:11:33:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11563741 * 640; EvalClassificationError = 0.57187500 * 640; time = 1.0992s; samplesPerSecond = 582.2
MPI Rank 1: 12/12/2017 15:11:34:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13568211 * 640; EvalClassificationError = 0.55156250 * 640; time = 1.2467s; samplesPerSecond = 513.3
MPI Rank 1: 12/12/2017 15:11:35:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10708006 * 640; EvalClassificationError = 0.59531250 * 640; time = 1.0263s; samplesPerSecond = 623.6
MPI Rank 1: 12/12/2017 15:11:37:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.04020009 * 640; EvalClassificationError = 0.56250000 * 640; time = 1.3620s; samplesPerSecond = 469.9
MPI Rank 1: 12/12/2017 15:11:38:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10129234 * 640; EvalClassificationError = 0.58906250 * 640; time = 1.4619s; samplesPerSecond = 437.8
MPI Rank 1: 12/12/2017 15:11:39:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.09623744 * 640; EvalClassificationError = 0.55625000 * 640; time = 1.1088s; samplesPerSecond = 577.2
MPI Rank 1: 12/12/2017 15:11:41:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.12505980 * 640; EvalClassificationError = 0.57968750 * 640; time = 1.4073s; samplesPerSecond = 454.8
MPI Rank 1: 12/12/2017 15:11:42:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.15263867 * 640; EvalClassificationError = 0.57812500 * 640; time = 1.0382s; samplesPerSecond = 616.4
MPI Rank 1: 12/12/2017 15:11:42:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.14296839 * 10304; EvalClassificationError = 0.57822205 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:11:42:  AdaptiveMinibatchSearch Epoch[2]: Keep searching... epochCriterion = 2.14296839 vs. baseCriterion = 2.14296839
MPI Rank 1: 12/12/2017 15:11:42:  AdaptiveMinibatchSearch Epoch[2]: Evaluating trial minibatchSize=128 (search range: 64..8192)...
MPI Rank 1: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:11:42: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 12/12/2017 15:11:44:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[   1-  10, 1.56%]: CrossEntropyWithSoftmax = 2.18052003 * 1280; EvalClassificationError = 0.55859375 * 1280; time = 1.4397s; samplesPerSecond = 889.1
MPI Rank 1: 12/12/2017 15:11:45:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  11-  20, 3.12%]: CrossEntropyWithSoftmax = 2.16092560 * 1280; EvalClassificationError = 0.58984375 * 1280; time = 1.4064s; samplesPerSecond = 910.2
MPI Rank 1: 12/12/2017 15:11:46:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  21-  30, 4.69%]: CrossEntropyWithSoftmax = 2.22443554 * 1280; EvalClassificationError = 0.60312500 * 1280; time = 1.1811s; samplesPerSecond = 1083.7
MPI Rank 1: 12/12/2017 15:11:48:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  31-  40, 6.25%]: CrossEntropyWithSoftmax = 2.22884967 * 1280; EvalClassificationError = 0.60078125 * 1280; time = 1.4726s; samplesPerSecond = 869.2
MPI Rank 1: 12/12/2017 15:11:49:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  41-  50, 7.81%]: CrossEntropyWithSoftmax = 2.13448612 * 1280; EvalClassificationError = 0.57578125 * 1280; time = 1.4793s; samplesPerSecond = 865.3
MPI Rank 1: 12/12/2017 15:11:50:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  51-  60, 9.38%]: CrossEntropyWithSoftmax = 2.09717408 * 1280; EvalClassificationError = 0.58750000 * 1280; time = 1.0999s; samplesPerSecond = 1163.7
MPI Rank 1: 12/12/2017 15:11:52:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  61-  70, 10.94%]: CrossEntropyWithSoftmax = 2.12784498 * 1280; EvalClassificationError = 0.58359375 * 1280; time = 1.4451s; samplesPerSecond = 885.7
MPI Rank 1: 12/12/2017 15:11:53:   AdaptiveMinibatchSearch: Epoch[ 2 of 3]-Minibatch[  71-  80, 12.50%]: CrossEntropyWithSoftmax = 2.17108666 * 1280; EvalClassificationError = 0.57500000 * 1280; time = 1.0959s; samplesPerSecond = 1168.0
MPI Rank 1: 12/12/2017 15:11:53:  Finished Mini-Epoch[2]: CrossEntropyWithSoftmax = 2.16665035 * 10368; EvalClassificationError = 0.58410494 * 10368; learningRatePerSample = 0.001953125; minibatchSize = 128
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:11:53:  AdaptiveMinibatchSearch Epoch[2]: Search successful. New minibatchSize is 64. epochCriterion = 2.14296839 vs baseCriterion = 2.14296839
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:11:53: Starting Epoch 2: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 1: minibatchiterator: epoch 1: frames [81920..163840] (first utterance at frame 81920), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:11:53: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 12/12/2017 15:11:54:  Epoch[ 2 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 2.24406520 * 640; EvalClassificationError = 0.57500000 * 640; time = 1.3018s; samplesPerSecond = 491.6
MPI Rank 1: 12/12/2017 15:11:56:  Epoch[ 2 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 2.12025872 * 640; EvalClassificationError = 0.54218750 * 640; time = 1.3079s; samplesPerSecond = 489.3
MPI Rank 1: 12/12/2017 15:11:57:  Epoch[ 2 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 2.24828172 * 640; EvalClassificationError = 0.60937500 * 640; time = 1.1130s; samplesPerSecond = 575.0
MPI Rank 1: 12/12/2017 15:11:58:  Epoch[ 2 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 2.06004589 * 640; EvalClassificationError = 0.57031250 * 640; time = 1.3467s; samplesPerSecond = 475.2
MPI Rank 1: 12/12/2017 15:11:59:  Epoch[ 2 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 2.23539626 * 640; EvalClassificationError = 0.61406250 * 640; time = 0.9332s; samplesPerSecond = 685.8
MPI Rank 1: 12/12/2017 15:12:01:  Epoch[ 2 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 2.15090807 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.3651s; samplesPerSecond = 468.8
MPI Rank 1: 12/12/2017 15:12:02:  Epoch[ 2 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 2.22819509 * 640; EvalClassificationError = 0.58750000 * 640; time = 1.2094s; samplesPerSecond = 529.2
MPI Rank 1: 12/12/2017 15:12:03:  Epoch[ 2 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 2.10290113 * 640; EvalClassificationError = 0.58437500 * 640; time = 1.1343s; samplesPerSecond = 564.2
MPI Rank 1: 12/12/2017 15:12:04:  Epoch[ 2 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 2.11563741 * 640; EvalClassificationError = 0.57187500 * 640; time = 1.1936s; samplesPerSecond = 536.2
MPI Rank 1: 12/12/2017 15:12:05:  Epoch[ 2 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 2.13568211 * 640; EvalClassificationError = 0.55156250 * 640; time = 1.0900s; samplesPerSecond = 587.2
MPI Rank 1: 12/12/2017 15:12:06:  Epoch[ 2 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 2.10708006 * 640; EvalClassificationError = 0.59531250 * 640; time = 1.0123s; samplesPerSecond = 632.2
MPI Rank 1: 12/12/2017 15:12:07:  Epoch[ 2 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 2.04020009 * 640; EvalClassificationError = 0.56250000 * 640; time = 1.2724s; samplesPerSecond = 503.0
MPI Rank 1: 12/12/2017 15:12:09:  Epoch[ 2 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 2.10129234 * 640; EvalClassificationError = 0.58906250 * 640; time = 1.3654s; samplesPerSecond = 468.7
MPI Rank 1: 12/12/2017 15:12:10:  Epoch[ 2 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 2.09623744 * 640; EvalClassificationError = 0.55625000 * 640; time = 1.0159s; samplesPerSecond = 630.0
MPI Rank 1: 12/12/2017 15:12:11:  Epoch[ 2 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 2.12505980 * 640; EvalClassificationError = 0.57968750 * 640; time = 1.2692s; samplesPerSecond = 504.3
MPI Rank 1: 12/12/2017 15:12:12:  Epoch[ 2 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 2.15263867 * 640; EvalClassificationError = 0.57812500 * 640; time = 0.9483s; samplesPerSecond = 674.9
MPI Rank 1: 12/12/2017 15:12:13:  Epoch[ 2 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 2.05587937 * 640; EvalClassificationError = 0.54531250 * 640; time = 1.3206s; samplesPerSecond = 484.6
MPI Rank 1: 12/12/2017 15:12:14:  Epoch[ 2 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 2.10819503 * 640; EvalClassificationError = 0.57656250 * 640; time = 1.0327s; samplesPerSecond = 619.7
MPI Rank 1: 12/12/2017 15:12:16:  Epoch[ 2 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 2.12865202 * 640; EvalClassificationError = 0.56562500 * 640; time = 1.3935s; samplesPerSecond = 459.3
MPI Rank 1: 12/12/2017 15:12:17:  Epoch[ 2 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 2.06628059 * 640; EvalClassificationError = 0.56406250 * 640; time = 1.2800s; samplesPerSecond = 500.0
MPI Rank 1: 12/12/2017 15:12:18:  Epoch[ 2 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 2.00805315 * 640; EvalClassificationError = 0.57500000 * 640; time = 1.1323s; samplesPerSecond = 565.2
MPI Rank 1: 12/12/2017 15:12:19:  Epoch[ 2 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 1.91689278 * 640; EvalClassificationError = 0.51562500 * 640; time = 1.2889s; samplesPerSecond = 496.6
MPI Rank 1: 12/12/2017 15:12:21:  Epoch[ 2 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 1.95414216 * 640; EvalClassificationError = 0.51718750 * 640; time = 1.0545s; samplesPerSecond = 606.9
MPI Rank 1: 12/12/2017 15:12:22:  Epoch[ 2 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 2.01854875 * 640; EvalClassificationError = 0.52656250 * 640; time = 1.3143s; samplesPerSecond = 487.0
MPI Rank 1: 12/12/2017 15:12:23:  Epoch[ 2 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 2.05836408 * 640; EvalClassificationError = 0.55000000 * 640; time = 1.0193s; samplesPerSecond = 627.9
MPI Rank 1: 12/12/2017 15:12:24:  Epoch[ 2 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 2.06750676 * 640; EvalClassificationError = 0.52500000 * 640; time = 1.4026s; samplesPerSecond = 456.3
MPI Rank 1: 12/12/2017 15:12:25:  Epoch[ 2 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 2.00537595 * 640; EvalClassificationError = 0.53125000 * 640; time = 0.8998s; samplesPerSecond = 711.3
MPI Rank 1: 12/12/2017 15:12:26:  Epoch[ 2 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 1.97651530 * 640; EvalClassificationError = 0.55156250 * 640; time = 1.3011s; samplesPerSecond = 491.9
MPI Rank 1: 12/12/2017 15:12:28:  Epoch[ 2 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 2.05821780 * 640; EvalClassificationError = 0.55937500 * 640; time = 1.2712s; samplesPerSecond = 503.5
MPI Rank 1: 12/12/2017 15:12:29:  Epoch[ 2 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 2.10469909 * 640; EvalClassificationError = 0.57500000 * 640; time = 1.4732s; samplesPerSecond = 434.4
MPI Rank 1: 12/12/2017 15:12:31:  Epoch[ 2 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 1.95014695 * 640; EvalClassificationError = 0.53906250 * 640; time = 1.6413s; samplesPerSecond = 389.9
MPI Rank 1: 12/12/2017 15:12:32:  Epoch[ 2 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 1.89832324 * 640; EvalClassificationError = 0.52812500 * 640; time = 1.0059s; samplesPerSecond = 636.3
MPI Rank 1: 12/12/2017 15:12:33:  Epoch[ 2 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 2.08061747 * 640; EvalClassificationError = 0.58281250 * 640; time = 1.3684s; samplesPerSecond = 467.7
MPI Rank 1: 12/12/2017 15:12:34:  Epoch[ 2 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 1.99681024 * 640; EvalClassificationError = 0.54375000 * 640; time = 1.1839s; samplesPerSecond = 540.6
MPI Rank 1: 12/12/2017 15:12:36:  Epoch[ 2 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 1.96934769 * 640; EvalClassificationError = 0.52812500 * 640; time = 1.1595s; samplesPerSecond = 552.0
MPI Rank 1: 12/12/2017 15:12:37:  Epoch[ 2 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 1.94326866 * 640; EvalClassificationError = 0.52343750 * 640; time = 1.4514s; samplesPerSecond = 441.0
MPI Rank 1: 12/12/2017 15:12:38:  Epoch[ 2 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 1.96389540 * 640; EvalClassificationError = 0.55312500 * 640; time = 1.1075s; samplesPerSecond = 577.9
MPI Rank 1: 12/12/2017 15:12:39:  Epoch[ 2 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 1.93880446 * 640; EvalClassificationError = 0.53437500 * 640; time = 1.2857s; samplesPerSecond = 497.8
MPI Rank 1: 12/12/2017 15:12:40:  Epoch[ 2 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 2.05454684 * 640; EvalClassificationError = 0.56875000 * 640; time = 0.9648s; samplesPerSecond = 663.4
MPI Rank 1: 12/12/2017 15:12:42:  Epoch[ 2 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 2.07650311 * 640; EvalClassificationError = 0.58281250 * 640; time = 1.3664s; samplesPerSecond = 468.4
MPI Rank 1: 12/12/2017 15:12:43:  Epoch[ 2 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 1.90309828 * 640; EvalClassificationError = 0.54843750 * 640; time = 1.2882s; samplesPerSecond = 496.8
MPI Rank 1: 12/12/2017 15:12:44:  Epoch[ 2 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 1.96886078 * 640; EvalClassificationError = 0.53750000 * 640; time = 1.1865s; samplesPerSecond = 539.4
MPI Rank 1: 12/12/2017 15:12:46:  Epoch[ 2 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 1.78937533 * 640; EvalClassificationError = 0.50156250 * 640; time = 1.3159s; samplesPerSecond = 486.4
MPI Rank 1: 12/12/2017 15:12:47:  Epoch[ 2 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 2.00661757 * 640; EvalClassificationError = 0.56250000 * 640; time = 1.1836s; samplesPerSecond = 540.7
MPI Rank 1: 12/12/2017 15:12:48:  Epoch[ 2 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 1.86844940 * 640; EvalClassificationError = 0.49687500 * 640; time = 1.4614s; samplesPerSecond = 437.9
MPI Rank 1: 12/12/2017 15:12:49:  Epoch[ 2 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 1.93771444 * 640; EvalClassificationError = 0.53437500 * 640; time = 0.9663s; samplesPerSecond = 662.3
MPI Rank 1: 12/12/2017 15:12:51:  Epoch[ 2 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 1.91579489 * 640; EvalClassificationError = 0.50000000 * 640; time = 1.3394s; samplesPerSecond = 477.8
MPI Rank 1: 12/12/2017 15:12:52:  Epoch[ 2 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 1.90873778 * 640; EvalClassificationError = 0.53281250 * 640; time = 1.2836s; samplesPerSecond = 498.6
MPI Rank 1: 12/12/2017 15:12:53:  Epoch[ 2 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 1.84148334 * 640; EvalClassificationError = 0.52656250 * 640; time = 1.0956s; samplesPerSecond = 584.2
MPI Rank 1: 12/12/2017 15:12:54:  Epoch[ 2 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 1.95277749 * 640; EvalClassificationError = 0.52968750 * 640; time = 1.1019s; samplesPerSecond = 580.8
MPI Rank 1: 12/12/2017 15:12:55:  Epoch[ 2 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 1.90510598 * 640; EvalClassificationError = 0.52343750 * 640; time = 1.0485s; samplesPerSecond = 610.4
MPI Rank 1: 12/12/2017 15:12:56:  Epoch[ 2 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 1.86406932 * 640; EvalClassificationError = 0.53750000 * 640; time = 1.1565s; samplesPerSecond = 553.4
MPI Rank 1: 12/12/2017 15:12:58:  Epoch[ 2 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 1.79901003 * 640; EvalClassificationError = 0.51093750 * 640; time = 1.3314s; samplesPerSecond = 480.7
MPI Rank 1: 12/12/2017 15:12:59:  Epoch[ 2 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 1.84271586 * 640; EvalClassificationError = 0.54375000 * 640; time = 1.3777s; samplesPerSecond = 464.5
MPI Rank 1: 12/12/2017 15:13:00:  Epoch[ 2 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 1.94342376 * 640; EvalClassificationError = 0.53750000 * 640; time = 1.0351s; samplesPerSecond = 618.3
MPI Rank 1: 12/12/2017 15:13:01:  Epoch[ 2 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 1.82340960 * 640; EvalClassificationError = 0.51093750 * 640; time = 1.3422s; samplesPerSecond = 476.8
MPI Rank 1: 12/12/2017 15:13:03:  Epoch[ 2 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 1.84100225 * 640; EvalClassificationError = 0.50312500 * 640; time = 1.2245s; samplesPerSecond = 522.7
MPI Rank 1: 12/12/2017 15:13:04:  Epoch[ 2 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 1.86702935 * 640; EvalClassificationError = 0.50937500 * 640; time = 1.1949s; samplesPerSecond = 535.6
MPI Rank 1: 12/12/2017 15:13:05:  Epoch[ 2 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 1.82416914 * 640; EvalClassificationError = 0.51093750 * 640; time = 1.1012s; samplesPerSecond = 581.2
MPI Rank 1: 12/12/2017 15:13:06:  Epoch[ 2 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 1.76276326 * 640; EvalClassificationError = 0.48750000 * 640; time = 1.1200s; samplesPerSecond = 571.4
MPI Rank 1: 12/12/2017 15:13:07:  Epoch[ 2 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 1.78909213 * 640; EvalClassificationError = 0.52343750 * 640; time = 1.3540s; samplesPerSecond = 472.7
MPI Rank 1: 12/12/2017 15:13:08:  Epoch[ 2 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 1.85574070 * 640; EvalClassificationError = 0.50468750 * 640; time = 1.0423s; samplesPerSecond = 614.0
MPI Rank 1: 12/12/2017 15:13:09:  Epoch[ 2 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 1.71771209 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.1779s; samplesPerSecond = 543.3
MPI Rank 1: 12/12/2017 15:13:11:  Epoch[ 2 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 1.83145821 * 640; EvalClassificationError = 0.52187500 * 640; time = 1.2831s; samplesPerSecond = 498.8
MPI Rank 1: 12/12/2017 15:13:12:  Epoch[ 2 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 1.84680472 * 640; EvalClassificationError = 0.51562500 * 640; time = 1.4515s; samplesPerSecond = 440.9
MPI Rank 1: 12/12/2017 15:13:14:  Epoch[ 2 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 1.76771219 * 640; EvalClassificationError = 0.50468750 * 640; time = 1.3169s; samplesPerSecond = 486.0
MPI Rank 1: 12/12/2017 15:13:15:  Epoch[ 2 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 1.86036179 * 640; EvalClassificationError = 0.52500000 * 640; time = 1.1688s; samplesPerSecond = 547.6
MPI Rank 1: 12/12/2017 15:13:16:  Epoch[ 2 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 1.76394582 * 640; EvalClassificationError = 0.51562500 * 640; time = 1.4024s; samplesPerSecond = 456.4
MPI Rank 1: 12/12/2017 15:13:17:  Epoch[ 2 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 1.79961750 * 640; EvalClassificationError = 0.51562500 * 640; time = 0.9712s; samplesPerSecond = 659.0
MPI Rank 1: 12/12/2017 15:13:19:  Epoch[ 2 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 1.77695582 * 640; EvalClassificationError = 0.50312500 * 640; time = 1.4136s; samplesPerSecond = 452.7
MPI Rank 1: 12/12/2017 15:13:20:  Epoch[ 2 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 1.80388288 * 640; EvalClassificationError = 0.49531250 * 640; time = 1.3326s; samplesPerSecond = 480.3
MPI Rank 1: 12/12/2017 15:13:21:  Epoch[ 2 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 1.73741415 * 640; EvalClassificationError = 0.49375000 * 640; time = 1.1301s; samplesPerSecond = 566.3
MPI Rank 1: 12/12/2017 15:13:23:  Epoch[ 2 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 1.74488749 * 640; EvalClassificationError = 0.50312500 * 640; time = 1.6086s; samplesPerSecond = 397.9
MPI Rank 1: 12/12/2017 15:13:24:  Epoch[ 2 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 1.83199026 * 640; EvalClassificationError = 0.52031250 * 640; time = 1.0626s; samplesPerSecond = 602.3
MPI Rank 1: 12/12/2017 15:13:25:  Epoch[ 2 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 1.73039433 * 640; EvalClassificationError = 0.46718750 * 640; time = 1.2724s; samplesPerSecond = 503.0
MPI Rank 1: 12/12/2017 15:13:26:  Epoch[ 2 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 1.75318483 * 640; EvalClassificationError = 0.51718750 * 640; time = 1.0244s; samplesPerSecond = 624.8
MPI Rank 1: 12/12/2017 15:13:27:  Epoch[ 2 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 1.75181081 * 640; EvalClassificationError = 0.48125000 * 640; time = 1.3813s; samplesPerSecond = 463.3
MPI Rank 1: 12/12/2017 15:13:29:  Epoch[ 2 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 1.67498368 * 640; EvalClassificationError = 0.46406250 * 640; time = 1.2430s; samplesPerSecond = 514.9
MPI Rank 1: 12/12/2017 15:13:30:  Epoch[ 2 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 1.71239884 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.3372s; samplesPerSecond = 478.6
MPI Rank 1: 12/12/2017 15:13:31:  Epoch[ 2 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 1.80154487 * 640; EvalClassificationError = 0.50156250 * 640; time = 1.5934s; samplesPerSecond = 401.7
MPI Rank 1: 12/12/2017 15:13:33:  Epoch[ 2 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 1.75771192 * 640; EvalClassificationError = 0.50781250 * 640; time = 1.1560s; samplesPerSecond = 553.7
MPI Rank 1: 12/12/2017 15:13:34:  Epoch[ 2 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 1.77726593 * 640; EvalClassificationError = 0.52812500 * 640; time = 1.3605s; samplesPerSecond = 470.4
MPI Rank 1: 12/12/2017 15:13:35:  Epoch[ 2 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 1.79806401 * 640; EvalClassificationError = 0.50312500 * 640; time = 1.1844s; samplesPerSecond = 540.4
MPI Rank 1: 12/12/2017 15:13:36:  Epoch[ 2 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 1.76751084 * 640; EvalClassificationError = 0.49687500 * 640; time = 1.2149s; samplesPerSecond = 526.8
MPI Rank 1: 12/12/2017 15:13:38:  Epoch[ 2 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 1.68622035 * 640; EvalClassificationError = 0.46875000 * 640; time = 1.2893s; samplesPerSecond = 496.4
MPI Rank 1: 12/12/2017 15:13:39:  Epoch[ 2 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 1.76818307 * 640; EvalClassificationError = 0.52500000 * 640; time = 1.0297s; samplesPerSecond = 621.6
MPI Rank 1: 12/12/2017 15:13:40:  Epoch[ 2 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 1.72762869 * 640; EvalClassificationError = 0.50156250 * 640; time = 1.1865s; samplesPerSecond = 539.4
MPI Rank 1: 12/12/2017 15:13:41:  Epoch[ 2 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 1.75327519 * 640; EvalClassificationError = 0.48906250 * 640; time = 1.0296s; samplesPerSecond = 621.6
MPI Rank 1: 12/12/2017 15:13:42:  Epoch[ 2 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 1.81252992 * 640; EvalClassificationError = 0.53281250 * 640; time = 1.3624s; samplesPerSecond = 469.8
MPI Rank 1: 12/12/2017 15:13:43:  Epoch[ 2 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 1.67586020 * 640; EvalClassificationError = 0.47500000 * 640; time = 1.0127s; samplesPerSecond = 632.0
MPI Rank 1: 12/12/2017 15:13:45:  Epoch[ 2 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 1.65736153 * 640; EvalClassificationError = 0.48281250 * 640; time = 1.3895s; samplesPerSecond = 460.6
MPI Rank 1: 12/12/2017 15:13:46:  Epoch[ 2 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 1.62426574 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.1939s; samplesPerSecond = 536.1
MPI Rank 1: 12/12/2017 15:13:47:  Epoch[ 2 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 1.74449030 * 640; EvalClassificationError = 0.50937500 * 640; time = 1.1574s; samplesPerSecond = 552.9
MPI Rank 1: 12/12/2017 15:13:48:  Epoch[ 2 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 1.67156510 * 640; EvalClassificationError = 0.49375000 * 640; time = 1.2428s; samplesPerSecond = 515.0
MPI Rank 1: 12/12/2017 15:13:49:  Epoch[ 2 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 1.74597436 * 640; EvalClassificationError = 0.49687500 * 640; time = 1.1467s; samplesPerSecond = 558.1
MPI Rank 1: 12/12/2017 15:13:51:  Epoch[ 2 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 1.74758767 * 640; EvalClassificationError = 0.50156250 * 640; time = 1.2922s; samplesPerSecond = 495.3
MPI Rank 1: 12/12/2017 15:13:52:  Epoch[ 2 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 1.70180785 * 640; EvalClassificationError = 0.49375000 * 640; time = 1.1102s; samplesPerSecond = 576.5
MPI Rank 1: 12/12/2017 15:13:53:  Epoch[ 2 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 1.63308195 * 640; EvalClassificationError = 0.46406250 * 640; time = 1.4198s; samplesPerSecond = 450.8
MPI Rank 1: 12/12/2017 15:13:54:  Epoch[ 2 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 1.71083838 * 640; EvalClassificationError = 0.49531250 * 640; time = 1.0267s; samplesPerSecond = 623.4
MPI Rank 1: 12/12/2017 15:13:56:  Epoch[ 2 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 1.63971265 * 640; EvalClassificationError = 0.46562500 * 640; time = 1.3416s; samplesPerSecond = 477.0
MPI Rank 1: 12/12/2017 15:13:57:  Epoch[ 2 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 1.67149404 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.1811s; samplesPerSecond = 541.9
MPI Rank 1: 12/12/2017 15:13:58:  Epoch[ 2 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 1.58195471 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.1485s; samplesPerSecond = 557.2
MPI Rank 1: 12/12/2017 15:13:59:  Epoch[ 2 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 1.69231155 * 640; EvalClassificationError = 0.47968750 * 640; time = 1.1819s; samplesPerSecond = 541.5
MPI Rank 1: 12/12/2017 15:14:00:  Epoch[ 2 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 1.64889734 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.1408s; samplesPerSecond = 561.0
MPI Rank 1: 12/12/2017 15:14:02:  Epoch[ 2 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 1.63176428 * 640; EvalClassificationError = 0.46562500 * 640; time = 1.3002s; samplesPerSecond = 492.2
MPI Rank 1: 12/12/2017 15:14:03:  Epoch[ 2 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 1.67374331 * 640; EvalClassificationError = 0.47031250 * 640; time = 1.1538s; samplesPerSecond = 554.7
MPI Rank 1: 12/12/2017 15:14:04:  Epoch[ 2 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 1.68498411 * 640; EvalClassificationError = 0.47031250 * 640; time = 1.4087s; samplesPerSecond = 454.3
MPI Rank 1: 12/12/2017 15:14:05:  Epoch[ 2 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 1.62657971 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.0581s; samplesPerSecond = 604.9
MPI Rank 1: 12/12/2017 15:14:07:  Epoch[ 2 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 1.63289543 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.3909s; samplesPerSecond = 460.1
MPI Rank 1: 12/12/2017 15:14:08:  Epoch[ 2 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 1.73718554 * 640; EvalClassificationError = 0.50937500 * 640; time = 1.1206s; samplesPerSecond = 571.1
MPI Rank 1: 12/12/2017 15:14:09:  Epoch[ 2 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 1.62632933 * 640; EvalClassificationError = 0.47031250 * 640; time = 1.1657s; samplesPerSecond = 549.0
MPI Rank 1: 12/12/2017 15:14:10:  Epoch[ 2 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 1.69410792 * 640; EvalClassificationError = 0.50625000 * 640; time = 1.1001s; samplesPerSecond = 581.8
MPI Rank 1: 12/12/2017 15:14:11:  Epoch[ 2 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 1.69136466 * 640; EvalClassificationError = 0.48125000 * 640; time = 1.2003s; samplesPerSecond = 533.2
MPI Rank 1: 12/12/2017 15:14:13:  Epoch[ 2 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 1.64519939 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.3119s; samplesPerSecond = 487.8
MPI Rank 1: 12/12/2017 15:14:14:  Epoch[ 2 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 1.59899012 * 640; EvalClassificationError = 0.46093750 * 640; time = 1.0942s; samplesPerSecond = 584.9
MPI Rank 1: 12/12/2017 15:14:15:  Epoch[ 2 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 1.67662786 * 640; EvalClassificationError = 0.48593750 * 640; time = 1.3306s; samplesPerSecond = 481.0
MPI Rank 1: 12/12/2017 15:14:16:  Epoch[ 2 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 1.54173823 * 640; EvalClassificationError = 0.47500000 * 640; time = 1.0331s; samplesPerSecond = 619.5
MPI Rank 1: 12/12/2017 15:14:17:  Epoch[ 2 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 1.68708734 * 640; EvalClassificationError = 0.45468750 * 640; time = 1.3369s; samplesPerSecond = 478.7
MPI Rank 1: 12/12/2017 15:14:18:  Epoch[ 2 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 1.63433268 * 640; EvalClassificationError = 0.47812500 * 640; time = 0.9748s; samplesPerSecond = 656.6
MPI Rank 1: 12/12/2017 15:14:20:  Epoch[ 2 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 1.54172544 * 640; EvalClassificationError = 0.44687500 * 640; time = 1.5268s; samplesPerSecond = 419.2
MPI Rank 1: 12/12/2017 15:14:21:  Epoch[ 2 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 1.59671999 * 640; EvalClassificationError = 0.48750000 * 640; time = 1.3446s; samplesPerSecond = 476.0
MPI Rank 1: 12/12/2017 15:14:22:  Epoch[ 2 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 1.67252430 * 640; EvalClassificationError = 0.51406250 * 640; time = 1.1136s; samplesPerSecond = 574.7
MPI Rank 1: 12/12/2017 15:14:24:  Epoch[ 2 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 1.52668310 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.3729s; samplesPerSecond = 466.2
MPI Rank 1: 12/12/2017 15:14:25:  Epoch[ 2 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 1.54751628 * 640; EvalClassificationError = 0.45156250 * 640; time = 1.3865s; samplesPerSecond = 461.6
MPI Rank 1: 12/12/2017 15:14:26:  Epoch[ 2 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 1.52823962 * 640; EvalClassificationError = 0.45625000 * 640; time = 1.2295s; samplesPerSecond = 520.5
MPI Rank 1: 12/12/2017 15:14:27:  Epoch[ 2 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 1.59498562 * 640; EvalClassificationError = 0.46562500 * 640; time = 1.1325s; samplesPerSecond = 565.1
MPI Rank 1: 12/12/2017 15:14:29:  Epoch[ 2 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 1.61145758 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.2189s; samplesPerSecond = 525.0
MPI Rank 1: 12/12/2017 15:14:30:  Epoch[ 2 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 1.69241622 * 640; EvalClassificationError = 0.48125000 * 640; time = 1.3604s; samplesPerSecond = 470.4
MPI Rank 1: 12/12/2017 15:14:30: Finished Epoch[ 2 of 3]: [Training] CrossEntropyWithSoftmax = 1.84274812 * 81920; EvalClassificationError = 0.51525879 * 81920; totalSamplesSeen = 163840; learningRatePerSample = 0.001953125; epochTime=207.536s
MPI Rank 1: 12/12/2017 15:14:30:  AdaptiveMinibatchSearch Epoch[3]: Evaluating minibatchSizes 64..128
MPI Rank 1: 12/12/2017 15:14:30:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=64 (search range: 64..128)...
MPI Rank 1: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:14:30: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 12/12/2017 15:14:32:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47476759 * 640; EvalClassificationError = 0.44062500 * 640; time = 1.9133s; samplesPerSecond = 334.5
MPI Rank 1: 12/12/2017 15:14:33:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65203361 * 640; EvalClassificationError = 0.50468750 * 640; time = 0.9656s; samplesPerSecond = 662.8
MPI Rank 1: 12/12/2017 15:14:35:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47013512 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.5249s; samplesPerSecond = 419.7
MPI Rank 1: 12/12/2017 15:14:36:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59084089 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.0860s; samplesPerSecond = 589.3
MPI Rank 1: 12/12/2017 15:14:37:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52690074 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.4354s; samplesPerSecond = 445.9
MPI Rank 1: 12/12/2017 15:14:39:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62275425 * 640; EvalClassificationError = 0.45156250 * 640; time = 1.4703s; samplesPerSecond = 435.3
MPI Rank 1: 12/12/2017 15:14:40:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.60682579 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.1278s; samplesPerSecond = 567.5
MPI Rank 1: 12/12/2017 15:14:41:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.57448117 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.3359s; samplesPerSecond = 479.1
MPI Rank 1: 12/12/2017 15:14:42:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60198560 * 640; EvalClassificationError = 0.46250000 * 640; time = 0.9648s; samplesPerSecond = 663.3
MPI Rank 1: 12/12/2017 15:14:43:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.67573179 * 640; EvalClassificationError = 0.50000000 * 640; time = 1.3245s; samplesPerSecond = 483.2
MPI Rank 1: 12/12/2017 15:14:45:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56876209 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.2418s; samplesPerSecond = 515.4
MPI Rank 1: 12/12/2017 15:14:46:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66496434 * 640; EvalClassificationError = 0.47656250 * 640; time = 1.2642s; samplesPerSecond = 506.2
MPI Rank 1: 12/12/2017 15:14:47:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.58498947 * 640; EvalClassificationError = 0.47343750 * 640; time = 1.3890s; samplesPerSecond = 460.7
MPI Rank 1: 12/12/2017 15:14:48:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.44821249 * 640; EvalClassificationError = 0.39687500 * 640; time = 1.0976s; samplesPerSecond = 583.1
MPI Rank 1: 12/12/2017 15:14:50:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.55596510 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.2615s; samplesPerSecond = 507.3
MPI Rank 1: 12/12/2017 15:14:51:   BaseAdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.59321105 * 640; EvalClassificationError = 0.49218750 * 640; time = 1.0675s; samplesPerSecond = 599.5
MPI Rank 1: 12/12/2017 15:14:51:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.57585658 * 10304; EvalClassificationError = 0.46011258 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:14:51:  AdaptiveMinibatchSearch Epoch[3]: Computed baseCriterion 1.57585658 for minibatchSize=64
MPI Rank 1: 12/12/2017 15:14:51:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=64 (search range: 64..128)...
MPI Rank 1: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:14:51: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 12/12/2017 15:14:52:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47476759 * 640; EvalClassificationError = 0.44062500 * 640; time = 1.2496s; samplesPerSecond = 512.2
MPI Rank 1: 12/12/2017 15:14:53:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65203361 * 640; EvalClassificationError = 0.50468750 * 640; time = 1.1161s; samplesPerSecond = 573.4
MPI Rank 1: 12/12/2017 15:14:55:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47013512 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.1369s; samplesPerSecond = 563.0
MPI Rank 1: 12/12/2017 15:14:56:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59084089 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.3955s; samplesPerSecond = 458.6
MPI Rank 1: 12/12/2017 15:14:57:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52690074 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.2670s; samplesPerSecond = 505.1
MPI Rank 1: 12/12/2017 15:14:59:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62275425 * 640; EvalClassificationError = 0.45156250 * 640; time = 1.4355s; samplesPerSecond = 445.8
MPI Rank 1: 12/12/2017 15:15:00:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.60682579 * 640; EvalClassificationError = 0.45937500 * 640; time = 0.9459s; samplesPerSecond = 676.6
MPI Rank 1: 12/12/2017 15:15:01:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.57448117 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.1234s; samplesPerSecond = 569.7
MPI Rank 1: 12/12/2017 15:15:02:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60198560 * 640; EvalClassificationError = 0.46250000 * 640; time = 1.0673s; samplesPerSecond = 599.7
MPI Rank 1: 12/12/2017 15:15:03:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.67573179 * 640; EvalClassificationError = 0.50000000 * 640; time = 1.5403s; samplesPerSecond = 415.5
MPI Rank 1: 12/12/2017 15:15:05:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56876209 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.3623s; samplesPerSecond = 469.8
MPI Rank 1: 12/12/2017 15:15:06:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66496434 * 640; EvalClassificationError = 0.47656250 * 640; time = 1.0417s; samplesPerSecond = 614.4
MPI Rank 1: 12/12/2017 15:15:07:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.58498947 * 640; EvalClassificationError = 0.47343750 * 640; time = 1.3181s; samplesPerSecond = 485.6
MPI Rank 1: 12/12/2017 15:15:08:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.44821249 * 640; EvalClassificationError = 0.39687500 * 640; time = 1.0787s; samplesPerSecond = 593.3
MPI Rank 1: 12/12/2017 15:15:09:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.55596510 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.2711s; samplesPerSecond = 503.5
MPI Rank 1: 12/12/2017 15:15:10:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.59321105 * 640; EvalClassificationError = 0.49218750 * 640; time = 1.0447s; samplesPerSecond = 612.6
MPI Rank 1: 12/12/2017 15:15:11:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.57585658 * 10304; EvalClassificationError = 0.46011258 * 10304; learningRatePerSample = 0.001953125; minibatchSize = 64
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:15:11:  AdaptiveMinibatchSearch Epoch[3]: Keep searching... epochCriterion = 1.57585658 vs. baseCriterion = 1.57585658
MPI Rank 1: 12/12/2017 15:15:11:  AdaptiveMinibatchSearch Epoch[3]: Evaluating trial minibatchSize=128 (search range: 64..128)...
MPI Rank 1: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:15:11: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 12/12/2017 15:15:12:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[   1-  10, 1.56%]: CrossEntropyWithSoftmax = 1.56408601 * 1280; EvalClassificationError = 0.46640625 * 1280; time = 1.4278s; samplesPerSecond = 896.5
MPI Rank 1: 12/12/2017 15:15:14:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  11-  20, 3.12%]: CrossEntropyWithSoftmax = 1.53650004 * 1280; EvalClassificationError = 0.45078125 * 1280; time = 1.3463s; samplesPerSecond = 950.8
MPI Rank 1: 12/12/2017 15:15:15:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  21-  30, 4.69%]: CrossEntropyWithSoftmax = 1.58612640 * 1280; EvalClassificationError = 0.45000000 * 1280; time = 1.0549s; samplesPerSecond = 1213.4
MPI Rank 1: 12/12/2017 15:15:16:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  31-  40, 6.25%]: CrossEntropyWithSoftmax = 1.59967631 * 1280; EvalClassificationError = 0.46796875 * 1280; time = 1.4111s; samplesPerSecond = 907.1
MPI Rank 1: 12/12/2017 15:15:17:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  41-  50, 7.81%]: CrossEntropyWithSoftmax = 1.66883413 * 1280; EvalClassificationError = 0.48750000 * 1280; time = 1.2884s; samplesPerSecond = 993.5
MPI Rank 1: 12/12/2017 15:15:19:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  51-  60, 9.38%]: CrossEntropyWithSoftmax = 1.65747310 * 1280; EvalClassificationError = 0.47734375 * 1280; time = 1.3359s; samplesPerSecond = 958.2
MPI Rank 1: 12/12/2017 15:15:20:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  61-  70, 10.94%]: CrossEntropyWithSoftmax = 1.62037708 * 1280; EvalClassificationError = 0.45781250 * 1280; time = 1.5244s; samplesPerSecond = 839.7
MPI Rank 1: 12/12/2017 15:15:21:   AdaptiveMinibatchSearch: Epoch[ 3 of 3]-Minibatch[  71-  80, 12.50%]: CrossEntropyWithSoftmax = 1.69746709 * 1280; EvalClassificationError = 0.48984375 * 1280; time = 1.0177s; samplesPerSecond = 1257.7
MPI Rank 1: 12/12/2017 15:15:22:  Finished Mini-Epoch[3]: CrossEntropyWithSoftmax = 1.61779559 * 10368; EvalClassificationError = 0.46913580 * 10368; learningRatePerSample = 0.001953125; minibatchSize = 128
MPI Rank 1: ValidateSubNetwork: InvStdOfFeatures InvStdDev operation changed, from [363 x 1] to [363].ValidateSubNetwork: MeanOfFeatures Mean operation changed, from [363 x 1] to [363].ValidateSubNetwork: Prior Mean operation changed, from [132 x 1] to [132].12/12/2017 15:15:22:  AdaptiveMinibatchSearch Epoch[3]: Search successful. New minibatchSize is 64. epochCriterion = 1.57585658 vs baseCriterion = 1.57585658
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:15:22: Starting Epoch 3: learning rate per sample = 0.001953  effective momentum = 0.939413  momentum as time constant = 1024.0 samples
MPI Rank 1: minibatchiterator: epoch 2: frames [163840..245760] (first utterance at frame 163840), data subset 1 of 2, with 1 datapasses
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:15:22: Starting minibatch loop, DataParallelSGD training (myRank = 1, numNodes = 2, numGradientBits = 2), distributed reading is ENABLED.
MPI Rank 1: 12/12/2017 15:15:23:  Epoch[ 3 of 3]-Minibatch[   1-  10, 0.78%]: CrossEntropyWithSoftmax = 1.47476759 * 640; EvalClassificationError = 0.44062500 * 640; time = 1.1564s; samplesPerSecond = 553.4
MPI Rank 1: 12/12/2017 15:15:24:  Epoch[ 3 of 3]-Minibatch[  11-  20, 1.56%]: CrossEntropyWithSoftmax = 1.65203361 * 640; EvalClassificationError = 0.50468750 * 640; time = 1.3356s; samplesPerSecond = 479.2
MPI Rank 1: 12/12/2017 15:15:25:  Epoch[ 3 of 3]-Minibatch[  21-  30, 2.34%]: CrossEntropyWithSoftmax = 1.47013512 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.1243s; samplesPerSecond = 569.3
MPI Rank 1: 12/12/2017 15:15:27:  Epoch[ 3 of 3]-Minibatch[  31-  40, 3.12%]: CrossEntropyWithSoftmax = 1.59084089 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.3105s; samplesPerSecond = 488.3
MPI Rank 1: 12/12/2017 15:15:28:  Epoch[ 3 of 3]-Minibatch[  41-  50, 3.91%]: CrossEntropyWithSoftmax = 1.52690074 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.0647s; samplesPerSecond = 601.1
MPI Rank 1: 12/12/2017 15:15:29:  Epoch[ 3 of 3]-Minibatch[  51-  60, 4.69%]: CrossEntropyWithSoftmax = 1.62275425 * 640; EvalClassificationError = 0.45156250 * 640; time = 1.2870s; samplesPerSecond = 497.3
MPI Rank 1: 12/12/2017 15:15:30:  Epoch[ 3 of 3]-Minibatch[  61-  70, 5.47%]: CrossEntropyWithSoftmax = 1.60682579 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.2121s; samplesPerSecond = 528.0
MPI Rank 1: 12/12/2017 15:15:32:  Epoch[ 3 of 3]-Minibatch[  71-  80, 6.25%]: CrossEntropyWithSoftmax = 1.57448117 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.4255s; samplesPerSecond = 449.0
MPI Rank 1: 12/12/2017 15:15:33:  Epoch[ 3 of 3]-Minibatch[  81-  90, 7.03%]: CrossEntropyWithSoftmax = 1.60198560 * 640; EvalClassificationError = 0.46250000 * 640; time = 1.4186s; samplesPerSecond = 451.1
MPI Rank 1: 12/12/2017 15:15:34:  Epoch[ 3 of 3]-Minibatch[  91- 100, 7.81%]: CrossEntropyWithSoftmax = 1.67573179 * 640; EvalClassificationError = 0.50000000 * 640; time = 0.9472s; samplesPerSecond = 675.7
MPI Rank 1: 12/12/2017 15:15:35:  Epoch[ 3 of 3]-Minibatch[ 101- 110, 8.59%]: CrossEntropyWithSoftmax = 1.56876209 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.4541s; samplesPerSecond = 440.1
MPI Rank 1: 12/12/2017 15:15:37:  Epoch[ 3 of 3]-Minibatch[ 111- 120, 9.38%]: CrossEntropyWithSoftmax = 1.66496434 * 640; EvalClassificationError = 0.47656250 * 640; time = 1.2637s; samplesPerSecond = 506.5
MPI Rank 1: 12/12/2017 15:15:38:  Epoch[ 3 of 3]-Minibatch[ 121- 130, 10.16%]: CrossEntropyWithSoftmax = 1.58498947 * 640; EvalClassificationError = 0.47343750 * 640; time = 1.2358s; samplesPerSecond = 517.9
MPI Rank 1: 12/12/2017 15:15:39:  Epoch[ 3 of 3]-Minibatch[ 131- 140, 10.94%]: CrossEntropyWithSoftmax = 1.44821249 * 640; EvalClassificationError = 0.39687500 * 640; time = 1.3936s; samplesPerSecond = 459.3
MPI Rank 1: 12/12/2017 15:15:40:  Epoch[ 3 of 3]-Minibatch[ 141- 150, 11.72%]: CrossEntropyWithSoftmax = 1.55596510 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.9389s; samplesPerSecond = 681.7
MPI Rank 1: 12/12/2017 15:15:42:  Epoch[ 3 of 3]-Minibatch[ 151- 160, 12.50%]: CrossEntropyWithSoftmax = 1.59321105 * 640; EvalClassificationError = 0.49218750 * 640; time = 1.3011s; samplesPerSecond = 491.9
MPI Rank 1: 12/12/2017 15:15:43:  Epoch[ 3 of 3]-Minibatch[ 161- 170, 13.28%]: CrossEntropyWithSoftmax = 1.58558110 * 640; EvalClassificationError = 0.48281250 * 640; time = 1.0848s; samplesPerSecond = 590.0
MPI Rank 1: 12/12/2017 15:15:44:  Epoch[ 3 of 3]-Minibatch[ 171- 180, 14.06%]: CrossEntropyWithSoftmax = 1.50779792 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.4468s; samplesPerSecond = 442.4
MPI Rank 1: 12/12/2017 15:15:45:  Epoch[ 3 of 3]-Minibatch[ 181- 190, 14.84%]: CrossEntropyWithSoftmax = 1.60664651 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.2982s; samplesPerSecond = 493.0
MPI Rank 1: 12/12/2017 15:15:47:  Epoch[ 3 of 3]-Minibatch[ 191- 200, 15.62%]: CrossEntropyWithSoftmax = 1.53184518 * 640; EvalClassificationError = 0.45156250 * 640; time = 1.2428s; samplesPerSecond = 515.0
MPI Rank 1: 12/12/2017 15:15:48:  Epoch[ 3 of 3]-Minibatch[ 201- 210, 16.41%]: CrossEntropyWithSoftmax = 1.54559012 * 640; EvalClassificationError = 0.46875000 * 640; time = 1.3717s; samplesPerSecond = 466.6
MPI Rank 1: 12/12/2017 15:15:49:  Epoch[ 3 of 3]-Minibatch[ 211- 220, 17.19%]: CrossEntropyWithSoftmax = 1.55510900 * 640; EvalClassificationError = 0.47343750 * 640; time = 0.9727s; samplesPerSecond = 657.9
MPI Rank 1: 12/12/2017 15:15:50:  Epoch[ 3 of 3]-Minibatch[ 221- 230, 17.97%]: CrossEntropyWithSoftmax = 1.47156965 * 640; EvalClassificationError = 0.42656250 * 640; time = 1.2558s; samplesPerSecond = 509.6
MPI Rank 1: 12/12/2017 15:15:51:  Epoch[ 3 of 3]-Minibatch[ 231- 240, 18.75%]: CrossEntropyWithSoftmax = 1.57361962 * 640; EvalClassificationError = 0.46562500 * 640; time = 1.1054s; samplesPerSecond = 579.0
MPI Rank 1: 12/12/2017 15:15:53:  Epoch[ 3 of 3]-Minibatch[ 241- 250, 19.53%]: CrossEntropyWithSoftmax = 1.47393717 * 640; EvalClassificationError = 0.42812500 * 640; time = 1.4203s; samplesPerSecond = 450.6
MPI Rank 1: 12/12/2017 15:15:54:  Epoch[ 3 of 3]-Minibatch[ 251- 260, 20.31%]: CrossEntropyWithSoftmax = 1.60361602 * 640; EvalClassificationError = 0.45781250 * 640; time = 0.9830s; samplesPerSecond = 651.1
MPI Rank 1: 12/12/2017 15:15:55:  Epoch[ 3 of 3]-Minibatch[ 261- 270, 21.09%]: CrossEntropyWithSoftmax = 1.62318418 * 640; EvalClassificationError = 0.47187500 * 640; time = 1.1628s; samplesPerSecond = 550.4
MPI Rank 1: 12/12/2017 15:15:56:  Epoch[ 3 of 3]-Minibatch[ 271- 280, 21.88%]: CrossEntropyWithSoftmax = 1.44941986 * 640; EvalClassificationError = 0.43281250 * 640; time = 1.1303s; samplesPerSecond = 566.2
MPI Rank 1: 12/12/2017 15:15:57:  Epoch[ 3 of 3]-Minibatch[ 281- 290, 22.66%]: CrossEntropyWithSoftmax = 1.60425367 * 640; EvalClassificationError = 0.49062500 * 640; time = 1.2245s; samplesPerSecond = 522.7
MPI Rank 1: 12/12/2017 15:15:58:  Epoch[ 3 of 3]-Minibatch[ 291- 300, 23.44%]: CrossEntropyWithSoftmax = 1.52839810 * 640; EvalClassificationError = 0.46406250 * 640; time = 1.2002s; samplesPerSecond = 533.3
MPI Rank 1: 12/12/2017 15:16:00:  Epoch[ 3 of 3]-Minibatch[ 301- 310, 24.22%]: CrossEntropyWithSoftmax = 1.51581284 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.1121s; samplesPerSecond = 575.5
MPI Rank 1: 12/12/2017 15:16:01:  Epoch[ 3 of 3]-Minibatch[ 311- 320, 25.00%]: CrossEntropyWithSoftmax = 1.54632435 * 640; EvalClassificationError = 0.44375000 * 640; time = 1.0267s; samplesPerSecond = 623.4
MPI Rank 1: 12/12/2017 15:16:02:  Epoch[ 3 of 3]-Minibatch[ 321- 330, 25.78%]: CrossEntropyWithSoftmax = 1.51517575 * 640; EvalClassificationError = 0.43750000 * 640; time = 1.1502s; samplesPerSecond = 556.4
MPI Rank 1: 12/12/2017 15:16:03:  Epoch[ 3 of 3]-Minibatch[ 331- 340, 26.56%]: CrossEntropyWithSoftmax = 1.60369287 * 640; EvalClassificationError = 0.46875000 * 640; time = 1.2524s; samplesPerSecond = 511.0
MPI Rank 1: 12/12/2017 15:16:04:  Epoch[ 3 of 3]-Minibatch[ 341- 350, 27.34%]: CrossEntropyWithSoftmax = 1.47326330 * 640; EvalClassificationError = 0.44218750 * 640; time = 1.1892s; samplesPerSecond = 538.2
MPI Rank 1: 12/12/2017 15:16:06:  Epoch[ 3 of 3]-Minibatch[ 351- 360, 28.12%]: CrossEntropyWithSoftmax = 1.61175205 * 640; EvalClassificationError = 0.46250000 * 640; time = 1.5695s; samplesPerSecond = 407.8
MPI Rank 1: 12/12/2017 15:16:07:  Epoch[ 3 of 3]-Minibatch[ 361- 370, 28.91%]: CrossEntropyWithSoftmax = 1.53030127 * 640; EvalClassificationError = 0.44687500 * 640; time = 1.0843s; samplesPerSecond = 590.2
MPI Rank 1: 12/12/2017 15:16:08:  Epoch[ 3 of 3]-Minibatch[ 371- 380, 29.69%]: CrossEntropyWithSoftmax = 1.53453730 * 640; EvalClassificationError = 0.47968750 * 640; time = 1.4694s; samplesPerSecond = 435.5
MPI Rank 1: 12/12/2017 15:16:09:  Epoch[ 3 of 3]-Minibatch[ 381- 390, 30.47%]: CrossEntropyWithSoftmax = 1.59778376 * 640; EvalClassificationError = 0.45937500 * 640; time = 1.0678s; samplesPerSecond = 599.4
MPI Rank 1: 12/12/2017 15:16:11:  Epoch[ 3 of 3]-Minibatch[ 391- 400, 31.25%]: CrossEntropyWithSoftmax = 1.50381349 * 640; EvalClassificationError = 0.40625000 * 640; time = 1.2432s; samplesPerSecond = 514.8
MPI Rank 1: 12/12/2017 15:16:12:  Epoch[ 3 of 3]-Minibatch[ 401- 410, 32.03%]: CrossEntropyWithSoftmax = 1.47868865 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.3834s; samplesPerSecond = 462.6
MPI Rank 1: 12/12/2017 15:16:13:  Epoch[ 3 of 3]-Minibatch[ 411- 420, 32.81%]: CrossEntropyWithSoftmax = 1.59931512 * 640; EvalClassificationError = 0.46406250 * 640; time = 1.0893s; samplesPerSecond = 587.5
MPI Rank 1: 12/12/2017 15:16:14:  Epoch[ 3 of 3]-Minibatch[ 421- 430, 33.59%]: CrossEntropyWithSoftmax = 1.63250429 * 640; EvalClassificationError = 0.47031250 * 640; time = 1.2574s; samplesPerSecond = 509.0
MPI Rank 1: 12/12/2017 15:16:15:  Epoch[ 3 of 3]-Minibatch[ 431- 440, 34.38%]: CrossEntropyWithSoftmax = 1.49853807 * 640; EvalClassificationError = 0.44218750 * 640; time = 1.0494s; samplesPerSecond = 609.9
MPI Rank 1: 12/12/2017 15:16:17:  Epoch[ 3 of 3]-Minibatch[ 441- 450, 35.16%]: CrossEntropyWithSoftmax = 1.48667596 * 640; EvalClassificationError = 0.44531250 * 640; time = 1.3164s; samplesPerSecond = 486.2
MPI Rank 1: 12/12/2017 15:16:18:  Epoch[ 3 of 3]-Minibatch[ 451- 460, 35.94%]: CrossEntropyWithSoftmax = 1.65617302 * 640; EvalClassificationError = 0.49531250 * 640; time = 0.9685s; samplesPerSecond = 660.8
MPI Rank 1: 12/12/2017 15:16:19:  Epoch[ 3 of 3]-Minibatch[ 461- 470, 36.72%]: CrossEntropyWithSoftmax = 1.46898744 * 640; EvalClassificationError = 0.42031250 * 640; time = 1.4082s; samplesPerSecond = 454.5
MPI Rank 1: 12/12/2017 15:16:20:  Epoch[ 3 of 3]-Minibatch[ 471- 480, 37.50%]: CrossEntropyWithSoftmax = 1.54734642 * 640; EvalClassificationError = 0.46093750 * 640; time = 1.2390s; samplesPerSecond = 516.6
MPI Rank 1: 12/12/2017 15:16:22:  Epoch[ 3 of 3]-Minibatch[ 481- 490, 38.28%]: CrossEntropyWithSoftmax = 1.43416148 * 640; EvalClassificationError = 0.42187500 * 640; time = 1.2217s; samplesPerSecond = 523.8
MPI Rank 1: 12/12/2017 15:16:23:  Epoch[ 3 of 3]-Minibatch[ 491- 500, 39.06%]: CrossEntropyWithSoftmax = 1.56624483 * 640; EvalClassificationError = 0.44843750 * 640; time = 1.2794s; samplesPerSecond = 500.3
MPI Rank 1: 12/12/2017 15:16:24:  Epoch[ 3 of 3]-Minibatch[ 501- 510, 39.84%]: CrossEntropyWithSoftmax = 1.52464832 * 640; EvalClassificationError = 0.45000000 * 640; time = 0.9528s; samplesPerSecond = 671.7
MPI Rank 1: 12/12/2017 15:16:25:  Epoch[ 3 of 3]-Minibatch[ 511- 520, 40.62%]: CrossEntropyWithSoftmax = 1.30943399 * 640; EvalClassificationError = 0.38281250 * 640; time = 1.4006s; samplesPerSecond = 456.9
MPI Rank 1: 12/12/2017 15:16:26:  Epoch[ 3 of 3]-Minibatch[ 521- 530, 41.41%]: CrossEntropyWithSoftmax = 1.50544335 * 640; EvalClassificationError = 0.46718750 * 640; time = 0.9270s; samplesPerSecond = 690.4
MPI Rank 1: 12/12/2017 15:16:28:  Epoch[ 3 of 3]-Minibatch[ 531- 540, 42.19%]: CrossEntropyWithSoftmax = 1.60015038 * 640; EvalClassificationError = 0.47812500 * 640; time = 1.4390s; samplesPerSecond = 444.7
MPI Rank 1: 12/12/2017 15:16:29:  Epoch[ 3 of 3]-Minibatch[ 541- 550, 42.97%]: CrossEntropyWithSoftmax = 1.38509585 * 640; EvalClassificationError = 0.40781250 * 640; time = 1.0590s; samplesPerSecond = 604.4
MPI Rank 1: 12/12/2017 15:16:30:  Epoch[ 3 of 3]-Minibatch[ 551- 560, 43.75%]: CrossEntropyWithSoftmax = 1.54075585 * 640; EvalClassificationError = 0.45000000 * 640; time = 1.3341s; samplesPerSecond = 479.7
MPI Rank 1: 12/12/2017 15:16:32:  Epoch[ 3 of 3]-Minibatch[ 561- 570, 44.53%]: CrossEntropyWithSoftmax = 1.47883913 * 640; EvalClassificationError = 0.42812500 * 640; time = 1.6987s; samplesPerSecond = 376.8
MPI Rank 1: 12/12/2017 15:16:33:  Epoch[ 3 of 3]-Minibatch[ 571- 580, 45.31%]: CrossEntropyWithSoftmax = 1.56904501 * 640; EvalClassificationError = 0.46406250 * 640; time = 1.1364s; samplesPerSecond = 563.2
MPI Rank 1: 12/12/2017 15:16:34:  Epoch[ 3 of 3]-Minibatch[ 581- 590, 46.09%]: CrossEntropyWithSoftmax = 1.43381650 * 640; EvalClassificationError = 0.41875000 * 640; time = 1.4021s; samplesPerSecond = 456.5
MPI Rank 1: 12/12/2017 15:16:35:  Epoch[ 3 of 3]-Minibatch[ 591- 600, 46.88%]: CrossEntropyWithSoftmax = 1.52029729 * 640; EvalClassificationError = 0.45000000 * 640; time = 1.1847s; samplesPerSecond = 540.2
MPI Rank 1: 12/12/2017 15:16:37:  Epoch[ 3 of 3]-Minibatch[ 601- 610, 47.66%]: CrossEntropyWithSoftmax = 1.43772599 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.1783s; samplesPerSecond = 543.1
MPI Rank 1: 12/12/2017 15:16:38:  Epoch[ 3 of 3]-Minibatch[ 611- 620, 48.44%]: CrossEntropyWithSoftmax = 1.46138787 * 640; EvalClassificationError = 0.43750000 * 640; time = 1.1566s; samplesPerSecond = 553.4
MPI Rank 1: 12/12/2017 15:16:39:  Epoch[ 3 of 3]-Minibatch[ 621- 630, 49.22%]: CrossEntropyWithSoftmax = 1.42613409 * 640; EvalClassificationError = 0.43750000 * 640; time = 1.1947s; samplesPerSecond = 535.7
MPI Rank 1: 12/12/2017 15:16:40:  Epoch[ 3 of 3]-Minibatch[ 631- 640, 50.00%]: CrossEntropyWithSoftmax = 1.46340343 * 640; EvalClassificationError = 0.43906250 * 640; time = 1.4067s; samplesPerSecond = 455.0
MPI Rank 1: 12/12/2017 15:16:41:  Epoch[ 3 of 3]-Minibatch[ 641- 650, 50.78%]: CrossEntropyWithSoftmax = 1.53686246 * 640; EvalClassificationError = 0.42187500 * 640; time = 1.0081s; samplesPerSecond = 634.8
MPI Rank 1: 12/12/2017 15:16:43:  Epoch[ 3 of 3]-Minibatch[ 651- 660, 51.56%]: CrossEntropyWithSoftmax = 1.59556144 * 640; EvalClassificationError = 0.47656250 * 640; time = 1.2889s; samplesPerSecond = 496.6
MPI Rank 1: 12/12/2017 15:16:44:  Epoch[ 3 of 3]-Minibatch[ 661- 670, 52.34%]: CrossEntropyWithSoftmax = 1.51150023 * 640; EvalClassificationError = 0.45468750 * 640; time = 1.1368s; samplesPerSecond = 563.0
MPI Rank 1: 12/12/2017 15:16:45:  Epoch[ 3 of 3]-Minibatch[ 671- 680, 53.12%]: CrossEntropyWithSoftmax = 1.44456911 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.1916s; samplesPerSecond = 537.1
MPI Rank 1: 12/12/2017 15:16:46:  Epoch[ 3 of 3]-Minibatch[ 681- 690, 53.91%]: CrossEntropyWithSoftmax = 1.45832784 * 640; EvalClassificationError = 0.45468750 * 640; time = 1.2452s; samplesPerSecond = 514.0
MPI Rank 1: 12/12/2017 15:16:47:  Epoch[ 3 of 3]-Minibatch[ 691- 700, 54.69%]: CrossEntropyWithSoftmax = 1.57553892 * 640; EvalClassificationError = 0.45312500 * 640; time = 1.0314s; samplesPerSecond = 620.5
MPI Rank 1: 12/12/2017 15:16:48:  Epoch[ 3 of 3]-Minibatch[ 701- 710, 55.47%]: CrossEntropyWithSoftmax = 1.42915991 * 640; EvalClassificationError = 0.39687500 * 640; time = 1.1242s; samplesPerSecond = 569.3
MPI Rank 1: 12/12/2017 15:16:49:  Epoch[ 3 of 3]-Minibatch[ 711- 720, 56.25%]: CrossEntropyWithSoftmax = 1.43923172 * 640; EvalClassificationError = 0.42656250 * 640; time = 1.0936s; samplesPerSecond = 585.2
MPI Rank 1: 12/12/2017 15:16:51:  Epoch[ 3 of 3]-Minibatch[ 721- 730, 57.03%]: CrossEntropyWithSoftmax = 1.43711429 * 640; EvalClassificationError = 0.42031250 * 640; time = 1.0992s; samplesPerSecond = 582.2
MPI Rank 1: 12/12/2017 15:16:52:  Epoch[ 3 of 3]-Minibatch[ 731- 740, 57.81%]: CrossEntropyWithSoftmax = 1.42376466 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.1763s; samplesPerSecond = 544.1
MPI Rank 1: 12/12/2017 15:16:53:  Epoch[ 3 of 3]-Minibatch[ 741- 750, 58.59%]: CrossEntropyWithSoftmax = 1.46373212 * 640; EvalClassificationError = 0.42812500 * 640; time = 1.1949s; samplesPerSecond = 535.6
MPI Rank 1: 12/12/2017 15:16:54:  Epoch[ 3 of 3]-Minibatch[ 751- 760, 59.38%]: CrossEntropyWithSoftmax = 1.48734009 * 640; EvalClassificationError = 0.44531250 * 640; time = 1.0658s; samplesPerSecond = 600.5
MPI Rank 1: 12/12/2017 15:16:55:  Epoch[ 3 of 3]-Minibatch[ 761- 770, 60.16%]: CrossEntropyWithSoftmax = 1.33492865 * 640; EvalClassificationError = 0.40937500 * 640; time = 1.3871s; samplesPerSecond = 461.4
MPI Rank 1: 12/12/2017 15:16:57:  Epoch[ 3 of 3]-Minibatch[ 771- 780, 60.94%]: CrossEntropyWithSoftmax = 1.45062139 * 640; EvalClassificationError = 0.43281250 * 640; time = 1.1601s; samplesPerSecond = 551.7
MPI Rank 1: 12/12/2017 15:16:58:  Epoch[ 3 of 3]-Minibatch[ 781- 790, 61.72%]: CrossEntropyWithSoftmax = 1.36885165 * 640; EvalClassificationError = 0.40625000 * 640; time = 1.3146s; samplesPerSecond = 486.8
MPI Rank 1: 12/12/2017 15:16:59:  Epoch[ 3 of 3]-Minibatch[ 791- 800, 62.50%]: CrossEntropyWithSoftmax = 1.48323648 * 640; EvalClassificationError = 0.45781250 * 640; time = 0.9115s; samplesPerSecond = 702.2
MPI Rank 1: 12/12/2017 15:17:00:  Epoch[ 3 of 3]-Minibatch[ 801- 810, 63.28%]: CrossEntropyWithSoftmax = 1.33848948 * 640; EvalClassificationError = 0.41093750 * 640; time = 1.3457s; samplesPerSecond = 475.6
MPI Rank 1: 12/12/2017 15:17:01:  Epoch[ 3 of 3]-Minibatch[ 811- 820, 64.06%]: CrossEntropyWithSoftmax = 1.43713565 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.9164s; samplesPerSecond = 698.4
MPI Rank 1: 12/12/2017 15:17:03:  Epoch[ 3 of 3]-Minibatch[ 821- 830, 64.84%]: CrossEntropyWithSoftmax = 1.51660478 * 640; EvalClassificationError = 0.43281250 * 640; time = 1.4843s; samplesPerSecond = 431.2
MPI Rank 1: 12/12/2017 15:17:04:  Epoch[ 3 of 3]-Minibatch[ 831- 840, 65.62%]: CrossEntropyWithSoftmax = 1.48694605 * 640; EvalClassificationError = 0.43281250 * 640; time = 1.1323s; samplesPerSecond = 565.2
MPI Rank 1: 12/12/2017 15:17:05:  Epoch[ 3 of 3]-Minibatch[ 841- 850, 66.41%]: CrossEntropyWithSoftmax = 1.50715727 * 640; EvalClassificationError = 0.44218750 * 640; time = 1.1104s; samplesPerSecond = 576.4
MPI Rank 1: 12/12/2017 15:17:06:  Epoch[ 3 of 3]-Minibatch[ 851- 860, 67.19%]: CrossEntropyWithSoftmax = 1.40272164 * 640; EvalClassificationError = 0.39687500 * 640; time = 1.2144s; samplesPerSecond = 527.0
MPI Rank 1: 12/12/2017 15:17:07:  Epoch[ 3 of 3]-Minibatch[ 861- 870, 67.97%]: CrossEntropyWithSoftmax = 1.50124672 * 640; EvalClassificationError = 0.43437500 * 640; time = 1.3047s; samplesPerSecond = 490.5
MPI Rank 1: 12/12/2017 15:17:09:  Epoch[ 3 of 3]-Minibatch[ 871- 880, 68.75%]: CrossEntropyWithSoftmax = 1.49536744 * 640; EvalClassificationError = 0.44687500 * 640; time = 1.5369s; samplesPerSecond = 416.4
MPI Rank 1: 12/12/2017 15:17:10:  Epoch[ 3 of 3]-Minibatch[ 881- 890, 69.53%]: CrossEntropyWithSoftmax = 1.43536357 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.0593s; samplesPerSecond = 604.2
MPI Rank 1: 12/12/2017 15:17:11:  Epoch[ 3 of 3]-Minibatch[ 891- 900, 70.31%]: CrossEntropyWithSoftmax = 1.51852426 * 640; EvalClassificationError = 0.44843750 * 640; time = 1.2891s; samplesPerSecond = 496.5
MPI Rank 1: 12/12/2017 15:17:12:  Epoch[ 3 of 3]-Minibatch[ 901- 910, 71.09%]: CrossEntropyWithSoftmax = 1.46455974 * 640; EvalClassificationError = 0.45000000 * 640; time = 1.2488s; samplesPerSecond = 512.5
MPI Rank 1: 12/12/2017 15:17:14:  Epoch[ 3 of 3]-Minibatch[ 911- 920, 71.88%]: CrossEntropyWithSoftmax = 1.42139152 * 640; EvalClassificationError = 0.40156250 * 640; time = 1.2545s; samplesPerSecond = 510.2
MPI Rank 1: 12/12/2017 15:17:15:  Epoch[ 3 of 3]-Minibatch[ 921- 930, 72.66%]: CrossEntropyWithSoftmax = 1.37289030 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.3694s; samplesPerSecond = 467.4
MPI Rank 1: 12/12/2017 15:17:16:  Epoch[ 3 of 3]-Minibatch[ 931- 940, 73.44%]: CrossEntropyWithSoftmax = 1.48403103 * 640; EvalClassificationError = 0.44531250 * 640; time = 1.0930s; samplesPerSecond = 585.5
MPI Rank 1: 12/12/2017 15:17:18:  Epoch[ 3 of 3]-Minibatch[ 941- 950, 74.22%]: CrossEntropyWithSoftmax = 1.45404988 * 640; EvalClassificationError = 0.41562500 * 640; time = 1.3691s; samplesPerSecond = 467.5
MPI Rank 1: 12/12/2017 15:17:19:  Epoch[ 3 of 3]-Minibatch[ 951- 960, 75.00%]: CrossEntropyWithSoftmax = 1.36486848 * 640; EvalClassificationError = 0.42187500 * 640; time = 1.0848s; samplesPerSecond = 590.0
MPI Rank 1: 12/12/2017 15:17:20:  Epoch[ 3 of 3]-Minibatch[ 961- 970, 75.78%]: CrossEntropyWithSoftmax = 1.33833342 * 640; EvalClassificationError = 0.40000000 * 640; time = 1.2274s; samplesPerSecond = 521.4
MPI Rank 1: 12/12/2017 15:17:21:  Epoch[ 3 of 3]-Minibatch[ 971- 980, 76.56%]: CrossEntropyWithSoftmax = 1.45630697 * 640; EvalClassificationError = 0.42500000 * 640; time = 0.9607s; samplesPerSecond = 666.2
MPI Rank 1: 12/12/2017 15:17:22:  Epoch[ 3 of 3]-Minibatch[ 981- 990, 77.34%]: CrossEntropyWithSoftmax = 1.39637189 * 640; EvalClassificationError = 0.40625000 * 640; time = 1.1560s; samplesPerSecond = 553.6
MPI Rank 1: 12/12/2017 15:17:23:  Epoch[ 3 of 3]-Minibatch[ 991-1000, 78.12%]: CrossEntropyWithSoftmax = 1.42767318 * 640; EvalClassificationError = 0.42656250 * 640; time = 1.2189s; samplesPerSecond = 525.1
MPI Rank 1: 12/12/2017 15:17:24:  Epoch[ 3 of 3]-Minibatch[1001-1010, 78.91%]: CrossEntropyWithSoftmax = 1.43782335 * 640; EvalClassificationError = 0.43281250 * 640; time = 1.1358s; samplesPerSecond = 563.5
MPI Rank 1: 12/12/2017 15:17:26:  Epoch[ 3 of 3]-Minibatch[1011-1020, 79.69%]: CrossEntropyWithSoftmax = 1.43327475 * 640; EvalClassificationError = 0.41718750 * 640; time = 1.2812s; samplesPerSecond = 499.5
MPI Rank 1: 12/12/2017 15:17:27:  Epoch[ 3 of 3]-Minibatch[1021-1030, 80.47%]: CrossEntropyWithSoftmax = 1.41761283 * 640; EvalClassificationError = 0.41562500 * 640; time = 1.1713s; samplesPerSecond = 546.4
MPI Rank 1: 12/12/2017 15:17:28:  Epoch[ 3 of 3]-Minibatch[1031-1040, 81.25%]: CrossEntropyWithSoftmax = 1.48752040 * 640; EvalClassificationError = 0.44218750 * 640; time = 1.4444s; samplesPerSecond = 443.1
MPI Rank 1: 12/12/2017 15:17:29:  Epoch[ 3 of 3]-Minibatch[1041-1050, 82.03%]: CrossEntropyWithSoftmax = 1.46948032 * 640; EvalClassificationError = 0.44531250 * 640; time = 1.0699s; samplesPerSecond = 598.2
MPI Rank 1: 12/12/2017 15:17:30:  Epoch[ 3 of 3]-Minibatch[1051-1060, 82.81%]: CrossEntropyWithSoftmax = 1.34891898 * 640; EvalClassificationError = 0.40312500 * 640; time = 1.0671s; samplesPerSecond = 599.8
MPI Rank 1: 12/12/2017 15:17:32:  Epoch[ 3 of 3]-Minibatch[1061-1070, 83.59%]: CrossEntropyWithSoftmax = 1.45118836 * 640; EvalClassificationError = 0.43437500 * 640; time = 1.6504s; samplesPerSecond = 387.8
MPI Rank 1: 12/12/2017 15:17:33:  Epoch[ 3 of 3]-Minibatch[1071-1080, 84.38%]: CrossEntropyWithSoftmax = 1.38543708 * 640; EvalClassificationError = 0.42343750 * 640; time = 1.4055s; samplesPerSecond = 455.4
MPI Rank 1: 12/12/2017 15:17:35:  Epoch[ 3 of 3]-Minibatch[1081-1090, 85.16%]: CrossEntropyWithSoftmax = 1.45996370 * 640; EvalClassificationError = 0.43437500 * 640; time = 1.3250s; samplesPerSecond = 483.0
MPI Rank 1: 12/12/2017 15:17:36:  Epoch[ 3 of 3]-Minibatch[1091-1100, 85.94%]: CrossEntropyWithSoftmax = 1.48223623 * 640; EvalClassificationError = 0.42968750 * 640; time = 0.9190s; samplesPerSecond = 696.4
MPI Rank 1: 12/12/2017 15:17:37:  Epoch[ 3 of 3]-Minibatch[1101-1110, 86.72%]: CrossEntropyWithSoftmax = 1.45381259 * 640; EvalClassificationError = 0.44531250 * 640; time = 1.3117s; samplesPerSecond = 487.9
MPI Rank 1: 12/12/2017 15:17:38:  Epoch[ 3 of 3]-Minibatch[1111-1120, 87.50%]: CrossEntropyWithSoftmax = 1.40590782 * 640; EvalClassificationError = 0.40937500 * 640; time = 1.0117s; samplesPerSecond = 632.6
MPI Rank 1: 12/12/2017 15:17:39:  Epoch[ 3 of 3]-Minibatch[1121-1130, 88.28%]: CrossEntropyWithSoftmax = 1.46130102 * 640; EvalClassificationError = 0.42500000 * 640; time = 1.3032s; samplesPerSecond = 491.1
MPI Rank 1: 12/12/2017 15:17:40:  Epoch[ 3 of 3]-Minibatch[1131-1140, 89.06%]: CrossEntropyWithSoftmax = 1.39530065 * 640; EvalClassificationError = 0.42343750 * 640; time = 0.8848s; samplesPerSecond = 723.3
MPI Rank 1: 12/12/2017 15:17:41:  Epoch[ 3 of 3]-Minibatch[1141-1150, 89.84%]: CrossEntropyWithSoftmax = 1.35419083 * 640; EvalClassificationError = 0.41406250 * 640; time = 1.2176s; samplesPerSecond = 525.6
MPI Rank 1: 12/12/2017 15:17:43:  Epoch[ 3 of 3]-Minibatch[1151-1160, 90.62%]: CrossEntropyWithSoftmax = 1.33073646 * 640; EvalClassificationError = 0.41250000 * 640; time = 1.4348s; samplesPerSecond = 446.0
MPI Rank 1: 12/12/2017 15:17:44:  Epoch[ 3 of 3]-Minibatch[1161-1170, 91.41%]: CrossEntropyWithSoftmax = 1.38949160 * 640; EvalClassificationError = 0.41093750 * 640; time = 1.2314s; samplesPerSecond = 519.7
MPI Rank 1: 12/12/2017 15:17:45:  Epoch[ 3 of 3]-Minibatch[1171-1180, 92.19%]: CrossEntropyWithSoftmax = 1.32880727 * 640; EvalClassificationError = 0.39062500 * 640; time = 1.3300s; samplesPerSecond = 481.2
MPI Rank 1: 12/12/2017 15:17:46:  Epoch[ 3 of 3]-Minibatch[1181-1190, 92.97%]: CrossEntropyWithSoftmax = 1.40184500 * 640; EvalClassificationError = 0.43750000 * 640; time = 0.9576s; samplesPerSecond = 668.3
MPI Rank 1: 12/12/2017 15:17:48:  Epoch[ 3 of 3]-Minibatch[1191-1200, 93.75%]: CrossEntropyWithSoftmax = 1.40949007 * 640; EvalClassificationError = 0.39531250 * 640; time = 1.2055s; samplesPerSecond = 530.9
MPI Rank 1: 12/12/2017 15:17:49:  Epoch[ 3 of 3]-Minibatch[1201-1210, 94.53%]: CrossEntropyWithSoftmax = 1.23195500 * 640; EvalClassificationError = 0.38437500 * 640; time = 1.1078s; samplesPerSecond = 577.7
MPI Rank 1: 12/12/2017 15:17:50:  Epoch[ 3 of 3]-Minibatch[1211-1220, 95.31%]: CrossEntropyWithSoftmax = 1.38284649 * 640; EvalClassificationError = 0.42343750 * 640; time = 1.2701s; samplesPerSecond = 503.9
MPI Rank 1: 12/12/2017 15:17:51:  Epoch[ 3 of 3]-Minibatch[1221-1230, 96.09%]: CrossEntropyWithSoftmax = 1.48791262 * 640; EvalClassificationError = 0.42031250 * 640; time = 1.4842s; samplesPerSecond = 431.2
MPI Rank 1: 12/12/2017 15:17:53:  Epoch[ 3 of 3]-Minibatch[1231-1240, 96.88%]: CrossEntropyWithSoftmax = 1.44552472 * 640; EvalClassificationError = 0.42968750 * 640; time = 1.1966s; samplesPerSecond = 534.9
MPI Rank 1: 12/12/2017 15:17:54:  Epoch[ 3 of 3]-Minibatch[1241-1250, 97.66%]: CrossEntropyWithSoftmax = 1.39650699 * 640; EvalClassificationError = 0.42187500 * 640; time = 1.1277s; samplesPerSecond = 567.5
MPI Rank 1: 12/12/2017 15:17:55:  Epoch[ 3 of 3]-Minibatch[1251-1260, 98.44%]: CrossEntropyWithSoftmax = 1.34393857 * 640; EvalClassificationError = 0.40781250 * 640; time = 1.1624s; samplesPerSecond = 550.6
MPI Rank 1: 12/12/2017 15:17:56:  Epoch[ 3 of 3]-Minibatch[1261-1270, 99.22%]: CrossEntropyWithSoftmax = 1.40896873 * 640; EvalClassificationError = 0.43593750 * 640; time = 1.0513s; samplesPerSecond = 608.8
MPI Rank 1: 12/12/2017 15:17:57:  Epoch[ 3 of 3]-Minibatch[1271-1280, 100.00%]: CrossEntropyWithSoftmax = 1.39640866 * 640; EvalClassificationError = 0.43750000 * 640; time = 1.2692s; samplesPerSecond = 504.2
MPI Rank 1: 12/12/2017 15:17:57: Finished Epoch[ 3 of 3]: [Training] CrossEntropyWithSoftmax = 1.48429042 * 81920; EvalClassificationError = 0.43870850 * 81920; totalSamplesSeen = 245760; learningRatePerSample = 0.001953125; epochTime=207.091s
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:17:57: Action "train" complete.
MPI Rank 1: 
MPI Rank 1: 12/12/2017 15:17:57: __COMPLETED__