Found 122200 unique tokens. ('Shape of data tensor:', (268013, 1000)) ('Shape of label tensor:', (268013, 6)) [ 0. 18256. 18976. 30509. 70248. 76422.] [ 0. 4611. 4732. 7568. 17602. 19089.] Found 400000 word vectors.
Layer (type) Output Shape Param # Connected to
================================================================================ ====================
input_1 (InputLayer) (None, 1000) 0
embedding_1 (Embedding) (None, 1000, 100) 12220100 input_1[0][0]
bidirectional_1 (Bidirectional) (None, 1000, 200) 120600 embedding_1[0 ][0]
attlayer_1 (AttLayer) (None, 200) 200 bidirectional _1[0][0]
dense_1 (Dense) (None, 6) 1206 attlayer_1[0] [0] ================================================================================ ==================== Total params: 12342106
Train on 214411 samples, validate on 53602 samples Epoch 1/10 214411/214411 [==============================] - 16658s - loss: 0.9339 - acc: 0. 5794 - val_loss: 0.8602 - val_acc: 0.6082 Epoch 2/10 214411/214411 [==============================] - 16628s - loss: 0.7905 - acc: 0. 6501 - val_loss: 0.8035 - val_acc: 0.6449 Epoch 3/10 214411/214411 [==============================] - 16447s - loss: 0.7414 - acc: 0. 6738 - val_loss: 0.8184 - val_acc: 0.6377 Epoch 4/10 214411/214411 [==============================] - 16443s - loss: 0.6977 - acc: 0. 6970 - val_loss: 0.8364 - val_acc: 0.6338 Epoch 5/10 214411/214411 [==============================] - 16446s - loss: 0.6542 - acc: 0. 7201 - val_loss: 0.8053 - val_acc: 0.6500 Epoch 6/10 214411/214411 [==============================] - 16446s - loss: 0.6078 - acc: 0.7442 - val_loss: 0.8510 - val_acc: 0.6339 Epoch 7/10 214411/214411 [==============================] - 26803s - loss: 0.5567 - acc: 0.7687 - val_loss: 0.8837 - val_acc: 0.6336 Epoch 8/10 214411/214411 [==============================] - 26727s - loss: 0.5065 - acc: 0.7949 - val_loss: 0.9444 - val_acc: 0.6302 Epoch 9/10 214411/214411 [==============================] - 16449s - loss: 0.4588 - acc: 0.8175 - val_loss: 1.0033 - val_acc: 0.6227 Epoch 10/10 214411/214411 [==============================] - 16444s - loss: 0.4134 - acc: 0.8378 - val_loss: 1.0967 - val_acc: 0.6144
Found 122200 unique tokens. ('Shape of data tensor:', (268013, 1000)) ('Shape of label tensor:', (268013, 6)) [ 0. 18227. 18946. 30350. 70286. 76602.] [ 0. 4640. 4762. 7727. 17564. 18909.] Found 400000 word vectors.
Layer (type) Output Shape Param # Connected to
================================================================================ ====================
input_1 (InputLayer) (None, 1000) 0
embedding_1 (Embedding) (None, 1000, 100) 12220100 input_1[0][0]
bidirectional_1 (Bidirectional) (None, 200) 160800 embedding_1[0 ][0]
dense_1 (Dense) (None, 6) 1206 bidirectional _1[0][0] ================================================================================ ==================== Total params: 12382106
Train on 214411 samples, validate on 53602 samples Epoch 1/10 214411/214411 [==============================] - 18079s - loss: 0.9802 - acc: 0. 5609 - val_loss: 0.8675 - val_acc: 0.6098 Epoch 2/10 214411/214411 [==============================] - 18303s - loss: 0.8147 - acc: 0. 6394 - val_loss: 0.8309 - val_acc: 0.6286 Epoch 3/10 214411/214411 [==============================] - 18305s - loss: 0.7633 - acc: 0. 6651 - val_loss: 0.8085 - val_acc: 0.6427 Epoch 4/10 214411/214411 [==============================] - 18302s - loss: 0.7221 - acc: 0. 6866 - val_loss: 0.8149 - val_acc: 0.6402 Epoch 5/10 214411/214411 [==============================] - 18307s - loss: 0.6835 - acc: 0.7061 - val_loss: 0.8163 - val_acc: 0.6379 Epoch 6/10 214411/214411 [==============================] - 18300s - loss: 0.6444 - acc: 0.7264 - val_loss: 0.8338 - val_acc: 0.6421 Epoch 7/10 214411/214411 [==============================] - 38503s - loss: 0.6043 - acc: 0.7472 - val_loss: 0.8713 - val_acc: 0.6334 Epoch 8/10 214411/214411 [==============================] - 18315s - loss: 0.5626 - acc: 0.7678 - val_loss: 0.9014 - val_acc: 0.6318 Epoch 9/10 214411/214411 [==============================] - 18292s - loss: 0.5204 - acc: 0.7883 - val_loss: 0.9376 - val_acc: 0.6265 Epoch 10/10 214411/214411 [==============================] - 12314s - loss: 0.4791 - acc: 0.8080 - val_loss: 0.9800 - val_acc: 0.6214