*1:Vaswani, A., Brain, G., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., … Polosukhin, I. (n.d.). Attention Is All You Need. Retrieved from https://arxiv.org/pdf/1706.03762v5.pdf
Google Colaboratoryは神．ただし軽いタスクに限る．
大学の予算の使い方の仕様上，従量課金制というのがとてつもなく相性が悪いです．産総研のABCIみたいな一定ポイント買い切り制ならまだ良いかも知れませんが，そもそもラボ内のマシンで四苦八苦している人がクラウドのインスタンスでどうのこうのなんて，理解出来ると思いますか？
無料でトライアンドエラーできるのがオンプレの良いところなのですが，これにお金がかかるとなって，結局「みんな怖がって使わない→クラウドインスタンスがエリクサー化」するのも嫌です．やっぱり学内共用計算マシンと，その使用方法講座みたいなのを実施するのがベストなんじゃないかなぁと．
[I 2019-03-2415:57:00,465] A new study created with name: prune_test
[I 2019-03-2415:57:42,481] Finished trial#0 resulted in value: 0.03238105773925781. Current best value is 0.03238105773925781 with parameters: {'n_unit': 36, 'batch_size': 105}.
# 省略[I 2019-03-2420:16:07,683] Finished trial#99 resulted in value: 0.022976338863372803. Current best value is 0.018449485301971436 with parameters: {'n_unit': 95, 'batch_size': 37}.
[Trial summary]
Copmleted: 100
Pruned: 0
Failed: 0[Best Params]
Epoch: 9
Accuracy: 0.9815505146980286
Batch size: 37
N unit: 95
[I 2019-03-2415:56:47,192] A new study created with name: prune_test
[I 2019-03-2415:57:31,076] Finished trial#0 resulted in value: 0.02388054132461548. Current best value is 0.02388054132461548 with parameters: {'batch_size': 67, 'n_unit': 116}.
# 省略[I 2019-03-2416:29:43,264] Setting status of trial#99 as TrialState.PRUNED. Trial was pruned at epoch 1.
[Trial summary]
Copmleted: 14
Pruned: 86
Failed: 0[Best Params]
Epoch: 8
Accuracy: 0.9790022373199463
Batch size: 69
N unit: 125
[I 2019-03-2415:56:58,310] A new study created with name: prune_test
[I 2019-03-2415:58:00,723] Finished trial#0 resulted in value: 0.023097515106201172. Current best value is 0.023097515106201172 with parameters: {'batch_size': 61, 'n_unit': 70}.
# 省略[I 2019-03-2416:26:50,098] Setting status of trial#99 as TrialState.PRUNED. Trial was pruned at epoch 1.
[Trial summary]
Copmleted: 8
Pruned: 92
Failed: 0[Best Params]
Epoch: 9
Accuracy: 0.9769024848937988
Batch size: 61
N unit: 70
