@mhoye you can outperform a non-pre-trained deep neural network. I don’t understand text classification enough to know what the difference is there. ”Non-pre-trained” sounds like a key factor in that comparison though.