I think that pushback against literary analysis is an expression of contempt for art in general. "It's not that deep" is a way of saying art is not worth understanding, which is another way of saying that it is not worth spending any time on. People who say this very often do spend time engaging with art, but they internalise an ideology which is opposed to art functioning as anything other than a commodity