@darius it's actually very strange imho - probably if this was non fiction, it wouldn't be any different from listening to a podcast (which I often do). But the one I'm listening to is a fiction book and I'm about 75% enjoying it and the rest is feeling lost because my book imagination isn't being used? It might just also depend on how good the person/voice who's reading is in delivering the lines.
But do give it a try! :D