@thomasfuchs
So how is google's bot going to index such sites? Given the obvious answer, what's going to stop malicious bots?

They can try, but they can't have it both ways.