Email or username:

Password:

Forgot your password?
Top-level
sayrer

@nikitonsky @tolmasky you can write a bot to fetch them all without reading them.

2 comments
Niki Tonsky

@sayrer @tolmasky well, first, you can write bot either way.

Second, what’s the problem with that?

sayrer

@nikitonsky @tolmasky it's because it is a natural rate limiter (they have to parse the response to get only one next link). This is not a security mechanism, just cost savings. Old content is more expensive to serve than new content, this is how Twitter, IG, and even Netflix work. There is a computer in my local ISP that holds the current popular movies. Same idea, but for the Redis or edge server that powers your website.

Go Up