Email or username:

Password:

Forgot your password?
Top-level
Foone🏳️‍⚧️

No one hates the modern web more than web scrapers, and unfortunately I have been coding those for like a decade and a half

16 comments
DELETED

@foone That was the only thing I was ever good at coding in Python.

Eaton

@foone why make divs when we can make new custom shadow-divs

Robert Wire

@unlofl @foone Don't worry, you can add CSS animations and JavaScript event handlers to make it look/behave more and more like a real button! It's called "progressive enhancement"!!1
-- statements made by the utterly deranged^W^W^W StackOverflow

sirlan

@unlofl@mstdn.social not accurate enough, would be more like

<!-- button -->
<div class="bg-blue-500 hover:bg-blue-700 text-white font-bold py-2 px-4 rounded">

Ian Rudderbutt

@unlofl this is the biggest “thanks, I hate it”

Craig Rangoon

@unlofl Just gonna hang onto this for when my IT Department says the semantic HTML documentation I wrote for the so-called "shadow IT" projects they refused to do for me is too confusing and should be templated Word doc.

DELETED

@foone
I was wondering what new challenges you are seeing?

I'm maybe not noticing them.

User-Agent sniffing is fairly easy to automate my way out of, by faking user-agent strings, special sentinel headers or cookies can take a bit more thought; but if it's designed to be on the public internet; I feel like scraping has never been easier.

React et-al mangling classes is a bit more awful for me.

Rho

@foone mitm app scrapers are the only thing worse, I hated writing those 😬

Blake Leonard

@foone@digipres.club Most "modern web" developers (or rather, their bosses) consider this a feature.

Go Up