Gregory's ServerThis is glorious.The best time to burn a bridge is when you never, ever want to cross it again. #genai (Edit: This is a notice explaining why somebody is shutting down a long-running project to measure word frequencies.) https://github.com/rspeer/wordfreq/blob/master/SUNSET.md
 40 comments
 @williampietri "I don't think anyone has reliable information about post-2021 language usage by humans." @rosco @williampietri Give it a few years and humans will talk like the AI-generated slop they see on the Internet. Look how shorthand invented to save time typing on 1990s mobile phone number pads became used in everyday speech. @natpryce Could be! Although I could see it going the other way, people leaning into slang and other human-driven linguistic evolution so that they are more likely to feel real. And perhaps we'll see a fair bit of both.  @natpryce @rosco @williampietri For a while, telegraphers' and radio operators' shorthand expressions crossed over into general use.  @rosco @williampietri reminds me of how carbon dating suffered after nuclear tests in the 1950s    @MichaelPorter of all things, delve is the most human artifact of the llms – it's a result of employing nigerian english speakers. @williampietri  @williampietri Tldr: lib that scrapes human language is going to stop maintenance because the web is polluted with ai slop  @williampietri "Reddit also stopped providing public data archives, and now they sell their archives at a price that only OpenAI will pay. And given what's happening to the field, I don't blame them." I do. Reddit's mid-2023 moves were, and still are, disgraceful and have resulted in a reduction of my usage by 99%. (Yes, I know I'm the only one.)  @MisterMoo @williampietri You're not the only one. When they killed third-party apps, I stopped going to Reddit. @chiraag @MisterMoo Same! I didn’t even use a third-party client, but shutting them out was the reason I walked away. @chiraag @MisterMoo @williampietri there's three of us. I deleted all my data and my account. I still end up with a bunch of Reddit access via proxy frontends via LibRedirect, because Reddit is still the central forum of the internet where everything that doesn't live on Twitter or Facebook/Insta lives, and I often want to read forum-style content, but... It's read-only for me, and via a frontend.  @MisterMoo @williampietri Yet another one. Reddit (outside of old.reddit.com) was really only tolerable with third-party apps and when Reddit effectively killed those off, I deleted my account and much of what I wrote there (which already wasn’t a lot). I’ll still look at plausible search results from Reddit as long as that’s still a useful trick, but that’s about it.  @MisterMoo @williampietri I really hope somebody leaks the twitter database. The use of that dataset in Because Internet is amazing.  > Now the Web at large is full of slop generated by large language models, written by no one to communicate nothing. 👏    @williampietri "OpenAI and Google can collect their own damn data. I hope they have to pay a very high price for it, and I hope they're constantly cursing the mess that they made themselves." ... they won't see it that way, but come up with justifications that change laws and public opinions. The goal is to circumvent any privacy and moral guards, and further manipulate our emotion-hormones to get us to divulge what they want, and have us pay for it by giving up our cherished common good. @williampietri smells like another ai winter... except it's the other way around, it's not that nobody talks about or does ai but that nobody talks or does anything because of ai @williampietri that was a truly beautiful goodbye. Its really sad she had to do this. @williampietri Thank you for sharing!  @williampietri It is terribly sad that the largest collection of human writing ever assembled is now polluted in such a way @williampietri this doesn't bode well for the future of our language. Already heavily influenced by corporate speak via advertisers and US TV/movie culture, AI-generated slop isn't going to help. Bring on the next generation of word artists please: poets, writers, songwriters. I hope lots of 'em don't lean on ChatGPT et al. 
Seriously, NLP is a cool area with all kinds of cool stuff, but all of the actually clever ideas and actually useful applications have faded away. It’s like when something super bright gets in frame and the camera auto adjusts and now that’s the only thing anyone can actually see.  @williampietri That was a great, but honestly heartbreaking, read. |
@williampietri
Robyn Speer is a treasure and she makes great points.