Someone should scrape all t.co links and build.up a database with the original links, or we will lose all of it eventually. Even the archives twitter gave us only contain those broken t.co links
Top-level
Someone should scrape all t.co links and build.up a database with the original links, or we will lose all of it eventually. Even the archives twitter gave us only contain those broken t.co links 9 comments
@angelo Could be a legal angle here. That means the download your data tool doesn’t actually download your data — it’s missing the links you posted. @angelo last year when I exported my archive, there was a tool I ran that expanded all of the shortened links to their full versions, I believe it was https://github.com/timhutton/twitter-archive-parser Although with the change to require a login to access the shortened links, I'm not sure if it would work if you ran it now... :thinkingg: @angelo@social.veltens.org and once again archiveteam is correct @angelo I'm thankful Michele Weigle pointed this out when people were leaving Twitter in November 2022. https://twitter.com/weiglemc/status/1593698822257102851 They gave directions on how to scrape the URLs & batch submit them to the Internet Archive as well as get them into a Google Sheet. @angelo Additional tools I have not used, but were linked at the time: https://wiert.me/2022/11/12/exporting-your-twitter-content-converting-to-markdown-and-getting-the-image-alt-texts-thanks-isotopp-hbeckpdx-for-the-info-and-kcgreenn-dreamjar-for-the-comic/ @angelo The #ArchiveTeam has been doing this for quite a while already. https://wiki.archiveteam.org/index.php/URLTeam |
@angelo sounds like a job for https://wiki.archiveteam.org :)