After a Decade of Tracking Politicians’ Deleted Tweets, Politwoops Is No More
--
Since Elon Musk took over Twitter, it has disabled the function we used to track the deleted Tweets of elected officials and political candidates — and the new method that Twitter says should identify deleted tweets appears to be broken.

Regardless of one's feelings about Twitter, this is a loss for transparency.

Thanks to @derekwillis for coming back to write this obit.

https://www.propublica.org/article/politwoops-deleted-tweets-twitter-politicians-musk

After a Decade of Tracking Politicians’ Deleted Tweets, Politwoops Is No More

Whether officials were deleting an embarrassing post or just correcting a typo, Politwoops tracked them all. But service changes made after Elon Musk’s acquisition of Twitter have rendered it impossible for us to continue tracking these tweets.

ProPublica
@ProPublica @derekwillis
Since the courts verified that tweets are public record for officials I feel like that might also be illegal, but IANAL
@deirdrebeth @ProPublica It's not illegal - Twitter isn't fully government speech, despite what some courts have held.
@derekwillis @ProPublica
If you post as John Smith, no. If you post as "Senator from Idaho", it is. That's what the courts said. If you want the caché of posting under your job title you have the responsibilities too. Just like posting sexist, racist, fascist shit as "CEO of Whatsit" loses you a job.
@deirdrebeth @derekwillis @ProPublica need to find some way to make the public see it as distasteful / socially unacceptable for politicians to post on, much less conduct official business on, Twitter. It’s a private site with rules that are not conducive to official government use. Congress, the White House, and government agencies should have their own Mastodon instances •instead•.
@ProPublica @derekwillis ... this is (1/1000) reasons why Mastodon and the #opensource Social Movement is so important today - support your communities online and support the move to #opensource in any way you can ...!
@ProPublica @derekwillis the broken thing will never be fixed, too rich to afford to fix a platform
@ProPublica @derekwillis I feel like it should be possible to build a o tool to do this
@JetForMe @ProPublica it is possible; the problems are scale (thousands of accounts to track) and timeliness. And, not insignificantly, cost. Twitter could just run this themselves, tbh, but I understand why they don't.
@derekwillis @ProPublica 10k accounts, 10 tweets/day, 100k tweets/day, what, 1k of data per tweet, less than 500 GB over 10 years, I feel like it wouldn't more than $100/mo in cloud services, would it? I don't have any sense of the budget available for something like this, though.

@JetForMe @ProPublica it's complicated, Politwoops relies on the streaming API, which means it has to run 24/7, because in order to know which tweets have been deleted you have to have copies of them first (the notification is just the ID).

That latter bit is what's currently broken - Twitter isn't sending those notifications. So we would have to, I guess, go back and check if tweets had been deleted, which is possible but you lose time context.

Also, ppl delete stuff after a long time.

@JetForMe @ProPublica So you could build a system that does all of that, absent the timeliness factor, but it would be difficult to say that you'd be capturing all of the deletions.
@derekwillis @ProPublica Yeah, it's not pretty, but it is doable. The worst part is re-checking every tweet frequently, which scales poorly. I suppose you could check older tweets less frequently, but there's no getting around the poor scaling. Still, might be worth it for public accountability reasons. Not sure how Twitter API rate limiting would affect things.
@JetForMe @derekwillis @ProPublica You'd probably have to build your own Twitter website scraper and have that use various available open http proxy servers, or frequently spin up new virtual servers with new IP addresses to avoid Twitter's rate limits. But yes, definitely doable if you got plenty of spare time and a credit card (otherwise the cloud server providers don't want you as customer).

@ProPublica @derekwillis

broken? it seems a curiously convenient break for Musk.

@ProPublica @derekwillis

Just a day after, #MTG said "billion"and edited it to "million" but ment "thousands"

@ProPublica @derekwillis it’s not like he is a spiteful ahole and he is trying to kill the site because he was forced to buy it