I wrote a nano tool that tries to extract the #Fediverse accounts of your #Twitter followings: https://fedifinder.glitch.me/

It searches for the patterns @[email protected], [email protected] and host.tld/@user in the screen name, description, location and URL field. It displays them to you in the correct format for easy copying as well as a CSV download that can be imported to #Mastodon.

New version: https://fedifinder-backup.glitch.me/

Fedifinder

Fediverse accounts of your X/Twitter followings

You can now check if the handles in your own Twitter profile are found. They are not added to the export. If there are issues with your profile, let me know.

Thanks for the idea @nelson. #twittermigration #neuhier #nieuwhier

Updates to #fedifinder
- Accounts are now sorted by fediverse instance
- Strings that look like mail addresses are included again eg. [email protected]
- domains are checked for /.well-known/host-meta (if it exists, the domain is more likely to be part of the fediverse; someday I may look at the content as well; currently just HEAD requests) Thanks @yetzt for the idea.
- domain checks are cached to make them faster and don't put unnecessary load on servers
- offline domains excluded

I was able to reduce the wait time by around 40% by moving the domain checks to after the page got rendered. I fear some rate limiting issues came from people reloading before receiving a response.

False positives are kept in the visible list, but striked through. They are still removed from the exported CSV to reduce server load on imports.

Next up: Lists. They are the most requested feature. #fedifinder

Support for lists arrived in #fedifinder.

It shows you your own lists as well as the lists you are subscribed to. You can scan each of them and the found handles are added to the visible list as well as the download. (False positives of the previous scan are removed from the visible list with each additional scan.)

I made the scan of the followings optional in #fedifinder to improve speed, reduce the amount of rate limiting errors (eg. users reloading the page) and make it easier for people who only want to scan lists or maybe something else that gets added in the future.

Rate limiting errors aren't displayed as json anymore, but tell you how to fix them (wait, wait and wait).

More improvements for #fedfinder.

The results now display basic stats for each instance and if the registration is open. Thanks for the hint @pfefferle.

Better check if something is part of the #fediverse.

Data handling is still a mess, but less messy now, which results in fewer requests to the server and less jumping text.

Tiny changes on the frontend, massive ones in the backend. #fedifinder

- Option to scan the profiles of your followers
- Twiter handle where the fediverse account was found
- Handles of failed servers can be displayed

- Switched to API v2
- Pinned Tweets are included
- You can now scan up to 15k followings and 15k followers
- Better handling of rate limits
- Caching of reason of unreachability of servers (and limited amount of retries for servers that timed out)
- better regex

I am currently looking through the #fediverse software options to find more URL patterns of profiles. Here is what I have at the moment. Most of them are easy to detect. But for pleroma I saw some servers with and some without the @ in the username. Makes it harder.

domain.tld/@name
mastodon, misskey, pleroma, funkwhale

domain.tld/profile/name
friendica, hubzilla

domain.tld/u/name
diaspora

domain.tld/c/name/videos
peertube

domain.tld/name
pleroma, gnusocial

Today wasn't fun. While I was outside, I got many messages that #FediFinder didn't work. I checked it and saw that it was overloaded and crashed every few minutes. I then tried to fix it from my mobile, but with each line of code it seemed like I added multiple new bugs. Not good. So I added a message that its broken and to check back later.

I spent the whole afternoon and evening trying to fix the mistakes of past me and clean up the code to make it at least slightly easier in the future.

The important thing: #FediFinder is back!

While https://fedifinder.glitch.me seems to work fine again, I added two backups that you can use as well:
https://fedifinder-backup.glitch.me and https://fedifinder-backup2.glitch.me

New feature: You can now click on the usernames for the fediverse (may not always work because of different formats of software) and Twitter.

Fedifinder

Fediverse accounts of your X/Twitter followings

Instead of building a better export, I made the sessions persistent, so that not everyone re-logins when I change something and the server restarts.

You can now watch as #FediFinder checks the domains. And even retry if it gets stuck (should add a 10 second timeout there as well).

And I added links to the backup servers and info about donations to the homepage.

I added an API (kinda) to #FediFinder. The only endpoint is /api/known_instances.json. It returns all instances it knows at the moment.

Currently, It is used to share data with @debirdify.

I don't know if it will stay public/available and/or if the structure will change in the future.

#FediFinder Day 9(?). I moved the handle identification from the backend to the frontend to improve performance. The server is only responsible for getting the data from Twitter and checking domains. No changes for the users.

With the functions, I moved some tests to the frontend. Only visible on the staging server or the code.

If handles are detected on the user profile, I show links to their import. Thanks @nart for the idea.

JSON export (including accounts without handles).

Fixed bugs.

There are people who had problems using #fedifinder. Not everyone knows what a CSV is or where to find the import. But I have a solution: Follow buttons!

If one or more #fediverse handles are identified on the profile of the person using fedifinder, they can now toggle on follow buttons to get directly to the follow request on their own instances. This should make it much easier.

(At the moment they only work for mastodon instances. I am open to pull requests for other software.)

But Luca, not everyone is in the fediverse. The export is useless for the other accounts. And in my Twitter archive are only the IDs of the people I followed. Not their names or websites. What about them?

If you scroll to the bottom of #Fedifinder, you can now view a table of the accounts that you have scanned. Even if they have no handle in their profile. Or one that wasn't correctly detected.

For half an hour full of stress I thought, I exposed the sessions database. I noticed a data folder in the git repository that should not have been there (wrong path). First I deleted the folder (to make it less visible), then I revoked the Twitter app tokens, filtered the data from the git history (to actually remove it) and put a notice on the #fedifinder homepage. Finally, I felt like I did, what I could. I relaxed and realized that user data was never at risk. The was the staging database.

I updated the ReadMe to help people run their own #Fedifinder (no coding skills needed) and how to contribute.

https://github.com/lucahammer/fedifinder

And fedifinder got a new API endpoint. api/check. You can use it with a domain and/or handle as query parameters and get back the cached information fedifinder has for that: https://fedifinder.glitch.me/api/check?handle=@[email protected]

GitHub - lucahammer/fedifinder: Find fediverse addresses in the profiles of your Twitter followings

Find fediverse addresses in the profiles of your Twitter followings - lucahammer/fedifinder

GitHub

Full speed! Thanks to the latest update, #Fedifinder scans my 2k followings within 10 seconds. From login to exported file.

The solution to a slow databases wasn't a fast database, but no database at all. Finally, I can tell you to share fedifinder with all of your contacts without fearing that the
service will go down because of it.

Go and find your people! https://fedifinder.glitch.me/

Fedifinder

Fediverse accounts of your X/Twitter followings

Only a small update for #FediFinder today: Splitting up functionality to multiple servers.

The main server is only responsible for getting data from Twitter from now on. A second server does the handle and domain lookups. Because the lookups locked the server up from time to time, this should make the service more stable and faster. If no lookup server is added to the .env, fedifinder is fully functional as a single server.

The sleepless #fediFinder update.

Authorize your Mastodon account to see which Fediverse accounts of your Twitter followings, you already follow.

Because the feature isn't finished yet and still confusing (you have to authorize, then click hide followings, then scan followings; no export yet) it's currently only available on the backup server: https://fedifinder-backup.glitch.me/

I am looking forward to your feedback (cc @illionas @ColinSch @botolo86) And to my bed. Good night.

Fedifinder

Fediverse accounts of your X/Twitter followings

First version of the new #Fedifinder. I redesigned the frontend to make it easier to use for people who are joining the #fediverse.

You can try it here: https://fedifinder-backup2.glitch.me/

Let me know, what you think.

Fedifinder

Fediverse accounts of your Twitter followings

@Luca The "Choose an instance" list is (I believe) not sorted by how many contacts you have on each server (I think it's approximately sorted, possibly based on the first batch of 1000 accounts?)

Might make sense to sort that after all batches are scanned.

@crschmidt @Luca Agreed about the sorting. I was hoping for a "connect to Mastodon...You are already following everybody/Here are the people you are not currently following"
@rbairwell @crschmidt it's sorted now, mastodon login will come back.
@Luca sieht gut aus und tut ... Mobil wirkt dir Account Liste sehr "unaufgeräumt"
Danke für Deine Arbeit!

@Luca sehr schick, geworden , dank dir dafür.

Einziger Bug, den ich gefunden hab: der Link zum Importieren in der Instanz funktioniert nicht, der wird falsch gebaut

@Luca Love it. 😍 Would it be possible and useful to sort the instances by number of my contacts? (I know, promoting popular instances even more, but an long unsorted list is hard to read.) Also, for newcomers: How about mentioning Mastodon as an example for a Fediverse-type network? And for the risk-averse some info (maybe just as a help popup link) on what authorizing Twitter to do this means in terms of security?
@wortfeld instances are sorted now. About modal explains how it works and some info about privacy.
@Luca Fantastic. Thanks for all the effort you put in!
@Luca I liked the list of all found accounts. I used it to unfollow all found accounts on Twitter. The old version is better for me. (But please add a target=_blank to the Twitter account links)
@kuschelkirche I will add them again.
@Luca Thank you for your great work! That's what really helped me and still helps me to move. Aaah, and the found accounts are also back as "your network in the fediverse" - I don't think they were there when I first checked version 2. :-) Put the Twitter links back and it's absolutely brilliant!
@Luca ah well the Mastodon-Links link to https://undefined/... in my case. I don't know if that's a failure on my side.
@kuschelkirche Was a bug. Should be fixed now.
@kuschelkirche Twitter links are back.
@Luca You are the hero of all Twitter migrants. Thank you so much!
@Luca the json export is fantastic cause the Twitter archive doesn't include your list members
@Luca don't know if you're already aware of this bug, but the lists array is pointing to null
@ilovecomputers After scanning lists?

@Luca yes

I scanned my followings, then all my lists

lists are null in export · Issue #151 · lucahammer/fedifinder

Find fediverse addresses in the profiles of your Twitter followings - lists are null in export · Issue #151 · lucahammer/fedifinder

GitHub
@Luca thank you!
@ilovecomputers Should be fixed now. Let me know if it still doesn't work.
@Luca yep I see it now. Thank you for fixing that!
@Luca Can it be, that I get results from outside the fediverse? Like @[email protected] (DB_Presse)
@elba013 Whoops. Looks like I forgot an if clause there. Will fix that tomorrow. Thanks.
@Luca Looks like it takes an e-mail address from description. Saw two cases in my list.
@elba013 they should be listed separately again. Fediverse handles and mail addresses can look exactly the same. I try to check each domain, but if it times out or has other errors I don't know if it's a server issue or not part of the fediverse.
@Luca I was unable to get it to work on my iPhone
@Fenix What error did you get?
@Luca I don’t remember exactly but I tried again, this time on my iPad & it did work.
@Luca @anthony This has been a tremendous help over the past couple of days. Thank you!
@Luca thanks for #fedifinder! It worked perfectly.
@Luca link to the settings for import is broken; shows up to me as https://fedifinder-backup2.glitch.me/%7B%7Bhandle.split('@')[2]+'/settings/import'%7D%7D
@annodomini @Luca same for me, link in step 5 returns the error “Cannot GET /%7B%7Bhandle.split(%27@%27)[2]+%27/settings/import%27%7D%7D”

@Luca I just tried using it (it’s really useful, but it didn’t work when I exported the CSV and tried to import it into Mastodon. It said that the foe “has contents that are not what they are reported to be”

I tried an export and there were 2 additional headers in the export that aren’t in your file:
* Notify on new posts
* Languages

Not sure if this is why. I’m on my phone right now so can’t properly check.

@Luca It looks like this was actually an issue with trying to do it on mobile - maybe the .csv was malformed by my phone. I just tried on desktop and it all worked fine
@Luca This is awesome. Thank you for building and shipping!
@Luca um... #BirdSite doesn't need any more data on me than it already has.
Hard pass
@ssb #fedifinder frees the data from Twitter. But whatever.
@Luca I used the earlier version a few hours ago, so this is a much better experience than before. I’m sure it’ll make easier for many more people to migrate!
@Luca There is an issue with the link at step 5, it mixes the name of your website and the actual link
@ericfreyss should be fixed now.
@Luca Seems to load a few instances, but then I get a blank screen sorry 😟
@ericfreyss I need to tweak the performance. When you wait for a moment and/or scroll around, it should work again.
@Luca thank you for Fedfinder 
@Luca not sure if anyone has reported yet, but the 'import your network' link is broken (at least for the instance i'm on). it's sending me to "https://fedifinder-backup2.glitch.me/%7B%7Bhandle.split('@')[2]+'/settings/import'%7D%7D"
@Luca Just got a code error, I presume you're changing stuff?
@Luca Works quite well, awesome. The import link is broken though.