Debugging our crawler right now
We are a software development studio from Austria specializing in creating exceptional digital experiences for businesses and brands.
| hompage | https://ghostbyte.dev/ |
| Socialfolio Profile | https://socialfolio.me/ghostbyte |
Ghostbyte Development
@ghostbyte
- 66 Followers
- 17 Following
- 48 Posts
Already found a bug which marked most Wordpress servers as dead. That are more than 4.000 servers, so the numbers should go in the right direction.
@krafting Thank you very much!
But as other people already mentioned, please don't take the numbers too seriously at this state. It is a very early state of development.
But as other people already mentioned, please don't take the numbers too seriously at this state. It is a very early state of development.
@crossgolf_rebel As we said in the post, this is not a finished product. The crawler isn't perfect yet. There are many edge cases the crawler has to take care of. Troll instances with fake numbers, robots.txt policies, handling DNS alias/redirects, ...
Daniel HiebelerI love all the creative Mastodon instance thumbnails😍
To initially fill the software table of the database we used the data in the "software.json" file of communityDB (FediDB).
The source code of all three repositorys is public now:
Crawler: https://github.com/ghostbyte-dev/fedisea-crawler
API: https://github.com/ghostbyte-dev/fedisea-api
We deployed the current version of FediSea. It is now available on https://fedisea.surf/
This is a very early version and is nothing more than the current development state.
Our platform Socialfolio reached the milestone of 200 registered users🥳
