xDL ​Nov 20, 2022
@jerry Just curious, what are the server specs running infosec.exchange? This instance runs beautifully compared to some of the others.
Andr3Baca0 🐋Nov 20, 2022
Show threadJerry 🦙💝🦙
@xDL heh. Yes.
2 AMD 5950 16c/32thread 128GB ram with nvme ssds running sidekiq jobs
1 AMD 5950 16c/32thread 128GB ram with nvme ssds running elasticsearch and redis
1 AMD 5950 16c/32thread 128GB ram with nvme ssds running Postgres DB
2 AMD 5950 16c/32thread 128GB ram with nvme ssds running PUMA (mastodon web app) and nginx (only one is currently powered on - other is being reworked
1 AMD Epyc 32c/64th 400GB ram with 10TB of nvme ssd acting as a s3 storage provider and another nginx/PUMA web front end
Nov 20, 2022 at 5:28amWeb
Show threadxDL ​Nov 20, 2022
@jerry Fucking hell, thanks for the breakdown. Props for making this instance run so smoothly!
Show threadWaLLy3K ​Nov 20, 2022
@jerry @xDL Damn boi, cw that smut 😂​😄​
Show threadxDL ​Nov 20, 2022
@wally3k @jerry Got a solid laugh out of me. 😂​
Show threadITX MikeNov 20, 2022
@jerry @xDL Daaaaaaamn 🤯 That's a heck of a stack. #MastoInstance #MastoAdmin
Show threadJerry 🦙💝🦙Nov 20, 2022
@mspsadmin @xDL it’s finally keeping up - we had a major period of growth since Thursday and it absorbed the load without an issue.
Show threadxDL ​Nov 20, 2022
@jerry @mspsadmin Great job calling the growth. It's insane to think how much those boxes are getting slammed with all of the new people (including myself).
Show threadJerry 🦙💝🦙Nov 20, 2022
@xDL @mspsadmin that’s what they’re here for. I wanted people to have a decent landing spot. And I really didn’t want people’s first impression of the fediverse be skewed by bad performance.
Show threadxDL ​Nov 20, 2022
@jerry @mspsadmin Definitely the right call. I used Diaspora back in the day and the particular instance I was using slowed to a crawl after a small set of users. I'm sure it was due to a tiny box hosted in someone's basement.
Show threadQueNov 20, 2022
@jerry @mspsadmin @xDL lots of the fediverse seems to be suffering under the load of new arrivals. I’m impressed how well your stack is doing.
Show threadJin DiggsMar 10, 2023
@mspsadmin @jerry @xDL Yes, I wonder why he needs such ? What's the minimum for Mastodon ?
Show threadJerry 🦙💝🦙Mar 10, 2023
@jindiggs @mspsadmin @xDL at the time, we had 20,000 simultaneous connections hammering the environment. Since then, it’s fallen considerably (3000 simultaneous or so) and the footprint is smaller now, though I am having to expand it a bit again because it’s starting to lag again
Show threadJerry 🦙💝🦙Mar 10, 2023
@jindiggs @mspsadmin @xDL also, the minimum for mastodon is pretty small - can be run on a raspberry pi for a single user instance
Show threadKuma Chan 🧸Nov 20, 2022
@jerry @xDL you rent these from Hetzner?
Show threadJerry 🦙💝🦙Nov 20, 2022
@kumachan @xDL I do
Show threadKuma Chan 🧸Nov 20, 2022
@jerry @xDL nice. do you mind if I know how much your costs are?
Show threadJerry 🦙💝🦙Nov 20, 2022
@kumachan @xDL my bill for November will be in the $2500 range, which includes one time setup fees and other charges. Optimizing it comers next.
Show threadKuma Chan 🧸Nov 20, 2022
@jerry @xDL oh that's not bad given what you get for it. optimizing will really squeeze the cost I'm sure.
Show threadAdam BarnettNov 20, 2022
@kumachan @jerry @xDL https://wiki.infosec.exchange/about/operating_costs #ixwiki
Operating costs for infosec.exchange [Infosec.Exchange wiki]

Show threadWaLLy3K ​Nov 20, 2022
@dreadpir8robots Bookmarked, thanks!
Show threadAdam BarnettNov 20, 2022
I also made a start on the hosting history, @wally3k
@jerry has mentioned blogging about the serup, so I'm looking forward to that. I wasn't sure about one or two details but I hope what's there is accurate.
https://wiki.infosec.exchange/about/hosting #ixwiki
Infosec.Exchange hosting [Infosec.Exchange wiki]

Show threadxDL ​Nov 20, 2022
@dreadpir8robots @kumachan @jerry Another beautiful thing about this community--the transparency. No questions about ill intent or malice, just plain 'ol information. Thank you @dreadpir8robots on maintaining the wiki!
Show threadGòrdNov 20, 2022
@jerry @xDL That's some real nice hardware there :)
Show threadGreg Kutzbach Nov 20, 2022
@jerry @xDL It would be interesting to see the federated hardware stack running. That could help people understand the importance of their donated dollars.
Show threadJerry 🦙💝🦙Nov 20, 2022
@dasgrog @xDL that is a good idea
Show threadFerdinando SimonettiNov 20, 2022
@jerry @xDL may I share this info to others, non-technical, Mastodon users?
Show threadJerry 🦙💝🦙Nov 20, 2022
@rimmon1971 @xDL sure. Note that will be get out of date fairly quickly though, as i make changes
Show threadclarkeeNov 20, 2022
@jerry @xDL still so impressed that this is a single pgsql instance!
Show threadJerry 🦙💝🦙Nov 20, 2022
@clarkee @xDL the psql server is barely touched by this load.
Show threadJaxxAINov 20, 2022
@jerry @xDL the specs are a lot higher than I was expecting!
Show threadFriendlyMike Nov 20, 2022
@jerry @xDL howdy could you share how you do deployment/management. I aspire to have your type of setup someday. ♥️
Show threadJerry 🦙💝🦙Nov 20, 2022
@friendlymike @xDL “not well” is the current answer. I am moving more to ansible, but it’s fairly manual for the moment, though to be honest, most of what I’m currently doing isn’t ongoing ops, but rather refactoring and rearchitecting, so once that settles out, I will be codifying more into ansible playbooks
Show threadGreg Kutzbach Nov 20, 2022
@jerry @xDL Whats the backup infrastructure look like? What happens in a storage failure? What’s the RPO and RTO?
Show threadMatt Cameron Nov 20, 2022
@xDL @jerry WOW. Thank you for all that you do, Jerry!
Show threadbahuaDec 1, 2022
@jerry @xDL Holy balls. So, to support 34k users, you're paying(if my rough swings at hetzner's pricing are in the ballpark) thousands out of pocket per month for hosting alone. Are you able to recoup any of this?
Show threadbahuaDec 1, 2022
@jerry @xDL I ask because this has potentially terrified me away from starting a new instance.
Show threadxyhhxDec 23, 2022
@jerry @xDL woah
Show threadSass, DavidDec 23, 2022
@jerry @xDL You have no idea how fast #SharePoint would be running on these!
Show threadmoved - [email protected]Jan 25, 2025
@jerry @xDL what does this look like now?