executive director @ #mit • office of research computing and data • long time high performance (#hpc) and scientific computing nerd • industry professionalization advocate for folks running gnarly research computing services (#rse, #aciref)
part time & forever chief marketing officer for https://micheleclamp.com
happy admin @ https://cuff.social • running on an awesome artisanally overclocked #raspberrypi
~20yrs as an expat brit in #massachusetts, #usa
🇬🇧 / 🇺🇸
| #key | https://keyoxide.org/[email protected] |
| #web | https://witnix.com |
| #git | https://drcuff.github.io |
| #tag | #hpc #linux #rse #green #foss #science |
Stumbled across a #fediverse viewer.
Calls API requests to find peers and builds an SQLite database.
https://github.com/H4kor/fediverse-explorer
Driven by:
async with session.get("https://" + instance + "/api/v1/instance/peers") as r:
https://github.com/H4kor/fediverse-explorer/blob/main/pipeline/instances.py
Found myself!
https://h4kor.github.io/fediverse-explorer/
Gives you a sense of peering in the network as size and scale.
Well the ncdu and the file sizes in the database track and match up.
I think the difference in the "file" (inode) count is literally the /120/124/123 hashing that's adding "file" count.
Yeah - this should have been an object store - POSIX is gonna get mad!
Yep - confirmed!
root@mastodon:/home/mastodon/live/public/system/cache/accounts# find avatars/ -name '*' -type f | wc -l
28056
root@mastodon:/home/mastodon/live/public/system/cache/accounts# find headers/ -name '*' -type f | wc -l
19719
To add to the thread, I keep 5 days of media attachments, it's cycling nicely at about 2.4GB. See attached, federated timeline is essentially "off".
However, let's talk about user headers and avatars for a moment. A quick ncdu shows 7.7G and 278,000 unique files.
Seems a lot.
The bit I don't understand is how there are only 30,000 accounts known to Postgres, but 280k avatar/header files.
This will require a bit more digging and head scratching.
So this post was pretty popular - thanks Kris, I've left you on copy hope that's ok, as some of the discussion has been interesting.
So last night, the little raspberry pi had moved only 690MB, @ 300kbit/s.
This one toot, (tooted nothing else since) was boosted ca. 50 times.
The stats are now 3.64 GiB, @ 575.10 kbit/s !!
At 38,500 frontend hits, It's shaping up to be the busiest day ever (see screenie)
Quick reminder this is data for
One. Single. Toot.
Interesting.
#mastodon as currently built may not scale as is - we should look carefully at these rapidly growing numbers.
I'm on the edge, and not even part of the main core.
I see 31.20 GiB of traffic over just a few days, for a single, one person instance, with tiny #'s of followers, and not much boosting.
It's a lot.
No wonder large instances are suffering!
Also ref proper experts, such as: @nova / @nova on medium:
https://medium.com/@kris-nova/experimenting-with-federation-and-migrating-accounts-eae61a688c3c
Software developers here are one step ahead.
Albeit multiple choice is a nice one! 🤣
Six months.
Yep. Six months of weird stuttery screen savers on the iTV thing.
It was plugged into “the wrong” video hole — the hole the sound bar company said I should put it in.
Audio holes, and video holes aren’t equivalent.
And the sound bar is now about 59F cooler for not having to process all the video hole data through the sound hole.
I’m way too old and tired for all of this.
Finally researching snow blowers for the winter with Michele.
This UX though…. It’s a lot.
Bit late with this toot. We’ve done plenty of standing rib roasts in the oven in the past. This year we did something radical, a three pound single boner, but on the grill with patented ripping hot middle grill, then side burner on low roasty action.
Michele made some roast spuds and parsnips to go with, I did grilled asparagus as the beef rested - It was delicious! Came out like a giant bone in, 48oz fancy ass steak dinner for two.
🇬🇧 doing #thanksgiving 🤣
You know it’s definitely the holiday season when the singing Christmas Tree shows up on the telly!
The first year we arrived in the 🇺🇸 we thought this parade was utterly bonkers. Every year it gets a little more, and we just can’t stop watching!
