Shlee fooled around &ooh god. I've been meaning to move off AWS S3 for a while.... and now it's an absolute requirement
Check this madness out
DAMN YOU AWS NETWORK FEES! WHY DO YOU EVEN HAVE NETWORK FEES! AAARRGGHHH
Mike [SEC=OFFICIAL]@shlee hooooly shit man wow
VirtualWolf@shlee Oh fucking hell.
Leo 🌏🚀🔴@shlee do you have any good alternatives?
Darren Reid@shlee Cloudflare R2 is a lot cheaper for traffic, but since they charge by the request (same with AWS S3 really), I'm not sure how it will compare in aus.social traffic case.
@layoric I've got a few plans... and there are a other instances on R2 that are experiencing problems
Kind of a new service... so it's having issues like we are
@shlee yeah, building a new product on it myself as well. We've needed to implement retries for fetching data to hide some of the issues.. but every other cloud is so predatory with their egress fees.. 😢 happy to throw $50 to help with this month bill, let me know best place (highest cut goes to you).
@shlee confident you have it all covered with options, but available if you ever want to bounce ideas/options.
I've built fairly large projects (petabyte+ of queryable data) on AWS whilst (trying) to keep costs down, but also happy to be a rubber duck if you just want to voice trade offs 👍. Hope it all goes well!
dprk_ebooks@dprk_ebooks @shlee 😂 unless cache hit rate is super high, will still be paying a good chunk in AWS egress.
Maybe someone on aus.social has some rackspace in a data center somewhere where could run a minio instance? 🙏
Christopher Owen@shlee i was just thinking about this. It would be nice if there was a way for users to bring their own storage, even if they aren’t using their own instance
Voradams 
@shlee let us know if you need more to cover the instance costs
kauer@shlee what is on s3? And are you using cloudfront?
@kauer nope. this is just straight boring public S3.
@shlee definitely check storage class if you haven't already, make sure your buckets are in ap-southeast-2, and look at cloudfront because sometimes the fees for getting stuff to caching endpoints works out at less than the cost of repeated direct retrievals. And make sure your buckets don't have versioning enabled...
Cycling Stu@shlee Well, that is just rude!
Ada@shlee Are you covered for these costs by the existing patrons, or will this be out of pocket? That's full on
kofeyh@shlee 😬 oof.
Mike Honey@shlee Azure doesn't charge for incoming network data, AFAIK.
If you have an NFP, Microsoft offers USD 3,500 credits, per year.
If you have an NFP, Microsoft offers USD 3,500 credits, per year.
sochumpy@shlee you should setup a patreon or something dawg. happy to chip in
Justified Ancient of Moomin
Gus@sochumpy FWIW there is https://www.patreon.com/shleeau/ - can find the link on @shlee 's profile page and the @aussocialadmin profile. Let's all chip in, get them some of those gold plated fancy media servers!
dkam@shlee Phoar! You should checkout Wasabi or Backblaze
@dkam Yeah. Wasabi has a Sydney region, so that's the likely choice...
@shlee just be aware of Wasabi’s minimum 90 day object lifetime. If your uploads are staying for less than 90 days, it’s worth investigating another service. Backblaze or Linode’s object store maybe.
Most of our files are going to "forever".. Sadly backblaze/linode don't have a Sydney region.
Cefiar@dkam @shlee Makes me wonder if Jortage ( https://jortage.com/ ) would work for Aus sites, tho I suspect where it's hosted out of might just be too slow? That said, also makes me wonder if there are similar things out there too that are a bit more local.
dorkus malorkus 🧙♂️🪄@shlee 😳
might be time to update the patreon monthly goal (currently $50)
Nemo_bis 🌈@shlee Condolences. https://ashfurrow.com/blog/migrating-from-cloudflare/ recommended BunnyCDN.
Migrating From Cloudflare
Running a Mastodon instance requires at least one thing: a server somewhere to run the code and store media uploads. Since media upload storage is a common burden for servers, many solutions exist for upload storage. Mastodon can optionally be configured to upload media somewhere else. I use an AWS S3 "bucket" for…
@nemobis thanks. I'm going to be very happy when Bunny.net launch BunnyS3 and I can use them for all of my media.
Guy Morton@shlee using cloudfront? Have been wondering what hosting mastodon on aws might look like.
@guymo It'll look expensive. 
My S3 bucket network egress fees alone are going to be over $1000 a month (so I'm moving away)
@shlee would cloudfront help? 1TB of free egress per month https://aws.amazon.com/blogs/aws/aws-free-tier-data-transfer-expansion-100-gb-from-regions-and-1-tb-from-amazon-cloudfront-per-month/
AWS Free Tier Data Transfer Expansion – 100 GB From Regions and 1 TB From Amazon CloudFront Per Month | Amazon Web Services
The AWS Free Tier has been around since 2010 and allows you to use generous amounts of over 100 different AWS services. Some services offer free trials, others are free for the first 12 months after you sign up, and still others are always free, up to a per-service maximum. Our intent is to make […]
Funkpirata@shlee that's absolutely crazy increase wow