My interview with @blaine, who was there at the very beginning of Twitter; now he's focused on building #fediverse infrastructure that will help #Mastodon scale. https://thenewstack.io/why-a-twitter-founding-engineer-is-now-all-in-on-mastodon/
Why a Twitter Founding Engineer Is Now All-in on Mastodon

Blaine Cook was there at the very beginning of Twitter; now he's focused on building fediverse infrastructure that will help Mastodon scale.

The New Stack

@ricmac @blaine the picture at the top looks awfully like it was from a Foo Camp or similar?

Thanks for the article, been a while since I thought about IPFS.

@ewj @ricmac it was! Social Web Foo or something, can't remember exactly which, but definitely at the O'Reilly campus.
@ricmac @blaine I happen to agree with this: “Many people would like to join a Mastodon instance that lets them open their posts up for indexing, so that we can search content on that instance — it’s good for topic tracking, monitoring news, etc.”

@JamesGleick @ricmac @blaine I'd argue that the safety of those who have historically been targeted by trolls using such indexing trumps that.

Of course being instance-specific lessens the impact but also the usefulness.

But rather than bend Mastodon into something it’s not designed to be the better question is “is Mastodon the right place for such discourse?”. The answer might be “no”, which is absolutely ok.

The web is not short of platforms, you may find one better suits that use case.

@JamesGleick @ricmac @blaine mastodon does not need to be, nor is it trying to be, all things to all people.

It’s a big internet out there 😊

@wiredfire @JamesGleick @ricmac totally. The caveat is that the fediverse (not even just federated microblogging) isn't just Mastodon, and we'd all be worse off if Mastodon ended up consuming all the oxygen there.

The time of centralized online "platforms" is over; we need to think about ecosystems, instead.

Rather than trying to control everything everywhere all at once, I'd love to see us tackle the question:

How can we all live happily and together with emergent complexity?

@wiredfire @JamesGleick @ricmac non-western approaches to understanding are key; we have a unique opportunity to apply lessons from so many incredible thinkers (James Scott, Elinor Ostrom, David Graeber, Suzanne Simard to name a few from the Western tradition – I am owning that I don't have a similar list from outside those folks to hand, and need to do better) and build a rich, diverse, and evolving future quite apart from the monopolizing trends of the past few decades.

@blaine @JamesGleick @ricmac agreed wholeheartedly. I only referred to Mastodon as the post above did, but you’re absolutely right that we need the fediverse to be more than Mastodon (in the same way we need web browsers to be more than Chrome / Blink / WebKit).

The more folk see that and start exploring the wider systems out there with excitement, instead of trying to make the one they’re on right now beaten to fit, the better 😁

@wiredfire @JamesGleick @ricmac @blaine

Exactly. No point building yet another platform/network, spexes based on a few hundred million people's comfort. Meanwhile around 7.5 billion potential users' critical needs would again be sidestepped.

"I would love for everyone to search in everything that I have tooted" = they have never been & are unlikely to become seriously bullied & have no marginalized near & dear = globally a minority.

@ronja @wiredfire @JamesGleick @ricmac I fully agree that we need to build networks that can adapt to the needs of *everyone*, not just the needs of rich white people.

That said, folks like @shengokai have been very vocal that things like QT are an important tool, culturally and liberationally, for (at the very least) Black people in America.

Similarly, white narratives have long overshadowed e.g. indigenous voices. "History is written by the victor" and all that.

@ronja @wiredfire @JamesGleick @ricmac @shengokai which is really just to say that *agency* is the important outcome here, *especially* for marginalized people who have historically been denied that.

In that sense, Mastodon's form being set (to use a gentle word) by a white European man is a real problem, even if he purports to speak for the wider "mastodon community."

I have faith we won't end up in that situation, though!

@ronja How about, “I would love for everyone to decide whether their posts can be searchable or not”? (And change their minds for any particular post.) Wouldn’t that work?

@JamesGleick

If and only if you figure out a way to 100% stop anyone, including global scale employers, child "protection" authorities in Texas, the police in Hungary, US antisemitist groups etc. from comparatively analyzing millions of posts. Then they can draw discriminatory, dangerous or just plain wrong conclusions about individuals of interest based on e.g. metadata: when they toot, how the length of their toots varies, where they appear to be tooting from...

@JamesGleick

TL;DR: if a feature can be used, including indirectly, for massive surveillance, for stalking an individual or group, or similarly harmfully, that feature should not exist.

@ronja I’m sincerely interested in this issue. I’m a Mastodon newbie. And I acknowledge that I’m a member of privileged groups that suffer less abuse.

Will you explain? If everyone has the ability to keep all their posts (or any, as they choose) invisible to search, how would the existence of the search feature make them vulnerable to stalking etc.?

@JamesGleick, forgive me for butting in. I’m a friend of @ronja ’s from way back on other platforms that were subject to persistent, abusive stalking and targeting of vulnerable people.

Say Alice runs excellent op sec so that Bob cannot stalk her and cannot search her posts, which are not indexed; all well and good. But Bob may have prior knowledge which may be able to establish Alice’s previous interests or connections, or provide a link to one of Alice’s friends or relatives, say, Carol.

@JamesGleick @ronja
Suppose that Carol doesn’t always think of protecting herself or others from stalkers; if Alice’s posts aren’t available to Bob, perhaps Bob will search through Carol’s posts which *are* indexed, for anything that might give him a clue about Alice.

Humans are social beings, so even if you’re targeted by abusive trolls, is the solution to go “deep stealth” and forgo all of your previous friendships and relationships just to avoid giving a clue to the trolls?

@JamesGleick @ronja

In some cases where there is a threat to life (e.g. domestic violence stalkers, overwhelmingly men) this is exactly what the targets do, and try to completely suppress all traces of their previous and current life.

So I do see a case for a platform like Mastodon giving the user control for what is searchable, with an opt-in model (use a hashtag if you want it to be searchable) rather than an opt-out model (if you don’t protect your posts then it gets indexed by default).

@JamesGleick @ronja

We know that trolls who become fixated on certain people go to incredibly elaborate lengths to search out every aspect of the victim’s life and try to exploit every possible weakness (either human failings, or technical) of the social systems we all deal with, to further harass and intimidate them. Online platforms like Twitter almost seem designed to help stalkers find their prey, rather than to prevent it. Anyway, that’s mostly what I wanted to say, besides: …

@JamesGleick @ronja Thanks for your books. When I was starting my undergraduate degree in physics, Chaos had come out the previous year and it was pretty much the hottest book circulating through the science/maths community, not merely for the subject matter but also the wonderful narrative pictures of the scientists piecing together the new science. I think my copy was more often loaned out for others to read than sitting on my shelves.

@xanthe_cat @JamesGleick

Thank you @xanthe_cat for taking the time to explain.

Did I ever tell you this back then?

During the siege that we experienced together, a senior member from the attackers' site sent me a message through non-public channels to tell that he had recognized my style of writing.

He basically wrote "I know it's you even though you have a different username." Considering that my abusive then-husband was also on his site, that sucked.

Hi @ronja, thank you – and no, I’m not sure you did tell me. Yuck. How incredibly creepy (after all this time I should *not* be surprised by anything that happened back then, but I always end up being slightly blindsided by how nasty some people can be). I’m also fairly certain I wasn’t aware that your ex was peripherally involved with that website. Double yuck.

Best solstice wishes from the summer climes to you and the family.

@xanthe_cat @JamesGleick

James, please read this. Cat Valente explains better than I can why so many of us multiply marginalized people are adamantly against features and policies that could lure fascists and/or commercial interests closer to our digital spaces.

TL;DR: It is impossible to extract vulgar capitalism style profits from genuine communities / inclusive public squares, and attempting to do so destroys the communities.

https://catvalente.substack.com/p/stop-talking-to-each-other-and-start

Stop Talking to Each Other and Start Buying Things: Three Decades of Survival in the Desert of Social Media

I bet you're wondering how we got here...

Welcome to Garbagetown

@xanthe_cat @JamesGleick

And please read also this toot and the thread it spawned. Defending users and instances from wannabe abusers, be they individuals, 8chan troops or state-funded disinformation farms, is necessarily a pattern recognition task (among all the other subtasks), in my experience.

https://weirder.earth/@MerlinJStar/109567077753389417

Merlin Star (any pronoun) (@[email protected])

Content warning: Quote Retweet Meta, Never used Twitter, Discusses Abusers

weirder.earth

@ronja @JamesGleick perhaps fedi gunk could have an export function that scrubs names? like people do with socmed screenshots they post to socmed.

we could standardise how to do that properly, making verifiable "stuff from someone" as the wider community.

@ronja @JamesGleick because there is some beautiful writing in here...
@JamesGleick @ricmac @blaine So long as we can block it. I don't want people searching to harass.
@suldrew @JamesGleick @ricmac yes, agreed. Consent is critical and must be central to the Fediverse model. @[email protected]'s work on capability-based communication in particular, an extension of her work on ActivityPub, will be important in this regard. In the meantime, though, we can 100% build search with explicit opt-in/opt-out semantics.

@JamesGleick @ricmac @blaine Not sure why that isn't a per user or per post thing.

I could default to index and then flag some no index or vice versa. Then I get to choose how findable my content is.

@JoeCotellese @JamesGleick @ricmac @blaine I am sure we will get there. The influx of folks getting into Mastodon will (as explained in the interview) lead to investment into features.

(@mozilla is going to launch (well, test) a public instance soon - it that's not a turning point I don't know what is..)

@ricmac @JamesGleick @matt @mozilla @blaine @JoeCotellese I’m afraid what will happen is that, e.g., Microsoft will produce a proprietary “Mastodon compatible” server software with lots of features like searchabilty. Then they will add extensions—the best features are only available from another Microdon instance. W/ enough market share, their support of the open source will become progressively more buggy…
@CDunnPasadena @ricmac @JamesGleick @matt @mozilla @blaine I don’t know, that’s not working out too well for IIS.
@JoeCotellese @JamesGleick @ricmac @blaine Isn’t that what ‘unlisted’ is for?

@keithwilson @JamesGleick @ricmac @blaine

I was assuming OP meant searching inside Mastodon.

When I first tried Mastodon my impression was - "This is dumb, why can't I search for anything."

Now, I get why some in the community want to mask their content but not everyone does.

So when I was referring to letting me opt into / out of my posts showing up it was within some mythical Federated search engine.

@JamesGleick @ricmac @blaine

I saw a post somewhere yesterday that public posts become searchable via Google.

On Google, you can enter:

site: instance keyword

to search an instance's public feed for a keyword. e.g.

site: sciencemastodon.com indexing

Far from perfect, and will always lag content by a while (until Google's crawlers find it), but potentially of use.

@JamesGleick @ricmac @blaine
Of course now I can't find the post...

@JamesGleick @ricmac @blaine

+1 and I think there is a lot of room for non-masto application categories that do interesting things with aggregation of activitypub-sourced content and indexes. It could allow you to eg create a river of news community that's basically links indexed from feeds based on topic etc.

@ricmac @blaine @redsage oh, wow. I really wish I’d been in closer contact with these guys fifteen years ago, when I first moved to the Bay.

I was deep into XMPP-pubsub at the time, while Blaine was pushing to decentralize Twitter with a similar protocol stack. It sounds like we’d have been intellectually simpatico.

Heck. Sounds like we’d get along today, too.

@ricmac also: thanks for writing this up! Fascinating reading =D

@ricmac @blaine

Wonderful article.

And I would love search. I'd kill for search. I've got my own little single instance server, and tried ElasticSearch, and it was ... bloat.

I envision keeping a long timeline since I find this shut a useful research nugget over time, and so I need search!

@blaine @ricmac Mastodon (and other federated platforms) do not need scaling. that should not turn into disgusting monster like twitter. there should me many small indfependent servers insterad of huge instances with thousands of users. that what decentralization is. and that what Fediverse should keep going. the way to globalization and centralization is a way to hell, paved with coproration interests. there go all that searches, etc. it is surveillance, it is targeting and data stealing, it is nothing good.
@iron_bug @blaine @ricmac But if we wanna onboard some billions of people more, does the federation also require some sort of scaling? Even if it would be many small instances. Pardon my ignorance, I don't know how the federation here works, do know XMPP and some other techs but new here.
@blaine @ricmac @antont nope. it ALREADY has the scaling in-built in its structure: it is decentralized. no centralization - no problems with "scaling".
@iron_bug @blaine @ricmac well if the network traffic is terrible flooding, like you said in the followup, I guess it does not really scale. But it’s great how well all this works already and maybe is in a good position for optimizations.
@blaine @ricmac @antont it does. just servers are written inoptimally. terribly inoptimally, really. and clients are even worse.
but even if all was written carefully the protocol anyway needs reviewing and updating. it could be much more optimal and save even more traffic.
@blaine @ricmac @antont imho, what Fediverse really needs is the reviewing and serious updating of the underlying protocol (it's too vague and does not cover the needs of the network, does not allow selective subscriptions, cross-server authorization and many other things) and optimize the network exchange. now the network traffic of Fediverse is a terrible flood cesspit. it can and it should be optimized for better throughput performance for real "scaling", in decentralized way.
@ricmac @blaine Random question: if Twitter federated NOW, might it manage to stunt the fediverse’s growth? Could it “embrace and extinguish,” by leveraging its scale?
@ricmac @blaine
“The project, called Bluesky, was turned into an independent company — albeit one that was reliant on Twitter’s financial support (it’s unclear what the status of that funding is today).”
… but I could make a guess at to whether Elon is keen on funding a/the Fediverse.
“We can use things like the IPFS network, host that content in essentially a BitTorrent-style way. So no one host will take the load of all of those requests […] We’re working on infrastructure that could be used in ways to help the fediverse scale.”
@ricmac @blaine I admit I have not yet read the article. I may edit this post after that. But on the face of it it is incongruous to say we have to do something extra to scale Fediverse;more so to focus just on Mastodon alone.
@ricmac @blaine ok, I have read this before. It is wrong to summarize it saying "focus on scaling Mastodon". It is clear the focus is on Fediverse.
@blaine @aswath I would suggest reading the article before criticizing it
True everywhere, on/offline: "One set of rules for sociality just doesn’t work,”
@blaine told @ricmac "There’s always going to be differences of opinion, so the federated model gives us the ability to have different communities...rules...cultures online. And that's just admitting there are humans in the loop, really.”
@annecollier @blaine @ricmac There is an amazing decentralised experimental social network called TAGGR. It's built on the Internet Computer and runs WASM. I really like it. https://taggr.top/.
TAGGR

@treb0r @blaine @ricmac Have heard of it too but still grieving the loss due to #twittermigration of my large, formerly vibrant community of researchers, educators and NGOs. It's not decentralized, is it? Is it anything like Post and Spill, other destinations for community dispersal?