a common affordance in scifi is that spaceships can just video call each other, even spaceships of different races who have never met before. this implies that there is a sufficiently mathematically obvious RTC protocol that all spacefaring races eventually discover
„but halcy, the computer simply adapts the signal“ try piping an opus bitstream into chatgpt, see how that goes
„This situation where everyone uses their own protocol is ridiculous.“, says Alien A, „We shall develop one protocol that satisfies everyones ne-“ and before they can even finish, they are handed The Document. No one remembers where it came from originally, what the letters „XKCD“ mean, or the significance of the number 927
@halcy Just the idea of _having_ a protocol presumes that the various species have compatible visual perception. A human video stream isn’t going to make to a species that isn’t using RGB-sensitive receptors, no matter how it’s encoded.

@ttuegel @halcy Current tech yes, but there is no physics reason you can't have each pixel sampling the waveform from IR to UV with say 1000 samples and storing that. And it's what you'd want if really caring about colour rendering.

But yes, you are very unlikely to do that before encountering, and probably starting to staff species with different eyes.

I guess you might start doing it if people start bio engineering replacement eyes with exotic receptors.

@LovesTha @ttuegel @halcy will that work with dogs who use smell primarily, or consider insect societies run by pheromones.

@rrb @ttuegel @halcy it is my vision based bias, but I have trouble imagining those systems getting to space.

But yes, vision based communication is only vision :)

@LovesTha @rrb @ttuegel @halcy a species that "sees" with sonar might not realize that space is even there.

@ttuegel @halcy What if you didn't use RGB? Maybe they've all got full-spectrum cameras and can transmit the spectrum data. Or I wonder if there's some fancy signal processing way to produce a synthetic spectrum from an RGB-channels signal so you can convert it to a different-primaries color space.

This'd be a problem even on earth! Wolves don't have the same color receptors as humans, so if I ever somehow got to transition (I won't :<) I'd have issues with every existing display.

@ttuegel @halcy ... Apparently purple is weird. But it sounds like most everything else can be mapped to a wavelength.

I wonder how accurate such a mapping would be. I bet it'd fail for a bunch of stuff because it probably doesn't reflect one singular wavelength, just a mix that humans can't distinguish from that singular wavelength. Other critters with different eyes would be terribly confused.

Exactly.

"I wonder if there's some fancy signal processing way to produce a synthetic spectrum from an RGB-channels signal."

Can't be done, for mathematical reasons. If you pick only four different wavelengths out of the optical spectrum and amplitude-modulate each independently of the other three, you have a whole dimension of additional options than can be covered with the three RGB sensors.

Next, use 100 different wavelengths...

@IceWolf @ttuegel @halcy

@ttuegel @halcy

But is that truly the case? Couldn't RGB map comprehensively onto any trichromate system? (Cf space telescopes that work outside of the terrestrial visual range, but can nevertheless be made to produce imagery that makes sense to humans?)

Also, there are many cross-modality mappings that produce interesting & useful results. Print-to-speach being only one example.

@ttuegel @halcy
This is also why Klingon Birds of Prey are always so dim and red — they're actually brightly lit, for the Klingon visual perception, in the same way that our lights are (sometimes even today) three narrowband spikes in R, G, B
@halcy Especially since you know every single one of the aliens' protocols is so convoluted and hampered to be backwards-compatible with whatever that species' first audio-video display system was. The USS Enterprise has a VGA input on their big screen 1000%
@KolaMagpie conference rooms in intergalactic conference centers are, by volume, 10% seating area, 90% storage for adapters. and yet, the one you need is missing, for some reason
@halcy Exactly one person on the ship or station knows how to fix whatever problem the current conference is having (the problem changes each time); it's a matter of tracking them down and they'll be like "oh yeah I had that three years ago you gotta plug this into that first, /then/ connect your tablet and route the call through the /BOX/ not the tablet, and it should work fine :)"
@KolaMagpie @halcy trying to make a pun on Startech/Star Trek here but I got nothing
@KolaMagpie @halcy wherein VGA stands for Vulcan Graphics Adaptor?
@halcy how do you say "your certificate is out of date and needs to be updated " in Klingon?

@halcy Maybe the systems are just banking on everyone having figured out some product of primes and the systems sling a ton of zeroes back and forth until they figure out a common one and then things get all weird for a few frames until it can figure out the light and dark sums of channels as things move around in the hi-res signals and then try to figure out the rest based on how many channels there are.

Meeting a new species is understood as everyone waving their arms around a bit and being weird and purple for a few seconds and then everyone just pretending it never happened. XD

@bluestarultor @halcy Everyone knows you start by showing a feed of the brightest star visible from the current location, it is the obvious sane way to calibrate streams.

@bluestarultor @halcy

I would love to see the VFX implied by this. Some skiffy production should really have a go at it. It'd be a marvelous opportunity for some stealth math education.

(Why does Darmok suddenly leap to mind?)

@cavyherd @halcy I feel like "Darmok" failed to anticipate Wikipedia. As a writer with some sci-fi in the works, it's reasonable to expect anyone with interstellar travel down is going to have a digital encyclopedia. Leeloo uses this method in The Fifth Element to rapidly update herself on everything leading up to her breakdown over learning about war, but it's a solid tactic. And something analytical A.I. would actually be good for to rapidly identify parallels in language. I mean yes it would burn down a forest, but if you can start with some concept of, say, "dog," you have domestication, carnivores, pets, friendly behaviors, probably agriculture, etc. Building that web would get you started on basic concepts. Would it be rough? Absolutely. But it would be a start.

@bluestarultor @halcy

My reference to Darmok is less about the story element of the language decoding than the way the story is structured to bring the audience along while the characters work out the puzzle.

Structuring a story to display the process you describe in the 1st paragraph of the reply I resonded to could be a lot of fun for at least one episode. (Though I imagine subsequently it'd just be implicit, in the way the transporter was first introduced, & then later just assumed.) >

@bluestarultor @halcy

There are a lot of critiques that could (& have been) made about the primary conceit in Darmok.

But as a piece of story-telling that also carries the viewer along through the experience of solving the puzzle, I found it to be a delight.

@cavyherd Ah, yeah, now that you spelled it out I see exactly what you mean. XD

@bluestarultor

Oh grumble. Now I really really wanna see somebody do that.

I mean, I love the comms hook-up conceit, but it'd be so much fun from a production standpoint to play with that.

@halcy

In Star Trek, the Universal Translator translates speech between aliens with entirely different frames of reference (e.g. humans and sentient gas clouds). Presumably it’s also doing some false-colour magic to video streams that come from species with totally different visual perception. Next to that, decoding some data stream that you already know is a video feed seems quite easy.

@halcy

Okay, this legit made me LOL. I'm surprised I didn't scare the guinea pigs.

See also: "The beautiful thing about standards is that there are so many of them!"