Whoa: Weston, the reference compositor for #Wayland, supports multiple physical independent mice at the same time! 😀

"New mouse, who dis?"

(See toot later in the thread for how to set this up!)

There are couple of surprises around window interaction:

- Once a cursor starts to resize/move a window, those actions are not possible for the other one.
- One cursor can open a menu, and the other one can use it, that one works pretty well!
- Closing a window with one cursor, while the other drags it, makes the second one *disappear*! :D

I mean, these are really hard UI questions to solve! Often, it's not clear to me what the correct behavior should be!

Okay, let's try some applications, and see how they deal with multiple mice! 😈

First up: Gedit, a GTK application.

Both cursors can place the cursor and select text, but movement from one cursor "interrupts" the selection of the other one. Not very satisfying.

Imagine how cool it would be if both had their own selections + cursors!! That would allow a really neat form of collaboration within the same document!

Next up: Chromium! It has a very pragmatic solution: It just *ignores* all cursors but the first one!

In the video, the arrow-shaped cursor can click on stuff. The turtle has no power here.

In Firefox, it seems like all mouse events are mashed together, and are seen as coming from the same device.

That means that both cursors can click – if the other one "holds still". Otherwise, I guess Firefox is very confused by a click on a link while the mouse is not in it! 😆

Selections feel strange – the last-moving cursor will determine the selection.

Also notice how, if one cursor hovers a link, *both* turn into hand icons!

Of course, we *had* to try a drawing application next!

Here's @tldraw (in Firefox)! 

Collaborative drawing at it's best! 💚

Finally, I tried attaching an additional keyboard and assigned them to a different "seat"!

That worked really well! In Weston, each "seat" has its own keyboard focus, so you can actually work side-by-side with two mice + two keyboards independently!

Also!!! The two seats have their own (independent) clipboards!!!! Whatttt! 🤯

I totally didn't expect this. But multi-seat as a concept seems deeply integrated into libinput + #Wayland! Now it's up to GUI toolkits and compositors to support it!

Tried it again, and the independent clipboards still seem a bit glitchy after all… :(

An issue asking for proper support in GTK was closed five years ago, for example… https://gitlab.gnome.org/GNOME/gtk/-/issues/1574

Per-seat clipboard on Wayland (#1574) · Issues · GNOME / gtk · GitLab

Context On Wayland, all input devices (mice, keyboard, etc) are grouped into so-called seats, represented by the wl_seat interface....

GitLab
Side note: I think more window managers should support *this* feature!

Very useful when your very long line of code doesn't fit on your screen, for example! :P

(Shout-out to @xssfox, who first did this on X.org! https://sprocketfox.io/xssfox/2021/12/02/xrandr/)

Okay, here's how to set this up!

You need to create a udev rule for the "second" input device that sets ENV{WL_SEAT} to a string other than "default", and then start Weston from a virtual console. (At least, starting it from another Wayland session didn't work for me.) That's it!

The WL_SEAT property is what Wayland refers to as a "logical seat". Assign the same seat name to a mouse and a keyboard to make them work together! The default seat is "default".

Detailed steps:

1. Use `sudo libinput list-devices` to find the device file (like "/dev/input/event12")
2. Use `udevadm info -a /dev/input/event12` to find the parent device with a catchy ATTRS{name}.
3. Create a file /run/udev/rules.d/00-multiseat.rules like this:

ATTRS{name}="Name of your mouse" ENV{WL_SEAT}="second"

4. Run `sudo udevadm trigger` to apply the new rules.

You can check again with `sudo libinput list-devices`. The device's "Seat" should now say "seat0, second"!

@blinry have you by change tried if it also works with a monitor or GPU the same? I've a KVM integrated into the server mainboard and it would be great to put that onto it's own seat and have a dedicated GUI running there. Otherwise it always causes bad application behavior with graphics acceleration when it pics the wrong GPU to run on...
@agowa338 I *think* that's what the physical seats are for! ENV{ID_SEAT}. But I haven't tried it at all! https://www.freedesktop.org/wiki/Software/systemd/multiseat/
multiseat

@blinry I tried to use seats a few years ago, but documentation was shit. I never figured out how to properly configure them. I didn't even find that it was a udev rule thing back then.
Also a lot of people in forums and mailing lists told me that they're not even aware of that feature existing to begin with. (there wasn't a single one that know that this feature exists and also knew how it worked)
So at some point I just gave up on it.

Maybe it's time to check it out again by now.

@agowa338 @blinry that's always sad because people put a lot of time and effort making multiseat possible and having it be inaccessible due to poor documentation doesn't provide any value for the people who might find it useful
×

Very useful when your very long line of code doesn't fit on your screen, for example! :P

(Shout-out to @xssfox, who first did this on X.org! https://sprocketfox.io/xssfox/2021/12/02/xrandr/)

Okay, here's how to set this up!

You need to create a udev rule for the "second" input device that sets ENV{WL_SEAT} to a string other than "default", and then start Weston from a virtual console. (At least, starting it from another Wayland session didn't work for me.) That's it!

The WL_SEAT property is what Wayland refers to as a "logical seat". Assign the same seat name to a mouse and a keyboard to make them work together! The default seat is "default".

Detailed steps:

1. Use `sudo libinput list-devices` to find the device file (like "/dev/input/event12")
2. Use `udevadm info -a /dev/input/event12` to find the parent device with a catchy ATTRS{name}.
3. Create a file /run/udev/rules.d/00-multiseat.rules like this:

ATTRS{name}="Name of your mouse" ENV{WL_SEAT}="second"

4. Run `sudo udevadm trigger` to apply the new rules.

You can check again with `sudo libinput list-devices`. The device's "Seat" should now say "seat0, second"!

You could try this script (requires zenity & possibly more tools? Please read before running!) https://github.com/n3rdopolis/rebeccablackos/blob/master/rebeccablackos_files/usr/bin/configureseats

(Doesn't work on #NixOS, where /etc/udev is read-only. 💀)

I'd love to have a little command line helper tool to help set this up, for an arbitrary number of mice! :D

rebeccablackos/rebeccablackos_files/usr/bin/configureseats at master · n3rdopolis/rebeccablackos

Git mirror of the SVN for the fan made RebeccaBlackOS - n3rdopolis/rebeccablackos

GitHub

This was a fun afternoon! Thanks for following along.

Let me know which other programs I should try with multiple mice! :D

Looks like SDL (the multimedia library) very recently merged support for multi-seat input! https://www.phoronix.com/news/SDL-Merges-Wayland-Multi-Seat

So… many-mouse games should be possible on Wayland? :3

SDL Merges Wayland Multi-Seat Support

An interesting merge this weekend to the Simple DirectMedia Library (SDL) that is widely-used by cross-platform games and other applications for software/hardware abstractions is Wayland multi-seat support

@blinry that's awesome! Though I will point out that multi mouse support has totally been possible all along (even back in X11) if you use direct input device access instead of using input events from the windowing system. I played with that a bunch back when I was still making games in Crystal Space.
@blinry some kind of game? Not sure if any would support this. Needs to be developed!
@blinry please try Ardour and bespoke. Ardour uses its own flavor of gtk, if I understood correctly. Bespoke synth, idk.
Oh, VCV Rack would be interesting too. Imagine patching with collaborators. Like a real eurorack session.
@blinry Good thing! Random scripts writing things into system file is only creating chaos.

@blinry For NixOS, I think you could do this (just typing this on my phone, I hope it is correct but if not it should be close):

services.udev.packages = [
(lib.writeTextDir "lib/udev/rules.d/00-multiseat.rule" ''
ATTRS{name}="foo bar"
ENVS{WL_SEAT}="second"
'')
];

@blinry have you by change tried if it also works with a monitor or GPU the same? I've a KVM integrated into the server mainboard and it would be great to put that onto it's own seat and have a dedicated GUI running there. Otherwise it always causes bad application behavior with graphics acceleration when it pics the wrong GPU to run on...
@agowa338 I *think* that's what the physical seats are for! ENV{ID_SEAT}. But I haven't tried it at all! https://www.freedesktop.org/wiki/Software/systemd/multiseat/
multiseat

@blinry I tried to use seats a few years ago, but documentation was shit. I never figured out how to properly configure them. I didn't even find that it was a udev rule thing back then.
Also a lot of people in forums and mailing lists told me that they're not even aware of that feature existing to begin with. (there wasn't a single one that know that this feature exists and also knew how it worked)
So at some point I just gave up on it.

Maybe it's time to check it out again by now.

@agowa338 @blinry that's always sad because people put a lot of time and effort making multiseat possible and having it be inaccessible due to poor documentation doesn't provide any value for the people who might find it useful

@blinry @agowa338

Physical seats effectively signal "this is a different computer" except it shares some of the same hardware.

Logical seats effectively signal "this is a different person" so they share the environment but work independently within that environment (mouse, keyboard focus, etc).

Except sometimes a logical seat is a different *hand*, not person (because you may want left and right hand to work independently, hence two logical seats) and wheee, off into the rabbit hole we go.

@blinry @xssfox Oh, ironically I thought xssfox did it with wayland when I saw the images online at the time.
@blinry @xssfox oh noes...
Reminds me of a colleague who, after being told the rule of thumb that a function should not be longer than the screen, showed us that one of his his ultra wide monitors was in landscape mode 🙈
@DerPumu I'm a Java dev, but no
@robinsyl Yeah, in my Java times, I was glad for wider screens rather than taller ones 😜
@DerPumu but then you can't see the stacktrace
@blinry It's especially useful if you want to create flat smart surfaces where you want multiple people to interact with it at once, from their own corner of the table. Still kinda wish we would see some Microsoft Surface (the original one https://en.wikipedia.org/wiki/Microsoft_PixelSense ) but Linux based, it seems entirely feasible
Microsoft PixelSense - Wikipedia

@blinry I was struggling to come up with a single use case aside table top flat screens (like a mutltitouch table where people could be viewing from any angle)
@imikotoba @blinry Use red/green glasses so you can read text upside-down too?
@blinry I see the use case at a tablet / table, which is used by two different persons sitting next to each other.
@blinry …does this count? 😁
(Came back to my resized terminal window after it had been auto-migrated to the other screen by the window manager when changing screen layouts)