current debian no longer writes to syslog 😦

if you look in /var/log, someone left a README file.

the README says "you are looking for logs? but you cannot find them?" and continues in broken english, smugly telling you that systemd has made logs obsolete, and you should use "journal cattle" to ask politely for your own logs.

[did you just tell me to fuck off, jim?]

if you run journal cattle, it shows a page of syslog from april. if you hit G to go to the end, it hangs forever.

[slow clap]

@robey You’ve been Potteringed!

@jgeorge @robey

I recently started using FreeBSD on my desktop and I was smugly bragging about not needing pulseaudio anymore until one day I discovered that Firefox actually starts it on demand. I've been Poetteringed too!

Build your Firefox from ports! It's a compile option there (enabled by default, unfortunately, so pkg pulls it in) so you can presumably avoid dealing with that bit of shovelware in exchange for a few hours of compile time -- well worth the trade in my opinion.
@sam I'll try it out when I get back if I can enable OSS support. Although I'm slightly scared that either there's a reason OSS isn't the default in the port, and/or that the frequent browser updates means too much recompiling.
I don't actually use Firefox on that box (qutebrowser has too great a UX lead on Tridactyl), so I can't speak to the experience itself, but the audio options section says OSS is always enabled. There are flags for ALSA, jack, Pulseaudio, and sndio (ALSA the only one disabled by default, if I remember correctly), but they're additional rather than replacements. Definitely makes me wonder/worry why they're on by default, too.
@robey @buherator Sucks, but (re-)installing rsyslog should help. Otherwise tune /etc/systemd/journalctl.conf to your liking. (Because of course there’s no log rotate for it otherwise.) also, -b, or --since are handy. But I agree, LennartOS is too intrusive. (Also: /etc/fstab is a lie. Systemd generates mount units from it, and then uses those to mount stuff.)

@robey I despise "technologists" like whomever that smug fucking asshole was.

It's why I despise Rust: My 1st Rust experience were the smug dickheads that write the Python cryptography library going from C to Rust and giving sysadmins smug fucking answers when they broke everybody's builds overnight... at the time IBM Z didnt have a Rust compiler and the crypto people said that anyone without it was a "legacy" platform nobody cared about and that their "quest for memory safety" trumped all else

@robey Took me a while but I'm starting to like journalctl over the plain logs.
journalctl-cheat-sheet : Hal Pomeranz : Free Download, Borrow, and Streaming : Internet Archive

One-page cheat sheet for the Linux journalctl command. Targeted at DFIR professionals.

Internet Archive
@hal_pomeranz i bet that would be useful for people who want to use journalctl instead of less
@robey I’m as much against systemd scope creep as the next person, but the systemd journal is actually a significant improvement over traditional syslog style logs.
@hal_pomeranz my favorite significant improvement is about to turn 7: https://github.com/systemd/systemd/issues/2460#issuecomment-2408617734
Showing status of service via systemctl is slow (>10s) if disk journal is used · Issue #2460 · systemd/systemd

With big (4GB, few months of logs) on-disk journal, systemctl status service becomes very slow (!) [13:37:30]:/var/log/journal☠ time systemctl status nginx * nginx.service - A high performance web ...

GitHub

@hal_pomeranz @robey No, I'm not sure that it is. At least not from the context of a single machine administrator.

The accessibility of my logs has been changed; I can get the logs in traditional time order, oldest at the top, as long as I wait an unpredictable amount of time for 'journalctl' to do its job. Over 2 minutes for this little single-user machine that was only installed a couple of months ago. Nice. I don't know how to ask "how big is the log" before querying it, where I'm used to using 'ls -l' to look at text files.

Or I can get the latest logs instantly with 'journalctl -r', didn't know about that one because I don't need to fix a problem more than I need to complain about my aching knees. But when I get my results, they're in the opposite sequence order to the logs I'm used to seeing, which causes delays in understanding the content.

(I'm not saying that I'm not used to seeing events in that order, just that I don't see that in the context of text streams that look the same as file contents, for good reason)

If you have a bunch of related machines to look after, the absolute last thing you should be doing for logging is looking on the individual machines, you should be streaming log events out over the network to a trusted location. Throw them into an Elastic, or a Greylog, or something like that; and now log events become "a database of events" rather than "a sequence of events". Put your efforts into centralised logging, rather than messing around on the machine itself (unless of course, you're investigating why logging isn't going to your central point, in which case ...)

@yojimbo @robey apt install your favorite syslog package and your preferred log style will return

@robey @hal_pomeranz @phessler I unfortunately had reason to dig into this situation recently. journalctl actually invokes less(1), but with a set of non-default flags, and also in a way that honors a config variable other than the ones less(1) usually consults.

https://mastodon.social/@gnomon/112565743587893108

It's a ludicrous situation but you _can_ convince journalctl to give you a vanilla less(1) experience, if you fight hard enough and keep reading the changelogs to stay ahead of future breakage.

👎

@robey @hal_pomeranz @phessler I'm just glad that relying on the journal is the default but not the only option. Syslog, logrotate, and all the usual log indexing tools remain one apt-get away, and my systems still work exactly the way I want them to.

But that systemd attitude, man... I just have zero patience for it.

@gnomon @robey @phessler

export SYSTEMD_PAGER=cat
journalctl … | less

@robey journalctl -r is your friend.
@robey use journalctl -b 0 (That's for the current boot, -1 for the last boot etc) you can also do journalctl -n 100 to see the last 100 log lines.
@robey It is the smugly tone, isn't it? I really wanted to give systemd a chance. The documentation points you to the blog posts of a particular systemd developer, and these posts are filled with snarky comments directed towards anyone having the audacity to dislike the tiniest bit of that software. I did not enjoy reading that.
@robey When it comes to systemd, Slackware will never give you up - or let you down! 
@robey Debian 12 was released in 2023-06-10. If you do a clean install and choose only gnome, you will indeed get an installation without rsyslog. If you don't have a Debian system at hand you can see package list, disk image and installation screencast at https://lindi.iki.fi/lindi/debian12/desktop/debian-installer/ . In the disk image you can see that README is not a file but a symlink pointing to /usr/share/doc/systemd/README.logs. This allows you to find it from git any send any grammar fixes upstream.
Index of /lindi/debian12/desktop/debian-installer

@robey fun fact:
You can install Debian stable without Systemd.
It takes a bit of doing but it works fine. There's also Devuan for not-reinventing-the-wheel.

All of which is to say "yes, that effing sucks, and I am really sorry you're dealing with it. For the use case where you have the option, a few reasonable choices exist and are fine."

@robey reminds me of local hackerspace IRC bot having a line for systemd mentions which translates to "journald? Where are my logs dammit??"
@robey so much for stability huh
@robey
Yes. I was less than impressed by that when I rebuilt my server this week.
The Ubuntu I left behind was not like that