I've spent 3 days combing through system logs... 1000% NOT recommended as a way to have a nice day β€‹

On the upside it's cool to see how comfortable I am moving around terminal. I always have a lot of fun with CLI β€‹

Oh the highs and lows of #MySoCalledSudoLife πŸ₯²

In 10 minutes I leave the house to pick up my little one from pre-school and I look forward to the next few hours away from my computer. Bliss!

@elena and next up in elena's #MySoCalledSudoLife: graphana
@mensrea stop tempting me please - especially now that I need to leave the house πŸ˜‚β€‹ Graphana looks SOOOO COOL πŸ˜β€‹

@elena @mensrea Or graylog :D

Less visually appealing, but oh so great to aggregate and search.

@antoine_ali @elena @mensrea now we’re talking seriously!

@elena @mensrea grafana would really be my last recommendation if you need to search something in your logs. Very far behind ELK (even though I think ELK is terrible).
And I spend hours every week diving into logs, it’s a very important part of my job.

On the other hand, if you want to get some fancy graphs you can try grafana. But to be honest, even there, grafana won’t shine.

@patpro @elena at a self hosting scale, a small script to pull the log files and drop them in sqlite is likely one of the better options. but my goal is to pull elena further down the rabbit hole

@mensrea @elena honestly, I self-host #splunk for my own needs.
I’m using it at home (free 500MB/day license) and at work (old enterprise perpetual license) for more than 12 years now.

It’s FREAKING good. I can’t find a decent contender in the #FOSS world for the enterprise version. For the free tier (striped down version without user profile, alerting, etc.), things like #graylog or #wazuh can be great alternatives.
Still, deployment of Splunk is super easy.

@elena @mensrea There is no coming back once you start building custom dashboards in Grafana. Yet another rabbit hole. A very, very deep one πŸ˜†
@drfyzziks @mensrea another one?!? πŸ˜‚β€‹
@elena Sooo many! This is why after 16 years in my house, I still haven't gotten around to replacing the kitchen backsplash like I said I would in year 2... πŸ˜†
@elena reading logs... So unsatisfying... Especially when you don't even know what you are looking for.

@hikingdude precisely this! thank goodness for YunoHost's forum and some super kind people on here offering to help via DM. I feel very lucky.

Still, there's no way I can get these hours back, LOL πŸ˜…β€‹

@elena OK I totally feel your pain. I have spent so many hours combing through log files over the years too!

Here’s another free/useful tool: Visidata - https://www.visidata.org

You can think of it as a command-line spreadsheet for structured text files (log files, CSV, html, Excel & other formats).

For starters, it’s just a nice way to view the files. But you can also search them, drill down on specific fields for info, and even do fancy data-analytics.

Super-handy, and even works in tmux 😁

Open-source data multitool | VisiData

Command-line interactive multitool for tabular data.

VisiData

@elena Visidata example:

Say you have a web server log file and one of the columns in the log shows the IP address of each visitor. You want to determine which IPs have visited your site the most.

Just put your cursor over the IP column and press shift-F to do a frequency analysis. It will count all the times each IP address shows in the logs, and then give you a bar graph showing your top visitors.

So useful!

Also it can load really, really large files without any trouble.