Elena Rossini on GoToSocial ⁂

I've spent 3 days combing through system logs... 1000% NOT recommended as a way to have a nice day ​

On the upside it's cool to see how comfortable I am moving around terminal. I always have a lot of fun with CLI ​

Oh the highs and lows of #MySoCalledSudoLife 🥲

In 10 minutes I leave the house to pick up my little one from pre-school and I look forward to the next few hours away from my computer. Bliss!

Mar 31 at 12:50pmWeb
Show threadcuan_knaggsMar 31
@elena and next up in elena's #MySoCalledSudoLife: graphana
Show threadElena Rossini on GoToSocial ⁂Mar 31
@mensrea stop tempting me please - especially now that I need to leave the house 😂​ Graphana looks SOOOO COOL 😍​
Show threadIrweneMar 31

@elena @mensrea Or graylog :D

Less visually appealing, but oh so great to aggregate and search.

Show threadpatproMar 31
@antoine_ali @elena @mensrea now we’re talking seriously!
Show threadpatproMar 31

@elena @mensrea grafana would really be my last recommendation if you need to search something in your logs. Very far behind ELK (even though I think ELK is terrible).
And I spend hours every week diving into logs, it’s a very important part of my job.

On the other hand, if you want to get some fancy graphs you can try grafana. But to be honest, even there, grafana won’t shine.

Show threadcuan_knaggsMar 31
@patpro @elena at a self hosting scale, a small script to pull the log files and drop them in sqlite is likely one of the better options. but my goal is to pull elena further down the rabbit hole
Show threadpatproMar 31

@mensrea @elena honestly, I self-host #splunk for my own needs.
I’m using it at home (free 500MB/day license) and at work (old enterprise perpetual license) for more than 12 years now.

It’s FREAKING good. I can’t find a decent contender in the #FOSS world for the enterprise version. For the free tier (striped down version without user profile, alerting, etc.), things like #graylog or #wazuh can be great alternatives.
Still, deployment of Splunk is super easy.

Show threadDr. FyzziksMar 31
@elena @mensrea There is no coming back once you start building custom dashboards in Grafana. Yet another rabbit hole. A very, very deep one 😆
Show threadElena Rossini on GoToSocial ⁂Apr 1
@drfyzziks @mensrea another one?!? 😂​
Show threadDr. FyzziksApr 1
@elena Sooo many! This is why after 16 years in my house, I still haven't gotten around to replacing the kitchen backsplash like I said I would in year 2... 😆
Show threadFranz GrafMar 31
@elena reading logs... So unsatisfying... Especially when you don't even know what you are looking for.
Show threadElena Rossini on GoToSocial ⁂Mar 31

@hikingdude precisely this! thank goodness for YunoHost's forum and some super kind people on here offering to help via DM. I feel very lucky.

Still, there's no way I can get these hours back, LOL 😅​

Show threadDr. FyzziksMar 31

@elena OK I totally feel your pain. I have spent so many hours combing through log files over the years too!

Here’s another free/useful tool: Visidata - https://www.visidata.org

You can think of it as a command-line spreadsheet for structured text files (log files, CSV, html, Excel & other formats).

For starters, it’s just a nice way to view the files. But you can also search them, drill down on specific fields for info, and even do fancy data-analytics.

Super-handy, and even works in tmux 😁

Open-source data multitool | VisiData

Command-line interactive multitool for tabular data.

VisiData
Show threadDr. FyzziksMar 31

@elena Visidata example:

Say you have a web server log file and one of the columns in the log shows the IP address of each visitor. You want to determine which IPs have visited your site the most.

Just put your cursor over the IP column and press shift-F to do a frequency analysis. It will count all the times each IP address shows in the logs, and then give you a bar graph showing your top visitors.

So useful!

Also it can load really, really large files without any trouble.