Jerry 🦙💝🦙Dec 16, 2022
Now at 1700 new accounts on the day @infosec.exchange. This is what it looks like on the load balancer:
Show threadJerry 🦙💝🦙Dec 16, 2022
And this is what's happening at the CDN:
Show threadJerry 🦙💝🦙Dec 16, 2022
And this is what the aggregate CPU on the PUMA servers look like (note, almost no change)
Show threadJerry 🦙💝🦙Dec 16, 2022
And this is the aggregate load on the sidekiq servers (also, nearly no change)
Show threadJerry 🦙💝🦙Dec 16, 2022
Transaction growth on the postgresql database:
Show threadJerry 🦙💝🦙Dec 16, 2022
CPU on the redis/elasticsearch server. I can barely find it:
Show threadJerry 🦙💝🦙Dec 16, 2022
final graph (I don't have much else that would be interesting) is the sidekiq graph:
Show threadJerry 🦙💝🦙Dec 16, 2022
I lied. One more. I feel bad that I am just now realizing I didn't tell Prometheus to monitor the load balancer, so here is a snapshot of nmon from the load balancer:
Show threadVissDec 17, 2022

@jerry kinda surprised you dont have a giant linux terminal with:
- htop
- nload
- iftop
- atop
- ioping

and prolly asciiquarium and cmatrix for good measure :D

Show threadzeno's paradox speedrunner

@Viss @jerry https://nicolargo.github.io/glances/

tho it can be a little heavy

Glances - An Eye on your system

Glances is a cross-platform curses-based system monitoring tool written in Python.

Dec 17, 2022 at 12:00amWeb
Show threadJerry 🦙💝🦙Dec 17, 2022
@pixelnull @Viss oh that looks amazing
Show threadzeno's paradox speedrunnerDec 17, 2022

@jerry @Viss it has a package avail for most distros.

i wouldn't do a github or pip install for it, they can get a little experimental with releases in my exp

Show threadVissDec 17, 2022
@pixelnull @jerry oh yes! glances! i always forget about glances. You need a big terminal for it tho
Show threadJerry 🦙💝🦙Dec 17, 2022
@Viss @pixelnull I have two 43" monitors 🎉​
Show threadVissDec 17, 2022
@jerry @pixelnull heh, i excitedly await the screenshots :D
Show threadzeno's paradox speedrunnerDec 17, 2022
@Viss @jerry nono take a picture of the monitors with your phone... make sure to brush your teeth in front of them tho. they need a bunch of gunk on them
Show threadVissDec 17, 2022

@pixelnull @jerry

brew install glances

Show threadaburka 🫣Dec 17, 2022
@Viss @pixelnull @jerry brew is always like "ah, if you wish to install an apple pie you must first install the universe"
Show threadVissDec 17, 2022
@aburka @pixelnull @jerry hah, yeah
Show threadCompuguy 🐱Dec 17, 2022
@aburka @Viss @pixelnull @jerry Yep, though I would 1-up you and say that trying to deploy software that still uses Python 3.6 & Pipenv is much worse....trust me!
Show threadzeno's paradox speedrunnerDec 17, 2022

@compuguy @aburka @Viss @jerry

python packaging is a dumpster fire, nestled in a tire fire, that is then placed in a high-rise apartment building fire.

a fire-turducken as it were

Show threadCompuguy 🐱Dec 17, 2022
@pixelnull @aburka @Viss @jerry Yep, but that's what the developers I work with use. That and Node/NPM. I call it "Dependency Hell"....
Show threadzeno's paradox speedrunnerDec 17, 2022

@compuguy @aburka @Viss @jerry normally, i'm all like "fuck it throw in the whole [python current version] and all the libs with it"

60Megs for a small script? sure why not

Show threadCompuguy 🐱Dec 17, 2022
@pixelnull @aburka @Viss @jerry That actually exists. Its called PyInstaller. Works great unless you have to use a *really* old OS like I don't know.....CentOS 7. Curse you GLIBC 2.17!
Show threadzeno's paradox speedrunnerDec 17, 2022

@compuguy @aburka @Viss according to my org, CentOS 7 is cutting edge

*cries*

Show threadCompuguy 🐱Dec 17, 2022
@pixelnull @aburka @Viss We have the option to use RHEL 8.....though certain people think its SELinux is different than CentOS....ugh...🙄
Show threadzeno's paradox speedrunnerDec 17, 2022

@compuguy @aburka @Viss we don't really use linux much in our environment, we have no dedicated linux admin. i had to beg for them just to get RHEL instead of CentOS

also i would like to take this opportunity to say how much i hate RHEL/Cent as a distro

Show threadVissDec 17, 2022
@pixelnull @compuguy @aburka i quit redhat when they split to fedora way back when, and went to debian. then ubuntu. apt is just so much kinder to people than rpm and yum
Show threadzeno's paradox speedrunnerDec 17, 2022

@Viss @compuguy @aburka arch and more manjaro are my go to now.

yay is too good, it's addictive and does literally everything i need before i know i need/want it

Show threadCompuguy 🐱Dec 17, 2022
@Viss @pixelnull @aburka Yeah I'm a Ubuntu & Debian person. Unfortunately I don't have that option at $job. Its CentOS or RHEL...🤷‍♂️
Show threadJustin KnoxDec 17, 2022
@pixelnull @compuguy @aburka @Viss @jerry fire turducken. And that’s a follow. Cheers!
Show threadCompuguy 🐱Dec 17, 2022
@jerry @Viss @pixelnull NICE! You got a mini-NOC there 😎
Show threadJerry 🦙💝🦙Dec 17, 2022
@pixelnull @Viss yeah, I will play with it on other systems before curl $randosite |bash on the load balancer
Show threadzeno's paradox speedrunnerDec 17, 2022
@jerry @Viss it's literally in my first install on my systems, i mean in a long chain of other things
Show threadWaLLy3K ​Dec 17, 2022

@pixelnull @jerry @Viss Piping to bash is convenient, but not a great option if you're wanting to do it on a prod box.

https://www.idontplaydarts.com/2016/04/detecting-curl-pipe-bash-server-side/

Detecting the use of "curl | bash" server side | Application Security

Another reason not to pipe from curl to bash. Detecting curl | bash serverside.

Show threadVissDec 17, 2022

@wally3k @pixelnull @jerry

curl hax.lol

you can also do it with apache rewrite rules by detecting the user-agent.

Show threadRallias  Dec 17, 2022
@Viss @wally3k @pixelnull @jerry I disclaim any relationship with this website.
Show threadVissDec 17, 2022
@rallias @wally3k @pixelnull @jerry good, cuz i own it :D
Show threadRallias  Dec 17, 2022
@Viss @wally3k @pixelnull @jerry I approve, I just disclaim relationship.
Show threadVissDec 17, 2022
@rallias @wally3k @pixelnull @jerry if you hit it in a browser its a bit more colorful. if your browser is old enough itll play the goat simulator theme :D
Show threadRallias  Dec 17, 2022
@Viss @wally3k @pixelnull @jerry With that website name, I'm not sure I want to load it with an old browser, no offense.
Show threadzeno's paradox speedrunnerDec 17, 2022

@rallias @Viss @wally3k @jerry

do it. this is me bullying

Show threadVissDec 17, 2022

@pixelnull @rallias @wally3k @jerry their loss :D

i use it at every con for a harmless kiosk bypass payload

Show threadRallias  Dec 17, 2022

@pixelnull @Viss @wally3k @jerry Ok, fine, I did it in a VM...

Erm...

Show threadVissDec 17, 2022

@jerry @pixelnull if you want some fun lolballs,

curl hax.lol | bash (on a mac)

or just curl hax.lol to see the bullshits :D

Show threadVissDec 17, 2022
@jerry @pixelnull (i havent tested this in actual years, it used to work, but that was several versions of osx ago)
Show threadCompuguy 🐱Dec 17, 2022
@pixelnull @jerry @Viss That's Python virtualenv exists..so you don't firebomb your OS's python! 😹
Show threadzeno's paradox speedrunnerDec 17, 2022
@compuguy @jerry @Viss yeah it's better a s a package so venv isn't needed
Show threadviqDec 17, 2022
@pixelnull
Wait till you see https://github.com/aristocratos/btop
@Viss @jerry
GitHub - aristocratos/btop: A monitor of resources

A monitor of resources. Contribute to aristocratos/btop development by creating an account on GitHub.

GitHub
Show threadVissDec 17, 2022
@viq @pixelnull @jerry WHOOOAAAA
Show threadVissDec 17, 2022
@viq @pixelnull @jerry IM INSTALLING THIS RIENOW
Show threadVissDec 17, 2022
@viq @pixelnull @jerry wuh, the colors on osx leave a bit to be desired, but i bet you can tweak them
Show threadzeno's paradox speedrunnerDec 17, 2022
@viq @Viss @jerry i like btop, but glances is better for servers with it's webui and api (esp for grafana)
Show threadviqDec 17, 2022
@pixelnull
Webui and API you say? https://github.com/netdata/netdata
@Viss @jerry
GitHub - netdata/netdata: The fastest path to AI-powered full stack observability, even for lean teams.

The fastest path to AI-powered full stack observability, even for lean teams. - netdata/netdata

GitHub
Show threadviqDec 17, 2022
@pixelnull
Wait, viewing data from glances in grafana? How?
@Viss @jerry
Show threadzeno's paradox speedrunnerDec 17, 2022

@viq @Viss @jerry glances is a server daemon for performance stats, it doesn't need the front end in a terminal to run

https://grafana.com/grafana/dashboards/2387-glances-for-flux/

Glances | Grafana Labs

A Glances dashboard for Glances + InfluxDB2

Grafana Labs
Show threadviqDec 17, 2022
@pixelnull
That sends to InfluxDB, apparently there's also Prometheus exporter built in https://glances.readthedocs.io/en/latest/gw/prometheus.html
Interesting 🤔
@Viss @jerry
Prometheus — Glances 3.3.0.1 documentation

Show threadzeno's paradox speedrunnerDec 17, 2022

@viq @Viss @jerry yeah glances is a must for me, i don't ever use any *top programs in lieu of it.

the only downside is that it's a little heavy, but it's not too bad. if there's a performance issue and i want to diag it with little resources i'll just use top which is build in to every (?) distro

Show threadviqDec 17, 2022
@pixelnull
Yeah, top is mostly everywhere, though it's not necessarily same top on say Linux and *BSD.
On the other hand, I'm not sure how much btop would be able to get on *BSD
I've somewhat moved from glances to btop, though i look at glances sometimes as well.
I need to finally set up properly Prometheus 😅
@Viss @jerry
Show threadJerry 🦙💝🦙Dec 17, 2022
@viq @pixelnull @Viss that looks really sweet