disconnectikacioApr 26, 2024

Auto kill memory leaking processes before swap death loop

https://lemmy.world/post/14718467

Auto kill memory leaking processes before swap death loop - Lemmy.World

I’m using linux mint 21.3, and a process (brave aka chrome) sometimes memory leaking, so eats all the RAM, and then linux goes into swap death loop, when everything freezes (sometimes the mouse cursor is moving), and nothing can’t be done, i can just see the HDD led blinking, and do a reset. Is there a way to make the system automatically detect swap death loop, and close the biggest ram user process, and so on?

Show threadShadowApr 26, 2024
Just turn off swap? You don’t really need it, and the kernel wiil just oom kill without it.
Show threadgnuhautApr 26, 2024

This doesn’t work to avoid thrashing.

On Linux, there’s a thing called the page cache (aka disk cache): Every time (part of) a file gets read to or written from, that (part of) the file gets copied to RAM. The file is then kept there unless that RAM is needed for something more important. It is cached in RAM. But since it is also on disk, the kernel can drop the file from RAM anytime it wants.

If you’re low on RAM, the kernel therefore evicts all the of the disk cache, because it can, because those pages can be reloaded from disk if needed. This means it will drop all the programs you’re running, the binary code. So any program you’re running is constantly interrupted, because its code is not in RAM.

So it runs a couple of instructions, but oh no! Call to function foo() from glibc, but guess what? That’s on disk. Queue wait for the kernel to load that. Oh now it wants function bar() from zlib, shit! Need to load that. Since loading stuff from disk is about as slow as running like a million instructions or something like that, all your programs now are like 1000x slower now.

This happens even with zero swap.

The correct advise is the one from @[email protected]: install/enable systemd-oomd or earlyoom.

Show threadShadow

Well that’s technically correct, but if you’re so dependent on disk cache for system performance that you can’t live without it then you really need to look at doing an upgrade.

When a box swap deaths, it usually struggles to actually fill swap enough to have the kernel still OOM kill it at any point. Generally the massive performance impact of swapping just slows the app down to the point of being useless, along with the entire rest of the box. Disk cache should not be a concern during these abnormal events.

Apr 26, 2024 at 5:26pmWeb
Show threadgnuhautApr 26, 2024

I’ll make an appeal to authority (kernel developer working on memory management):

Disabling swap does not prevent disk I/O from becoming a problem under memory contention, it simply shifts the disk I/O thrashing from anonymous pages to file pages. Not only may this be less efficient, as we have a smaller pool of pages to select from for reclaim, but it may also contribute to getting into this high contention state in the first place.

And then he goes on to say what I said, that it can make the OOM killer quicker to react.

chrisdown.name/2018/01/…/in-defence-of-swap.html

In defence of swap: common misconceptions

tl;dr: Having swap is a reasonably important part of a well functioning system. Without it, sane memory management becomes harder to achieve.

Show threadShadowApr 26, 2024
Interesting, thanks for the link!