Mastodawn

Solvena Aug 12, 2023

Have I been DoS'd?

Have I been DoS'd? - Lemmy.world

Hi, I know this is quite impossible to diagnose from afar, but I came across the posting from lemmy.world admins talking about the attacks they are facing where the database will get overwhelmed and the server doesn’t respond anymore. And something similar seemed to have happened to my own servers. Now, I’m running my own self-hosted Lemmy and Mastodon instances (on 2 seperate VPS) and had them become completely unresponsive yesterday. Mastodon and Lemmy both showed the “there is an internal/database error” message and my other services (Nextcloud and Synapse) didn’t load or respond. Login into my VPS console showed me that both servers ran at 100% CPU load since a couple of hours. I can’t currently SSH into these servers, as I’m away for a couple of days and forgot to bring my private SSH key on my Laptop. So, for now I just switched the servers off. Anyway, the main question is: what should I look at in troubleshooting when I’m back home? I’m a beginner in selfhosting and I run these instances just for myself and don’t mind if I’d have to roll them back a couple days (I have backups). But I would like to learn from this and get better at running my own services. For reference: I run everything in docker containers behind Nginx Proxy Manager as my reverse proxy. I have only ports 80, 443 and 22 open to the outside. I have fail2ban set up. The Mastodon and Lemmy instances are not open for registration and just have 2 users each (admin + my account).

Show thread

Solvena Jul 27, 2023

I have a decent CPU and GPU with 12GB VRam - this should let me run the 7B at least, from what I have seen in the sticky post.

Beside downloading the model, what kind of UI should I start with? Are there good tutorials around, that you are aware of?

Show thread

Solvena Jul 27, 2023

Thanks for the input!

I recently built a new PC to handle Stable Diffusion, that gives me 12GB of VRAM to work with. I also started to self-host a few things on a VPS recently, so I have a bit of a basis there.

As for Stable Diffusion integration: I do storytelling/worldbuilding as a hobby and find LLM’s to be an amazing tool to “brainstorm with myself”. It would be amazing if I could tell the LLM to “make a picture of the new character” and it would connect to and prompt SD accordingly. I assume that this is out of scope of what’s currently possible, but something like that would be my goal. I will certainly have a look at langchain as you proposed. Also that’s the context of me asking about cross referencing and context length. I’ve been working with ChatGPT, and while it is an amazing tool it had me bummed out when it couldn’t reference a character that was developed a couple hours earlier (even in the same thread). The cross referencing solution that you sketched above might work for me, but I guess it’ll take a while to learn how to do it.

Given this as a bit of context: where should I start? Downloading Llama 2 as another reply suggests and go from there?

Solvena Jul 27, 2023

How to get started? A number of questions ....

https://lemmy.world/post/2231664

How to get started? A number of questions .... - Lemmy.world

Hi there, If I’m looking to use LLM AI in a similar way like Stable Diffusion, i.e. running it on my own PC using pre-trained models (checkpoints?) - where would I start? If I would want to have access to it on my mobile devices - is this a possibility? If I would then later want to create workflows using these AI tools - say use the LLM to generate prompts and automatically run them on Stable Diffusion - is this a possibility? I’m consistently frustrated with ChatGPT seemingly not beeing able to remember a chat history past a certain point. Would a self-run model be better in that regard (i.e. will I be able to reference somethin in a chat thread that happened 2 weeks ago?) Are there tools that would allow cross-thread referencing? I have no expert knowledge whatsoever, but I don’t shy away from spending hours learning new staff. Will I be able to take steps working towards my own personal AI assistant? Or would this be way out of scope for a hobbyist?

Show thread

Solvena Jul 17, 2023

Yes, the final setup would be to run Adguard on a docker container and have this container be in a VPN. I’m not sure yet, how I would do that without massing up the other things already running on that VPS. Maybe I will go for Raspberry to run adguard at home.

Solvena Jul 17, 2023

What could be happening here? Question about DNS entries

https://lemmy.world/post/1616464

What could be happening here? Question about DNS entries - Lemmy.world

Hi there, I’m trying to set up AdGuard home and it doesn’t seem to work properly. Maybe I’m getting it wrong on how it’s supposed to work, but I’m kinda confused right now and it seems to me than Win11 is lying to me about my DNS entries … Here’s my setup: as I have a VPS server already, I wanted to try and use it for Adguard as well. Installation there was straightforward enough and I have it up running and it has a static IP that I would use now as a DNS server, routing my traffic through it. Now, all tutorials say that one should set the DNS entries on the router that connects to the Internet, but this option is not enabled on my router (more about this later on). I thought, no worries, I will deal with the router situation later and just see how Adguard works with a single computer. So I went into network settings of my Win11 machine and configured my IP settings manually. Gave me a fixed IP in my home network and used the static IP from my adguard server for DNS entries. But this didn’t seem to do anything. Still got ad’s everywhere although my Adguard dashboard showed a lot of blocked domains (clearly identifiable as ad-servers by their name). Ok, I went to troubleshooting and here’s the first weird thing I noticed: When I sutdown Adguard (as in stopping the docker container it’s running in on my server), I still can connect to the internet on my Windows machine. This shouldn’t be happening, no? I set both DNS entries (main and fallback) to the same IP, where no DNS server should be running and I still got to browse the web? So, is Windows lying to me and has a secret fallback DNS somewhere that get’s used when the entries don’t work? Do I not understand how this all should work? Or - and here my specific router/modem comes into play - my hardware get’s around DNS entries. I do have a “hybrid modem” which connects to the internet using both fiber DSL and LTE at the same time to get extra bandwith and speed. The customer support forum of my ISP revealed that due to the nature of this “dual line internet connection” DNS entries are fixed on the router and cannot be changed by the user. I still think the settings in Windows should take precedence, but admittedly I have no real understanding how this is all supposed to work in detail. So, question: how could I get Adguard to work on a VPS without being able to set DNS entries on my router? Would using a second router get around this (i.e. using the router of my ISP just as a modem and do my home network/wifi from this second router)? And why would Win11 still connect to the internet with supposedly broken DNS entries?

Show thread

Solvena Jul 15, 2023

thanky you, this looks like exactly what I need.

I do run several webservices (nextcloud, matrix) behind the same reverse proxy (nginx prxy manager). In my setup I have one docker with nginx running, which is the only one to be exposed to the web. It proxy-ing for the other services relies upon them being in the same network. It all works well, however I ran into problems when restarting my server after a shutdown. I suspect that some of the services tried to get the same ip adress as my nginx service, which results in that service not running properly and my whole reverse proxy setup falls apart at that point.

I’m not certain, that this is really what happens but I want to try and assign the fixed ip’s and see if that solves the problem.

Solvena Jul 14, 2023

Q: Docker container joining existing network with fixed ip (via docker compose)

https://lemmy.world/post/1484786

Q: Docker container joining existing network with fixed ip (via docker compose) - Lemmy.world

Hi, I figured out how to get docker containers to join an existing network with putting “networks” into the respective sections of the docker-compose.yml If I want to also give them fixed ip’s on this network, what would the syntax look like in the docker-compose.yml?

Show thread

Solvena Jul 14, 2023

thanx! I got it running now, not sure yet if federation is working, but at least I have my instance up and could register admin + standard user :)

Show thread

Solvena Jul 14, 2023

Which domain name should I put in the nginx configuration from Lemmy? My intended domain (like lemmy.my-domain.tld) or do I put some internal IP (e.g. 172.20.0.1) and point to that IP from my host nginx?