Porkbun

CalDav server (Baikal or anything similar, even Synology DSM has an app for it if you have a NAS), plus Davx5 if you're on Android, plus Simple Calendar.

I think it's not accurate to say you can keep them "forever" if you can't download a local copy