Hi ! I have this kubernetes cluster at home, to play around with. At some point, one of the machines' HDD died, and with it, all the data on it was lost.
The problem is that, even after multiple weeks, longhorn still hasn't registered that those replicas don't exist anymore. I deleted all of them manually to fix the problem... or so I thought, because I actually forgot one.
Today, the volume has become unresponsive. I think longhorn tries to connect to the non existent replica, and just can't do it. I've tried taking a snapshot, or a backup, but none of those work. I also cannot delete the replica via the UI (the button is greyed out), and trying to delete the replica resource from kubernetes via the command line is useless (it does nothing).
On the UI, the (non existent) replica flashes red with the "Failed" status, but is otherwise grey.…