Tech

Fixing data corruption in a PostgreSQL database running in kubernetes as a non-root container

I am running the Dependency Track application in my homelab microk8s cluster. One day I started seeing error messages on INSERT’s like this: ERROR: invalid page in block 3693 of relation base/16384/16531

Take note of the final number (16531 in my case), this is the file inode causing a problem. You’ll need this later.

A death in the (hardware) family

Looks like we had a death in the family yesterday 😢

My really old HP ProLiant MicroServer looks to have suffered either a fatal IO bus problem, or hard drive failure 🪦

I’m thinking IO bus more than HDD (yes, it is an HDD in there) because the whole server either freezes or reboots whenever it tries to read data....