• schizo@forum.uncomfortable.business
    link
    fedilink
    arrow-up
    4
    ·
    3 hours ago

    powered occasionally to hold data

    A bit more detail: simply being powered on won’t necessarily stop that.

    You want something checksumming the data and making sure it’s not silently rotting off the disk.

    ZFS does this, something like snapraid can do it too, and there’s various other methods of making checksums you can validate data integrity with and be able to repair minor corruption. (PAR files, for example.)

    A real-world example of this kind of oops is everyone’s favorite Youtube Tech Personality™ LTT who lost a fuck-ton of data due to not scrubbing data on a ZFS array and had to go through months of restoration to get most of it back, so uh, yeah, make sure you’ve taken steps to detect and correct the bitrot that’s going to happen anyways.

      • schizo@forum.uncomfortable.business
        link
        fedilink
        arrow-up
        1
        ·
        40 minutes ago

        Yeah, that wasn’t meant to be remotely comprehensive: there’s a lot of ways you can do this ranging from the filesystem to what kind of archives you’re storing, to programs that make parity data for validation.

        …also, since I haven’t started a flamewar yet today, I don’t think I’d personally use BTRFS. It’s still too new, has had data consistency issues too recently, and just plain doesn’t have the kind of historical performance record for something I’d want to use for archival purposes.

        Come back in another decade and we’ll see how it’s been going.