- 1
Pool file duplication causing file corruption under certain circumstances
As this continues to be an important topic, I've pinned it and am summarising here:
- I've confirmed that enabling Read Striping can result in corrupted reads of duplicated files.
- On (newer?) versions of DrivePool the feature is apparently enabled by default.
If you cannot confirm your installation is unaffected you should ensure Read Striping is disabled:
- For each pool you have, open the DrivePool GUI, go to Manage Pool -> Performance -> make sure Read Striping is not ticked.
Shane, volunteer mod.
Question
Catch-22
I am using StableBit DrivePool and noticed that I am getting file corruption that is somewhat reproducible. I particularly noticed this with FLAC files as I was attempting to verify my library of music using flac -t which checks the MD5 signature of the decoded WAV file.
My setup is DrivePool with Folder Duplication enabled on specific folders, "Bypass filesystem Filters" checked, "Read striping" checked and "Real-time duplication checked".
Note that it appears to be "Read striping" that is the culprit for this but I am not 100% sure. Particularly concerning to me is that this happens even with "Verify after copy" checked.
Steps for me to reproduce are to download a FLAC to a DrivePool location that matches the above parameters, verify it with flac -t (ensure that it verifies OK), copy the file to a different location (doesn't even have to be a DrivePool location), verify this copied file with flac -t and see that the file does not verify anymore.
Checking with a hex editor, I can see it's not even just 1 byte difference, usually something like the first 32kb is fine, then I get random jumbled up data for a 128kb or so then the remainder of the file is correct (and the file size is correct).
Here's something I would never expect to see in a working filesystem:
Edit:
It seems I am not the only one running into this problem, see this recent Reddit thread:
21 answers to this question
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.