Jump to content
  • 0

DrivePool file corruption


mhendu
 Share

Question

I have DrivePool installed on two computers - one where I've had it installed for quite a while with no issues, and another where I just finally migrated from FlexRaid pooling. I have the SSD Optimizer plugin installed but am using it to cache files on a regular 3 TB hard disk before moving them to my array (the other drives, but not this disk, are still set up with FlexRaid transparent RAID to provide some protection via parity).

Although the speed of this pool is much quicker than with FlexRaid, I'm running into some disturbing file corruption issues. I've compressed a few movies with StaxRip and the resulting file, when placed on the pool, will have corrupt sections (note this is on the 3TB cache drive that is not set up with FlexRaid). Some of the movies worked fine when muxed to the cache drive, but then when file balancing runs they'll get corrupted when they get moved to a different drive in the array. This makes the product unusable.

Any help would be appreciated.

 

Link to comment
Share on other sites

3 answers to this question

Recommended Posts

  • 0

I have not experienced your specific problems, but I have a few things I might try.

You might want to turn on the verify after copy option. Goto Settings Cog>Troublshooting>Verify After Copy. This feature is normally turned off because it will slow down your system. However, in your case with suspected bad copies, it might be worth it to check out that feature.

I use the free program MultiPar to create .par2 files for file verification and rebuild. In your case, you would tag the movie file, or folder, and create .par2 files. When you run MultiPar on the .par2 file, it will verify if the original file is intact or if it has been damaged. If damaged, it will attempt to repair the file(s) with the .par2 files you created. You can adjust the % of .par2 files for rebuild anywhere from 0% (index only) to 100% complete blocks for total rebuild. I have my MultiPar set to 10% .par2 files which is enough to verify the file(s) in the folder and will rebuild some damaged and lost files.

Of course, I would recommend a good offline backup plan. If your files become corrupt, and MultiPar cannot rebuild the damaged files with the .par2 files you created, then you can pull the backup files and reload them.

I really don't understand why DrivePool would be corrupting your files when it balances the pool, but maybe some of these ideas will help you narrow down the cause of your problem.

Link to comment
Share on other sites

  • 0
5 hours ago, gtaus said:

I have not experienced your specific problems, but I have a few things I might try.

You might want to turn on the verify after copy option. Goto Settings Cog>Troublshooting>Verify After Copy. This feature is normally turned off because it will slow down your system. However, in your case with suspected bad copies, it might be worth it to check out that feature.

I use the free program MultiPar to create .par2 files for file verification and rebuild. In your case, you would tag the movie file, or folder, and create .par2 files. When you run MultiPar on the .par2 file, it will verify if the original file is intact or if it has been damaged. If damaged, it will attempt to repair the file(s) with the .par2 files you created. You can adjust the % of .par2 files for rebuild anywhere from 0% (index only) to 100% complete blocks for total rebuild. I have my MultiPar set to 10% .par2 files which is enough to verify the file(s) in the folder and will rebuild some damaged and lost files.

Of course, I would recommend a good offline backup plan. If your files become corrupt, and MultiPar cannot rebuild the damaged files with the .par2 files you created, then you can pull the backup files and reload them.

I really don't understand why DrivePool would be corrupting your files when it balances the pool, but maybe some of these ideas will help you narrow down the cause of your problem.

Oh thanks - hadn't seen that option. Not sure why I'm running into this with DrivePool and not with FlexRaid pooling. After restarting my computer it largely seems to have stopped creating errors in files copied to my cache drive, but I'm still getting errors once the files are moved off the cache drive onto my array.

How does Verify After Copy work? Will it try to copy again if there's an error? Just keep the file on the original drive and notify you that the balancing failed? Or move the file, identify an error, tell you there's an error but delete the original?

Link to comment
Share on other sites

  • 0
On 7/27/2021 at 2:29 PM, mhendu said:

Oh thanks - hadn't seen that option. Not sure why I'm running into this with DrivePool and not with FlexRaid pooling. After restarting my computer it largely seems to have stopped creating errors in files copied to my cache drive, but I'm still getting errors once the files are moved off the cache drive onto my array.

How does Verify After Copy work? Will it try to copy again if there's an error? Just keep the file on the original drive and notify you that the balancing failed? Or move the file, identify an error, tell you there's an error but delete the original?

I have never experienced your problem of files getting corrupted when moved off the cache drive to the archive drives in the pool. I have never used the DrivePool Verify After Copy feature because I have not had the issues you are reporting. I don't know how DrivePool would respond if a verification failed, but I suspect it will alert you and will probably leave the file on the cache drive and try again the next time it balances. But, I really don't know as I have never used that feature.

I once had a problem with a USB 3.0 HDD caddy and transferring files into/from DrivePool. Files were getting corrupted in that transfer and I solved that issue by plugging the caddy into a USB 2.0 port and slowing all the transfers down. For some reason, my corrupt file transfer issues went away with USB 2.0. Maybe the caddy had a buggy USB 3.0 engine? 

I would still encourage you to use something like MultiPar with verification files to narrow down your issue. If you had a test folder(s) with files and .par2 files, you could verify the folders first and then transfer those files to your DrivePool cache. You could immediately run a verification on the files in cache to see if they transferred without corruption into DrivePool. Then after the cache flushes to the archive drives, run the verification on the folder again using the .par2 files. In that way, you could verify the files on your initial device or computer, in the DrivePool cache, and in DrivePool archives.

Also, you might consider trying a different interface cable on your archive drive to see if that makes a difference. Cables can go buggy and cause intermittent corruption. Just enough to drive you crazy because you probably can't verify it was a bad cable unless a different cable solves your issue.

Good luck. I hope you find the solution to your corrupted files issue. 

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Answer this question...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
 Share

×
×
  • Create New...