Hello,
Recently i read about HDFS. I think rebalancing the files on file hashes with a quorum would be a cool feature.
This would work in the following way:
Rebalancing is scheduled by another plugin, e.g StableBit Scanner Plugin
File movements are calculated
Before a file is moved, it is read on multiple Disks and a hash (e.g md5, sha256, ... ) is calculated
If the hash is the same on all disks, all disks are used to move the file
If the hash is diffrent on the disks a Quorum is used to identify the disks where the file is read from
Files getting copied/moved
The Balancing could also do the following
On a schedule, the hash for every file on every disc is calculated.
If the hashes are diffrent on some disks, Quorum is used to determine from wich disk the files are replaced.
Files are copied
This would add a new level of integrity for the files.