Find out what is "unduplicated"?

[backpackhasjetz]

I have a DrivePool that's setup to be 100% mirrored, but I'm seeing weird "Other" and "Unduplicated" amounts:

 

Unduplicated: 64.6 GB

Duplicated: 1.82 TB

Other: 26.5 GB

 

I just don't understand what "Other" and "Unduplicated" could be. Looking at the drives themselves I don't see any folders other than the drivepool hidden ones.

[panabodifed]

Go to File Protection > Folder Duplication. You will see the settings on each folder and change if you want.

 

There is a topic about Other somewhere.  From my experience, files in use like virtual machine disks show under Other while virtual machine is on. Files outside the pool (root of the drive) also, thats not your case.

[backpackhasjetz]

Thanks, but every folder shows "2x", like I was expecting.

 

Just not sure what to do. Scared to turn off duplication and turn it back on, just to try and fix the numbers. Would be nice to know if there's a problem, and how to best fix it.

[sspell]

other is files on disk not in pool

[Christopher (Drashna)]

The meaning of the sizes are here:

http://community.covecube.com/index.php?/topic/37-faq-unduplicated-vs-duplicated-vs-other-vs-unusable/

 

 

ALso, if you ahve files in the root folder of the pool, they may not be duplicated, and could cause the issue. Enable the "Pool File duplication" option to enable everything.

 

 

Also try running the remeasure option, as that may fix the issue.

[Carsten]

1) I also have the problem to find out the "unduplicated" files? I still have 5,6MB of unduplicated out of 4TB duplicated. Which are these 5,6MB files?

 

2) There seem to be a problem with the "File Protection > Folder Duplication" dialog: When I open this dialog, all directories are set to x2 and it starts calculating. However this process never finishes but starts over again and again after about 60% of the pool size. Also when it starts measuring the readings for "size" and "duplication" are identical but differ after some time

 

I have DP version 2.1.1.561.

[Christopher (Drashna)]

An "auditing" tool or option for the pool as been requested a few times. It is definitely on our "to do list".

 

However, in the meanwhile, the "Folder Protection" option that brings up the folder tree actually calculates the duplication and size in real time. This can be used to audit the pool in the meanwhile.

 

However, it seems like you are having issues with this. Could you see if the latest beta build fixes this issue?

http://dl.covecube.com/DrivePoolWindows/beta/download/

If it doesn't, then enable file system logging and reproduce the issue.

http://wiki.covecube.com/StableBit_DrivePool_2.x_Log_Collection

[Carsten]

I upgraded to the latest beta 2.2.0.599 and both problems are still there. But since this version also the "Troubleshooting" option is missing, so I cannot activate logging. How to do this with this version?

[Christopher (Drashna)]

Open the Start Menu. We've moved the troubleshooting stuff out the main UI, so that it's harder to get to.

Since the troubleshooting stuff isn't needed all the time, and soem of the stuff can cause issues (resetting your settings, for example).

 

In the start menu, in the "StableBit DrivePool" group, there should be a "Troubleshooting" folder there now. Open that, and select the "DrivePool (Troubleshooting)" option

[Carsten]

The "recalculation bug" from point 2 is till there in the latest beta.

[Christopher (Drashna)]

The "recalculation bug" from point 2 is till there in the latest beta.

Are you using the 2.2.0.606 build. This should address the issue specifically. 

If you're not using this build, then please update to it and see if it fixes the issue.

http://dl.covecube.com/DrivePoolWindows/beta/download/

 

If you ARE using this build then please let us know.

[Carsten]

The recalculation bug seems to be fixed in 2.2.0.634, but the "unduplicated" problem is still there, even though I did a "remeasure" with this version. Now I have 2.35MB of "unduplicated" files, but don't now, how to find out which files are not duplicated. Also why does a "remeasure" not fix the problem. There should be 0 "unduplicated" files.

[Christopher (Drashna)]

We'll I'm glad ot hear that the newest beta build has fixed the unduplicated issue.

 

This was likely due to "sparse files" on the pool (files that are assigned much larger size than they actually use). 

 

 

As for the duplication status and a verification/audit tool, I've posted here. http://community.covecube.com/index.php?/topic/1122-duplication-check-tool/&do=findComment&comment=9488

[kenwshmt]

Ive had bad file names, empty file directories, make it calculate wrong.

[Christopher (Drashna)]

Ive had bad file names, empty file directories, make it calculate wrong.

If you've run into this and are able to reproduce it, please let us know (both that it's happening, and specifically how you're producing the issue).