Pool not rebalancing

[ATWindsor]

I have a problem with a pool not rebalancing. It starts the operation with "building bucket lists", but after that is finished, it does nothing. Forcing the rebalanace, waiting for 24 hours, restarting and re-measuring the pool has been tried, but none of it seems to make a difference.

 

I recently added a big drive to the pool, and removed a small one, the pool has rebalanced once or twice since then, but it never finished (it didn't reach the target as shown by arrows), and now it doesn't do anything when rebalancing.

 

Any tips?

[Christopher (Drashna)]

Could you verify the balancing settings (Click on "Pool Options" and the "Balancing").

Make sure that balancing isn't disabled, just in case.

 

If it is enabled, what settings are you using?

And which balancers do you have enabled (said from Disk Space Equalizer)?

 

 

And could you get the logs from the system?

http://wiki.covecube.com/StableBit_DrivePool_2.x_Log_Collection

Namely, just do steps #6-8.

[ATWindsor]

Balancing is enabled, all settings is default i think, except for the "do not balance more often than" which i disabled to see if it helped with the problem.

 

Screenshots attached, log has been uploaded in accordance with instructions in link.

[Christopher (Drashna)]

From the text logs, there are a lot of "The device is not connected" errors.

 

 

 

Error moving '\\?\Volume{8e165666-c65a-4efe-849d-84419094f4fe}\PoolPart.756c226b-d7f3-4515-af16-4f293fcec9af\.....' to '\\?\Volume{7ac7acd6-ff75-4b5d-ad0c-99bfc29e159d}\PoolPart.4e5c8b54-b86c-4ef5-a80c-dc3600dbabc6\.....'. The device is not connected

 

 

Are any of the disks in your system having issues?

 

Also, just how full is that one drive? (How much free space does it have?).

[ATWindsor]

From the text logs, there are a lot of "The device is not connected" errors.

 

 

 

 

 

Are any of the disks in your system having issues?

 

Also, just how full is that one drive? (How much free space does it have?).

 

What is the time of those errors? I did have issues with one disk getting disconnected, but I have since removed it (and moved 2 other disk to other sata-connecters), I have not noticed any issues with the remaing disks after that.

 

The drive is very full it has 239 megabytes of free space. 

 

A small timeline

 

4* 750 GB disks

- one disk is getting flakey and is removed

3*750 GB disks 

- pool is a bit to small to have everything duplicated, and is filled to the brim.

3*750 GB + 1 * 4TB

-Large new disk is added

2*750 + 1 * 4TB

- one of the small disks are removed for other use (noe problems occur during the moving of data), and the to remaing 750s are moved from a controller-card in passthrough config and attatched directly to the motherboard with the 4 TB.

- rebalancing starts and continues for a while (data copied away from disc 7)

- Todays situation occures. (rebalancing starts, but no files are actually moved)

[ATWindsor]

So, would it be possible to start to remove the disk that is full from the pool, to force moving some files away from that disk, and then abort the removal process after some time?

[Christopher (Drashna)]

So, would it be possible to start to remove the disk that is full from the pool, to force moving some files away from that disk, and then abort the removal process after some time?

Yes. However, there is a MUCH simpler method. The "Disk Usage Limiter" balancer can be used to do this.

Uncheck "duplicated" and "unduplicated" for the disk in question and save the settings. 

 

In fact, I personally use this to "prep" a drive for removal, as it can take hours or more to remove a disk if it's full. Using the Disk Usage Balancer this way will cause DrivePool to clear out the disk, making the removal immediate.

 

 

 

As for when the errors where happening, the first I saw happened at:

014-12-28 23:06:47 (UTC, aka GMT-0).

 

Also, seeing some really bad errors:

Data error (cyclic redundancy check)

This happened to:

\\?\Volume{8e165666-c65a-4efe-849d-84419094f4fe}\PoolPart.756c226b-d7f3-4515-af16-4f293fcec9af\

(I've truncated the file name, for the sake of privacy)

You can compare the folder name, or run "cmd /k mountvol" to see the list of the volumes and what letters they have assigned.

 

However, the CRC error seems to be what "kicked" the drive off.

 

Additionally, on the 28th, a lot of " Errors checking xxxxx for duplication consistency. There is not enough space on the disk" errors.

[ATWindsor]

Ok, using the limiter yields the same result, the target filling rate is moved to "zero" for the drive, it goes into "building bucket lists", but then it stops.

 

The 28th is probably the day or day before I added the large disk. There wasn't enough space with only the 3 small drives. So any errors at the 28th or before I think is not relevant for the pools situation today.

[Christopher (Drashna)]

Do you have any antivirus installed?

Could you do this:

http://wiki.covecube.com/StableBit_DrivePool_Q2159701

 

 

Also, could you download the latest build? 

http://dl.covecube.com/DrivePoolWindows/beta/download/

Then enable file system logging and reproduce the issue?

http://wiki.covecube.com/StableBit_DrivePool_2.x_Log_Collection

[ATWindsor]

Do you have any antivirus installed?

Could you do this:

http://wiki.covecube.com/StableBit_DrivePool_Q2159701

 

 

Also, could you download the latest build? 

http://dl.covecube.com/DrivePoolWindows/beta/download/

Then enable file system logging and reproduce the issue?

http://wiki.covecube.com/StableBit_DrivePool_2.x_Log_Collection

 

 

No third party AV.

 

Result of command:

 

Filter Name                     Num Instances    Altitude    Frame

------------------------------  -------------  ------------  -----

DfsDriver                               1       405000         0

Cbafilt                                10       261150         0

DfsrRo                                  0       261100         0

Datascrn                                0       261000         0

luafv                                   1       135000         0

Quota                                   2       125000         0

npsvctrig                               1        46000         0

 

 

Latest build installed, problem reproduced, and log sent in.

[Christopher (Drashna)]

Do you have quotas set up on the pooled drives?

 

Also, file flagged, issue here:

https://stablebit.com/Admin/IssueAnalysis/13452

[ATWindsor]

Do you have quotas set up on the pooled drives?

 

Also, file flagged, issue here:

https://stablebit.com/Admin/IssueAnalysis/13452

 

No there is no quota set up on the drives. (In the OS itself, if there was some quota in the pool settings you where talking about, please specify)

[Christopher (Drashna)]

Okay, I just wanted to make sure, as you do appear to have the feature installed.