Duplication speed

[TomG]

Hello,

 

After a second hard drive crash, I decided to duplicate some folders in the pool to prevent data loss from specific folders.

During the duplication the performance indicator in DrivePool isn't showing any activity (read / write speeds) in the pool, although it is duplicating.

When I open Stablebit scanner it shows activity on two drives, one for reading, one for writing. Like I said, it is duplicating, this isn't the problem.

 

What I noticed is that the duplication speed is around 45 MB/s and I think this is quite slow.

When performing file copy in for example Total Commander the disks are working on a speed between 160-200 MB/s

 

I found another thread in this forum about duplication speed from November 2013 where Christopher wrote that this isn't typical behavior.

Unfortunately there wasn't a clear solution to this behavior, that's why I'm posting a new topic.

 

Edit: I already uploaded a logfile as described here

[Christopher (Drashna)]

Duplication and balancing activity are not shown in the StableBit DrivePool UI, only access "through" the pool are shown.  

 

This is a common request though, and may be added in the future. 

 

 

 

As for the speed itself, this is entirely normal.  We use a background priority to duplicate and balance data, so this won't be as fast a a straight file copy.  Additionally, because there may be a lot of small files, this can (will) reduce the speeds of any transfer in general. 

 

There are some advanced setting that can increase the priority (and thereforce may increase the speed), but this may impact overall performance. 

 

You can do this temporarily, in the UI, by clicking on the ">>" button at the bottom (when it's balancing/duplicating). 

Or you can set this permanently, by editing the advanced config file.

http://wiki.covecube.com/StableBit_DrivePool_2.x_Advanced_Settings

Set "FileBalance_BackgroundIO" and/or "FileDuplication_BackgroundIO" to "false" and reboot the system. 

[TomG]

Hello Christopher,

 

Thank you for your quick reply!

I will try both the temporarily and the permanently settings and I will let you know if there's any change in duplication speed.

The filesize won't be the problem. It's all mkv's with several GB in size and now and then a single text file.

[Christopher (Drashna)]

Well, if you have a lot of those text files... they add up over time.

Especially if those MKVs are tv shows, and you have a lot of them.

 

And let me know how things go, positive or negative. 

[TomG]

I just tested both ways and both work like a charm! I'm getting reading / writing speeds up to 200MB/s

 

The temporarily solution was off course easy peasy, I should've figured that one out myself   the second one is now permanently stored in the config file.

To other readers: read the instructions in the wiki carefully, don't forget to rename the filename (delete default in the filename) otherwise it doesn't work.

[Christopher (Drashna)]

Glad to hear it!  

 

And yeah, I use these personally.

 

 

that said, yeah, definitely don't forget to remove the "default" from the file name.