Jump to content
Covecube Inc.
  • 1

Extremely slow balance speeds


Question

As above, I'm experiencing extremely slow balancing speeds of around 4 MB/s when I've added in another new disk to my pool

Burst testing with scanner and directly copying the files in windows results in speeds of around 150 MB/s which is as I'd expect

The pool is 3 x 10TB WD external drives connected by USB 3. I've tried clicking the forward arrow to increase the priority and ot doesn't so alot

 

Any help would be appreciated as I have alot of data to move and dont fancy babysitting a manual copy

Thanks

Link to post
Share on other sites

11 answers to this question

Recommended Posts

  • 0

Having the same issue.  Very slow speeds on a set of internal drives.  Had a drive fail suddenly.  Looking for general recommendations to maximize performance of balancing the pool.  I'm not concerned about network speeds / delivery of files across the network.  This is a JBOD setup for a hobbyist home user.  Duplication speed seems to be about 0.1% per hour or so, on 10 TB of non-duplicated storage.  Thanks.

Link to post
Share on other sites
  • 0

@Hereisphilly could you give more details on the hardware (e.g. drive and enclosure models, board they're plugged into, how they're plugged in, etc), including the new disk you've added?

@MattG You can delve into the advanced settings here: https://wiki.covecube.com/StableBit_DrivePool_2.x_Advanced_Settings

Don't know if it'll help in your case, but for whatever it's worth my personal settings for "I don't want DrivePool to do balancing/duplication/measuring/etc with background/idle/low priority, even if it impacts delivery" are:

CoveFs_AsyncFindFilesLowPriorityThreads - override from null to 2

CoveFs_MeasureBackgroundTaskPriority - override from null to false

DrivePool_BackgroundTasksPreventSleep - override from null to true (don't use if you want your computer to go into standby at night or whenever)

DrivePool_BackgroundTasksPriority - override from null to 0

FileBalance_BackgroundIO - override from null to false

FileDuplication_BackgroundIO - override from null to false

... and if you're like me and insist drivepool checks for itself that what it told Windows to copy between disks is actually what got copied between disks (because I once ran into a problem where a SATA controller was silently corrupting files and Windows didn't notice at all) though this does impact performance:

DrivePool_VerifyAfterCopy - override from null to true (note that this seems to be independent of whether "Verify after copy" is ticked in the GUI under Cog -> Troubleshooting)

YMMV.

Link to post
Share on other sites
  • 0
6 hours ago, Shane said:

@Hereisphilly could you give more details on the hardware (e.g. drive and enclosure models, board they're plugged into, how they're plugged in, etc), including the new disk you've added?

@MattG You can delve into the advanced settings here: https://wiki.covecube.com/StableBit_DrivePool_2.x_Advanced_Settings

Don't know if it'll help in your case, but for whatever it's worth my personal settings for "I don't want DrivePool to do balancing/duplication/measuring/etc with background/idle/low priority, even if it impacts delivery" are:

CoveFs_AsyncFindFilesLowPriorityThreads - override from null to 2

CoveFs_MeasureBackgroundTaskPriority - override from null to false

DrivePool_BackgroundTasksPreventSleep - override from null to true (don't use if you want your computer to go into standby at night or whenever)

DrivePool_BackgroundTasksPriority - override from null to 0

FileBalance_BackgroundIO - override from null to false

FileDuplication_BackgroundIO - override from null to false

... and if you're like me and insist drivepool checks for itself that what it told Windows to copy between disks is actually what got copied between disks (because I once ran into a problem where a SATA controller was silently corrupting files and Windows didn't notice at all) though this does impact performance:

DrivePool_VerifyAfterCopy - override from null to true (note that this seems to be independent of whether "Verify after copy" is ticked in the GUI under Cog -> Troubleshooting)

YMMV.

Shane

Thanks for getting back to me, the pc is an I3 4150 on an Asrock H97M Pro4

The disks in this array are 2 X 10Tb WD mybooks connected over usb 3 to the rear Io usb3 ports and then the new 10tb WD element that I connected up again on the rear Io.

Swapping disks over to the front Io ports don't change anything in terms of speed. 

 

This is my cold storage backup array that I can power down, my other main array on an internal pcie hba are all working fine

Direct copy speeds via windows direct to the disks works absolutely fine and I get the seeds I would expect for a rust spinner over usb3

I've made the recommended changes to the settings.json file, restarted my pc and the doesn't seem to be any change. Balance speeds in talks manager and scanner are around the 4-10 MB/s mark

 

 

 

Link to post
Share on other sites
  • 0

@Hereisphilly Hmm. Nothing obvious springs to mind, sorry. Maybe some kind of buffer or other limit is being hit in the USB drivers, since the problem only showed up when you added a third USB drive? When you're doing the direct copy via Windows and getting the normal expected speeds, are you doing so from one mybook to the other mybook? Do you get that same speed when direct copying from one of the mybook drives to the elements drive? Have you tested with both a single very large file and many very small files of comparable total size to see if that influences the result?

@MattG Also, are any of the drives in your pool are SMR type drives?

Link to post
Share on other sites
  • 0
4 minutes ago, Shane said:

@Hereisphilly Hmm. Nothing obvious springs to mind, sorry. Maybe some kind of buffer or other limit is being hit in the USB drivers, since the problem only showed up when you added a third USB drive? When you're doing the direct copy via Windows and getting the normal expected speeds, are you doing so from one mybook to the other mybook? Do you get that same speed when direct copying from one of the mybook drives to the elements drive? Have you tested with both a single very large file and many very small files of comparable total size to see if that influences the result?

@MattG Also, are any of the drives in your pool are SMR type drives?

I'm not sure the problem arose when adding this drive, up until now I've never needed to balance as the 2 mybooks were bought at the same time last year and then initially synced with the main array fine. Weekly backups go through fine with them too.

I've tried direct copying from the ntfs mounts of each mybook into the element direct mount both with loads of 3-10mb files, 10gb and then 30gb files, all of which give speeds circa 60 Mb/s for the small files, and the 130 for the larger, and that's whilst the balance is still happening. Turning that off increases the speed slightly even more, so I think I can rule out any USB3 buffering issues. 

Both mybooks into the element are the same on performance

Link to post
Share on other sites
  • 0
On 11/28/2020 at 4:58 PM, Hereisphilly said:

Any help would be appreciated as I have alot of data to move and dont fancy babysitting a manual copy

I don't know if this will work for your situation, but I recently had to move lots of data (TB's of movie files) into my DrivePool. The standard Windows Explorer copy/move of bulk files is, like you said, pretty much a babysitting manual copy/move job. The first problem Windows Explorer hits in the bulk transfer will stop everything and wait for you to clear the error box before it will continue. I had about 10 hours of files to move to DrivePool, I set it up to move the files overnight, but it snagged a problem only 30 minutes into the transfer and stopped. Hardly any files were moved.

Since that experience, I now use the free TeraCopy for my large bulk file transfers. TeraCopy has a number of advantages over Windows Explorer. First, and foremost for me, it queues up all the files in a transfer list. If TeraCopy hits a problem with a file transfer, it will mark that file in the queue, skip over it, and continue on with transferring all the other files in the list. In my overnight example, it transferred all the files except 1 file that was corrupt. In the morning, all I had to do was look at the one file that errored out on the transfer. Much, much better than Windows Explorer.

Teracopy also has a checkbox for verifying files after a copy/move. Of course, this doubles your transfer time with a verification on each file, but for important files that you want verified it works great. I almost always use the verify command on files I transfer to archive backup drives. It takes a little longer, but I really don't care as it does it in the background and I don't have to babysit TeraCopy.

On 11/28/2020 at 4:58 PM, Hereisphilly said:

I'm experiencing extremely slow balancing speeds of around 4 MB/s when I've added in another new disk to my pool

How are you measuring the balancing transfer speeds of DrivePool? The read and write status on my DrivePool GUI does not register any disk speeds when DrivePool is balancing the pool in the background. I know it is working because I can see the lights flashing on my USB HDDs, showing activity, and balancing will list the % of completion. But I don't see anywhere the speed is measured for balancing in the background.

In my case, I am not very concerned about the speed of background balancing as long as it gets done correctly. I use DrivePool mainly for my media center file storage, so I don't need really fast transfer speeds. Having said that, I added a 248GB SSD to the front end of my DrivePool and that is very fast. I set the SSD Optimizer to re-balance only when there is at least 100GB of data to move. Essentially, I now have a 100GB SSD cache for my files, and if/when I reach 100GB threshold, DrivePool re-balances the data off the SSD in the background and I don't even notice it.

You did not mention any SSD on your DrivePool, so I would encourage you to look into the benefits of front loading your files to a SSD. It really works great for me. Obviously, once you transfer more data than your threshold (100GB in my case), the transfer speed will slow down to the read/write speed of your USB drive(s) because DrivePool will not attempt to overfill the SSD and will switch over to writing to the slower USB drives directly until the SSD flushes its cache. DrivePool works great, and it is even better with a SSD on the frontend.

Anyway, using TeraCopy and a SSD on the frontend of my DrivePool has made everything easier and faster for me.

Link to post
Share on other sites
  • 0
9 hours ago, gtaus said:

I don't know if this will work for your situation, but I recently had to move lots of data (TB's of movie files) into my DrivePool. The standard Windows Explorer copy/move of bulk files is, like you said, pretty much a babysitting manual copy/move job. The first problem Windows Explorer hits in the bulk transfer will stop everything and wait for you to clear the error box before it will continue. I had about 10 hours of files to move to DrivePool, I set it up to move the files overnight, but it snagged a problem only 30 minutes into the transfer and stopped. Hardly any files were moved.

Since that experience, I now use the free TeraCopy for my large bulk file transfers. TeraCopy has a number of advantages over Windows Explorer. First, and foremost for me, it queues up all the files in a transfer list. If TeraCopy hits a problem with a file transfer, it will mark that file in the queue, skip over it, and continue on with transferring all the other files in the list. In my overnight example, it transferred all the files except 1 file that was corrupt. In the morning, all I had to do was look at the one file that errored out on the transfer. Much, much better than Windows Explorer.

Teracopy also has a checkbox for verifying files after a copy/move. Of course, this doubles your transfer time with a verification on each file, but for important files that you want verified it works great. I almost always use the verify command on files I transfer to archive backup drives. It takes a little longer, but I really don't care as it does it in the background and I don't have to babysit TeraCopy.

How are you measuring the balancing transfer speeds of DrivePool? The read and write status on my DrivePool GUI does not register any disk speeds when DrivePool is balancing the pool in the background. I know it is working because I can see the lights flashing on my USB HDDs, showing activity, and balancing will list the % of completion. But I don't see anywhere the speed is measured for balancing in the background.

In my case, I am not very concerned about the speed of background balancing as long as it gets done correctly. I use DrivePool mainly for my media center file storage, so I don't need really fast transfer speeds. Having said that, I added a 248GB SSD to the front end of my DrivePool and that is very fast. I set the SSD Optimizer to re-balance only when there is at least 100GB of data to move. Essentially, I now have a 100GB SSD cache for my files, and if/when I reach 100GB threshold, DrivePool re-balances the data off the SSD in the background and I don't even notice it.

You did not mention any SSD on your DrivePool, so I would encourage you to look into the benefits of front loading your files to a SSD. It really works great for me. Obviously, once you transfer more data than your threshold (100GB in my case), the transfer speed will slow down to the read/write speed of your USB drive(s) because DrivePool will not attempt to overfill the SSD and will switch over to writing to the slower USB drives directly until the SSD flushes its cache. DrivePool works great, and it is even better with a SSD on the frontend.

Anyway, using TeraCopy and a SSD on the frontend of my DrivePool has made everything easier and faster for me.

I had looked at tera copy and was an option, but at the moment I have just let the disks run while I'm raising the ticket with drivepoool direct as I really want the underlying problem fixing.

This affected array is my cold storage backup so gets fired up once a week to sync and then is powered off. I don't have any of the speed issues when copying to the pool, its just in the balance where the problem is.

Disk speeds are shown in stablebit scanner and also can be seen in task manager.

 

SSD as a cache wont really be necessary for me as my main array sees more intensive IO and I'm currently happy with those speeds anyway. A cache for this backup array is definitely not needed as i set the sync off and let it run until complete 

Link to post
Share on other sites
  • 0
13 hours ago, Hereisphilly said:

Disk speeds are shown in stablebit scanner and also can be seen in task manager.

I specifically turned on task manager and looked under the Performance tab to monitor the disk activity. There was no disk activity while DrivePool was reporting a re-balancing in the background. Perhaps I just happened to look at it when DrivePool was "thinking" rather than "doing" and actually moving data. I don't have Stablebit Scanner running on my system.

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Answer this question...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...