Jump to content
  • 1

Extremely slow balance speeds


Hereisphilly

Question

As above, I'm experiencing extremely slow balancing speeds of around 4 MB/s when I've added in another new disk to my pool

Burst testing with scanner and directly copying the files in windows results in speeds of around 150 MB/s which is as I'd expect

The pool is 3 x 10TB WD external drives connected by USB 3. I've tried clicking the forward arrow to increase the priority and ot doesn't so alot

 

Any help would be appreciated as I have alot of data to move and dont fancy babysitting a manual copy

Thanks

Link to comment
Share on other sites

17 answers to this question

Recommended Posts

  • 0

Having the same issue.  Very slow speeds on a set of internal drives.  Had a drive fail suddenly.  Looking for general recommendations to maximize performance of balancing the pool.  I'm not concerned about network speeds / delivery of files across the network.  This is a JBOD setup for a hobbyist home user.  Duplication speed seems to be about 0.1% per hour or so, on 10 TB of non-duplicated storage.  Thanks.

Link to comment
Share on other sites

  • 0

@Hereisphilly could you give more details on the hardware (e.g. drive and enclosure models, board they're plugged into, how they're plugged in, etc), including the new disk you've added?

@MattG You can delve into the advanced settings here: https://wiki.covecube.com/StableBit_DrivePool_2.x_Advanced_Settings

Don't know if it'll help in your case, but for whatever it's worth my personal settings for "I don't want DrivePool to do balancing/duplication/measuring/etc with background/idle/low priority, even if it impacts delivery" are:

CoveFs_AsyncFindFilesLowPriorityThreads - override from null to 2

CoveFs_MeasureBackgroundTaskPriority - override from null to false

DrivePool_BackgroundTasksPreventSleep - override from null to true (don't use if you want your computer to go into standby at night or whenever)

DrivePool_BackgroundTasksPriority - override from null to 0

FileBalance_BackgroundIO - override from null to false

FileDuplication_BackgroundIO - override from null to false

... and if you're like me and insist drivepool checks for itself that what it told Windows to copy between disks is actually what got copied between disks (because I once ran into a problem where a SATA controller was silently corrupting files and Windows didn't notice at all) though this does impact performance:

DrivePool_VerifyAfterCopy - override from null to true (note that this seems to be independent of whether "Verify after copy" is ticked in the GUI under Cog -> Troubleshooting)

YMMV.

Link to comment
Share on other sites

  • 0
6 hours ago, Shane said:

@Hereisphilly could you give more details on the hardware (e.g. drive and enclosure models, board they're plugged into, how they're plugged in, etc), including the new disk you've added?

@MattG You can delve into the advanced settings here: https://wiki.covecube.com/StableBit_DrivePool_2.x_Advanced_Settings

Don't know if it'll help in your case, but for whatever it's worth my personal settings for "I don't want DrivePool to do balancing/duplication/measuring/etc with background/idle/low priority, even if it impacts delivery" are:

CoveFs_AsyncFindFilesLowPriorityThreads - override from null to 2

CoveFs_MeasureBackgroundTaskPriority - override from null to false

DrivePool_BackgroundTasksPreventSleep - override from null to true (don't use if you want your computer to go into standby at night or whenever)

DrivePool_BackgroundTasksPriority - override from null to 0

FileBalance_BackgroundIO - override from null to false

FileDuplication_BackgroundIO - override from null to false

... and if you're like me and insist drivepool checks for itself that what it told Windows to copy between disks is actually what got copied between disks (because I once ran into a problem where a SATA controller was silently corrupting files and Windows didn't notice at all) though this does impact performance:

DrivePool_VerifyAfterCopy - override from null to true (note that this seems to be independent of whether "Verify after copy" is ticked in the GUI under Cog -> Troubleshooting)

YMMV.

Shane

Thanks for getting back to me, the pc is an I3 4150 on an Asrock H97M Pro4

The disks in this array are 2 X 10Tb WD mybooks connected over usb 3 to the rear Io usb3 ports and then the new 10tb WD element that I connected up again on the rear Io.

Swapping disks over to the front Io ports don't change anything in terms of speed. 

 

This is my cold storage backup array that I can power down, my other main array on an internal pcie hba are all working fine

Direct copy speeds via windows direct to the disks works absolutely fine and I get the seeds I would expect for a rust spinner over usb3

I've made the recommended changes to the settings.json file, restarted my pc and the doesn't seem to be any change. Balance speeds in talks manager and scanner are around the 4-10 MB/s mark

 

 

 

Link to comment
Share on other sites

  • 0

@Hereisphilly Hmm. Nothing obvious springs to mind, sorry. Maybe some kind of buffer or other limit is being hit in the USB drivers, since the problem only showed up when you added a third USB drive? When you're doing the direct copy via Windows and getting the normal expected speeds, are you doing so from one mybook to the other mybook? Do you get that same speed when direct copying from one of the mybook drives to the elements drive? Have you tested with both a single very large file and many very small files of comparable total size to see if that influences the result?

@MattG Also, are any of the drives in your pool are SMR type drives?

Link to comment
Share on other sites

  • 0
4 minutes ago, Shane said:

@Hereisphilly Hmm. Nothing obvious springs to mind, sorry. Maybe some kind of buffer or other limit is being hit in the USB drivers, since the problem only showed up when you added a third USB drive? When you're doing the direct copy via Windows and getting the normal expected speeds, are you doing so from one mybook to the other mybook? Do you get that same speed when direct copying from one of the mybook drives to the elements drive? Have you tested with both a single very large file and many very small files of comparable total size to see if that influences the result?

@MattG Also, are any of the drives in your pool are SMR type drives?

I'm not sure the problem arose when adding this drive, up until now I've never needed to balance as the 2 mybooks were bought at the same time last year and then initially synced with the main array fine. Weekly backups go through fine with them too.

I've tried direct copying from the ntfs mounts of each mybook into the element direct mount both with loads of 3-10mb files, 10gb and then 30gb files, all of which give speeds circa 60 Mb/s for the small files, and the 130 for the larger, and that's whilst the balance is still happening. Turning that off increases the speed slightly even more, so I think I can rule out any USB3 buffering issues. 

Both mybooks into the element are the same on performance

Link to comment
Share on other sites

  • 0
On 11/28/2020 at 4:58 PM, Hereisphilly said:

Any help would be appreciated as I have alot of data to move and dont fancy babysitting a manual copy

I don't know if this will work for your situation, but I recently had to move lots of data (TB's of movie files) into my DrivePool. The standard Windows Explorer copy/move of bulk files is, like you said, pretty much a babysitting manual copy/move job. The first problem Windows Explorer hits in the bulk transfer will stop everything and wait for you to clear the error box before it will continue. I had about 10 hours of files to move to DrivePool, I set it up to move the files overnight, but it snagged a problem only 30 minutes into the transfer and stopped. Hardly any files were moved.

Since that experience, I now use the free TeraCopy for my large bulk file transfers. TeraCopy has a number of advantages over Windows Explorer. First, and foremost for me, it queues up all the files in a transfer list. If TeraCopy hits a problem with a file transfer, it will mark that file in the queue, skip over it, and continue on with transferring all the other files in the list. In my overnight example, it transferred all the files except 1 file that was corrupt. In the morning, all I had to do was look at the one file that errored out on the transfer. Much, much better than Windows Explorer.

Teracopy also has a checkbox for verifying files after a copy/move. Of course, this doubles your transfer time with a verification on each file, but for important files that you want verified it works great. I almost always use the verify command on files I transfer to archive backup drives. It takes a little longer, but I really don't care as it does it in the background and I don't have to babysit TeraCopy.

On 11/28/2020 at 4:58 PM, Hereisphilly said:

I'm experiencing extremely slow balancing speeds of around 4 MB/s when I've added in another new disk to my pool

How are you measuring the balancing transfer speeds of DrivePool? The read and write status on my DrivePool GUI does not register any disk speeds when DrivePool is balancing the pool in the background. I know it is working because I can see the lights flashing on my USB HDDs, showing activity, and balancing will list the % of completion. But I don't see anywhere the speed is measured for balancing in the background.

In my case, I am not very concerned about the speed of background balancing as long as it gets done correctly. I use DrivePool mainly for my media center file storage, so I don't need really fast transfer speeds. Having said that, I added a 248GB SSD to the front end of my DrivePool and that is very fast. I set the SSD Optimizer to re-balance only when there is at least 100GB of data to move. Essentially, I now have a 100GB SSD cache for my files, and if/when I reach 100GB threshold, DrivePool re-balances the data off the SSD in the background and I don't even notice it.

You did not mention any SSD on your DrivePool, so I would encourage you to look into the benefits of front loading your files to a SSD. It really works great for me. Obviously, once you transfer more data than your threshold (100GB in my case), the transfer speed will slow down to the read/write speed of your USB drive(s) because DrivePool will not attempt to overfill the SSD and will switch over to writing to the slower USB drives directly until the SSD flushes its cache. DrivePool works great, and it is even better with a SSD on the frontend.

Anyway, using TeraCopy and a SSD on the frontend of my DrivePool has made everything easier and faster for me.

Link to comment
Share on other sites

  • 0
9 hours ago, gtaus said:

I don't know if this will work for your situation, but I recently had to move lots of data (TB's of movie files) into my DrivePool. The standard Windows Explorer copy/move of bulk files is, like you said, pretty much a babysitting manual copy/move job. The first problem Windows Explorer hits in the bulk transfer will stop everything and wait for you to clear the error box before it will continue. I had about 10 hours of files to move to DrivePool, I set it up to move the files overnight, but it snagged a problem only 30 minutes into the transfer and stopped. Hardly any files were moved.

Since that experience, I now use the free TeraCopy for my large bulk file transfers. TeraCopy has a number of advantages over Windows Explorer. First, and foremost for me, it queues up all the files in a transfer list. If TeraCopy hits a problem with a file transfer, it will mark that file in the queue, skip over it, and continue on with transferring all the other files in the list. In my overnight example, it transferred all the files except 1 file that was corrupt. In the morning, all I had to do was look at the one file that errored out on the transfer. Much, much better than Windows Explorer.

Teracopy also has a checkbox for verifying files after a copy/move. Of course, this doubles your transfer time with a verification on each file, but for important files that you want verified it works great. I almost always use the verify command on files I transfer to archive backup drives. It takes a little longer, but I really don't care as it does it in the background and I don't have to babysit TeraCopy.

How are you measuring the balancing transfer speeds of DrivePool? The read and write status on my DrivePool GUI does not register any disk speeds when DrivePool is balancing the pool in the background. I know it is working because I can see the lights flashing on my USB HDDs, showing activity, and balancing will list the % of completion. But I don't see anywhere the speed is measured for balancing in the background.

In my case, I am not very concerned about the speed of background balancing as long as it gets done correctly. I use DrivePool mainly for my media center file storage, so I don't need really fast transfer speeds. Having said that, I added a 248GB SSD to the front end of my DrivePool and that is very fast. I set the SSD Optimizer to re-balance only when there is at least 100GB of data to move. Essentially, I now have a 100GB SSD cache for my files, and if/when I reach 100GB threshold, DrivePool re-balances the data off the SSD in the background and I don't even notice it.

You did not mention any SSD on your DrivePool, so I would encourage you to look into the benefits of front loading your files to a SSD. It really works great for me. Obviously, once you transfer more data than your threshold (100GB in my case), the transfer speed will slow down to the read/write speed of your USB drive(s) because DrivePool will not attempt to overfill the SSD and will switch over to writing to the slower USB drives directly until the SSD flushes its cache. DrivePool works great, and it is even better with a SSD on the frontend.

Anyway, using TeraCopy and a SSD on the frontend of my DrivePool has made everything easier and faster for me.

I had looked at tera copy and was an option, but at the moment I have just let the disks run while I'm raising the ticket with drivepoool direct as I really want the underlying problem fixing.

This affected array is my cold storage backup so gets fired up once a week to sync and then is powered off. I don't have any of the speed issues when copying to the pool, its just in the balance where the problem is.

Disk speeds are shown in stablebit scanner and also can be seen in task manager.

 

SSD as a cache wont really be necessary for me as my main array sees more intensive IO and I'm currently happy with those speeds anyway. A cache for this backup array is definitely not needed as i set the sync off and let it run until complete 

Link to comment
Share on other sites

  • 0
13 hours ago, Hereisphilly said:

Disk speeds are shown in stablebit scanner and also can be seen in task manager.

I specifically turned on task manager and looked under the Performance tab to monitor the disk activity. There was no disk activity while DrivePool was reporting a re-balancing in the background. Perhaps I just happened to look at it when DrivePool was "thinking" rather than "doing" and actually moving data. I don't have Stablebit Scanner running on my system.

Link to comment
Share on other sites

  • 0
On 11/14/2022 at 10:27 AM, est3ban129 said:

I have 16 disks and the balancing is done at 10 mbps, it's horrible. 
If I do speed test to the disks individually, the speed is 400mbps so it is a drivepool problem, how can I fix it?

I installed the trial version of Stablebit Scanner about 3 weeks ago, and my DrivePool volume with 20 USB HDDs (82TB) has basically gone done to a crawl on Measuring and is at a standstill with Balancing. I exited Scanner to see if everything in DrivePool would return to it's previous state, but it still remained extremely slowed down. Then, I noticed that although I had exited Scanner, there were still 3 active tasks for Scanner running in my Task Manager. So, I killed those Scanner tasks and my DrivePool ran better/faster.

I have another DrivePool volume with only 3 USB HDDs (10TB) and Scanner seemed to work fine on that volume. Maybe the number of USB HDDs in a pool is a factor with Scanner slowing everything down so much?

Anyway, currently my DrivePool with Scanner GUI not running, but with those 3 Scanner tasks showing up in Task Manager, my system got stuck on Balancing at 0.1% for the past several hours. I really don't know what to do other than to uninstall Scanner, and then restart my computer to see if it has cleaned out all those Scanner tasks in the Task Manager.

With my 20 USB HDDs (82TB) in DrivePool, I was used to having to wait a couple of hours for Measuring and then maybe another hour for Balancing and Checking Duplication. Since I installed Scanner, those same jobs will run for days if they ever complete, but most often I have seen my computer just hang in the process requiring reboot of the server.

 

Link to comment
Share on other sites

  • 0

Cam,

I had the same issue with drive balancing as I removed a single 8TB Red Nas and inserted an 18TB Red Nas drive in its place for increased storage and the drive balancing was plodding along at about 25MB/s. (value taken from StableBIt Drive Scanner) At this rate it will take longer than a week in my 5 drive StableBit DrivePool. My drives are fast than this, much faster.

So what I decided to do was:

  1. hit the dobble arrows to the right of the balancing portion of the screen (at the very bottom)image.png.e52206a33ca38f5b590e75f971635157.png 
  2. removed all background applications i.e Plex etc., from running
  3. removed all background processes not necessary for the balancing to occur
  4. checked the throughput on Drive Scanner then closed it too 

My Results:

My balancing is now humming along between 180MB/s and 210MB/s. (value taken from StableBIt Drive Scanner) And now maybe sometime this evening it will be finished.

Hopefully this helps someone as it helped me.

Link to comment
Share on other sites

  • 0
On 12/7/2022 at 6:24 AM, Mesonto said:

Cam,

I had the same issue with drive balancing as I removed a single 8TB Red Nas and inserted an 18TB Red Nas drive in its place for increased storage and the drive balancing was plodding along at about 25MB/s. (value taken from StableBIt Drive Scanner) At this rate it will take longer than a week in my 5 drive StableBit DrivePool. My drives are fast than this, much faster.

So what I decided to do was:

  1. hit the dobble arrows to the right of the balancing portion of the screen (at the very bottom)image.png.e52206a33ca38f5b590e75f971635157.png 
  2. removed all background applications i.e Plex etc., from running
  3. removed all background processes not necessary for the balancing to occur
  4. checked the throughput on Drive Scanner then closed it too 

My Results:

My balancing is now humming along between 180MB/s and 210MB/s. (value taken from StableBIt Drive Scanner) And now maybe sometime this evening it will be finished.

Hopefully this helps someone as it helped me.

Yea I have smashed the "FF arrow" button over 100x... and closed all other programs... still no change

Link to comment
Share on other sites

  • 0
On 1/11/2023 at 12:48 PM, Cam said:

Yea I have smashed the "FF arrow" button over 100x... and closed all other programs... still no change

I just migrated my Plex to a newly built box this morning and was having the same issue....writing at at an abysmal 2.1 MB/s compared to the normal 200ish MB/s. It'd of taken a week or more to balance out my 91TB box. Came across this post while trying to figure out what the issue was as normal copying to any of the drives in the pool were as expected...~225 MB/s.

The FF button is what fixed it for me. The trick is not to mash it, but to click it once and it stays highlighted or bolded if you will. Seems to be a toggle button, but it took me a couple times to get it to stay. Looks to be a slight delay of some sort once you click it and it actually shows or takes effect. Attached a pic of mine.

I'm not sure what DP is doing by default that is causing it to behave like this, but I'd like to change this. Anyone know if it's a setting in the aforementioned JSON settings and if so, which one?

 

Capture.PNG

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Answer this question...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...