Jump to content
  • 0

Why is balancing so slow? Is it just me, or like this for everyone?


gd2246

Question

I added two new 12 TB drives to my pool yesterday and hit Re-Balance, and it is taking forever. As you can see in the pictures, it is currently moving data from one of my 8 TB drives to one of my new 12 TB drives. It has been doing so all night at about 10 to 20 MBps. At this rate (2% completed in one day) it will take about 50 days.

Also shown in the pictures is me bypassing DrivePool by manually moving some files within the PoolParts using Windows Explorer from a 10 TB drive to the other new 12 TB drive. Stablebit Scanner shows that these speeds are normal, around 200 MBps. They are all on the same HBA, so the problem can only be caused by DrivePool.

I know the obvious solution would be to manually move all the files to the new drives myself like I demonstrated in the pictures, but that would still be several days of me babysitting the process. I paid for DrivePool, and would like to be able to use it so I can just hit the Balance button and walk away.

I tried checking and unchecking the Bypass File System Filters and Network I/O Boost settings but that had no effect, and I am not using file duplication. Is there anything else I can try?

01.jpg

02.jpg

03.jpg

04.jpg

Link to comment
Share on other sites

14 answers to this question

Recommended Posts

  • 1

Sorry guys I wish I could help. It's been years since I made that post, and hitting the arrows button has always worked for me. There are only two things I can think of that may help.

One is that someone above said they've tried hitting the button "100x times". But it is a toggle, meaning that it is either on or off, so you only need to press it once, then wait. It can take a few minutes to have an effect, so don't press it again or you'll be turning it off.

The other thing is that every time I get a notification to update drivepool, I click on it but it fails for some reason. I don't remember the exact error message and I've never cared enough to figure out why because it works just fine, but what I'm getting at is that I'm running an older version of it, version 2.2.5.1237. Perhaps this is a problem introduced in newer versions.

If it's neither of those things, then I can't think of anything else. I hope you figure it out.

Link to comment
Share on other sites

  • 0
36 minutes ago, Umfriend said:

In the DP GUI, see the two arrows to the right of the balancing status bar? If you press that, it will increase the I/O priority of DP. May help some. Other that that, ouch! Those are more like SMR-speeds.

Thank you for your reply, I didn't even notice those arrows. I hope it will help. I'll try it as soon as my latest manual move is completed.

Since no one replied till now and I couldn't think of anything else, all day I've been using the DrivePool re-balance target arrows just to tell me how much needs to be moved from each drive and doing it manually in Windows Explorer, from two drives to my two new drives simultaneously which should cut my initial estimate of a few days in half. Each time I initiate a move it takes a few hours for those two drives to finish moving the data, but that's far better than what I was getting.

Just to hammer home that it is not my HBA and I don't have any SMR drives, here's another photo of the manual file-moving I've been doing. It's been going like this with no speed problems all day. I've never thought to take a screenshot of StableBit Scanner during a SnapRAID parity check, but it always goes quickly so I'd bet it can maintain these speeds across all drives. It has to be something to do with DrivePool.

Thanks again for the help, I'll post again when I have a chance to try it.05.thumb.jpg.c3e0c40a3ede1927ee5d0c1d4cd3ff60.jpg

Link to comment
Share on other sites

  • 0

BTW, if you move files among pooled-drives, I think it is strongly advised to stop the DrivePool Service (and restart it or reboot when done). Also, I realise it is painfully slow for you (and I have no clue as to what would be the cause of that) but in my experience, DP is really a fire-and-forget program. I wouldn't care if it took a month so to say, it works just fine while it is balancing.

Link to comment
Share on other sites

  • 0
2 hours ago, Umfriend said:

In the DP GUI, see the two arrows to the right of the balancing status bar? If you press that, it will increase the I/O priority of DP.

OMG, that was it! Thank you so much! I'm kicking myself for not seeing it. :)

06.thumb.jpg.959a65ed93b41e79e2402c95f66a476c.jpg

1 hour ago, Umfriend said:

I realise it is painfully slow for you (and I have no clue as to what would be the cause of that)

Not true, you nailed it! :D

About moving the files without stopping DrivePool, I did notice that after each move the data I moved showed up as "Other", rather than part of the pool. A quick Re-measure got it to see it as part of the pool again though. Not sure if that's what you meant or if it could have been something more serious, but thanks for the heads up.

And yeah I know Drivepool will work fine while it balances, but it's my SnapRAID parity files I'm worried about. When I do these re-balances, it renders the parity files invalid. Some say that having more than one parity drive increases your chances to recover if the files are on different disks, but I don't want to test that. Plus I would add a lot of data in almost 2 months, and with it constantly moving from the balancing, I wouldn't even be able to do another scan. Well I could if I paused it but the parity info would be useless once I started it back up again.

Normally I don't use the balance feature for that reason, because it creates a window where I have no backups. I only do it when I add new drives. Actually not even always then, I only did it this time because I waited too long to buy new ones and the rest of my drives were over 90% full, which from what I understand isn't good for them.

Anyway you really helped me out here, thanks again!

Link to comment
Share on other sites

  • 0
5 minutes ago, gd2246 said:

Not true, you nailed it! :D

A bit by accident as I did not really expect that simple thing to make such a difference. Anyway, you are welcome.

What you say about the "Other", yeah, that is part of it. Donnow whether it can lead to more serious consequences but stopping the DP Service when you want to do your own file tranfers is best practice.

Now to nitpick, SnapRAID is not a backup. Sure, it may save you from HDD failure to some extent but not against accidental deletions, theft, fire, simultaneous multiple HDD failure (and you got a few). If you value your data, you might consider a real solution. You wouldn't want to lose your personal copy of the entire interweb (91TB, uhm, wow!) :D

Link to comment
Share on other sites

  • 0

Hey you got it right so you knew more than I did, lol.

And yeah I know it's not really a backup but it's a nice balance between buying double the amount of drives I have and nothing at all. I've got two parity drives which would mean I'd have to lose 3 at the same time to experience any data loss. Except of course as you said fire, theft, etc.

And also not to nitpick but it does protect against accidental deletions, as long as you realize what you did right away you can get those files back. :)

But I know you're right. It's just that there's a reason my drives got so full this time, I was waiting for a sale! This gets really expensive & there's no way I could afford a true backup. Besides, what I'm hoarding can all be replaced, it would just take a year or two, lol. But all my irreplaceable stuff like family photos & videos have both offline & offsite backups. 

Thanks for your concern though, and again of course for your help!

Link to comment
Share on other sites

  • 0

Same thing. It is balancing off my SDD to a WD Red Plus at ~5mb/s. Clicking the arrow does nothing.

 

I tried editing the settings config as mentioned here without luck:

Meanwhile directly copying a file from the SSD to the the HDD results in speeds around 200 mb/s. I'm really at a loss as to why this is happening, I don't remember this behavior before.

Link to comment
Share on other sites

  • 0

Yeah its really irritating. My concern is that I would not be able to remove a drive if it started to fail since it is so slow. This can't be normal behavior.

To illustrate, first pic is Drivepool moving unduplicated files from an SSD to an archive HDD. The second is when I pause Drivepool and manually copy over the files.  5mb/s vs 197 mb/s.

Edit: I should add, moving or copying files from the Drivepool to an unpooled drive also hits an appropriate speed. It's just the internal balancing/drive removal that is very slow.

 

Screenshot2023-12-08110520.thumb.png.61a71ec78ff1d8d23f2d6847f27a0849.pngScreenshot2023-12-08140434.thumb.png.f447d780167fad1d2fdaf78f13cb7ff5.png

Link to comment
Share on other sites

  • 0

Thank you! I did a complete uninstall with RevoUninstaller (reg entries, Drivepool program folders etc) and installed 2.2.5.1237.

I'm not sure if it was uninstalling it or using an earlier version but now it seems to work how I remember.

I'm going to upgrade to the newest version since it has specific features I use and see if it continues to work normally.

Screenshot is now how it looks balancing.

Screenshot 2023-12-08 173022.png

Link to comment
Share on other sites

  • 0

So this is weird.

A complete uninstall including registry entries and Drivepool's program folder with Revo Uninstaller followed by fresh install with 2.2.5.1237 works with expected speeds.

Installing latest version 2.3.3.1505 over that goes back to 5mb/s.

A standard uninstall using Windows of 2.3.3.1505 and rolling back to 2.2.5.1237 continues to be 5 mb/s

Doing a complete uninstall with Revo and reinstalling 2.2.5.1237 again allows it resumes working at expected speeds.

I'm testing by using a folder with a 15gb video file and mixed smaller files and bouncing it between drives using a folder placement rule.  I also tested using a 500gb solid file. Only on a clean 2.2.5.1237 installation am I able to get expected speeds.

So it seems like at at some point something changed that negatively affects transfer speeds and persists unless you completely uninstall it from your system.

Anyway, going to try a different version next.


Edit: Tentatively 2.3.2.1493 seems to work well. I will update if anything changes.

Edit2: Nope, started noticing the same behavior. Worked my way back to 2.3.1.1448 and still getting slow speeds on re-balancing. It takes a really long time to reinstall, recheck drives, test balancing so I'm back to the latest version now as 2.2.5.1237 is missing a lot of the functionality of the later releases. I'm hoping a future update changes something. This is with unduplicated files. SDD to HDD balancing caps at 5mb/s and SDD to SDD balancing caps at 40 mb/s.

Edit3: Alright so I feel like an idiot but it looks like my SSD drives were running on a USB 2.0 interface and not a USB 3.1 despite it being in the same enclosures as my HDD which were all 3.1 per USBTreeView. I remember checking this before and the SSDs were running at 3.1 Superspeed. I think this is also why the 'fix' of swapping to a different Drivepool version stopped working because  at some point they downgrade to USB 2.0 and the transfer speed plummets. I don't think this has anything to do with Drivepool but wanted to throw this edit out there to save someone a bunch of misplaced effort. Anyway, not sure if its an enclosure issue (Mediasonic Probox, have used a handful and they have always worked well) or windows, but I reinstalled the drive drivers and reseated them so I'll see.

 

 

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Answer this question...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...