Jump to content
Covecube Inc.
  • 0
Adramelramalech

eXtreme bottlenecks

Question

I never seen my drives do this until I installed pooldrive. I transfer data and it goes normally for about 30 seconds and then it just dies. Literally goes and drops to 0kb/s, then up a little more, then down, then up, then maybe up to 60mb/s, then back down, stays under 5mb/s for a while, may go backup, may stay down. I am moving TB's of data and it has been weeks. I pause the transfer, wait some time, resume and it goes right back up to normal speeds, then drops right back down and dies. I open resource monitor and I clearly see the problem. It is reading a few files from the source driving but making a queue of way too many files to write on destination. For example, one season had 22 eps, another 12 and another 12. I sorted by write speed and the last ep, ep 22, all of the next season and a few of the next were in queue. That is 15 files. So it is reading 3-4 files and writing almost a dozen and a half. Why? that is dumb. hmmmm. Makes no sense. So how do i tell stablebit to write one file at a time?

speeds.png

speeds.png

Share this post


Link to post
Share on other sites

15 answers to this question

Recommended Posts

  • 0

In my experience Resource Monitor's reporting of read and write rates can lag behind what's actually happening, making it look like it's transferring more files at any given point than it really is - but that transfer graph is definitely a sign of hitting some kind of bottleneck. It's the sort of thing I'd expect to see from a large number of small files, a network drive over wireless, or a USB flash drive.

Can you tell us more about what version of DrivePool you're using (the latest "stable" release is 2.2.3.1019), what drives are involved (HDD, SSD, other), how they're hooked up (SATA, USB, other) and if you've made any changes to the Manage Pool -> Performance options (default is to have only Read striping and Real-time duplication ticked)?

Examining the Performance indicators of DrivePool (to see it, maximise the DrivePool UI and click the right-pointing triangle to the left of the word Performance) and the Performance tab of Task Manager when the bottlenecking is happening might also be useful.

Hmm. You might also want to try something other than the built-in Windows copier to see if that helps, e.g. FastCopy ?

Share this post


Link to post
Share on other sites
  • 0

they are gig or so or under 1 gig sized files, some are 1.5gb

2.2.3.1019
seagate barracudas

internal SATA controller pciexpress
right now they all are checked. thought it would help but i think it made it worser.

speeds.png
 

They are all SATA

20200907_222442.jpg

Share this post


Link to post
Share on other sites
  • 0

All i know is it is taking weeks to move terabytes of data. I have no time for this and I am getting so far behind.
I just do not understand why there is no good or easy harddrive software out that there. All companies expect people to just have all these empty drives. Only reason why I am moving data is to get it into the pool. I emptied one drive, added that to the pool and just been repeating disk for disk. And these bottle necks are truly killing me.

Share this post


Link to post
Share on other sites
  • 0

It looks like you've got only one physical disk currently in your pool? Are you "moving" your files from a folder on that physical disk to a folder in your pool?

If so that'll lead to Windows not realising it's still the same drive "physically" and it'll be bottlenecking itself by doing copy-delete-copy-delete-copy-delete when it could just be doing move-move-move...

Just saw your latest post as I was typing the above; looks like that's what's happening? There's a MUCH faster way if so...

Share this post


Link to post
Share on other sites
  • 0

it has gotten to the point where i do not know what to do. I hate to uninstall this and I hate to have wasted the last few weeks. I have never seen my drives act like this before. I am literally transferring hundreds of gigs at 2MB/s a second

 

Share this post


Link to post
Share on other sites
  • 0

If you've got time now, I can help you out via remote support (I'm on lunch break). I'll message you a link.

Share this post


Link to post
Share on other sites
  • 0

So many have no such issues at all. Could it be there is something somewhat specific to your situation is going on? Some here will be trying to help but it helps if you provide a bit of sensible information. So, again, have you checked Event Viewer (for IDE/ATAPI/DISK errors specifically but any other errors might be relevant) and what model HDD s this exactly?

Also, can you try to copy some represntative files to that drive F:\ instead of to the Pool?

Share this post


Link to post
Share on other sites
  • 0

I'm hoping for another remote session. After further reading I suspect the (main) issue may be the use of SMR drives (horribly slow during long sequential writes involving used sectors) but I'd like to confirm exactly what's going on. And if we seed the pool at least we can work around that problem for the time being.

Share this post


Link to post
Share on other sites
  • 0

As a belated followup to this: yes, there was a SMR drive involved.

If you're looking at buying new drives, check the manufacturer specs very closely for SMR showing up instead of CMR or PMR, as it might not be mentioned by the seller.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Answer this question...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...

×
×
  • Create New...