Jump to content
  • 0

Slow Copying speed after Fast Copying


Damionix

Question

Hello there, 

 

I am having a very peculiar issue here with Drivepool. I have a stand alone hard drive ( let's call it D:), that I use to download stuff to, rename it, and then copy it to my Pool (F:). When I started using drivepool, the copying speeds used to fluctuated between 80-300MBPS. But after a few months of using it, it starts at about 1.2GBPS and drops to a low low 9MBPS and stays there for the whole copying. Needless to say this takes me a lot more time to copy huge files. Like it took me 2hrs 15 mins to copy a 75GB TV Show. That is quite unusual. That should have been done in less than 20 minutes in normal copying time. 

 

Is there something I have done in my settings that could have caused this? Attached is a screenshot of my Balancing settings. 

Any help is appreciated. I go through at least 200GB of file manipulation a week. 

 

Just to add, Stablebit Scanner reports all the drives as being fine.

 

Any help is appreciated. 

 

Thanks.

post-2551-0-95185600-1473432695_thumb.jpg

Link to comment
Share on other sites

Recommended Posts

  • 0

What OS are you using (run "winver" if you're not sure)

What version of StableBit DrivePool are you using (listed in the UI).

 

Also, are you using any antivirus, backup or disk tools in the system? 

Could you post the results of this: http://wiki.covecube.com/StableBit_DrivePool_Q2159701

 

And could you grab the event viewer logs? 

Run "eventvwr.msc", open the "Windows Logs" section, right click on the "System" entry, and select "Save all events as" and create a ".evtx" file, and upload it to us (there is a link in the log collection link below to upload the files, and use that)

 

Additionally, could you grab the logs from here: http://wiki.covecube.com/StableBit_DrivePool_2.x_Log_Collection

 

 

Also, as Lando mentioned, do any of the disks in the pool have issues copying files to them individually? 

Also, have you tried running the "Burst Test" in StableBit Scanner, to see if yoou're having any communication issues with one or more disks?

 

Also, try opening up StableBit Scanner when this is happening. Right click on the column header and select "Performance" and "Disk Queue".  See what this shows, and see if the disk queue goes above 3. 

Link to comment
Share on other sites

  • 0

I have never tried copying directly into another drive. Always directly into the Pool in question. This is where things get a little confusing. I have another pool of 16TB that I use to mirror the contents of the first fool. I use 'Create Synchronicity" to accomplish this. When it is copying from the Main pool to the secondary pool ( all pools created with Drivepool), I don't get this same slow down. Copying speed goes up between 80-150MBPS. So from one pool to another, all seems fine. However, from a singular hard drive that is not part of the pool, to the main pool, I get this slow downs. Writing to the pool seems to be the issue and not copying from it. 

 

The only Anti Virus I have is Windows Defender. 

OS is Windows 8.1 Pro with Media Center. Version 6.3 , Build 9600

 

I will do the Burst test next time I have a a huge file set to copy and I will report that back. 

In the mean time, I have attached the files you asked me to. 

 

post-2551-0-11702000-1473530370_thumb.png

logs.evtx.zip

ErrorReports.zip

Logs.zip

Link to comment
Share on other sites

  • 0

They are all Internal. The AllmightyBackup is external over USB 3, four bay enclosure, but am not worried about this one. 

Am more worried about the internal drives for my main Multimedia pool. 

I have narrowed the issue down to Drivepool as I performed test from normal Drive (not in pool) to another USB drive and the speeds were very normal. 

However if I tried to copy the same file to any of the pools, (Multimedia or AllMightyBackup), the slowness begins.

Is there something I need to change in the settings for Drivepool?

 

PS: Sorry about your emergency. Hope things got better.

Link to comment
Share on other sites

  • 0

Specifically, are any of the pooled disks external? 

 

 

 

Also, could you install one of the later betas, and see if that fixes the issue (there have been a lot of changes, so it's possible that it's already resolved). 

THe 2.2.0.651 build is the public beta, but the 2.2.0.708 is the latest internal beta.  I'd recommend the second one, but either may help. 

 

 

if the issue persists, then please enable logging: 

http://wiki.covecube.com/StableBit_DrivePool_2.x_Log_Collection

 

As soon as the slow copy occurs, turn off logging and upload the files. 

 

 

 

PS: Sorry about your emergency. Hope things got better.

Thanks.  And mostly. It's being "handled" but waiting on surgery ... to remove my gallbladder. Yay...

Link to comment
Share on other sites

  • 0

Specifically, are any of the pooled disks external? 

 

 

 

Also, could you install one of the later betas, and see if that fixes the issue (there have been a lot of changes, so it's possible that it's already resolved). 

THe 2.2.0.651 build is the public beta, but the 2.2.0.708 is the latest internal beta.  I'd recommend the second one, but either may help. 

 

 

if the issue persists, then please enable logging: 

http://wiki.covecube.com/StableBit_DrivePool_2.x_Log_Collection

 

As soon as the slow copy occurs, turn off logging and upload the files. 

 

 

 

Thanks.  And mostly. It's being "handled" but waiting on surgery ... to remove my gallbladder. Yay...

 

Ok. I did download the internal Beta and installed it. During multiple testing, I now have speeds between 9MBPS on low, and 21MBPS on high. 

There is a slight improvement over the 2MBPS and 9MBPS highs I was getting. 

I have always had the same settings. Am just wondering what could have caused this much deterioration in copying speed over time. 

Do you have any more suggestions?

Link to comment
Share on other sites

  • 0

A couple of ideas that i don't think you have tried

 

the files you are copying are large i believe - i.e. multi gigabyte in size? so you should get maximum speed from the source drive

 

what type of drive is the D: drive - have you run any checks/speed tests/checked the smart records for the drive? is the D: drive full or "empty" when you do the transfer. if its an ssd is it getting hot and thermal throttling coming into play?

 

does the d: drive do anything else besides "copy" files over - it looks like you call it "database" have you got processes accessing the disk when doing the copy? Have the processes been updated recently and are hogging the disk?

 

Are the pool drives on the same sata controller to the D : Drive - has the driver(s) been updated in the recent past - by say windows update rather than you directly - have you checked what updates windows update has installed recently - i.e. anything to do with the system?

 

Can you swap the D: drive for another disk if possible a different type?

 

Might have some more ideas depending on the above

 

Have fun

Link to comment
Share on other sites

  • 0

Adding to the above have you tried connecting 1 of drives directly to the computer this would help rule out if there is a controller issue I really don't think this is a drivepool/scanner problem but more of a hardware issue also check the performance monitor to see what the disks are doing is there any throttling software or setting turned on

Link to comment
Share on other sites

  • 0

First of all, let me say thank you to all those who are responding. It is quite nice to have various feedbacks. Now, to answer the questions. 

 

D Drive: The D: drive is a 3TB Junk drive that I use for nothing but downloading files into, renaming, and then moving them into the pool. That is it's major purpose. It also serves as a DVR for Media Center. That is all I use it for. I have ran test of the drive and it reports as being fine.

As I reported earlier, If I copy anything from this drive to say and external HDD, it hits speed of 80MBPS and 150MBPS with no issues at all. 

As suggested earlier by one of the users on here, I also tried copying directly to one of the drives in the pool and not to the main pool itself and the slowness occurs. 

There have been no recent firmware updates to any of the drives. I monitor them with DriveScanner and CrystalDiskInfo Professional. 

 

During copying, the drive does nothing else but getting read from. No other application is writing to it or using it. 

In other to eliminate the D drive, I tried copying from an external USB drive to the pool and I get the same slow speeds. 

Copying a 9GB file takes about 20 minutes, copying that into the pool. That is not normal. 

 

Stablebit Scanner reports all the drives as being healthy with no pending issues. 

 

Now this is why I think it has something to do with Drivepool. I have a secondary pool (4 x4TB WD HDD in an external enclosure) connected via USB 3. If it were a problem with the drives in the main pool, then the copying should be OK for the second pool which is over USB 3. But it also goes through slow copying. 

 

Ever since I upgraded to the Internal Alpha build, the speed has gotten better progressively. I now get lows of 9 and highs of 25. Before it was lows of 2 and highs of 9.

Link to comment
Share on other sites

  • 0

"Are the pool drives on the same sata controller to the D : Drive - has the driver(s) been updated in the recent past - by say windows update rather than you directly - have you checked what updates windows update has installed recently - i.e. anything to do with the system?"

 

no i was meaning sata drivers not drive firmware but that would have been an option had you updated the firmware

 

Ok another idea

 

copy from the D drive to the disks in the pool individually but NOT into the pool - doing this will by pass the pool driver (if its the cause) and if everything is working correctly you should get the same speed from each drive making up the pool

 

do you have a spare drive to swap D: with - if you can that's the quickest way to check the disk is not the problem

 

you haven't got encryption running have you? the drive is not compressed?

 

When doing the copy check system resources to see what the computer is doing etc

Link to comment
Share on other sites

  • 0

"Are the pool drives on the same sata controller to the D : Drive - has the driver(s) been updated in the recent past - by say windows update rather than you directly - have you checked what updates windows update has installed recently - i.e. anything to do with the system?"

 

no i was meaning sata drivers not drive firmware but that would have been an option had you updated the firmware

 

Ok another idea

 

copy from the D drive to the disks in the pool individually but NOT into the pool - doing this will by pass the pool driver (if its the cause) and if everything is working correctly you should get the same speed from each drive making up the pool

 

do you have a spare drive to swap D: with - if you can that's the quickest way to check the disk is not the problem

 

you haven't got encryption running have you? the drive is not compressed?

 

When doing the copy check system resources to see what the computer is doing etc

 

I did try copying it directly to one of the drives and experienced the same slowness. Unfortunately I do not have any other spare drive to test it with by replacing the D: drive. 

 

Here is the filter test you wanted me to do: 

 

Microsoft Windows [Version 6.3.9600]
© 2013 Microsoft Corporation. All rights reserved.
 
C:\Windows\system32>fltmc
 
Filter Name                     Num Instances    Altitude    Frame
------------------------------  -------------  ------------  -----
WdFilter                               18         328010         0
luafv                                    1           135000         0
npsvctrig                               1          46000         0
FileInfo                               18          45000         0
Wof                                     0           40700         0
 
C:\Windows\system32>
 
 
I will try to get another HDD by the weekend and replace the D drive and see if things change.
Link to comment
Share on other sites

  • 0

The filters listed are the normal ones for Windows 8, and are well tested. 

 

Do you have the read striping open enabled (it is by default).  

Try toggling that and see if it helps (Pool Options -> Performance).  

 

And have you grabbed logs yet?

 

Ok. I will go ahead and toggle the performance options and get you a log, as well as let you know what happens when I do. 

 

Thanks.

Link to comment
Share on other sites

  • 0

Toggling the performance did not help. I tried different combinations and it still would drop to 9MBPS. The logs were included on the first page. 

Oh, I think I should mention this and see what you guys make of this. 

 

The Pool made up of external Hard drives in an Enclosure, over USB 3.0 now copies at a steady 110MBPS. Not sure what changed. But the Internal HDDs are still slow. 

Link to comment
Share on other sites

  • 0

Sorry for resurrecting my old thread, but this issue was never resolved. I just dealt with it. I am now forced to come back here because it has gotten significantly worst overtime. Now to copy a 20GB file takes over 1h30min. This is crazy. It took me more than 5 hours the other day to copy a 130GB collection of files with a minimum of 1GB per file. I have used Stablebit Scanner to monitor my drives and they are all healthy. Can you please help me see what my issue could be? I am still on Windows 8 Pro WMC.  I attached the logs months ago and never got a response back. Sad Panda :-( 

Link to comment
Share on other sites

  • 0

Have you checked your event logs for any warnings being thrown?

 

Something doesn't make sense to me though, you said if you copy directly to the disk, bypassing using DrivePool, you still get slow speeds, yet you still think DrivePool is the issue? Have you just uninstalled DrivePool and then seen if you still have slowness to those disks? There should be no real harm to doing this, and re-adding your disks to a pool after you re-install, other then if you had significant amounts of file shares on the aggregate disk.

 

Copying directly to the pool disks would bypass any DrivePool involvement, so this seems to me to exclude DrivePool as the problem and suggests either cabling, controller, or disk problems. You can even go the extra step of temporarily stopping your drivepool service and seeing if you still have the slow performance directly to disk. 

 

How old are your disks?

 

Have you re-seated your cables/checked them?  Did you do the copy test directly to each disk in the pool, i.e. do they all exhibit slowness?  You have significant external USB disks, if you swap an internal disk and an external disk, does slowness on the previously internal disk go-away and does the disk that was USB now appear slow? If you pop task manager and resource monitor, and do a large copy, do you see anything unusual happening (excessively high CPU, or in resource monitor, processes that are touching the files you are copying)?

 

Boot safe mode and copy some files around between pool disks, still show performance problems?

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Answer this question...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...