Jump to content
  • 0

Backing up large amounts causes server to "freeze"


WHS_Owner

Question

Hi,

 

I'm using CloudDrive to backup files to Google Drive. I was using "Allway Sync", but had the issues I will describe below, so switched to "GoodSync", but this issue persists so I have to assume it's related to CloudDrive?

 

I'm using an empty 3TB drive as the cache location (so space is not an issue), I have Cloudbit settings as default (cache 1GB but allowing it to grow as needed). If I set up a sync with either of the above programs for a smaller selection of files like My Pictures (couple of GB) it will all copy to the cache drive quickly then happily saturate my internet upload speed and be uploaded with no problems. As soon as I try and sync a larger selection of folders, say My Movies, I can see it copying to the cache drive, but the next morning I can no longer RDP to my server. 

 

The server is still running, I can see a list of the shared folders from my PC over my home network, Team Speak is running as I can see the entry on my PC, but trying to read/write or RDP to the server is sooo slow to the point it deosn't happen. The server runs WHS 2011, I have the latest beta version of Cloudrive & Drivepool. The files I'm copying are on the Pool but as mentioned the cache drive is separate and not used for anything else. The only way I've been able to get back into the server previously is to hard reboot it by holding down the power button...which can cause problems of it's own!

 

I'm running out of ideas as to what the problem is? Any ideas? Getting pretty frustrated as I know this should work but it's not :-( 

Link to comment
Share on other sites

7 answers to this question

Recommended Posts

  • 0

Windows uses RAM as a cache when copying files between drives. My guess is that your large transfer eventually saturates your computer's RAM before that RAM can be destaged to the cache drive. Since your computer is now starving for RAM, other tasks begin to fail/take forever.

 

My server has 16GB of RAM and I saw something similar. I would suggest using UltraCopier to throttle the copy. I set the throttle to the same as my upload speed and I had no more issues trying to copy a 4TB folder to my CloudDrive (other than it taking a few weeks) :)

Link to comment
Share on other sites

  • 0

Windows uses RAM as a cache when copying files between drives. My guess is that your large transfer eventually saturates your computer's RAM before that RAM can be destaged to the cache drive. Since your computer is now starving for RAM, other tasks begin to fail/take forever.

 

My server has 16GB of RAM and I saw something similar. I would suggest using UltraCopier to throttle the copy. I set the throttle to the same as my upload speed and I had no more issues trying to copy a 4TB folder to my CloudDrive (other than it taking a few weeks) :)

 

Right ok, that makes sense...the one thing I didn't take into consideration!! Guess I can wait until it's all being copied to the cache and see if the server comes back to "life". This problem will only happen the first time I start these huge uploads anyway then, as after that they will just be backing up any new or different files.

 

Thanks for the info :-)

Link to comment
Share on other sites

  • 0

The newest builds (620+) include some changes to the memory management and may help reduce the memory usage.  It may be worth trying it out. 

 

http://dl.covecube.com/CloudDriveWindows/beta/download/StableBit.CloudDrive_1.0.0.624_x64_BETA.exe

 

Ok thank you, would I still need to use something like Ultracopy to limit copy speed to upload speed do you think?

Link to comment
Share on other sites

  • 0

It wouldn't be a bad idea. 

 

Update! It's fixed. I limited the upload speed to slightly less than my internet upload speed and it's happily chugged away all night. 

 

So the upshot of this is, I don't need a 3TB drive as a cache drive (it'll never get used) as the real limiting factor seems to be memory! In 4 days when this lot is uplloaded I'll switch back to a much smaller cache drive somewhere and make better use of that 3TB!

 

Thanks :-)

Link to comment
Share on other sites

  • 0

Update! It's fixed. I limited the upload speed to slightly less than my internet upload speed and it's happily chugged away all night. 

 

So the upshot of this is, I don't need a 3TB drive as a cache drive (it'll never get used) as the real limiting factor seems to be memory! In 4 days when this lot is uplloaded I'll switch back to a much smaller cache drive somewhere and make better use of that 3TB!

 

Thanks :-)

 

I'm glad to hear that! 

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Answer this question...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...