I've run into an odd issue with CloudDrive and PreFetch. Essentially, with prefetch off, I get 300MB/s up and ~150MB/s down (when something is being pushed/pulled.) when I turn prefetch on, the upload downloads come to a screeching halt, uploads bob up and down from 0 to 15mb's and downloads generally stay under 1mb/s although they may occasionally go up to 8mb/s for a few seconds. Once I turn prefetch off and the time expires, the numbers spike back to their normal throughput. Here are my settings:
Google Drive attached
256TB AES Encrypted mount
10TB in use
20MB chunks
10MB/1 minute upload trigger
500/500 Internet with Gig-E link
Upload/download threads set to 5/5 (have tried 3/3 and 10/10 as well with same results.) Background I/O checked
Prefetch - Trigger 1MB, Forward 400MB, Time 1800 Seconds (tried 10/100/600, 1/1000/3600 with same results)
Upload Download limited to 250MB/250MB, although tried removing these limits for testing, same results
30GB expandable cache set on local SSD drive (tried increasing, reducing, changing to fixed or dynamic with same results)
Upload queues are at 0 prior to prefetch being enabled, but once enabled they start to grow due to the speed decrease
One thing I've noticed, I'f I'm understanding the summary screen correctly, is above the upload and download arrows it will show numbers like 3x or 5x. I'm assuming this is the number of threads being utilized. With prefetch off, this number never exceeds my max i/o settings for upload/download. However, with prefetch turned on, the download threads will go up, I've seen it go up to 12x for example. Does prefetch not respect the max i/o settings or am I missing something? Also, the prefetch fills slowly. Is the prefetch duration saying "if 1mb of same file is read, fetch next 400MB steadily/evenly spread over the next 1800 seconds" or is it saying "if 1mb of same file is read, fetch next 400MB as fast as possible keep for 1800 seconds."?
Also, what is the significance of the "Background I/O" checkbox next to upload threads? What does turning this option off and on do?
Question
Edrock200
Hey all,
I've run into an odd issue with CloudDrive and PreFetch. Essentially, with prefetch off, I get 300MB/s up and ~150MB/s down (when something is being pushed/pulled.) when I turn prefetch on, the upload downloads come to a screeching halt, uploads bob up and down from 0 to 15mb's and downloads generally stay under 1mb/s although they may occasionally go up to 8mb/s for a few seconds. Once I turn prefetch off and the time expires, the numbers spike back to their normal throughput. Here are my settings:
Google Drive attached
256TB AES Encrypted mount
10TB in use
20MB chunks
10MB/1 minute upload trigger
500/500 Internet with Gig-E link
Upload/download threads set to 5/5 (have tried 3/3 and 10/10 as well with same results.) Background I/O checked
Prefetch - Trigger 1MB, Forward 400MB, Time 1800 Seconds (tried 10/100/600, 1/1000/3600 with same results)
Upload Download limited to 250MB/250MB, although tried removing these limits for testing, same results
30GB expandable cache set on local SSD drive (tried increasing, reducing, changing to fixed or dynamic with same results)
Upload queues are at 0 prior to prefetch being enabled, but once enabled they start to grow due to the speed decrease
One thing I've noticed, I'f I'm understanding the summary screen correctly, is above the upload and download arrows it will show numbers like 3x or 5x. I'm assuming this is the number of threads being utilized. With prefetch off, this number never exceeds my max i/o settings for upload/download. However, with prefetch turned on, the download threads will go up, I've seen it go up to 12x for example. Does prefetch not respect the max i/o settings or am I missing something? Also, the prefetch fills slowly. Is the prefetch duration saying "if 1mb of same file is read, fetch next 400MB steadily/evenly spread over the next 1800 seconds" or is it saying "if 1mb of same file is read, fetch next 400MB as fast as possible keep for 1800 seconds."?
Also, what is the significance of the "Background I/O" checkbox next to upload threads? What does turning this option off and on do?
Thanks in advance,
-Ed
14 answers to this question
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.