Jump to content
Covecube Inc.
  • Announcements

    • Christopher (Drashna)

      Login issues   11/07/17

      If you have issues with logging in, make sure you use your display name and not the "username" or email.  Or head here for more info.   http://community.covecube.com/index.php?/topic/3252-login-issues/  
    • Christopher (Drashna)

      Getting Help   11/07/17

      If you're experiencing problems with the software, the best way to get ahold of us is to head to https://stablebit.com/Contact, especially if this is a licensing issue.    Issues submitted there are checked first, and handled more aggressively. So, especially if the problem is urgent, please head over there first. 
  • 0
Sign in to follow this  
Atarres

Recommended setup for Google drive?

Question

I'm in the middle of doing a setup on G-suite. Seeing they don't cap space (yet) I want to go that route (I'll upgrade to the required users if it becomes an issue later on). For a cloud drive setup (aiming at 65TB to mirror local setup) Any recommended methods for storage? I saw another post here recommending various prefetch settings, however was not clear on whether new drives should be sized a certain way? Various 2TB drives or max out at 10TB for each one then combine into one share using DrivePool?

 

Ultimately hoping to get an optimal setup out of the gate. And probably would not hurt to document that here for others to follow as well. Ideally using it with DrivePool so that it can be treated as one massive drive. 

Share this post


Link to post
Share on other sites

1 answer to this question

Recommended Posts

  • 0

Just a heads up, you can create drives up to 256tb, you just have to type it in. You can also resize drives, but you need to ensure the cluster size you set on creation will support the larger drive sizes. I created on massive 256tb. I'm not saying this is the best setup, but from a performance perspective it works just as well as my 2tb test drive in terms of speed. Cloud drive doesn't actually allocate the full drive space on creation, so I aside from the OS needing to mount the file allocation space, I don't think you will see performance differences based on drive sizes.

 

It's also important to note that although some settings can be changed on the fly or when mounting the drive, some settings cannot be changed once the drive is created unless you destroy it and start over. Off the top of my head the ones that cannot be changed I believe are: chunk size, cluster size, whether or not the drive is encrypted, if encrypted the key itself, and I think a chunk verification setting, but I could be wrong on that last one.

 

Min download size and chunk cache size can be changed, but not on the fly. You need to dismount and remount the drive to change this setting.

 

Prefetch, up/down thread count, bandwidth throttling and cache size/type can all be changed on the fly.

 

The biggest perfomance gains I've seen are from the chunk size, min chunk download/upload, read/write i/o threads and prefetch settings. These settings vary drastically depending on what type of media you are storing. If it's small data files, then smaller chunks are better. If it's large multimedia, larger chunks are better. I'm doing primarily multimedia storage so my settings are:

 

5/5 read/write threads

20MB chunks (max for Google Drive)

100MB Chunk Cache

20MB Min Download size

50GB Cache, Epandable (I've changed this from 20 all the way up to 80GB without much difference in streaming performance, however because I frequently move large files around, I benefit from the increased cache.

 

Prefetch:

20MB Trigger

100MB Prefetch

120 Second Window

 

 

250MB/250MB Up/Down Throttle

 

You'll probably notice that most others doing multimedia have much more aggressive prefetch settings than mine. In my case, these settings allow 3 to 4 HD streams without issue, and more aggressive prefetch settings cause me throttling and disconnect issues.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this  

×