Jump to content

  • Log in with Twitter Log in with Windows Live Log In with Google      Sign In   
  • Create Account

Photo

Recommended setup for Google drive?

gdrive google drive storage howto

  • Please log in to reply
1 reply to this topic

#1 Atarres

Atarres

    Member

  • Members
  • PipPip
  • 17 posts

Posted 02 May 2017 - 04:34 PM

I'm in the middle of doing a setup on G-suite. Seeing they don't cap space (yet) I want to go that route (I'll upgrade to the required users if it becomes an issue later on). For a cloud drive setup (aiming at 65TB to mirror local setup) Any recommended methods for storage? I saw another post here recommending various prefetch settings, however was not clear on whether new drives should be sized a certain way? Various 2TB drives or max out at 10TB for each one then combine into one share using DrivePool?

 

Ultimately hoping to get an optimal setup out of the gate. And probably would not hurt to document that here for others to follow as well. Ideally using it with DrivePool so that it can be treated as one massive drive. 


  • Antoineki likes this

#2 Edrock200

Edrock200

    Advanced Member

  • Members
  • PipPipPip
  • 36 posts

Posted 03 May 2017 - 05:23 AM

Just a heads up, you can create drives up to 256tb, you just have to type it in. You can also resize drives, but you need to ensure the cluster size you set on creation will support the larger drive sizes. I created on massive 256tb. I'm not saying this is the best setup, but from a performance perspective it works just as well as my 2tb test drive in terms of speed. Cloud drive doesn't actually allocate the full drive space on creation, so I aside from the OS needing to mount the file allocation space, I don't think you will see performance differences based on drive sizes.

 

It's also important to note that although some settings can be changed on the fly or when mounting the drive, some settings cannot be changed once the drive is created unless you destroy it and start over. Off the top of my head the ones that cannot be changed I believe are: chunk size, cluster size, whether or not the drive is encrypted, if encrypted the key itself, and I think a chunk verification setting, but I could be wrong on that last one.

 

Min download size and chunk cache size can be changed, but not on the fly. You need to dismount and remount the drive to change this setting.

 

Prefetch, up/down thread count, bandwidth throttling and cache size/type can all be changed on the fly.

 

The biggest perfomance gains I've seen are from the chunk size, min chunk download/upload, read/write i/o threads and prefetch settings. These settings vary drastically depending on what type of media you are storing. If it's small data files, then smaller chunks are better. If it's large multimedia, larger chunks are better. I'm doing primarily multimedia storage so my settings are:

 

5/5 read/write threads

20MB chunks (max for Google Drive)

100MB Chunk Cache

20MB Min Download size

50GB Cache, Epandable (I've changed this from 20 all the way up to 80GB without much difference in streaming performance, however because I frequently move large files around, I benefit from the increased cache.

 

Prefetch:

20MB Trigger

100MB Prefetch

120 Second Window

 

 

250MB/250MB Up/Down Throttle

 

You'll probably notice that most others doing multimedia have much more aggressive prefetch settings than mine. In my case, these settings allow 3 to 4 HD streams without issue, and more aggressive prefetch settings cause me throttling and disconnect issues.







Also tagged with one or more of these keywords: gdrive, google drive, storage, howto

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users