ironhead65

Hi there,
 
Awesome software - as always!  I've been using Drivepool and Scanner since nearly the beginning.  Currently I have something like 22 drives in my main drive pool.  They range from iSCSI, SATA-attached, USB (depending on the pool), Ximeta-attached (they have a custom network thing they do), or even virtualized under ESXi.  Anything that shows up to Windows as a physical drive can just be pooled.  I love it!
 
Recently purchased Clouddrive, after messing around and some Google Searching of this forum, I think I'm fairly setup well.
 
I have 13 clouddrives setup.
1 box.com, 2 dropbox, 10 Google Drive (not the paid cloud drives, but the provided ones for personal use).
 
I used all defaults for everything, except
set the cache to MINIMIAL+ Encrypted it, set it to auto login to that encrypted drives (as I only care that the CLOUD data is encrypted...I mean, you want to look at my pictures of my kids THAT bad and break into my PC to do it...okay, enjoy, you earned it).   Pointed to a specific 100GB hard drive partition that I could dedicate to this (using drivepool on all other drives and one specific thing mentioned was the cache drive could NOT be part of a drivepool) renamed it removed the drive letter and set it to a folder name (use this with drivepooling to cut down on the displayed drive letters for a clean look) I am getting a slew of "throttling due to bandwidth" issues.  I admit that my cache drive is probably too small for the amount of data I DUMPED and will continue to monitor this as I do not feel that I was getting those messages when I did not just DUMP enough data to fill the ENTIRE CloudPool in one shot.
 
So, my request is to have a view in the program to look at all drive upload/download at the same time.  Maybe even space?  I love the existing charts.  They are easy to look at, easy to read and understand.  I also like the "Technical Details" page as that shows a TON of information, such as the file - or chunk - and how much of it is uploaded / downloaded.
 
I'm wondering if there is a way to view all drives at once?  I would use this to get a sense of the overall health of the system.  That is, if I have to scan through all 13 drives, I do not see where my bandwidth is being consumed to understand if the cache drive is FULL or if I am having Upload/Download issues.  This reason, by the time I click through each drive, I do not see where the bandwidth is being consumed as the bandwidth seems to shift between drives fast enough that I do not see a true representation of what is going on.  I'm sure part of that is redrawing the graphs.
 
I find the technical details page much more useful, as I do not see what is LEFT to upload, but I get a much faster idea of what is going on and although annoying to click through ALL the drives, it seems to be giving me a better idea of what is going on.  I think that having an overall page would be fantastic.
 
Thank you again for continuing to show what is possible!
 
--Dan

Chris,
I just updated to the latest beta...an UPLOAD ALL PAUSE feature!  I really slacked and did not send you my script!
This is going to make things so nice!  I'll add that into my script as the original way, I also validated settings of the performance window.
Using the new mechanism will be so much faster!  I check for color around the PAUSE button, if grey, paused, if white, not paused.  Loop.  So much easier than clicking buttons and looking around for a popup!  Now, if you have to move things, I only have to adjust 1 thing, VS every button location!  Same with color.  This might make this easy enough to just check the window size and calculate where the buttons are.  This would REALLY make this fancy!
This is great!

if you didn't, then somebody else posted something similar then.  
 
And it's possible.  Though, generally,it shouldn't happen.  Though, if you reset the settings for StableBit CloudDrive, then that would cause this.
 
But I'm glad to hear that everything seems to have settled down for you!

Hello all,A 
 
little feedback..This MOSTLY works.  The issue seems to be that whenever a do my compare (for mirroring), there is ~768KB of data written to EVERY drive.  As this is the case, the ordered placement does not really help.  If I leave all the drives enabled for upload, as soon as I do the compare, ALL the drives start to hammer the internet to try to push their data out.  The BULK is still in the SINGLE drive (using ordered placment).  However, for the first few hours, that 768KB kills my drives and loops back through the above described undesired process (drives requiring re-authorization).
 
Guess I'm back to using my script mechanism for controlling the upload stream.
 
I will say that as long as I leave 1 drive running at a time, I can pull FULL bandwidth for that 1 drive!  This really is an awesome addon for my network!

Yeah, I know that a number of cloud provider clients would have issues with large files being changed a lot.... or even uploading all of it!
 
 
And totally understand about the internet speed stuff.   It's one of my biggest issues, as well.  60TB of data ... yeah, that's going to take a while.... even if I had good upload speeds. 
 
And yeah, I also remember dialup.  I don't miss the tones though.

well, I'm glad to hear that everything is working great now!
 
And that's a significant increase in performance!
 
And alex is reworking some of the code, and that may help things further, actually.  
 
 
But global limits would be a good idea. Or at least *per provider*. 
https://stablebit.com/Admin/IssueAnalysis/27562

I would agree with Chris.  With Clouddrive's ability to only upload changed sectors really makes this a good solution if you want a VeraCrypt container on the cloud.  I've tried this in the past with Google Drive's desktop app and Truecrypt.  I ended up re-uploading the file over and over...or so it seemed way back when I was trying this.  So, I gave up on that for a while (at least until CloudDrive showed up!).
 
Love this piece of software / middleware!  I've off loaded all my most precious files (pictures of the kids, and other unique files that I would never be able to get back if my house were to burn down).  It would be nice to mirror my entire DrivePool...but I can not see dumping THAT much data over my shoe-string internet connection.  Funny thing to me, I used to think I was fast....but then again, I can still recall the tones used on 300baud modems up to 14.4kbaud!  Then the digital bongs of 56K (I skipped 28.8kbaud).

Hello all,
 
I had an idea.  I'm going to try to use the Drivepool plugin "Ordered File Placment", which as I understand it will let me run the disks more like JBOD.  If I disable all optimizations for the Drivepool and just let it JBOD...that might resolve my need for the "single install" macro at this time.  I still would like the feature however maybe this will work by keeping most of my updates on one or two drives at a time!

I would agree with Chris.  With Clouddrive's ability to only upload changed sectors really makes this a good solution if you want a VeraCrypt container on the cloud.  I've tried this in the past with Google Drive's desktop app and Truecrypt.  I ended up re-uploading the file over and over...or so it seemed way back when I was trying this.  So, I gave up on that for a while (at least until CloudDrive showed up!).
 
Love this piece of software / middleware!  I've off loaded all my most precious files (pictures of the kids, and other unique files that I would never be able to get back if my house were to burn down).  It would be nice to mirror my entire DrivePool...but I can not see dumping THAT much data over my shoe-string internet connection.  Funny thing to me, I used to think I was fast....but then again, I can still recall the tones used on 300baud modems up to 14.4kbaud!  Then the digital bongs of 56K (I skipped 28.8kbaud).

Hello,
 
As of this post, I am on version:
 
 
After battling the many slowness issues I seem to have run into due to the numerous CloudDrives I have coupled with my dirt slow internet, I have been very happy with CloudDrive.  I have a macro script that goes through and allows the drives to run until they are flushed of "to upload" files allowing them to run one at a time.  This gives me pretty good performance as well!
 
As I discovered early on, and on purpose, if you  reboot before the drive's cache is 100% flushed out, you have to restart the upload of all the data in the cache.  Fair enough.
 
As I was able to make the drives perform properly through my crazy macro programming skillz, I recently was able to get the drive all flushed out to the internet.  So, I decided to reboot the PC.  I wanted to test my macro, backup software, etc. loading up upon reboot to try to try to make things automated.  Think upside down house of cards.  Everything has to be JUST RIGHT for this to work...but it is only used as a backup dumpsite..so ... I'm ok with that.
 
I was surprised that upon reboot:
EVERY drive needed to be unlocked, then re-authenticated.  They were ALL configured for automatic unlock upon creation.  Even if I made a mistake, I did not do that on EVERY drive every drive LOST my upload configuration. I understand for #2 you would automatically assume upload being enabled.  However, there was a reason I disabled prefetching as well as changed the upload threshold to [Off] instead of 1MB.  I also had a few drives that had Upload verification reenabled.  That might have been my fault for missing that on those drives, however I am mentioning it to ensure it is captured before that information leaves my brain.
 
Any idea what is going on?  As it takes SO long to unlock and re-authenticate that many drives, as well as reconfigure the settings on that many drives...I'm hopeful there is something I can do about this?

I feel like I'm not helping myself enough.  I'm not able to locate this, so maybe it doesn't exist...although the last few times I've looked and posted about various issues, Chris was able to point to some documentation...
 
Is there a way to control functions / features using command line for CloudDrive?
 
Specifically I want to be able to toggle the checkbox for the Upload Threads Count.
 
My thought is, until the Global Controls are added, when I know I have a HUGE dump of files, I can just toggle ALL Upload Threads to 0...well, unchecked.  Then, proceed to enable the drives one at a time.  I suppose if I could get the statistics of each drive, I could automate this.  Basically, check the drives status (how much left to upload).  Once that is 0, then enable the next drive.  That would be easy enough to do in script form.
 
Thanks!

Hi there,
 
I've been trying to organize my CloudDrive and Drivepool among my servers and struck upon what I thought was a good solution.
I have two licenses of DrivePool, one CloudDrive and two Scanner installs.
 
One File Main Server.  It runs Windows Home Server 2011.  I have DrivePool on that, with scanner.  I have 8 SATA drives and 1 iSCSI target (Nas4Free).  These are pooled into 1 drive.
The machine is pretty powerful resource-wise (Xeon X3440 @ 2.53GHz), 16GB ram, running ESXi.  The WHS install has 8 GB and 6 cores associated with it.
 
Along with being my data-tank for all my computers in the house, this machine is also my Serviio video transcoder over DLNA.  It works really well in this setup.
 
A while ago, I purchased CloudDrive.  I installed this on this machine - having made a snapshot prior to installing as we were still in beta at the time.  I played around with it and had setup enough CloudDrives using Google Drive, Box, DropBox, etc, in order to see the value.  I saw someone post saying they could use CloudDrives INSIDE DrivePool.  This was a great idea.  I pooled my drives together and saw that I had a massive Cloud based Drive!
 
What I saw happening though, is at least in how I had things setup the drive would constantly require re-authorization of my drives (beta?), but the issue I ran into was the system PAUSING.  So much so that it was difficult to watch ANYTHING transcoded.  The system would just pause and you wouldn't have access to the video stream.  Nor would you have access to any shared folders from the server.  I turned the CloudDrive service off in the services manager.  This resolved ALL my pausing issues.  
 
I set this aside for a while as I did not have time to mess with it.  Come back to this a few days ago.  I added a new server into my servers.  On this new machine, I also installed ESXi.  I added a 10G link between the two machines and setup a new LAN link in ESXi.  The intention is to move the iSCSI drives from the OLD Asus Easy Home machine into this new machine, giving my existing drivepool a much needed speed boost (the 1GB link on this seems to cause most writes to the file pool to be as slow as that one link).  On this new machine, I created a new VM for Windows Server 2008r2.  I installed CloudDrive and Drivepool.  This would hopefully allow me to have the pool, but have any performance issues with it NOT cause any issues with my existing setup.
 
Along the way I wanted to mess with StarWind's iSCSI target, which can do RAW drives.  My hope was to be able to use an iSCSI target to connect this pool, or the CloudDrives themselves back to the original WHS server so I can manage my pool there - or at least have access to the drives directly.
 
So, here is the question, in StarWind's software, it is NOT detecting any of the CoveCube drivers / drives / etc. as a real drive.  It only sees the virtual drive the OS is installed on.  Is there a reason for this?  I thought the drives were as real as you can get without actual hardware?  Maybe this is a question to pose to StarWind as to WHY their software does not see the StableBit drives?
 
Maybe my pausing issues were caused by needing to create a large cache?  As I intend this pool to just be a backup of all my most precious data, My settings for ALL drives were Minimum and FIXED.  I did not want ANYTHING cached as I wanted it ALL out on the cloud.

Christopher,
 
As always, thank you!  The awesome support provided by yourself and anyone else I've worked with on the forums is one of the reasons why I continue to purchase this software!
 
--Dan

Hi there,
 
Awesome software - as always!  I've been using Drivepool and Scanner since nearly the beginning.  Currently I have something like 22 drives in my main drive pool.  They range from iSCSI, SATA-attached, USB (depending on the pool), Ximeta-attached (they have a custom network thing they do), or even virtualized under ESXi.  Anything that shows up to Windows as a physical drive can just be pooled.  I love it!
 
Recently purchased Clouddrive, after messing around and some Google Searching of this forum, I think I'm fairly setup well.
 
I have 13 clouddrives setup.
1 box.com, 2 dropbox, 10 Google Drive (not the paid cloud drives, but the provided ones for personal use).
 
I used all defaults for everything, except
set the cache to MINIMIAL+ Encrypted it, set it to auto login to that encrypted drives (as I only care that the CLOUD data is encrypted...I mean, you want to look at my pictures of my kids THAT bad and break into my PC to do it...okay, enjoy, you earned it).   Pointed to a specific 100GB hard drive partition that I could dedicate to this (using drivepool on all other drives and one specific thing mentioned was the cache drive could NOT be part of a drivepool) renamed it removed the drive letter and set it to a folder name (use this with drivepooling to cut down on the displayed drive letters for a clean look) I am getting a slew of "throttling due to bandwidth" issues.  I admit that my cache drive is probably too small for the amount of data I DUMPED and will continue to monitor this as I do not feel that I was getting those messages when I did not just DUMP enough data to fill the ENTIRE CloudPool in one shot.
 
So, my request is to have a view in the program to look at all drive upload/download at the same time.  Maybe even space?  I love the existing charts.  They are easy to look at, easy to read and understand.  I also like the "Technical Details" page as that shows a TON of information, such as the file - or chunk - and how much of it is uploaded / downloaded.
 
I'm wondering if there is a way to view all drives at once?  I would use this to get a sense of the overall health of the system.  That is, if I have to scan through all 13 drives, I do not see where my bandwidth is being consumed to understand if the cache drive is FULL or if I am having Upload/Download issues.  This reason, by the time I click through each drive, I do not see where the bandwidth is being consumed as the bandwidth seems to shift between drives fast enough that I do not see a true representation of what is going on.  I'm sure part of that is redrawing the graphs.
 
I find the technical details page much more useful, as I do not see what is LEFT to upload, but I get a much faster idea of what is going on and although annoying to click through ALL the drives, it seems to be giving me a better idea of what is going on.  I think that having an overall page would be fantastic.
 
Thank you again for continuing to show what is possible!
 
--Dan

I'm hoping this thread can "pin" together all the best settings that everyone finds works for them.  If I leave anything out, please comment and let me know.
 
I think that knowing the number of threads (upload/download), speed of your internet connection (upload/download), anything special about it (in my case I have two connections that are pooled using pfSense), size of the drive, chunk size, if you are using drivepool, number of drives in the pool, services.
 
The reason I think this is useful, I have essentially left everything at defaults (but for a few things) and am getting the sense that with my exact configuration a 10MB chunk might be too large.  Maybe it is the VOLUME of data I tried to push at one time, but using the Technical Details page, I see a lot of chunks get 10-20% uploaded, then fail.  It "SEEMS" that the chunk is resumed, but again, I get 10-20% more and it fails again.  I'm not sure this is good for the system, so would a 1MB chunk work better?  I plan to test this in the future, but at this time, I'm still trying to get 1 final successful DUMP to see how well my backup strategy will work using my various cloud drives pooled together.
 
Update: after STOPPING the data flowing INTO the cache (stopped my copy of files) waiting for drive response - maybe your internet is too slow throttling messages went away.  I guess the defaults seem ok for now, it just does not like to be FLOODED with a TON of data all at once.  I think what also helped, as I am using this as a CloudPool (layering Drivepool on top of these drives), I disabled all balancers for this drivepool.  I thought, I'd try that as it might have been trying to move files around while it was still uploading the flood of data into the pool.  I decided that I could always re-enable them later on if I desired.  For now, I just wanted the logical "one drive access" to the entire pool of the many cloud drives I have setup.
 
So, is there settings that you have found that seem to work really well for you?  If so, could you please post them?  I'd certainly like to mess around with the settings in order to tune for optimal use.  I thought I would start by standing on the shoulders of giants, listen to those that have experience with this already!
 
Thanks!