Jump to content

Ginoliggime

Members
  • Posts

    0
  • Joined

  • Last visited

Reputation Activity

  1. Like
    Ginoliggime reacted to Midoxai in [Suggestion] Strato HiDrive   
    Hi,
     
    i suggest Strato HiDrive as the biggest (private and business) Storage Provider from Germany.
     
    General Infos:
    https://dev.strato.com/hidrive/ Get Started
    https://dev.strato.com/hidrive/getstarted SDKs
    https://dev.strato.com/hidrive/content.php?r=142-SDKs API Refernce
    https://dev.strato.com/hidrive/content.php?r=115-reference Pricing
    https://www.strato.com/en_us/cloud-storage/ Free Account
    https://www.free-hidrive.com/  
    Best regards
  2. Like
    Ginoliggime reacted to KiLLeRRaT in Feature Request - Dynamic prefetch size   
    Hey guys,
     
    Good to see that the releases are getting more and more solid.
     
    I just had a thought while looking at my transfers/prefetching.
     
    What if you had the prefetch forward value automatically scale based on the hit rate of the prefetch? Perhaps you can provide a range, e.g. between 1 MB and 500 MB based on hit rate. 
     
    For streaming movies, a large prefetch works well (e.g. 150 MB, or even more). The hit rate will be good, thus growing the prefetch size more and more.
     
    If I later then start looking through photos that are only 3 MB each, the hit rate will get pretty terrible, and thus scale back the prefetch again to say 1 MB again.
     
    Just thought this could improve the general bandwidth use, and ultimately performance.
     
     
  3. Like
    Ginoliggime reacted to skapy in copying from one to another drive is very slow   
    Hello,
    Im trying to copy some files from g-drive to another g-drive (~50gb) both are encrpyted.
    Speed it very slow ~4mb/sec.
    Using 1gb full duplex with a 6core xeon, 32gb ram and 4x2tb hdd (raid 10).
    So hardware or uplink shouldnt be the problem.
    download and uploadthreads are at 10 at both sides. I already tried it with different settings.
    Server isnt throttling (atleast no turtle sign in stablebit clouddrive)
     
    Is this only for me a problem or someone other also have this problem?
     
    best regards
  4. Like
    Ginoliggime reacted to surfyogi in Folder Duplication - backup file of settings? Settings lost with C: SSD failure   
    I lost my C: SSD drive some time ago. I seem to have lost a good working backup of it as well...
     
    So I installed a new Windows 7 on a new SSD. I now have the pool back up and running, with 1 difference.
     
    I don't know how to restore my Folder Duplication settings precisely as they were.
     
    I have a few questions regarding how drivepool will act for me, so please follow, and I'll be brief:
     
     
    1) Can I save my folder duplication config file (or, where is it and what's it called?) so that I can reload it sometime later if I lose my Windows C drive?  (assuming I am using same version of drivepool on new configuration? )   2) What happens to my backed up folders if I lose my C drive, have to re-install Windows 7? Will the original duplicated folders still be duplicated across 2 or more drives (for example, if I have 10 drives pooled)?   3) If for any reason I don't set up backup folders immediately after a Windows re-install, will those duplicate folders/files stay as is, or will they be deduplicated over time by DrivePool?   I have used this forum many times before, and I don't remember these questions ever being addressed, it may be a special situation. Please point me to other threads if this is a duplicate question.
  5. Like
    Ginoliggime reacted to grimpr in OS Drive on Motherboard RAID-1 or a better raid card?   
    Want to upgrade my OS drives to RAID-1 on my Stablebit FileServer and my Workstation, does the Intel raid on the motherboards that support works reliably? If i unplug a disk from the motherboard raid will the Intel raid proceed to boot degraded and report it?
     
  6. Like
    Ginoliggime reacted to ufo56 in File copy very slow   
    Hello
     
    I have done windows 7 vm (in unraid) with latest clouddrive beta .797
     
    Two hdds, one with windows and another is for cache (140gb cache disk). I copied about 50gb files to VM over lan and then copy paste to mounted google drive share.
     
    Copy/Paste transfer speed is ~900kb/sec. What i am doing wrong ?
     
    Internet connection is 300/300 but it should not matter when i copy files to drive, it first goes to cache and then it uploads to gdrive ? Clouddrive shows constantly 8mbps. It uses only 1 thread to upload, however i have set it to 10.
  7. Like
    Ginoliggime reacted to KiLLeRRaT in Google Drive Rate Limits and Threading/Exp Backoff   
    Hey Guys,
     
    I got slow transfers with Google Drive, and set the threads to 12 up and 12 down.  This worked for a while and everything was a bit faster.
     
    For the last two days, I have been getting countless Rate Limit Exceeded exceptions, even running 1 up and 1 down thread.
     
    I check out online in the Google Drive API guides and found a bit about exponential backoff.
     
    So a few questions/thoughts:
     
    Is exponential backoff implemented for the Google Drive provider? If I set the provider to use say 12 up and 12 down threads, do they all get blasted out using multiple requests at the same time? (causing rate limit exceptions later on)? Would it work to have something like a 'request gatekeeper' where you can set your own rate limits client side so that no matter how many threads you run, it always obeys that limit you set, and so that there is a 'master exponential backoff' in place? Is there at all a possibility to look at the provider implementation code? Or is this fully baked into the product? It'd be good if there was an API to allow anyone to build their own providers.
     
    Thanks for a good product!
     
     
    EDIT: Also, how will all the rate limiting work if you added say 5 Google Drives, each with 12 threads up and down? Quite quickly you will be making a TON of requests...
  8. Like
    Ginoliggime reacted to MetalGeek in New pool creating failure   
    New install of Beta .651 on Windows 10. Only rebooted once not twice.    Didn't have a new pool button, just an option to add drives so I clicked on the  + Add link for the D: drive, it hung at 95%.  When the pool was never created I cancelled the creation, then tried with the E: Drive.  This sat at 95%, then it appeared the pool creation canceled on it's own.  I have no pool and I cannot add the D: or E: drives as they error out saying they are in the pool already.   I found the article that I need to reboot 2x for Windows 10 after I tried creating the pool.  
     
    How do I remove the pool that exists but I cannot see and start over?
     
    [Edit] - I have rebooted 2x and no change in behavior.
  9. Like
    Ginoliggime reacted to chcguy88 in Feature request: Cache of all thumbnails + file index on client side.   
    So I have been having an issue with using the product. I've been pretty happy with it but when I access my media archive (Sometimes 200+ videos and pictures) I like to use the thumbnail view to view the items to make sure I am copying the correct items from my drive. The problem is with these larger folders, it takes about 2-5 minutes of scrolling down the folder to get the thumbnails to appear. I have a dedicated drive for stablebit and I would like to cache all those images + file names so that all cloud drive has to do is copy the file when accessed, not stream everytime to generate file information/thumbnails.
     
    Feature request:  Cache of all thumbnails + file index on client side via a local harddrive. This could be implemented as a check box in the settings. This would definitely help with the bandwidth impaired and save time when working with the drive.
  10. Like
    Ginoliggime reacted to Christopher (Drashna) in Why isn't XYZ Provider available?   
    Once we have a new public release, then after t hat, we may add more providers.
     
    however, we do have a request for OpenDrive already.... 
     
    But ... they're having issues today apparently ("Error establishing database connection").... Ooops.
  11. Like
    Ginoliggime reacted to Yuri Alexandrov in Dropbox business support?   
    What about Dropbox business support?  Even in minimum 5 members - $75/month it can be cheap unlimited space cloud provider.
     
    I try Dropbox business 30 day trial and try to create StableBit drive on it - but receive error "not enough space" from CloudDrive.
     
    Looks like it try to create in personal area
  12. Like
    Ginoliggime reacted to Joel Kåberg in Poor performance Google Drive (not rate limit)   
    I'm seeing poor upload performance with GD, it goes somewhere between 0 to 150 mbps (on average 50-70mbps) but very rarely above that.
    Here's my settings https://goo.gl/iXdlWc | https://goo.gl/H5T8G7
     
    An regular Speedtest https://goo.gl/iRjC8o
     
    Looking over the logs I can't see any Rate limit or similar, just a bunch of Write chunk
     
     
    My workflow
    Ubuntu server with samba (main storage for now)->1gbit lan->Windows 10 PC with clouddrive->google drive
     
    So I take it this is something related to my ISP or something between me and Google?
     
    I'm investigateing now if my data gets uploaded to EU or US datacenters (I'm located in the EU) Uploaded to EU/Amsterdam
     
    For comparision I can saturate my bandwith with the same Google Drive using rlcone, so this must be a CloudDrive issue.
     
    One thing that I've noticed is when I pause the transfer to the CloudDrive (and Clouddrive just sits uploading) I'm seeing a lot better bandwith usage (nearly 100%). I've now tried several (SSD) disk on different PC but they all suffer the same fate.

    So I think I got this down to IO issues, it seems better without encryption but I'd love haveing that. Task manager gives a pretty good hint as to the disk beeing excessevly used (I'm assuming due to the cache in CloudDrive). Perhaps this need some attention, also an RAM option would be nice here (for us with plenty of it). I tried creating a RAMdrive to see if that helped (use as a cache drive) but CloudDrive won't recognize it
  13. Like
    Ginoliggime reacted to modplan in Many files in Google Drive, something to be aware of   
    Just a PSA post here. I recently passed 1.26 MILLION files in my google drive account. Only ~400,000 of these files were from CloudDrive, but I use lots of other apps that write lots of files to my account and thought I would pass on this info.
     
    1) Google Drive for Windows client will crash, even if you only have 1 folder synced to your desktop: I have only a few docs folders actually synced to my desktop client, but the app insists on downloading an entire index of all of your files on your account into memory, before writing it to disk, when this crosses 2.1GB of RAM, as it did for me after 1.26 million files, the app will crash (due to Google Drive for Windows still stupidly being 32-bit). No workaround other than lowering your number of files on your account.
     
    2) Google Drive API documentation warns of API breakdowns as you cross 1 million files on your account, query sorting can cease to function, etc, who knows which apps depend on API calls that could start to fail.
     
    I've spent the last 10 days running a python script I wrote to delete un wanted/needed files, one by one. 10 days, and I probably have 10 days left. I hope to get to ~600,000 total by the time I am done. 
     
    Hope this helps someone in the future.
  14. Like
    Ginoliggime reacted to Christopher (Drashna) in Backup / Clone of a Google Drive account   
    Oh, god, yeah... that's bad.
     
    And yeah, you'd want the "metadata" folder, as this is ABSOLUTELY necessary. This contains the drive's information, including revision and "geometry".  Without it, you won't be able to mount the drive. Period.  
     
     
    And yeah, seeing all the usage info is very nice.
    (but I'm a "progress bar nerd")
  15. Like
    Ginoliggime reacted to RulliDidd in Google Drive: Server is throttling downloads   
    Hi
     
    I'm using version 1.0.0.725 with Google Drive. Even with prefetch disabled and only 1 download thread i constantly "Server is throttling downloads.".
     
    When looking at the service log I can see bunch of :  [ApiGoogleDrive:101] Google Drive returned error (rateLimitExceeded): Rate Limit Exceeded
     
    Is there something I'm doing wrong?
     
     
  16. Like
    Ginoliggime reacted to Atarres in REFS format for CloudDrive on ACD?   
    Is this recommended? Or even necessary? I guess my main concern is bitrot. I lost an (empty) drive to this and am currently attempting recovery operations as a test to see if I can recover from this state. I got the dreaded REFS The Volume repair was not successful. 
     
    This tells me that REFS was corrupted in some form. While I lost no data, I want to see if I can recover from this state. (running a days long operation to recover the ACD). 
     
    In the meantime I just want to know if it is a recommended to run REFS on an Amazon Cloud Drive. 
  17. Like
    Ginoliggime reacted to rbutler81 in Only duplicates on a CloudDrive   
    I know this has been asked before - I've even read a few threads on it, but I still can't seem to find a 100% "for sure" answer...
     
    What I have in my pool is this:
    Drive A - local drive
    Drive B - local drive
    Drive C - local drive
    Drive D - clouddrive
     
    What I want:
    1) All my files to be saved to drives A, B and C
    2) Folders that I choose to duplicate ONLY to be duplicated to drive D
     
    What I don't want:
    1) Duplicates on any of my local drives.
    2) Non-duplicated files on drive D
     
    The thread here:  http://community.covecube.com/index.php?/topic/1231-how-do-i-keep-duplicated-data-on-the-pool-but-other-copies-anywhere-else/
    is suggesting that I don't change the Drive Usage Limiter balancer, and just create rules for only the folders I want duplicated. In those rules I would ONLY choose drive D.
    In doing that, am I not limiting that folder to only be saved to drive D? It's not making much sense to me. How does that put just the duplicates on drive D and allow the "original" file to go on drives A, B or C - when they're all unchecked?
     
    Hopefully someone has a definitive answer for this as it's not very clear.
     
    Thanks!
  18. Like
    Ginoliggime reacted to Gishi in product packages?   
    hello,
     
    I was looking at your products and im debating buying all 3. So i was wondering if you had an all in one discount package? Id be more interested in buying at a lower price for a bundle then paying full price witch would run around $94.85.. that being sed its kinda a hard selling point for all of them. 35% to 40% off would seem like a good deal to me. but im not going to tell you guys thats what it has to be. thats just what would fell nice and comfy to me price wise.
  19. Like
    Ginoliggime reacted to PossumsDad in Need Advice On SATA Controller Purchase   
    Hi all,
     
    I've been using DrivePool and Scanner for quite some time. Everything has been running great.
     
    It's now time to upgrade some of my hardware. I am taking the plunge and am going to replace the tiring old Core 2 Duo 6420 2.13ghz with a modern i7 6700 3.4ghz processor and motherboard. I am looking at the H170-PRO/CSM LGA1151 ATX Motherboard from ASUS.
     
    I am now running 2 PCI-x 8 port sata cards. Super Micro SAT2-MV8. Of course they will not run at full speed in a regular PCI slot but they do run. The new motherboard does have 2 PCI slots. So I can run the old controller cards if necessary.
     
    So I am thinking about replacing both of them with: The SI-PEX40097 is the SYBA IOCrest 16-Port SATA III 6G PCI-Express Controller Card. This card, a x4 slot card from IOCREST, uses the newest Marvell 9215 Chipset to add up to 16 drives to your system for an overall massive storage capacity boost.
     
    I guess what I'm asking is will this card will work with DrivePool and Scanner or am I better off using my old Super Micro controller cards?
     
    Any advice would be appreciated.
     
    Phil
     
    P.S. I'm running Windows 8.1
  20. Like
    Ginoliggime reacted to WBadminUser in Does prefetch data go into the cache?   
    I am trying to find the sweet spot for streaming media. We have a large prefect which appears to work but a short prefetch time. Does the prefetch data just move to the cache when its done? We also have a large cache.
  21. Like
    Ginoliggime reacted to msq in Moving CloudPart.xxx folder to another drive ..?   
    Hello,
     
    Is there a way to move CloudPart.xxxxxxxx folder, where metadata and cache is stored from one location to another within the same machine without destroing and recreating entire drive?
    In my case - from P:\CloudPart.xxxxx to Q:\CloudPart.xxxxx ..?
     
     
  22. Like
    Ginoliggime reacted to ironhead65 in Chunk Size or other values   
    I'm hoping this thread can "pin" together all the best settings that everyone finds works for them.  If I leave anything out, please comment and let me know.
     
    I think that knowing the number of threads (upload/download), speed of your internet connection (upload/download), anything special about it (in my case I have two connections that are pooled using pfSense), size of the drive, chunk size, if you are using drivepool, number of drives in the pool, services.
     
    The reason I think this is useful, I have essentially left everything at defaults (but for a few things) and am getting the sense that with my exact configuration a 10MB chunk might be too large.  Maybe it is the VOLUME of data I tried to push at one time, but using the Technical Details page, I see a lot of chunks get 10-20% uploaded, then fail.  It "SEEMS" that the chunk is resumed, but again, I get 10-20% more and it fails again.  I'm not sure this is good for the system, so would a 1MB chunk work better?  I plan to test this in the future, but at this time, I'm still trying to get 1 final successful DUMP to see how well my backup strategy will work using my various cloud drives pooled together.
     
    Update: after STOPPING the data flowing INTO the cache (stopped my copy of files) waiting for drive response - maybe your internet is too slow throttling messages went away.  I guess the defaults seem ok for now, it just does not like to be FLOODED with a TON of data all at once.  I think what also helped, as I am using this as a CloudPool (layering Drivepool on top of these drives), I disabled all balancers for this drivepool.  I thought, I'd try that as it might have been trying to move files around while it was still uploading the flood of data into the pool.  I decided that I could always re-enable them later on if I desired.  For now, I just wanted the logical "one drive access" to the entire pool of the many cloud drives I have setup.
     
    So, is there settings that you have found that seem to work really well for you?  If so, could you please post them?  I'd certainly like to mess around with the settings in order to tune for optimal use.  I thought I would start by standing on the shoulders of giants, listen to those that have experience with this already!
     
    Thanks!
  23. Like
    Ginoliggime reacted to Christopher (Drashna) in Why isn't XYZ Provider available?   
    Not every Cloud Provider is going to be listed. And that's okay.

    For the public beta, we focused on the most prolific and popular cloud storage providers.

    If you don't see a specific provider in StableBit CloudDrive, let us know and we'll look into it.
    If you can provide a link to the SDK/API, it would be helpful, but it's not necessary.
     
    Just because you see it listed here does not me we will add the provider. Whether we add them or not depends on a number of factors, including time to develop them, stability, reliability, and functionality, among other factors.

    Providers already requested:
    Mega https://stablebit.com/Admin/IssueAnalysis/15659 SharePoint https://stablebit.com/Admin/IssueAnalysis/16678 WebDAV IceDrive OwnCloud (SabreDAV) https://stablebit.com/Admin/IssueAnalysis/16679 OpenStack Swift https://stablebit.com/Admin/IssueAnalysis/17692 OpenDrive https://stablebit.com/Admin/IssueAnalysis/17732 Yandex.Disk https://stablebit.com/Admin/IssueAnalysis/20833 EMC Atmos https://stablebit.com/Admin/IssueAnalysis/25926 Strato HiDrive https://stablebit.com/Admin/IssueAnalysis/25959 Citrix ShareFile https://stablebit.com/Admin/IssueAnalysis/27082 Email support (IMAP, maybe Pop) https://stablebit.com/Admin/IssueAnalysis/27124 May not be reliable , as this heavily depends on the amount of space that the provider allows. And some providers may prune messages that are too old, go over the quota, etc. JottaCloud https://stablebit.com/Admin/IssueAnalysis/27327 May not be usable, as there is no publicly documented API. FileRun https://stablebit.com/Admin/IssueAnalysis/27383 FileRun is a Self Hosted, PHP based cloud storage solution.  Free version limited to 3 users, enterprise/business licensing for more users/features available.    JSON based API.  SpiderOak https://stablebit.com/Admin/IssueAnalysis/27532 JSON based API Privacy minded pCloud https://stablebit.com/Admin/IssueAnalysis/27939 JSON based API OVH Cloud https://stablebit.com/Admin/IssueAnalysis/28204 StorJ https://stablebit.com/Admin/IssueAnalysis/28364 Providers like tardigrade.io appear to use this library/API iDrive Amazon S3 Compatible API. No need for separate provider. ASUS WebStorage https://stablebit.com/Admin/IssueAnalysis/28407 Documentation ... is difficult to read, making it hard to tell if support is possible.  Apple iCloud https://stablebit.com/Admin/IssueAnalysis/28548 uptobox https://stablebit.com/Admin/IssueAnalysis/28633 sCloud https://stablebit.com/Admin/IssueAnalysis/28650 Providers that will not be added:
    Degoo No publicly accessible API. Without an API that support reading and writing files to the provider, there is no possibility of adding support for this provider.  Sync.com No publicly accessible API Without an API that support reading and writing files to the provider, there is no possibility of adding support for this provider.  Amazon Glacier https://stablebit.com/Admin/IssueAnalysis/16676 There is a 4+ hour wait time to access uploaded data. This means Amazon Glacier completely unusable to us. We couldn't even perform upload verification on content due to this limitation.  HubiC https://stablebit.com/Admin/IssueAnalysis/16677 It's OpenStack - No need for a separate provider. CrashPlan? https://stablebit.com/Admin/IssueAnalysis/15664 The API provided appears to be mostly for monitoring and maintenance. No upload/download calls, so not suitable for StableBit CloudDrive, unfortunately.  MediaFire Not suitable due to stability issues. Thunderdrive No publicly accessible API. LiveDrive No Publicly accessible API. Zoolz No Publicly accessible (developer) API
  24. Like
    Ginoliggime reacted to kenwshmt in synology one way backup from nas   
    synology nas:
     
    https://www.synology.com/en-us/dsm/5.2
     
    'Also, Cloud Sync now offers one-way sync options, making things easier when backing up data to a public cloud or vice versa, while data encryption guarantees files sent to the public cloud remain for your eyes only. '
     
    the nas drives with dsm / disk station manager 5.2 and later can do one way transfer to cloud services, with encryption.. and if thats not enough Im sure something like box crypt would work on the device would substantially improve the encryption.
     
    Do any of you use this approach? I am buying a 2tb nas to try it out with.
     
    netdrive 2 and boxcryptor has been working wonderfully, but i am finding i need a non computer approach, and if a nas can backup and delete, so much the better.
     
     
     
     
  25. Like
    Ginoliggime reacted to KiLLeRRaT in Beta Version Discussions   
    Hey,
     
    Would it be useful to have a sticky on here, where it's posted when a new beta version comes out, along with what people run into and find in that version? Basically a copy of the changes.txt, but people can then post comments on it etc...
     
    e.g. The issue we had where drives become corrupt... That way it's quick to realize that you probably shouldn't update to the update until it's resolved...?
     
    Just a thought!
     
×
×
  • Create New...