Jump to content

Christopher (Drashna)

Administrators
  • Posts

    11804
  • Joined

  • Last visited

  • Days Won

    394

Reputation Activity

  1. Like
    Christopher (Drashna) reacted to endure in Creating a pool that includes existing files.   
    OK thank you. Time to get the credit card out 
  2. Like
    Christopher (Drashna) reacted to Quinn in Creating a pool that includes existing files.   
    Endure,
     
    When you install DrivePool and add your existing drives to it, DrivePool will see a pool size of 8TB (your total size across all drives added to the pool), but 4TB will be listed as "Other" (your existing files on the drives themselves).  As you move (not copy) your files from the drive(s) themselves into the pool drive, the files will be added to the pool itself, and the space will be reclaimed automatically to be used in the pool.
     
    You can also do something called "seeding", which will speed up the process.  You don't have to "seed", it's an option:
     
    http://wiki.covecube.com/StableBit_DrivePool_Q4142489
     
    -Quinn
  3. Like
    Christopher (Drashna) reacted to JazzMan in Creating a pool that includes existing files.   
    Yes, if you have whole disk duplication turned on, the effective useable space is half the raw space.  The advantage to this, though, is that you have an automatic immediate online backup and don't have to deal with all the stories you see about parity based RAID arrays not rebuilding or taking a week to rebuild.  The other advantage is being able to include a mixture of drives of any size.
     
    You can also configure to duplicate only certain folders also, though, so if there was a lot of temp work in the pool or something you could survive losing, you can exclude those folders from duplication.
  4. Like
    Christopher (Drashna) got a reaction from runewa in Partially Deleted CloudDrive - Amazon S3   
    Anyone still having this issue, it has been resolved in the latest beta (1.0.0.584). 
     
    http://dl.covecube.com/CloudDriveWindows/beta/download/StableBit.CloudDrive_1.0.0.584_x64_BETA.exe
    http://dl.covecube.com/CloudDriveWindows/beta/download/StableBit.CloudDrive_1.0.0.584_x86_BETA.exe
  5. Like
    Christopher (Drashna) reacted to steffenmand in CloudDrive + GoogleDrive   
    you are using an old version!
     
    http://dl.covecube.com/CloudDriveWindows/beta/download/?C=M;O=D
     
    follow this url for the newest updates! newest is .597 LOTS of speed improvements since then!
     
    you can increase the minimum download size while creating/attaching to get it to download larger pieces and get throttled a lot less! i still get throttled a lot but 100 mb chunks will improve that!
     
    Remember to make a new drive with the new version since stuff changed
     
    You can find their changelog here:
     
    http://dl.covecube.com/CloudDriveWindows/beta/download/changes.txt
  6. Like
    Christopher (Drashna) reacted to tcz06a in CloudDrive drive destroyed, ~158000 files left in Google Drive   
    I believe I have found a solution to this problem of mine. When I had CloudDrive destroy my drive, something, somewhere, had a hiccup. The folder on Google Drive wherein the chunks resided was deleted, but somehow the chunks themselves were not. Google forums indicates such files are called orphans, as they have no parent structure (folder). These orphans can be viewed by searching for 'is:unorganized owner:me' and deleted from there. As the Drive GUI produces 'server error occurred' when trying to delete more than 100 files at once, I looked for a script to automate their removal. I finally found one which worked. I found the code snippet at https://medium.com/@tashian/the-workaround-300ac8f05bb7#.vc41xsuwdalthough I am unsure if I can post a hyperlink in my comments. I can testify that it is deleting the orphaned files, while not touching anything else.
  7. Like
    Christopher (Drashna) reacted to Quinn in [HOWTO] File Location Catalog   
    wolfpac,
     
    If the cause is what I think it is (your folder/file name paths are over 255-260 characters long), there may not be a lot that can be done, except to fix that issue directly by renaming the file names/folders so they are shorter.
     
    You could use a utility like Bulk Rename Utility (http://www.bulkrenameutility.co.uk/Main_Intro.php) to rename files (if there are too many to do manually).  You could also use the 'subst' command to temporarily create a drive letter shortcut to the file path, then use that drive letter to move/adjust as necessary.
     
    Hope that helps...maybe someone else can chime in if there's a better way?
     
    -Quinn
  8. Like
    Christopher (Drashna) reacted to wolfpac in Pooled drives internal to external HDD case?   
    Yeah HUGE relief, so glad I bought the combo of Drivepool and Scanner! Well worth the 'cost of admission'!
     
    Ah ok then, there's 2 enclosures I've been looking at, one is USB3.0 only, the other is USB3.0 and eSATA. The eSATA one seems to have issues with not seeing all the drives on certain chipsets so I'll have to make sure the PCIe card I get is capable.
     
    But that's good to know, as long as WHS can see it, Drivepool can see the pool, everything continues working.
  9. Like
    Christopher (Drashna) got a reaction from wolfpac in Pooled drives internal to external HDD case?   
    I don't think anyone likes drives dying!  
    But yeah, it's nice when our software can help make that easier!
     
    And yes, you should be fine to do this.  I would recommend using eSATA (or SAS, if you have the money), as USB has issues with long term connectivity that could affect your data. 
     
    And as long as the external enclosure passes the disks through to the OS, so that our software can see them, there is absolutely no issues with moving them around. 
  10. Like
    Christopher (Drashna) reacted to freefaller in Clouddrive & Drivepool, Beta   
    I thought I'd stick my robocopy job up that I've been using for testing - succesfully so far - on the chance it might help someone else achieve what I've been trying to achieve .
    @echo @echo Begin Monitoring @echo robocopy P:\ E:\ /E /Z /XA:H /W:10 /MT:2 /MON:1 This runs on drive P:\ to drive E:\ and the switches do the following:
    /E - copy subdirectories, including Empty ones. /Z - copy files in restartable mode. /XA:H - excludes hidden files. /W:10 - waits 10 seconds between retries /MT:2 - uses two threads for copying /MON:1 - monitor the source (P:\) and run every 1 minute Because I'm not using the /MIR (mirror) switch, when files are deleted from my Drivepool drive (P:\), the Robocopy job picks this up, but does nothing. This is exactly what I want as I can look back through the job and see if files have been deleted, and if accidental, I can then copy them back down from my cloud storage.
     
    Here's a picture for verification of that - I've run a test by deleting (all duplicated test data of course!) a folder to simulate an accidental delete. The job runs every minute and detects the change, that the cloud drive now has all these extra files:

     
    So I can work out from here what I need to restore.
     
    I'll be working on the batch file so that I can output a proper log file of all folder differences to detect accidental deletes to make things easier, but the jist of this is it works!
  11. Like
    Christopher (Drashna) reacted to Black_Patriot in Duplication issues after faulty disk was removed   
    So it took a bit but that seems to have worked. I ended up booting into safe mode and removing 2 of the files, but the 3rd refused so I ran a chkdsk /F and then booted back into safe mode and could delete the file. Then booted back up normally and set the pool to re-balance. Thanks for your help.
  12. Like
    Christopher (Drashna) reacted to Markus in Drivepool Beta constant disk activity   
    ok, thanks, good to know! for now ive disabled the feature as described further above
  13. Like
    Christopher (Drashna) reacted to steffenmand in +1 for GoogleDrive for Work support   
    as a coder i know that what looks simple might often be complicated as hell lol!
     
    im sure you will get to it as fast as you can
  14. Like
    Christopher (Drashna) got a reaction from raidz in +1 for GoogleDrive for Work support   
    Yes, and IIRC, it's the next issue to address.  But I'll mention it to Alex to get it expedited. 
  15. Like
    Christopher (Drashna) got a reaction from steffenmand in +1 for GoogleDrive for Work support   
    Yes, and IIRC, it's the next issue to address.  But I'll mention it to Alex to get it expedited. 
  16. Like
    Christopher (Drashna) reacted to RobbieH in Newbie Question   
    Be very careful, do not consider DrivePool a backup solution. If you delete files or if you have files get corrupted on the primary drive, they will be the same on the pool drive. A backup will save you in the event you accidentally delete or corrupt files, DrivePool will not. 
     
    This is not a knock at DP or RAID solutions, it's just the truth. I am a huge DP fan, but please do not consider it to be a backup solution.
  17. Like
    Christopher (Drashna) reacted to RFOneWatt in Just RMA'd 10 Seagate ST4000DM001 4TB Drives   
    You just reminded me that I need to return the bad drives to Seagate before they charge me.
     
    I haven't had a chance to modify the firmware on any of the drives, which appears to be the best solution (you rock, Drashna) but I do need to do my 5TB pretty soon.
     
    For now I throttled the SMART queries in Scanner and at first glance I think its helping..  How much, I haven't had a chance to check yet... 
     
    -T
  18. Like
    Christopher (Drashna) got a reaction from grimpr in OS Drive on Motherboard RAID-1 or a better raid card?   
    I'm moving this to the "Off Topic" section, as this doesn't really involve StableBit DrivePool. 
     
    As for the Intel RST based RAID, I'm not sure honestly. 
     
    It should be fairly reliable though. But the performance out of it may not be great, because it's onboard/pseudo-software RAID. But that shouldn't matter much in this case. 
     
    As for unplugging it, I honestly couldn't tell you as I've never done this.  
    That said, I think that it does, at least if you have the software installed on the OS.
     
     
    But either way, this would essentially require reinstalling the OS, to get it to work properly. 
  19. Like
    Christopher (Drashna) reacted to Kraevin in +1 for GoogleDrive for Work support   
    Thanks for the update Christopher =)
  20. Like
    Christopher (Drashna) got a reaction from Kraevin in +1 for GoogleDrive for Work support   
    Sorry, I've been feeling a bit under the weather, so I hadn't kept up with the thread as much as I would have liked to/should have. 
     
     
    I *have* already mentioned the partial chunk size issue to Alex and he does plan on looking into it and testing it more thoroughly.  And I have created an issue/bug for it explicitly here:
    https://stablebit.com/Admin/IssueAnalysis/26012
     
    For now, there isn't a good solution to this.  Going back to the smaller size will be more reliable until we're able to fix this issue.
    But that's nto a great solution for long term.
     
     
    As for the "user Rate Limit exceeded", this is likely because of the said issue, with it repeatedly calling the same files.  Basically, it's calling the same file too many times in a short period of time.  Even after it fails on some of them, it retries, but with the "exponential backup" but that may not be quick enough and triggers this warning. 
     
     
    That said, Alex is still working on the "null chunks" issue (the one  that was causing corruption before).  While blocking it from uploading the chunks is good, figuring out why it's trying to do so, has been problematic. 
    Additionally, during this bug hunt, Alex has run into a number of other stability issues (especially with Box), and these issues unfortunately do get priority because they're corruption issues, where this is an API issue (and one that definitely needs more testing). 
     
     
     
    Again, sorry for the lapse in responding.  I will make a serious effort to not let it happen again!
     
    The 20MB limit was due to an API limit, so if the partial chunks are larger, then the whole size could be larger. 
     
    However, at best, we cannot have more than 20 chunks, to ensure t hat we don't run into that limit.  Which means new code to handle this, and testing to ensure it works properly.
     
    I've already discussed this directly with alex, and .... well. I have a sticky note on my monitor about the entire issue. That way, it reminds me to bring it up to him every chance I get.
  21. Like
    Christopher (Drashna) got a reaction from steffenmand in +1 for GoogleDrive for Work support   
    Sorry, I've been feeling a bit under the weather, so I hadn't kept up with the thread as much as I would have liked to/should have. 
     
     
    I *have* already mentioned the partial chunk size issue to Alex and he does plan on looking into it and testing it more thoroughly.  And I have created an issue/bug for it explicitly here:
    https://stablebit.com/Admin/IssueAnalysis/26012
     
    For now, there isn't a good solution to this.  Going back to the smaller size will be more reliable until we're able to fix this issue.
    But that's nto a great solution for long term.
     
     
    As for the "user Rate Limit exceeded", this is likely because of the said issue, with it repeatedly calling the same files.  Basically, it's calling the same file too many times in a short period of time.  Even after it fails on some of them, it retries, but with the "exponential backup" but that may not be quick enough and triggers this warning. 
     
     
    That said, Alex is still working on the "null chunks" issue (the one  that was causing corruption before).  While blocking it from uploading the chunks is good, figuring out why it's trying to do so, has been problematic. 
    Additionally, during this bug hunt, Alex has run into a number of other stability issues (especially with Box), and these issues unfortunately do get priority because they're corruption issues, where this is an API issue (and one that definitely needs more testing). 
     
     
     
    Again, sorry for the lapse in responding.  I will make a serious effort to not let it happen again!
     
    The 20MB limit was due to an API limit, so if the partial chunks are larger, then the whole size could be larger. 
     
    However, at best, we cannot have more than 20 chunks, to ensure t hat we don't run into that limit.  Which means new code to handle this, and testing to ensure it works properly.
     
    I've already discussed this directly with alex, and .... well. I have a sticky note on my monitor about the entire issue. That way, it reminds me to bring it up to him every chance I get.
  22. Like
    Christopher (Drashna) reacted to jmone in 10GB connection between two pools - performance tips?   
    Yup,  such a "pool aware" utility would be perfect!
  23. Like
    Christopher (Drashna) reacted to Erik Wright in Taking apart an external drive   
    From my 5 years both selling consumer electronics and repairing computers in a retail situation, I've yet to come across a Seagate drive with any fancy trickery going on under the hood.
    Usually its the Western Digital drives that have circuit boards with hardware encryption chips built in that cause the drive to appear scrambled when not used inside its' original enclosure.
     
    A useful feature for data security and encryption for sure, but very annoying if say the enclosure or drive begins to fail and you want to try to save the data...
     
    *Western Digital drives that have these logic boards can be used outside of their enclosures, but they must be re-formatted once taken out of their enclosure.
  24. Like
    Christopher (Drashna) reacted to freefaller in Clouddrive & Drivepool, Beta   
    Thanks, all very helpful answers and certainly enough for me to start trialling the software .
  25. Like
    Christopher (Drashna) got a reaction from taflemer in How do I know whether to replace a drive showing SMART errors?   
    If this is a new drive and it already has 2 reallocated sectors ... I'd personally go ahead and RMA the drive, as this indicates that there is already an issue with the drive. 
     
     
    However, if StableBit Scanner is able to run a full surface scan without any issues, you may be fine.  Worst case, you could see about running "chkdsk /b" on the disk, as this is a very in depth and rigorous test of the drive. If that passes without any issues, you should definitely be fine.
×
×
  • Create New...