Gbyrd
-
Posts
82 -
Joined
-
Last visited
-
Days Won
1
Posts posted by Gbyrd
-
-
To clarify here...
The issue is that the read-modify-write behavior is causing issues with Google Drive. Instead of updating the file, it's creating new chunks. This means that when you download the new chunks, it's only getting partial data.
This can cause data corruption, and cause the disks to show up as raw.
This has been addressed in the latest versions....
And more importantly, Alex has written a recovery routine into the newest version that attempts to peice together this data, to recover it.
Additionally, we've updated the API version, and adding additional code to ensure that this doesn't happen again.
Please grab the 1.0.0.834 version, if you haven't already.
http://dl.covecube.com/CloudDriveWindows/beta/download/StableBit.CloudDrive_1.0.0.834_x64_BETA.exe
Thanks updated. One drive is stuck in mounting in the software although the drive has shown up in my computer already. and the one that is broken is "connecting" Looks to be indexing data. Not sure why that one that is mounting is stuck on that because it should have alreayd successfully done so. Well hopefully it snaps out of it.
Downloaded it, it no longer asking to chkdsk the files like it use to however, it did not complete a chkdsk on anything. It is still not reading back the files from the drive.
-
I pressed y to dismount but chkdsk did not solve my issue, it made it worse infact and made the whole drive RAW so I wouldn't recommend it but it may work for you.
Yeah i don't know what to at this point so i am just letting it run at the moment. There really is no alternative as the data on the cloud is pretty useless if i can't read it back, how long did your chkdsk take and how much data did you have? just curious what the ballpark.
-
My stuff was RAW so the new update did not help me. This was my issue and resolution, http://community.covecube.com/index.php?/topic/2567-files-starting-to-go-corrupt-cloud-drive-throws-no-errors/?p=17786
how were you able to run chkdsk from command line? I am unable to get that because the drive gets put into use and it asks to have it dismount before i do it. It's been running for a few days now. Don't know if the data is going to be recoverable at this point. Don't know whether to restart my computer or wait until the chkdsk is finished But it is a lot of data 7TBs not sure what to do
-
Pretty much as it say. My current google drive seems to be in a limbo. It has a chkdsk error and i am currently running it. It's been a few days and it progressed on day one and now its "stuck" checking SDs/SIDs. While waiting I thought to myself make another drive to temporarily put files in there. Or frankly redownload my entire library and if it the original drive comes back well no big deal. If it doesn't well I have this new drive anyway. What i am wondering is if i have the files in raw data inside my google drive already. Would it be feasible to copy all those contents into the new cloud drives so i don't have to go about redownloading everything?
I know there is likely a check to ensure that the currently connecting CloudDrive owns the data and unobfuscate the raw data. But is there a way by chance to change that part so i can make my recovery process a bit easier. Thanks for any help.
-
Hello does the latest beta fix it for you guys?
http://dl.covecube.com/CloudDriveWindows/beta/download/StableBit.CloudDrive_1.0.0.827_x64_BETA.exe
Apparently you have to reset database in settings and reauthorize for api v3 to work.
.827
* [issue #27339] When a volume is dirty, display a more informative error message and user feedback item.
.826
* [issue #27342] Fixed "An element with the same key already exists" when multiple chunks exist with the same index.
.825
* [issue #27331] Rewrote volume name query code to not use VDS.
.824
* [issue #27344] When multiple files are found for the same chunk, note a warning in the log with the chunk number.
.823
* Fixed thread aborts.
* Fixed Technical Details window not updating.
.822
* [issue #27342] Updated the Google Drive provider to use the v3 API.
* [issue #27342] Enabled logging of chunk ID enumeration after database reset by default.
* [issue #27342] Added "Allow missing chunks" to the Troubleshooting menu.
* Fixed uploads getting stuck.
.819
* If multiple chunks exist with the same name, use the first one..827
* [issue #27339] When a volume is dirty, display a more informative error message and user feedback item.
.826
* [issue #27342] Fixed "An element with the same key already exists" when multiple chunks exist with the same index.
.825
* [issue #27331] Rewrote volume name query code to not use VDS.
.824
* [issue #27344] When multiple files are found for the same chunk, note a warning in the log with the chunk number.
.823
* Fixed thread aborts.
* Fixed Technical Details window not updating.
.822
* [issue #27342] Updated the Google Drive provider to use the v3 API.
* [issue #27342] Enabled logging of chunk ID enumeration after database reset by default.
* [issue #27342] Added "Allow missing chunks" to the Troubleshooting menu.
* Fixed uploads getting stuck.
.819
* If multiple chunks exist with the same name, use the first one.
Have not tried it yet. You have any luck? My drive is STILL running a chkdsk read which is god awfully long. I don't know whether to wait, or redownload everything on my drive cause at this point it seems like it would be faster.
-
Alex (the Developer) is looking into the "uploads getting stuck" issue, and hopefully will have a fix out soon.
As for the other issue, Alex is also looking into this issue, as we have a number of users (yes, you guys) that are experiencing this issue.
Thanks for the response. My issue might be slightly different although similar. At least windows is asking me to do run a chkdsk. Which i am doing at the moment. So i am waiting for that to finish before i make any conclusions on the data. The crappy part is i can't download anything since the drive is not accessible. Hopefully this scan finishes soon and it gets back to a working state.
-
So I can't change it from dynamic to basic without losing all my data so that is out of question for me. Is there another way to get it to work?
You might be able to use stable bit pool drive and make a new HDD from them. But i have personally never used that
-
This issue is recurring. Every 10-12 hours uploads stop being successful and I have to restart.
This is something common i have found it happens when google fails uploads and it will just stop the drive from writing instead of dismounting. Ever since the .800 iteration i have had problems.
-
Same here, updated to 819, got some corrupt folders that wouldn't open so ran chkdsk /r and then it went RAW.
My cloud usage went from 11.2 TB to 375 GB at the UI of the program.
I can confirm the chunks are still at Google Drive provider but it seems it lost track of them.
I ran testdisk http://www.cgsecurity.org/wiki/TestDiskwhich allows you to see files even though it's RAW.
When you start testdisk.exe press Create for log file
Pick the physicaldrive which has your clouddrive size.
Pick EFI GPT, then go to advanced and press down button to press on the other bigger size and do LIST, when I do list I only see 375 GB of information which is worrying.
But if you're using it like that it is only gonna see what is physically in the cache drive. It won't show you what is in your cloud. So i don't think this is accurate.
-
I lost about 48TB of data because of this issue. :/ The issue started happening to me when I was on a older version for over a month. I didn't upgrade or change anything and started having this chunkid="" issue. Stablebit is not finding chunks that do actually exist in Google Drive.
Open the technical details windows, and click on the "service logs" button.This will open up a new window that will show the service log output. Click on the "Tracing levels" button, the "C" group and open the "Chunk ID helper" section. Select "Verbose" and then reproduce the issue.Once you do the above you will most likely see something like this:22:15:26.3: Information: 0 : [ChunkIdHelper:84] Chunk 366031 read (State=Found, ChunkId='')22:15:26.5: Information: 0 : [ChunkIdHelper:89] Chunk ID for chunk 366031 is '' (via cache)22:15:26.5: Information: 0 : [ChunkIdHelper:89] Chunk 366031 read (State=Found, ChunkId='')If you see the above with ChunkId="" then you are affected by the same issue as me and a few others. Again, the chunk exists on Google Drive (I have verified this many times) but stablebit doesn't find it which causes corruption.Do you get chkdsk errors? I am just gonna wait for a bit and see what happens. I am in the midst of running chkdsk. After it runs i will check to see everything works hopefully. But seems to be the newer versions have something messed up. .802 had an upload issue and the newer ones seem to have corrupted everything else that was on the drive
-
When you go into the technical details does it show a bunch of prefetch threads but with all of them downloading 0%? This may be the same corruption problem that at least myself and another are having.
yeah it looks like it, however i am getting a chkdsk prompt did you get that?. So i am running that first and then going from there. If my drive corrupted it would be absolutely shitty because i have 7TBs of data, and to redownload would be annoying, although not too bad but realistically next time i get a version that works completely fine i am not touching it with an update. If it ain't broke!
It was working fine but it wasn't uploading. I was able to watch the shows with no problem. Updated it and then it fixed upload but broke the download. Gah
-
Might be because their type is dynamic
-
Fixed it, updated to another version and everything works now it appears....Nothing seems to be downloading anymore so i dunno what to do. It is prefetching however it is never actually playing any video. Always that thought of is this the update that is gonna break my drive completely. Windows keeps asking me to chkdsk the drive, just curious how you run the chkdsk when cloud drive mounts the drive.
-
You have to detach your drive and reattach it on with the new drive cache. You cannot use external drives.
-
Hi, I've just started using CloudDrive with google drive and i have some questions about the way to software works, i'm not very good at tech stuff so maybe these questions are stupid sorry about that!
Can i access my files from google drive if i'm using an unencrypted disk? Are they viewable , searchable in clear?
Is there a way to move my already backed up google drive files to an unencrypted disk? Without having to redownload them locally?
If i use CloudDrive for backing up my computer to an encrypted disk is there a way to access my files from somewhere else?
If i stop using this software will there be a way for me to be able to still access my files?
Thanks in advance
You cannot access files from google drive. They are obfuscated and only the software can read it
You will have to redownload them.
The software is the only way to view any data. It cannot connect to two machines at once. You will have to be detached on the other PC before you are able to mount it to another PC
-
what is "let it shut down properly" exactly? also, I'm on .818.
you can simply restart and don't force shut down and it should shut down the app correctly. I have heard reports of people being unable to do it. however if you have a cache there just simply remove the cache and it will only reupload what is pending instead. It is a safer approach than having it re upload everything that you already have
-
Cloud Drive has been attempting to upload without succeeding for about 5 hours now. This has resulted with 32 upload threads, but worst of all I can't make it stop trying. I've unchecked upload threads but Cloud Drive keeps on trying. I don't want to restart and send it into hours of recovery.
Same problem, and i think it has to do with .802. Restarting is fine as long as you let it shut down properly
-
I am on 1.0.0.802 and every night the upload mysteriously stops. It was similar to an issue i use to have before where it would dismount overnight but on 802 it doesn't seem to dismount which is nice it just errors and stops uploading. I have a drive trace ready however it is not letting me upload via your contact us form because the limit is 10 MB and mine is about 13. How should i submit a ticket? Thanks
-
Yeah make sure you have prefetch set up correctly, more threads but not too much you will get throttled and 20 MB chunk sizes are good.
-
Experienced this strange behaviours already as well. The funny thing is that after the crash some drives that were fully uploaded after recovery were just fine - while others were re-uploadiung everything.....
So it sounds like a poor design. Can't imagine any database doing this after unclean shut down.
Apart from that - if I will loose the drive where local cache was stored - assuming everything was completely uploaded - doest that mean I will loose my data stored in DriveCloud?
With this or you';ll "force" the app to trust what is uploaded or ... loose your data.
It isn't poor design though. If it shuts down randomly in the middle of an upload. How will it know what it has uploaded yet or not. The data is unreliable it is better to reupload the entire cache than to deal with the data inconsistencies. I personally clear cache often, this prevents that from happening to me. It has happened and it is annoying however it is one of those things that makes sense. And if you attempt a shut down and you force the shut down on windows. That will kill processes that are still active and give you a problem when you restart it.
-
I'm looking at using this product for a couple of different purposes both personally and professionally. I think I can answer most of my personal needs questions via a trial but the professional needs aren't so easily satisfied.
I'm looking at installing this on a Windows Server 2012 R2 server hosted in the cloud. This server runs production workloads. I would like to use this to enable a simpler means of scripting the offsite storage of backups from the server. There are 2 types of scheduled backups:
- Generated Zip files
- Full server images
Since the server is cloud hosted it has a few interesting properties:
- VERY fast IOPS (its on pure flash drives)
- VERY small hard drive
For instance there is NOT enough space available on the drive to perform a full image backup.
So question 1. Do you see this scenario as feasible?
And then question 2. Since this is a company asset and the internet is generally horrible, it is a high target for hacking and specifically ransomware type attacks. Ideally I would like to lock away access to the cloud drive to just the script that is performing the backups thus keeping the cloud drive completely hidden and protected from being encrypted by a hacker. Would this be possible via a .NET accessible API, or a command line?
I can give some input on number 2. The drive acts as a regular mounted drive on a system. So if you can encrypt the drive itself via any means you should be able to have it function as you want. However the data cache exists on a drive as a hidden folder. And if that were to be encrypted by say a cryptolocker the files would not be able to be read from the cache. So if anything you have pending to upload to the cloud or have it stored locally that could be encrypted and inaccessible. So a more recent backup may be unavailable, which is not great for your use case.
This is from my experience of working with the product. Drashna could probably enlighten you a bit more about this.
-
For fast connections it is also recommended to increase the minimal download size, so you can utilize your speed to get more data pr. thread. To change this you would have to detach and reattach your drive
This is my settings with no lag with plex:
20 MB chunks and 20 MB minimal download
1 MB prefetch
400 MB Forward (20x20 MB)
1000 Time Window
20 Download Threads
10 Upload Threads
1 gbit/1gbit line, so these might not be good for you, bit they give you an idea on how to increase speed on high speed lines
Gonna try these settings, at the moment it has worked fine but it pauses to essentially buffer which is what i am trying to fix. Have you tried to access to videos at once via plex? I am curious how the performance is to access multiple vids
-
my cache is about 300 GB, i plan to expand it more, as i put things back there. But so far it's been pretty awesome
-
The time window is how long the data will be saved on the drive. So for instance in plex this could be nice if you want to pause or rewind - else it would have to prefetch again.
I use 20 MB chunks and have a 20 minimal download
20 download threads and 400 MB prefetch.
My time window is set to 1000
Thanks i always thought anything that was prefetched ends up being cached, but clearly that isn't the case.
Upload stops overnight
in General
Posted
Yeah all is well both drive mounted, just one seems to have errors on it as it is showing up as a 4 KB remaining when in truth it should have TBs of space. Gotta run chkdsk again. Last time i ran it for a week and it never progressed passed a point. So i might have to run it forever in order for it to fix the drive.