Jump to content

  • Log in with Twitter Log in with Windows Live Log In with Google      Sign In   
  • Create Account

Photo

Files starting to go corrupt, Cloud Drive throws no errors


  • Please log in to reply
53 replies to this topic

#41 KiLLeRRaT

KiLLeRRaT

    Member

  • Members
  • PipPip
  • 23 posts

Posted 11 February 2017 - 05:45 PM

Heh still stays RAW... I guess I better dust off the old local disks and plug in the array controller :\ See what I can recover here.

 

I'm just thinking of a way to prevent this in the future without having local disks around... Any suggestions other than the rclone suggestion by Akame?



#42 Christopher (Drashna)

Christopher (Drashna)

    Customer and Technical Support

  • Administrators
  • 8,208 posts
  • LocationSan Diego, CA, USA

Posted 11 February 2017 - 09:13 PM

Heh still stays RAW... I guess I better dust off the old local disks and plug in the array controller :\ See what I can recover here.

 

I'm just thinking of a way to prevent this in the future without having local disks around... Any suggestions other than the rclone suggestion by Akame?

 

 

Well, if you're using the 1.0.0.830+ build, this should not happen in the future.  The issue that allowed this ot happen has been patched. 

 

Otherwise, the best advice I can give you is to always, ALWAYS have multiple copies of any important files. Even if you stop using StableBit CloudDrive, you should absolutely do this, because you never know when "something" might happen to one of those sets of data. 

 

https://www.veeam.co...eplication.html


Christopher Courtney

aka "Drashna"

Microsoft MVP for Windows Home Server 2009-2012

Lead Moderator for We Got Served

Moderator for Home Server Show

 

This is my server

 

Lots of "Other" data on your pool? Read about what it is here.


#43 KiLLeRRaT

KiLLeRRaT

    Member

  • Members
  • PipPip
  • 23 posts

Posted 12 February 2017 - 08:00 AM

Hey Chris,

 

Yeah I haven't lost anything important, I have quite a number of backups of my important stuff on multiple services and also multiple physical drives on separate locations.

 

I  was just hopeful with this since I just sorted out my TV Show library and took a while to get sorted out and working the way I wanted, so was hoping I wouldn't have to do it over again heh.

 

Thanks for the help and so on though, loving the product so far!


  • Christopher (Drashna) likes this

#44 Christopher (Drashna)

Christopher (Drashna)

    Customer and Technical Support

  • Administrators
  • 8,208 posts
  • LocationSan Diego, CA, USA

Posted 12 February 2017 - 07:42 PM

Well, I'm glad to hear it.

 

But I totally understand the frustration.  I've spent ... waay too many hours reorganizing my data.


Christopher Courtney

aka "Drashna"

Microsoft MVP for Windows Home Server 2009-2012

Lead Moderator for We Got Served

Moderator for Home Server Show

 

This is my server

 

Lots of "Other" data on your pool? Read about what it is here.


#45 ufo56

ufo56

    Member

  • Members
  • PipPip
  • 21 posts

Posted 19 July 2017 - 04:43 PM

Now i have this kind of error. Randomly files get corrupted. So far i have found ~50 files. Using 1.0.1.877 beta



#46 Christopher (Drashna)

Christopher (Drashna)

    Customer and Technical Support

  • Administrators
  • 8,208 posts
  • LocationSan Diego, CA, USA

Posted 19 July 2017 - 10:08 PM

Now i have this kind of error. Randomly files get corrupted. So far i have found ~50 files. Using 1.0.1.877 beta

 

What provider? File system?  integrity checking enabled?  Upload verification enabled? 

 

Have you run a memory test on the system? 

Have you tried checking the disk used for the cache?

 

 

The reason I ask, is that the storage chunks adds a checksum block to each chunk for the integrity checking.  If this information is intact, then it's not the software that is causing the corruption, but something causing it to be corrupted as it's being written. 


Christopher Courtney

aka "Drashna"

Microsoft MVP for Windows Home Server 2009-2012

Lead Moderator for We Got Served

Moderator for Home Server Show

 

This is my server

 

Lots of "Other" data on your pool? Read about what it is here.


#47 ufo56

ufo56

    Member

  • Members
  • PipPip
  • 21 posts

Posted 20 July 2017 - 12:19 AM

*Gdrive

*NTFS, 100TB disk

*Can't find on latest version integrity check

*Upload verification off

 

 

Memtest done. It's ok. Cache SSD ok.

 

Some corrupted files are dated few months back. Some files few days or week. Hundreds files that have been copied between are ok. Just some of them are broken. Annoying is that i can't even delete them. 



#48 Edrock200

Edrock200

    Advanced Member

  • Members
  • PipPipPip
  • 36 posts

Posted 22 July 2017 - 05:22 PM

Not sure if this is related to your issue, but I had drive corruptions as well with my 256tb cloud drive. Chkdsk would detect the errors, but could never repair them. I then found an article on Microsoft's knowledgebase stating that chkdsk repairs require the Volume Shadow Copy service, and that service does not work on partitions over 64TB. I couldn't shrink my partition size in clouddrive, but I could drink in in Windows Disk manager to 50TB, then I was successful in having chkdsk repair the volume.



#49 Christopher (Drashna)

Christopher (Drashna)

    Customer and Technical Support

  • Administrators
  • 8,208 posts
  • LocationSan Diego, CA, USA

Posted 27 July 2017 - 04:43 AM

*Gdrive

*NTFS, 100TB disk

*Can't find on latest version integrity check

*Upload verification off

 

 

Memtest done. It's ok. Cache SSD ok.

 

Some corrupted files are dated few months back. Some files few days or week. Hundreds files that have been copied between are ok. Just some of them are broken. Annoying is that i can't even delete them. 

 

Integrity checking is enabled at drive creation.   And it's on by default.  

 

You can check the statu by mousing over the disk info in the UI (towards the top).

 

 

 

Not sure if this is related to your issue, but I had drive corruptions as well with my 256tb cloud drive. Chkdsk would detect the errors, but could never repair them. I then found an article on Microsoft's knowledgebase stating that chkdsk repairs require the Volume Shadow Copy service, and that service does not work on partitions over 64TB. I couldn't shrink my partition size in clouddrive, but I could drink in in Windows Disk manager to 50TB, then I was successful in having chkdsk repair the volume.

 

Hmm.

 

In this case, the "scan" option may fix this, as it forces an online scan.  Though.... it does skip some checks.


Christopher Courtney

aka "Drashna"

Microsoft MVP for Windows Home Server 2009-2012

Lead Moderator for We Got Served

Moderator for Home Server Show

 

This is my server

 

Lots of "Other" data on your pool? Read about what it is here.


#50 ufo56

ufo56

    Member

  • Members
  • PipPip
  • 21 posts

Posted 02 August 2017 - 07:43 AM

*Gdrive

*NTFS, 100TB disk

*Can't find on latest version integrity check

*Upload verification off

 

 

Memtest done. It's ok. Cache SSD ok.

 

Some corrupted files are dated few months back. Some files few days or week. Hundreds files that have been copied between are ok. Just some of them are broken. Annoying is that i can't even delete them. 

Another folder full of files got corrupted. Drive has not been disconnected since files have been added.



#51 Banjo Joe

Banjo Joe

    Newbie

  • Members
  • Pip
  • 4 posts

Posted 10 August 2017 - 11:47 AM

This is scary.

 

I just started using CloudDrive about a week ago. Still under trial and will probably purchase. 

 

I have transferred about 1.5 TB of data and discovered one folder completely corrupted and cannot be opened. Using google as my provider and was transferring data over from Amazon Cloud. Had to recopy the entire folder again.

 

 

1. What's the best method or software to check if more of my existing data in Stablebit Cloud Drive is corrupted? 

 

2. Is it safer to create 4 x 1 TB drives for usage as opposed to having just one large 4TB drive?

 

3. Is data corruption less likely to occur if i use an unencrypted Cloud Drive instead of a full encrypted one.

 

4. Is there any situation where the entire Cloud Drive can be corrupted and data completely irrecoverable?

 

 

I do not have the resources to keep separate copies of my data in different clouds or physical HDD. 

 

Thanks !



#52 Banjo Joe

Banjo Joe

    Newbie

  • Members
  • Pip
  • 4 posts

Posted 10 August 2017 - 07:26 PM

How do i resolve this? Thanks. I have to stop using Cloud drive in case errors continue to mount. 

 

 

https://i.imgur.com/gao1cis.jpg



#53 ufo56

ufo56

    Member

  • Members
  • PipPip
  • 21 posts

Posted 17 August 2017 - 08:05 PM

Another folder full of files got corrupted. Drive has not been disconnected since files have been added.

And another folder corrupted. Now im doing chkdsk /f. Lets see if that changes something...

Annoying is that u can't even remove this corrupted folder.

 

This is scary.

 

I just started using CloudDrive about a week ago. Still under trial and will probably purchase. 

 

I have transferred about 1.5 TB of data and discovered one folder completely corrupted and cannot be opened. Using google as my provider and was transferring data over from Amazon Cloud. Had to recopy the entire folder again.

 

 

1. What's the best method or software to check if more of my existing data in Stablebit Cloud Drive is corrupted? 

 

2. Is it safer to create 4 x 1 TB drives for usage as opposed to having just one large 4TB drive?

 

3. Is data corruption less likely to occur if i use an unencrypted Cloud Drive instead of a full encrypted one.

 

4. Is there any situation where the entire Cloud Drive can be corrupted and data completely irrecoverable?

 

 

I do not have the resources to keep separate copies of my data in different clouds or physical HDD. 

 

Thanks !

 

1: Probably if u do md5 hash before upload and after that u check if this match with original

 

2: Yes, most people here probably is using 100+tb drives.

 

3: I don't belive there is difference.

 

4: In forum someone mentioned few months back that whole drive was corrupted.



#54 Christopher (Drashna)

Christopher (Drashna)

    Customer and Technical Support

  • Administrators
  • 8,208 posts
  • LocationSan Diego, CA, USA

Posted 17 August 2017 - 10:35 PM

How do i resolve this? Thanks. I have to stop using Cloud drive in case errors continue to mount. 

 

 

https://i.imgur.com/gao1cis.jpg

 

 

What size drive are you using?

 

 

Specifically, it looks like Windows (NTFS specifically) may have problems with drives larger than +55TB (the actual limit is 64TB, but there seems to be some window around that.

 

We would recommend smaller sized disks, or at least smaller volumes on those disks, to ensure you don't exceed this limit. Or ... use ReFS, which doesn't have this limitation.

 

 

Specifically, there seems to be a design flaw with the volume snapshot system for drives larger than 64TBs.  CHKDSK takes a snapshot of the disk, and then scans *that*.  Since ReFS doesn't use chkdsk, this isn't a consideration. 

 

 

As for preventing corruption, if the integrity checking is enabled (it is by default) when you create a disk, it will always validate the data it gets back from the cloud.

 

 

 

And yes, it is definitely safer to use more, smaller drives, and to pool them together.

 

 

 

As for encryption vs regular, no.

 

 

 

And the data should always be recoverable. Worst case, most data recovery tools will work on the drives.


Christopher Courtney

aka "Drashna"

Microsoft MVP for Windows Home Server 2009-2012

Lead Moderator for We Got Served

Moderator for Home Server Show

 

This is my server

 

Lots of "Other" data on your pool? Read about what it is here.





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users