Jump to content

  • Log in with Twitter Log in with Windows Live Log In with Google      Sign In   
  • Create Account

Photo

Drivepool issue with rclone


Best Answer Christopher (Drashna) , 19 May 2017 - 08:12 PM

Sorry for the long delay,

 

This should be fixed with the latest beta versions. 

 

http://dl.covecube.c...54_x64_BETA.exe

 

Alex (the dev) beleives that the issue was fixed here: 

https://stablebit.co...eAnalysis/27103

Go to the full post


  • Please log in to reply
8 replies to this topic

#1 hovee

hovee

    Newbie

  • Members
  • Pip
  • 4 posts

Posted 02 October 2016 - 01:34 AM

I've been using rclone lately to sync files up to my Amazon cloud drive. It is basically rsync for cloud storage. It is an amazing tool. However, I have been unable to sync files from my drivepool drive thru rsync up to my amazon cloud drive. These is a thread that I started on the rsync github page describing the issue. The developer for rsync said he'd like to work with a developer at Stablebit to figure out what needs changed to be able to work properly.

Here is the thread.
https://github.com/n...lone/issues/750

Is there a developer here that would be willing to reach out to figure out a solve? Thanks for the help!

#2 Christopher (Drashna)

Christopher (Drashna)

    Customer and Technical Support

  • Administrators
  • 8,203 posts
  • LocationSan Diego, CA, USA

Posted 02 October 2016 - 07:13 PM

Well, are you using any antivirus, backup or disk tools? 

And post the results of: http://wiki.covecube...vePool_Q2159701

These can cause weird interactions, in some cases. 

 

Additionally, what OS are you using and what version of StableBit DrivePool?

 

And are you using network IO Boost? And have you tried disabling read striping? 

In either case, these options are found in the UI, under Pool Options -> Performance

 

And specifically, could you test to see if this behavior still occurs in the latest version?

http://dl.covecube.c.../beta/download/

(specifically version 2.2.0.711)

 

And if it continues to occur, please grab file tracing: 

http://wiki.covecube..._Log_Collection

This is a kernel level log of what is going on, and should log the specific commands being sent to the pool and how the pool is responding.  

 

If this is an issue on our end, it should catch it, basically. 

 

 

And the best way to contact us is https://stablebit.com/Contact


Christopher Courtney

aka "Drashna"

Microsoft MVP for Windows Home Server 2009-2012

Lead Moderator for We Got Served

Moderator for Home Server Show

 

This is my server

 

Lots of "Other" data on your pool? Read about what it is here.


#3 hovee

hovee

    Newbie

  • Members
  • Pip
  • 4 posts

Posted 02 October 2016 - 08:24 PM

Thank you for the reply. I will upload some logs in a bit. I am on Windows 10 Pro 64bit. I found out that disabling Read Striping fixed the issue for rclone. I also tried the beta you mentioned and it behaved the same way with Read Striping On - rclone would not work correctly. When I disabled it again in the beta, rclone worked correctly.

 

Results of fltmc

 

C:\WINDOWS\system32>fltmc
 
Filter Name                     Num Instances    Altitude    Frame
------------------------------  -------------  ------------  -----
wcnfs                                   0       409900         0
WdFilter                               16       328010         0
storqosflt                              0       244000         0
wcifs                                   0       189900         0
FileCrypt                               0       141100         0
luafv                                   1       135000         0
npsvctrig                               1        46000         0
FileInfo                               16        45000         0
Wof                                    10        40700         0


#4 hovee

hovee

    Newbie

  • Members
  • Pip
  • 4 posts

Posted 03 October 2016 - 12:46 AM

I just uploaded my logs. "Service 10-2-16 840pm.zip" I enabled Read Striping and did a rclone copy to Amazon Cloud Drive. It did not upload properly and created the error as described before. The file that I was uploading to look for in the log was "01 I Can't Quit Her.mp3"

 

Note that I'm on Windows 10 Pro 64bit and have Drivepool 2.2.0.711 beta installed.



#5 Christopher (Drashna)

Christopher (Drashna)

    Customer and Technical Support

  • Administrators
  • 8,203 posts
  • LocationSan Diego, CA, USA

Posted 03 October 2016 - 05:39 PM

Okay, so this is definitely an issue with how we are handling read striping.  Thank you for testing and confirming that!

 

That, and the specific file name in question does help to identify the specific issue, so again thanks! 

 

https://stablebit.co...eAnalysis/27201


Christopher Courtney

aka "Drashna"

Microsoft MVP for Windows Home Server 2009-2012

Lead Moderator for We Got Served

Moderator for Home Server Show

 

This is my server

 

Lots of "Other" data on your pool? Read about what it is here.


#6 Christopher (Drashna)

Christopher (Drashna)

    Customer and Technical Support

  • Administrators
  • 8,203 posts
  • LocationSan Diego, CA, USA

Posted 09 October 2016 - 06:23 PM

Actually, I have a small request here.... while on another ticket, I remembered/stumbled upon a setting that may help. 

 

http://wiki.covecube...vanced_Settings

  • CoveFs_ReadStripingBlockMode
  • CoveFs_ReadStripingBlockModeNoCache

Try setting the "NoCache" setting to "True" and reboot. See if that helps.

If not, try setting the main setting to "false" and reboot. 

 

Let me know if either of these work.   


Christopher Courtney

aka "Drashna"

Microsoft MVP for Windows Home Server 2009-2012

Lead Moderator for We Got Served

Moderator for Home Server Show

 

This is my server

 

Lots of "Other" data on your pool? Read about what it is here.


#7 Christopher (Drashna)

Christopher (Drashna)

    Customer and Technical Support

  • Administrators
  • 8,203 posts
  • LocationSan Diego, CA, USA

Posted 19 May 2017 - 08:12 PM   Best Answer

Sorry for the long delay,

 

This should be fixed with the latest beta versions. 

 

http://dl.covecube.c...54_x64_BETA.exe

 

Alex (the dev) beleives that the issue was fixed here: 

https://stablebit.co...eAnalysis/27103


Christopher Courtney

aka "Drashna"

Microsoft MVP for Windows Home Server 2009-2012

Lead Moderator for We Got Served

Moderator for Home Server Show

 

This is my server

 

Lots of "Other" data on your pool? Read about what it is here.


#8 hovee

hovee

    Newbie

  • Members
  • Pip
  • 4 posts

Posted 24 May 2017 - 12:00 AM

Thank you! I can confirm that beta fixed the issue for me while Read Stripping is enabled.



#9 Christopher (Drashna)

Christopher (Drashna)

    Customer and Technical Support

  • Administrators
  • 8,203 posts
  • LocationSan Diego, CA, USA

Posted 24 May 2017 - 08:43 PM

Fantastic! 

 

And glad to hear it! :)


Christopher Courtney

aka "Drashna"

Microsoft MVP for Windows Home Server 2009-2012

Lead Moderator for We Got Served

Moderator for Home Server Show

 

This is my server

 

Lots of "Other" data on your pool? Read about what it is here.





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users