Jump to content
Covecube Inc.

Joel Kåberg

Members
  • Content Count

    15
  • Joined

  • Last visited

  • Days Won

    3

Joel Kåberg last won the day on February 8 2017

Joel Kåberg had the most liked content!

About Joel Kåberg

  • Rank
    Member
  1. This, and the speeds are caped around 7-8MB/s (tried from multiple locations) besides the fact that there is no official public API to work with.
  2. Yes, rclone does a lot of parallelization. Not just uploads, but it checks files remotely, localy etc. while uploading/downloading
  3. I've tried my setup again, this time with ACD which seems to upload at full speed (now 24h later and still uploading at full speed). Perhaps CD is doing to many requests, which then forces Google Drive to add an delay to each request? I'd like to note that rclone does not have this issue (I've already uploaded +/- 20TB using rclone to Google Drive and the avarage speed of that upload was 290mbps, which is my max upload).
  4. As you know I've already tried all this, and I'm on the very latest BETA build. The issue essentially boils down to the response time which increases over time, this really kills the performance of CD.
  5. Yeah, I applied your suggested fix last night. Still same thing :-/
  6. Just thought I'd say this is still happening on .776 (initial speed is very good, after an hour or two it drops significantly). No indication in the text logs to as if this is rate or throttling of any kind. This is on a brand new drive, created for the very purpose of testing this issue. Settings: https://goo.gl/tp4ngZ
  7. Exactly the same issue for me (just lower bandwidth ), I'll see if I can find some logs when I get home (OS logs or CloudDrive?)
  8. Yes I noticed very bad performance (not even close to the BW usage you see in my video) with the old keys (roughly around 20~60 mbps) so I updated on the 20th to the 770 build. Initial speeds was OK for a few hours (5-6), around 200~280 mbps with 100% I/O usage. Yesterday speeds went back to the same as with the old api keys (40-80 mbps) and has been steady since then. I/O usage on the HDD is now at 30~50% so I'm sure it isn't that. If Alex want's I'd let him remote controll the PC doing the upload, if he want's to debug. PS: yes, I did re-authorize.
  9. Just to make my point, here's a video: https://eth0.im/upload/2016-11-17_23-19-10.mp4 At 1 min I pause the transfer (from an SMB share) to the CloudDrive (while CD is still uploading to Google Drive) At 2 min I resume the transfer from SMB to CD At 3 min I show you system specs Pay attention to the upload speed. Normally it's steady above 300 mbps (while SMB transfer is paused) and occasionally hits 400 mbps, just had a bad run here. So while transfering from SMB to CD I see an 30-40% performance loss uploading to Google Drive, and I suspect/guess this is due to CD beeing dependent on the OS drive to split up chunks etc(?). So my suggestion is to offload I/O heavy actions into RAM (atleast make it optional), which should speed things up nicely.
  10. Not pausing the connection, pausing the transfer to the (local) CloudDrive (while CloudDrive tries to upload) What happends is I try to copy stuff to the local CloudDrive, CloudDrive then encrypts and uploads to Google Drive. When all this is happeing at the same time I see disk utilization hitting 100% and uploads really seem's to suffer from it as explained above Seem's the way CloudDrive handles disk IO is really killing it performance wise. I've now moved to rclone while this gets sorted (which caches in ram instead of on disk which i assume CloudDrive is doing as ram is hardly used by CloudDrive)
  11. I'm seeing poor upload performance with GD, it goes somewhere between 0 to 150 mbps (on average 50-70mbps) but very rarely above that. Here's my settings https://goo.gl/iXdlWc | https://goo.gl/H5T8G7 An regular Speedtest https://goo.gl/iRjC8o Looking over the logs I can't see any Rate limit or similar, just a bunch of Write chunk My workflow Ubuntu server with samba (main storage for now)->1gbit lan->Windows 10 PC with clouddrive->google drive So I take it this is something related to my ISP or something between me and Google? I'm investigateing now if my data gets uploaded to EU or US datacenters (I'm located in the EU) Uploaded to EU/Amsterdam For comparision I can saturate my bandwith with the same Google Drive using rlcone, so this must be a CloudDrive issue. One thing that I've noticed is when I pause the transfer to the CloudDrive (and Clouddrive just sits uploading) I'm seeing a lot better bandwith usage (nearly 100%). I've now tried several (SSD) disk on different PC but they all suffer the same fate. So I think I got this down to IO issues, it seems better without encryption but I'd love haveing that. Task manager gives a pretty good hint as to the disk beeing excessevly used (I'm assuming due to the cache in CloudDrive). Perhaps this need some attention, also an RAM option would be nice here (for us with plenty of it). I tried creating a RAMdrive to see if that helped (use as a cache drive) but CloudDrive won't recognize it
  12. I'm also seeing the exact same issue, pausing the local file transfer to the CloudDrive mount point will resume upload but once you resume the local copy it will pause in CloudDrive I hope Alex gets around to it soon! EDIT: Sorry for the noise. Using the latest beta now (756) with fixed cache size. Seem to do the trick here (you guys should update the frontpage links :-))
  13. I'm about to migrate lots of data from an drive to another, and to minimize the wait time I will use an VPS for the initial transfer (better bandwith) But when I have transfered my data onto the CloudDrive (Google Drive), can I then later mount the same drive using a licensed CloudDrive? I'm thinking of using a trial on the VPS, and my license at home.
  14. Is there any ETA on when the new API will be implemented, or anything resembeling a time frame? I've already purchased CloudDrive but not beeing able to use it with ACD is a big letdown
×
×
  • Create New...