Jump to content

All Activity

This stream auto-updates

  1. Today
  2. I'm having the same symptoms exactly (20-25MB/s) balancing while file transfer are over 200MB/s Unfortunately for me, even after clicking the arrow over 100x, it is still slow
  3. Yesterday
  4. Cam, I had the same issue with drive balancing as I removed a single 8TB Red Nas and inserted an 18TB Red Nas drive in its place for increased storage and the drive balancing was plodding along at about 25MB/s. (value taken from StableBIt Drive Scanner) At this rate it will take longer than a week in my 5 drive StableBit DrivePool. My drives are fast than this, much faster. So what I decided to do was: hit the dobble arrows to the right of the balancing portion of the screen (at the very bottom) removed all background applications i.e Plex etc., from running removed all background processes not necessary for the balancing to occur checked the throughput on Drive Scanner then closed it too My Results: My balancing is now humming along between 180MB/s and 210MB/s. (value taken from StableBIt Drive Scanner) And now maybe sometime this evening it will be finished. Hopefully this helps someone as it helped me.
  5. Last week
  6. Anyone? Does Christopher still monitor this forum?
  7. I'm getting 25MB/s balance speeds on WD Red drives that will typically transfer at 200-250MB/s with windows. I'm reading the speed from Stablebit Scanner. Definitely frustrating
  8. Hi, I am experiencing serious issues with the CloudDrive product in connection with my Microsoft One Drive accounts. I have 5 personal OneDrive accounts and successfully added them to the CloudDrive app. However, almost every day when I reboot the computer or wake up the computer from sleep either one or multiple of the accounts disconnected and error messages pop up: "Drive cannot be mounted", "Drive cannot be mounted, the drive was forced to unmount because it could not read data from the provider", "Can't reauthorize drive OneDrive1 - 1.00 TB. Drive data was not found when using provided credentials.", and "There was an error communicating with the storage provider. Sequence contains no matching element". I suspect that there is a bug in StableBit's API to Microsoft's OneDrive authentication process. Even though I authenticated and even successsfully reauthenticate I get constantly disconnected from the accounts. I already tried "CloudDrive_SynchronousServiceStart" to "true" and also tried running the service "StableBit CloudDrive Service" as "Automatic (delayed)" and none solved the problem. Any advice or anyone else in the same boat? Thanks
  9. beefjerky

    SSD Cache

    I use standard spinning hard drives for my drivepool. They can certainly saturate my network while moving larger files, as they're very fast for sequential transfers. However, for syncing and moving a bunch of small files, hard drives suck and they can slow to a crawl. An SSD would greatly help with those transfers, however, it doesn't look like it's really an option. I did hear back from support via a help ticket I put in, and they confirmed that the SSD optimizer would be of no help for my situation with transfers to/from a Veracrypt drive. Also, the size of the Veracrypt container precludes affordable SSD storage. This is especially the case since I really need that file to be duplicated. Having the container on a single SSD and duplicated to a HDD also wouldn't help since DrivePool handles the duplication in real time, so it would still be limited to HDD speeds. So, I'd need two very expensive SSDs. Regardless of whether Primocache can handle network transfers on a server, I'll avoid it. The data in the container is too important to risk corruption from a power outage or crash. So, for now, I'll just live with it. When 3+TB SSDs inevitably become cheaper, I'll reassess.
  10. gtaus

    SSD Cache

    Well, that's not what the people at PrimoCache told me. They made it clear to me that PrimoCache will not cache any network transfers because it uses a different protocol for network file transfers. I also don't see what caching benefit you would achieve using PrimoCache on the server. The bottleneck for speed on network transfers is usually the limited bandwidth speed of the network itself. My home network, for sure. Are there home networks that have data transfer rates higher than a write speed of a SSD? That's the only case where I could see a speed advantage to using RAM as cache with PrimoCache. Otherwise, you might as well write directly to a SSD/HDD over the network. It has been about a year since I last looked at PrimoCache for network transfers, and at that time it was not possible. Maybe they have made some progress on their end because I bet a lot of people would love to speed up the network file transfers, if possible. Caching to an SSD seems like a safer option. File writes would be verified before completing, and would be permanent on the SSD, as opposed to using RAM as cache and the possibility of a power loss with data in volatile RAM being lost forever. Windows 10 will cache some file transfer data in RAM natively. If you had lots of RAM on your computer, then your Windows 10 data file cache would be higher. PrimoCache just allows you to use more RAM as primary cache, and an SSD as secondary cache, to speed up your transfers within your computer. If you find that PrimoCache works to speed up your transfers, either on the server or client end, then that would be great. I can't even test it out anymore because my trial period ended about a year ago and PrimoCache doesn't forget your 30 day trial period. I'm not going to buy a license to try out software again that did not work for me in the past. Anyways, I hope you find a solution to your needs.
  11. beefjerky

    SSD Cache

    Hmm, I ended up contacting support for Primocache, and they gave me a different answer. They said it would work to accelerate transfers on client computers if run on the server. That said, they did tell me that regardless of whether using an SSD or RAM as cache, there was no protection at all from crashes or power outages. So, if the server suddenly loses power or crashes, that data is permanently gone. I was not comfortable with that. The SSD cache option for DrivePool makes it clear that no data would be lost in those scenarios. However, since no one from the development team has responded, I'm still not sure if it would work to do what I want. And, I can't really think of an easy way to test it either...
  12. I have two pools on my computer, one unencrypted and one encrypted. I've read on here that bitlocker is the preferred method of encrypting drives, and my normal procedure is to enter the password after restart for each drive before restarting the drivepool service, otherwise the encrypted drivepool doesn't show up at all and drivepool doesn't see the disks. Today, the drivepool service seems to be failing to restart, meaning I can neither make a new pool, add my encrypted drives to a pool, or see my encrypted pool. Drivepool doesn't show my encrypted pool at all, when I would expect it to still have the pool, but show the disks as missing. What do I need to do to come up with a procedure that will allow me to reliably restart my computer when required without restarting services?
  13. I'm running a Plex server currently with 8 HDDs in 2x4 bay boxes. I have some hard drives allocated to TV, and others allocated to Films. I'd like to have files written to the drives in consecutive writes to reduce fragmentation and to begin filling drives one after the other. What's the best way to do this? Just bought a new 18TB drive to add to the Films pool. I'd like to start by filling it up with content currently in the pool, and then begin to fill up the next highest capacity drive, and so on. How can I optimize this going forward?
  14. I have stopped the DrivePool services, too, but like you, I reboot when starting everything back up. I don't know if there is a shortcut. And by that I mean, I have 23 USB HDDs (82TB) and it takes a few hours to reboot DrivePool, check all the drives, check duplication, etc... before all those housekeeping services are complete. I typically only schedule a reboot for overnight housekeeping, if at all possible. DrivePool is a great system for my home media server, but it's just not lightning fast on reboots and checking itself. Of course, if I only had a few HDDs or few TBs of data to validate, then the process would go much faster.
  15. I'm not sure what's going on here, but my drives won't balance. This has been going on for a while, but it has gotten much worse today. Not sure what is going on here, let me know if there's more I need to provide other than these screenshots. Thanks!
  16. I would disable all the other balancers and see if it that fixes it. If so then you can add them back one by one, carefully considering whether you need them and the potential complications they bring, such as this issue, if in fact the issue is one of those other balancers.
  17. Earlier
  18. Thanks for that information!! Do you know if the Drive Pool staff still hang out in these forums or answer? I submitted a tech support ticket and haven't heard a response there either.
  19. On the few occasions when I have wanted to re-arrange the contents of the pool, I have used the Windows "Services" panel to stop the Drivepool service. In fact there are two Drivepool services that run continuously: Drivepool service Drivepool shutdown service I stop both services before changing pool content, but I don't know whether it is necessary to stop both. However, I also don't know what state the service is left in, so I don't risk restarting the Drivepool services from the "Serivces" panel. Instead I reboot the system. It would be useful if someone who actually knew the details could post the relevant information... -- from CyberSimian in the UK
  20. gtaus

    SSD Cache

    I think if you modify a file, and then save it, it will save it first on the SDD cache and then flush it to Archive drives later depending on your settings. That's exactly what I wanted to do with PrimoCache on my system. Either running on the server or the client computer. But, alas, it does not work. I contacted PrimoCache support and they verified to me that transferring files over any network, in any direction, is not supported by PrimoCache. They said the transfer protocol over a network is different and PrimoCache does not (yet) support that functionality. Too bad. I would have gladly bought a copy if it did.
  21. I don't use SnapRAID, but there is pretty good video on YouTube at:
  22. I have never really figured out the File Placement system. So, I'm just signing on here to see if anyone has a good response. I understand how DrivePool might split up a movie folder on 2 or more drives, depending on how many files were in that folder. I see that when I upload an album folder and the tracks of the album might be on any number of drives in the pool. If your goal is to have all the files in the movie folder on one drive, then I think there is an option in DrivePool to completely fill up one drive before it starts writing to the next drive. Also, I think you can designate your DrivePool "Movie" folder to only be on certain drive(s) in File Placement. One of those options might get you closer to your goal.
  23. I think I understand what you are doing. You are partioning an HDD into 2 or more volumes and DrivePool does not recognize the new partitions. From what I understand, and I could be wrong here, DrivePool reads the serial number (not the Drive letter) of the HDD and adds a hidden PoolPart folder to that drive. Problem is, if you add additional partitions to that drive, it still only has 1 serial number for that HDD. I ran into this issue thinking I could partition a SSD into 2 volumes and have 2 frontend caches for Duplication files. But no, it will not work that way because DrivePool only allows one hidden PoolPart folder per physical disk.
  24. You can easily hide the DrivePool drives from File Explorer by simply going into Disk Management and removing the Drive letter of that/those drives. DrivePool does not need a drive letter for the HDDs in the pool. I have 23 USB HDDs, without Drive letters, in my DrivePool, but the only thing showing in File Explore is the combined DrivePool volume letter. BONUS IDEA: Instead of assigning Drive letters to your DrivePool drives, you can mount them in a folder on your C: drive. You can still access each and every drive mounted in DrivePool that way in the mount folder and see what it contains, but you won't be clogging up File Explorer with a bunch of drives in the main list. BONUS BONUS IDEA: If you use a disk cataloging program to organize your files and/or conduct searches, the cataloging program will read and catalog each drive mounted in the special folder. That way, if you had a HDD fail in your DrivePool, you can easily go into your cataloging program and find out what was on that specific drive. For my DrivePool home media server without Duplication, it would allow me to see what files were lost on that drive and if I want to reload them from a backup disk in my storage closet.
  25. gtaus

    Simulating Raid 10

    I am trying to wrap my head around your idea. DrivePool works differently than RAID, but I think I can offer some suggestions. Since DrivePool writes full files to one disk at a time, not packets spread over multiple disks, would not standard duplication in DrivePool give you the same result of having a copy of your data on two separate disks? Essentially, Raid 1+0 is Mirroring with Striping combined. Mirroring for data redundancy, and Striping for speed in a packet writing system. I think you could do something similar in DrivePool using Duplication (Mirroring) on either your entire DrivePool, or just selected important folders, and using 2 SSD's, one each as frontend cache for each duplicate file (Striping) for increased speed. I was able to achieve RAID-like speed on my DrivePool when I added an SSD frontend cache (for WRITES). I also set my DrivePool SSD cache high enough that I can also use it as a very fast READ/WRITE cache for temporary files. I set my SSD cache not to flush until it has 100GB. That's more than I need on any of my temporary working directories. Another big plus with using DrivePool is that you don't have to add additional HDDs in pairs. I recently built a DrivePool with 3 end-of-life HDDs that I cannot trust on my main DrivePool. I set that entire end-of-life DrivePool to 2X Duplication, In theory, if/when any one drive fails, I'll still have another copy of my files on one of the other 2 remaining HDDs. If there is enough capacity on the remaining 2 HDDs on that DrivePool, it will duplicate the files as needed that were on the failed third HDD. I would never consider using those end-of-life HDDs in a RAID system, but DrivePool lets me get more time out of those old drives. That saves me money and was worth the cost of DrivePool itself. Another consideration is that a typical RAID system, with packet writing across disks, leaves you with nothing if a HDD fails - unless you build in duplication like your RAID 1+0 setup. You can't read a failed RAID HDD. DrivePool, on the other hand, can often retrieve many, if not most, files off a failing HDD because it contains the entire file, not mere packets. I have been able to retrieve all but maybe 2 or 3 files off a 4TB HDD that crapped out on me. Unless the HDD is totally dead, you have a decent chance of retrieving files off that failing HDD. Bottom line: To replicate the features of RAID 1+0, use Duplication on your DrivePool for redundancy and add 2 SSDs as frontend cache, one SSD for each duplicate file to be written for RAID-like speed. When you want to expand your setup, in DrivePool you can add one disk at a time instead of having to add disks in pairs.
  26. I now have 23 USB HDDs in my DrivePool. I don't remember at what point I started having problems with DrivePool reconnecting to the USB HDDs, but it's not just DrivePool. Windows Disk Management doesn't connect with all the drives if I try to reconnect all of them at the same time. I am thinking it has something to do with the USB and identifying too many drives at one time. My solution was to buy 7 port USB Hubs with individual power switches for each port. So, I start my computer, and then load each USB drive, one at a time, making sure it shows connection in the DrivePool GUI before I move on to the next USB HDD. Obviously, I hate rebooting the server. But at least I can now get DrivePool to reconnect to the HDDs, albeit one drive at a time. On my system, it takes about 30 seconds to turn on and reconnect to each HDD. Not a very fast process but is much better than before when half my USB HDDs never reconnected. I have one internal SSD as a frontend cache for my DrivePool. When I reboot my computer, it is the only drive found by DrivePool and all the other USB HDDs are missing until I turn them on and load them - one by one - into DrivePool. In your case, if you shut down all the USB HDDs but still had one small SSD/HDD online, you should be able to reconnect all the other USB HDDs without rebooting. I do that all the time with my DrivePool when I swap in/out USB HDDs. Since I always have that one SSD online and DrivePool is always up and running, I can disconnect and reconnect the other USB HDDs without rebooting the computer. Of course, if you have any HDDs listed as missing, DrivePool goes into a READ Only mode and you will not get full functionality READ/WRITE until all HDDs are reconnected. There might be a way to start/stop the DrivePool services without rebooting, but I have not figured it out.
  27. Sounds like the Duplication process is stuck. Have you tried stopping the Duplication process, and then restarting it? If I determine that DrivePool is frozen, sometimes I'll just shut down the computer/server and restart it again. In general, I find the DrivePool does a pretty good job at duplicating the folders in the background, but, like you said, it's not a very fast process. Have you tried opening up Task Manager and checking to see if there is any disk activity? The progress bar in DrivePool does not offer much information on the activity going on in the background. In the past, when I have had to swap out/in a number of HDDs all at the same time, I shut off all duplication, swapped out the HDDs, and then reset duplication for the folders I wanted. Only suggest that if you can survive without having all those files backed up all the time. But it allowed me to complete the swaps, get everything back up and running, and then do the duplication in the background at its own pace. I wonder if the minimal info on the DrivePool task bar that really does not show any activity happening just makes a person think that everything is taking a very long time to complete. I know that transferring large volumes of data from one HDD to another with Windows Explorer can also take forever, but at least it shows you an activity box and the transfer speed. If someone has a true method of speeding up duplication, I, too, would love to hear it.
  28. From what I understand, Balancing only moves files your SSD front end cache into the Archive drives. That's all I see happening. If you are talking about Equalizing data on all the Archive disks, I have never known DrivePool to do that by will. For Equalize, DrivePool writes new data to HDDs that have more capacity. As DrivePool writes new data to the HDDs, it will more or less equalize the data among the pool. But i have never seen it rob one drive to free up space and then move that data to another HDD that has more free space. If anyone is able to get DrivePool to equalize HDDs on demand, I would like to know how.
  29. A cool option would be the ability to hide the drives used in the the pool in file explorer with an option built into drive pool. Rather than using Local Group Policy editor. Thoughts?
  1. Load more activity
×
×
  • Create New...