Search the Community
Showing results for tags 'balancing'.
-
I added two new 12 TB drives to my pool yesterday and hit Re-Balance, and it is taking forever. As you can see in the pictures, it is currently moving data from one of my 8 TB drives to one of my new 12 TB drives. It has been doing so all night at about 10 to 20 MBps. At this rate (2% completed in one day) it will take about 50 days. Also shown in the pictures is me bypassing DrivePool by manually moving some files within the PoolParts using Windows Explorer from a 10 TB drive to the other new 12 TB drive. Stablebit Scanner shows that these speeds are normal, around 200 MBps. They are all on the same HBA, so the problem can only be caused by DrivePool. I know the obvious solution would be to manually move all the files to the new drives myself like I demonstrated in the pictures, but that would still be several days of me babysitting the process. I paid for DrivePool, and would like to be able to use it so I can just hit the Balance button and walk away. I tried checking and unchecking the Bypass File System Filters and Network I/O Boost settings but that had no effect, and I am not using file duplication. Is there anything else I can try?
-
Hi, I got a question: Ok, Here's what I am starting with: Local Machine D: 2 GB E: 5 GB F: 3 GB Local Network Server Windows Fire Share Lots of space. Network: 10 gbit network. Now, what I want to do: (already tried, actually) 1st pool: Local Pool D: E: F: No duplication, just 1 big 10 GB pool. "Local Pool Drive" is the name. 2nd pool: Cloud Drive, Windows File Share Provider, 10 GB disk, no encryption. "File Share Drive" is the name. 3rd Final Pool +"Local Pool Drive" +"Fire Share Drive" Some folders like my Steam Games I don't want to duplicate because Steam is my 'backup' I set this up, but something went backwards as it seems to be trying to put the un-duplicated files on File Share Drive, which is not what I want. I am currently taking my files back off to be able to rebuild this. I think I've set some stuff up wrong. I understand the basics, but I am missing something in the details. Now, my thinking was to allow me to have a local 10 GB drive, and a 10 GB mirror on my file server. So, I get the best of both worlds. it seems it can "Technically" do this. What I would like to know is, when reading files, will I get local copy reads, or is everything going to grind to a halt with Server Reads? Is there a way to force local reads? I expect a cache would hide the uploads unless I went crazy on it. (hint, I copied all my files on it, it went crazy.) but, I was hoping for a Quazi live backup. So, I get full use of my local disk sizes and have a live backup if a drive ever failed or I wanted to upgrade a disk. Is this one of those "yea, it can, but it doesn't work like you think" or "yea, your just doing it wrong" things. What are the best options for Could Drive (pinning, network IO settings, cache size, drive setup settings) What are the best Local Disk options, D: E: F: and the Local Disk oh, and as a nutty side note, I tend to play games that like SSDs, I have a C: SSD but it's limited in size, (yea, I know, buy a new one, ... eventually I will) so, I would like to setup those games along side my others and add C: to D: E: and F: and tell it no files go on C: cept for the ones I say and EVERYTHING just looks like a D: drive because the actual drive letters will be hidden in disk manager. so, If I want to move a game into or off of my C:, Drive pool SHOULD make it as easy as clicking a couple of boxes right? That's a lot so summary: Can I force local reads when using a pool of Local Pool and Could Drive Pool together? Can I force certain files into specific drives only? (seems I can, just want to confirm) Can specific folders not be duplicated? (again, I think I know how, but there's a larger context here.) Can I do the above 3 at once? Thanks!
- 4 replies
-
- drivepool
- cloud drive
-
(and 3 more)
Tagged with:
-
1.) Is there any way to override the default 3x duplication for reparse points? They're stored on my C Drive (I know, I know) which is backed up once a week. 2.) Are files verified when they're balanced? Is that why my poor drives are pegged at 100% utilization? Again, any way to turn this off?
- 1 reply
-
- reparse
- duplication
-
(and 2 more)
Tagged with:
-
I recently added 2 8TB HHDs to my das that had a 5TB and 8TB drive already in it. I've used DrivePool on another machine but not this one. I added all 4 HHDs to a new pool and moved the old data to the hidden "PoolPart" folders. The problem now is that the balancer won't pick up those "other" files and redistribute them amongst the new drives. How can I get this is data to be apart of the new pool?
-
Ordered File Placement via SSD optimizer not working properly, files from the Wester Digital drive won't move out and for some reason Drivepool is filling the 2nd disk on the list first. ...but when I uncheck the option from SSD Optimizer, and use the separate plugin, it seems to function properly: disks are being filled in the correct order. But since I'm using the separate plugin, all fresh writes seem to be going to the Archive #1 instead of the buffer SSD. Here are my balancing settings: What have I setup wrong? This begun after removing one old 1TB drive and adding two new 8TB drives to the pool, same settings worked properly before.
-
I'm not sure if this belongs in General or Nuts and Bolts but here goes. Basic scenario is I have 4 "drives." 1.) Operating system SSD (not part of the pool.) 2.) SSD landing zone (SSD-optimizer places all new files here for speed.) 3.) HDD 'scratch disk' (folder placement rules place my "temp folder here" when the SSD is emptied in order to hide it from SnapRAID) 4.) Archival drives (folder placement rules migrate my "archival" folders here from either the SSD or scratch disk. This is what SnapRAID sees.) The issue I'm having is that when balancing occurs, files / folders that are being moved from #3 to #4 are being copied BACK to the #2 first. This creates two issues. 1.) #3 and #4 are equally slow, so copying the files to #2 first means balancing takes twice as long as if they were copied from #3 to #4 directly. 2.) The volume of files being moved from #3 to #4 often exceeds the capacity of #2, so balancing has to be run multiple times for everything to migrate successfully. I'm not sure if there's something amiss with my placement / balancing rules, this is the intended behavior, or if this is just a scenario that's never come up. - I have 'file placement rules respect real-time file placement limits' unchecked. - I have 'balancing plug-ins respect file placement rules' checked. - I have 'unless drive being emptied' unchecked. Let me know if I need to clarify anything, I've been playing with it for so long I'm having trouble thinking straight. Thanks in advance.
-
Hello, I have been using DrivePool for a few years for a friend's animation machine. I am setting it up oh a project archive server. What I would like to do if possible is if I am transferring files to the Drive Pool the files balance between the different drives in the pool automatically. For example if I have 3 files I am coping to the pool 1 gets written to each of 3 disks. I will be using SnapRaid with this and don't want any balancing to happen after files are written to their respective disks. So I guess if anything I only want new files to balance between drives. What would be the best setup with the balacing setting to do this. Thanks!
-
Hi guys, I've set up my file placement rules to only allow files in a folder to go into a particular drive. In this case it's a CloudDrive drive. I'm finding that it's not following the rule and it just randomly putting it in any drive. Does anyone know if this is the correct behaviour or whether it's not right. I essentially only want files in a certain folder to only ever be put in a particular drive. I've configured it so that underneath the file placement options I only have the one drive I want it to put the file on, checked. Any help would be much appreciated. Thanks, Phillip
-
Hello, I'm pretty sure I'll be buying DP soon. Will either use duplication for protection, or SnapRAID. If I go with the former, and choose to use the plugin OrderedFilePlacement to disable balancing* and not make my HDDs spin all at once, then am I correct to assume that I will also need to think better about which HDDs I write to first. Consider the following scenarios: (I know it's an extreme one in terms of HDD-size difference) I currently have 1 x 8TB HDD and 2 x 2TB HDDs. This will basically mean that if I want file-duplication with balancing off, I'll have to make sure that I fill the 2TB HDD first, before I start writing to the 8TB HDD? This is because, if I write to the 8TB first, and then this drive fails, its contents are too big for the 2 x 2TB HDDs to hold even with file duplication on. (12/2 = 6 TB, which is > 2 x TB HDDs). Will I have to worry about stuff like that if I turn off balancing? I don't want to spin 2-3 HDDs just to play a movie file. Note: I'm new to the concept of pooling and even newer to that of RAID so your patience is appreciated! * That's what it does, right?
-
I'd like to pool 1 SSD and 1 HDD and with pool duplication [a] and have the files written & read from the SSD and then balanced to the HDD with the files remaining on the SSD (for the purpose of [a] and ). The SDD Optimizer balancing plug-in seems to require the files be removed from the SSD, which seems to prevent [a] and (given only 1 HDD). Can the above be accomplished using DrivePool? (without 3rd party tools) Thanks, Tom
- 1 reply
-
- SSD
- Performance
-
(and 4 more)
Tagged with:
-
Here's my scenario: - I have 7 drives in my pool - all are 4TB except for one 2TB. - I have 5.8 TB free in total - All drives were added last week and early this week (well I added several NEW and then swapped out old 2 TB drives). - The first 4 drives (one of which is the 2TB) each have 135 GB of free space - so obviously DrivePool balanced these out. - Of the remaining 3 drives, one has 414 GB free and the last 2 added (I know this based on the drive volume naming scheme) each have 2.44 TB free. So it seems DrivePool "balanced" the last 2 - 4TB drives out also - but does this "balancing" scheme make sense? Obviously any new files added to folder with duplication turned on will likely get added to the last 2 drives - so that shouldn't be an issue. I've never touched the settings in the "Balancers" tab in the "Balancing" settings. ALL have the checkboxes checked off. The settings are set to balance every day at 1am. It's been several days since I added the last 2 drives. Any concerns?
-
Is there a way to, say, add my C drive to the pool and have it not store anything on it unless other drives become 90% full? The Drive Usage Limiter is a little sparse on documentation of what the options do. If full pool duplication is on, doesn't unchecking unduplicated files do nothing since everything will be duplicated? Also, if both unduplicated and duplicated are unchecked, will it never place files on that drive no matter what? Furthermore, why is there another slider that says don't fill disk space above 90% here when this is also in the Prevent Drive Overfill balancer? Edit: I tried to simulate drive errors in Scanner to see if it would react the way I wanted it to, where if a drive is failing, it evacs the drive to the unused C drive. It, well, didn't. Balancer Settings: Moving Scanner's priority below Drive Usage Limiter didn't try to balance anything onto the C drive either. Didn't get screenshots of that, but it was still trying to keep files on the failing drives while the C drive went unused with no target for rebalancing. Odd behavior.
-
Hello and good Day to all! My Question Is -- What is the best way to keep my feeder array file free? I am using three Velociraptor "knock-off's" in RAID0 to speed up writes to my 64TB drive pool and I don't want ANY files stored on it (for obvious reasons) It looks like there are a couple of ways to accomplish this however I'm wondering which way would be the best? Thanks!!! ~rf
-
I have an 80GB SSD and 8 1.5TB drives in my pool. The SSD is also my OS drive so I want to just use it for initial writes, but I expect DrivePool to balance the pool out by eventually moving the files to two of the spinners. I only have about 20GB free on the SSD normally which puts it right at the 72% limit that I have on the drive for new file placement. The problem is that a few older files have one of their copies sitting on the SSD taking up space so DP thinks that there is no room to put new files on the SSD. The other drives are all set to 0% for new file placement, but when I move new files to the pool I can see that only the big drives are active. How do I flush all files off of the SSD to make room for new files without removing and re-adding?
-
So I recently updated my HTPC drivepool from 2x 320GB, 1x 1TB, and 1x 3TB hard drives by swapping the 320's and 1TB for 3x 3TB's. Decided to enable duplication for some sanity checking (would hate to have to redownload everything) and everything went smoothly. Old drives were removed from the pool quickly enough, new drives added, everything is duplicated and working fine. But I've noticed that DrivePool seems to be filling the original 3TB more than the other drives, instead of an equal distribution of files as I would except. So, is this correct? I haven't changed any default balancing or duplication settings yet, and the Volume Equalization plug-in has second priority, right after the stablebit scanner. Am I wrong or will the first drive get priority and fill before the others?
-
Hi all, I've been trying out the Archive Optimizer on my Drive Pool installation. I find that after a couple of hours the Feeder disk (SSD) becomes full. The pool remains in a 100% healthy state even though the bar graph beside the Feeder disk indicates that it has exceeded the limit. I guess the first thing is understanding what I expected the Archive Optimizer to do and if this actually aligns with its implementation. I would have expected that with Balancing settings configured to allow for immediate balancing, any data on the SSD Feeder disk would be scheduled for archive to the other disks in the pool. Furthermore, whilst unduplicated or duplicated data remains on the Feeder, the pool's health would be less than 100%. My pool's health remains at 100%. I do have some extra data on the drive outside of the Pool - Windows indexing database etc. I've tried a remeasure and trace logging. The only log entry is: "[Rebalance] Cannot balance. Requested critical only." Am I expecting this to do something that's not actually intended? Any configuration settings changes anyone can recommend that they find works well? Cheers, Salty. Edit: Running version 2.0.0.345 Beta, Server 2012.
-
Hi, I have some Questions about using Drivepool with server 2012. i'd like to duplicate a lot of files and some Hyper-V VHDs. The files are no Problem, but what can i suppose on VHDs? Can i store vhds on my pool without worrying about the data, which is written in a vm? One vhd can get a size of 500Gb or more. What happens when i enable the automatic balancing with the vhds? Do they get balanced without shutting down the vms? Can i exclude the vms/vhds from the balancing process? What happens when i remove one disk from the pool? What happens, when i create a vhd which is greater then the free space of the volume on which it is stored? Can i use the integrated per-volume-deduplication feature of Server 2012 to reduce the data, which is stored on one Volume? Can Drivepool still read the deduplicated files? Thanks for the answers best reagrds
-
- Server 2012
- Hyper-V
-
(and 4 more)
Tagged with: