andrewds
-
Posts
25 -
Joined
-
Days Won
3
Posts posted by andrewds
-
-
v 2.6.7.4027, updated today
Now no longer getting disk performance graph or active %, either in the main window or if I right-click a disk and select Disk Information.
I rebooted after installing.
I'd like to have this information back.
Related, but in DrivePool I am also no longer getting information about which files in the pool are currently being accessed. Shows n number of open files, doesn't show which. Updated that today too.
Thanks
-
43 minutes ago, Shane said:
To quote Christopher from that thread, "StableBit DrivePool pulls the directory list for the pool directly from the disks, and merges them in memory, basically. So if you have something that is scanning the folders, you may see activity."
There may be some directory/file list caching going on in RAM, whether at the Windows OS and/or DrivePool level, but DrivePool itself does not keep any form of permanent (disk-based, reboot-surviving) record of directory contents.
To quote my response to Christopher:
" If I'm understanding the rest of your explanation correctly, you're saying that anytime the application needs to retrieve a file from any disk in the pool all of the disks will wake up from sleep so that DrivePool can determine upon which disk a file is residing in order to deliver it back to the application. Is that correct?"
Your response still doesn't answer it clearly. Is there caching or isn't there? Will the drives wake up any time there is an application that needs to retrieve a file from any disk, or does DrivePool mitigate that somehow? Should I expect to see disk activity on all disks any time a file on a single disk is retrieved or are there times when DrivePool can deliver file location information without waking every disk?
-
@Katz777I just went through this recently after setting it up several months ago. I use Scanner, DrivePool, and CloudDrive. I had to update my Scanner settings not to query SMART more often than once per hour, and not to wake drives to query. I also had to disable BitLocker detection in the JSON config file. I didn't need to do anything with CloudDrive. Once I made those changes and a couple of Windows config changes everything worked fine.
Last time I updated DrivePool the BitLocker detection flag was reset to default and the drives wouldn't sleep anymore.
I did need to enable options 13 and 15 as described in this post in order to set the power options that worked for me. https://www.thewindowsclub.com/configure-hidden-power-options-in-windows-10
-
On 7/30/2023 at 12:00 AM, Shane said:
An issue here is that DrivePool does not keep a record of where files are stored, so I presume it would have to wake up (enough of?) the pool as a whole to find the disk containing the file you want if you didn't have (enough of?) the pool's directory stucture cached in RAM by the OS (or other utility).
Is that true? I asked for clarity on this exactly several days ago but never got a response.
-
Thanks @Christopher (Drashna). I have already disabled BitLocker to eliminate that activity. If I'm understanding the rest of your explanation correctly, you're saying that anytime the application needs to retrieve a file from any disk in the pool all of the disks will wake up from sleep so that DrivePool can determine upon which disk a file is residing in order to deliver it back to the application. Is that correct?
-
I've been diligently working on configuring my system so that spinning disks don't spin unnecessarily. I've got a SSD in place to serve up commonly accessed file types. Browsing the application being served retrieves files only stored on that SSD or the OS SSD. However, for some reason the spinning disks are also waking up when browsing. Does DrivePool store file location information directly on the disks? In other words, does it have to spin up the disks to determine where the requested files are located in the pool? Or is it caching those in the DrivePool application folders somewhere? I'm trying to determine if the disks are still waking up because DrivePool is retrieving information or if it's something about the application being served that's causing it?
I don't actually see any disk activity from the application when this occurs so I'm leaning towards DrivePool.
Thanks!
-
Nevermind, found it!
-
Sorry to confuse. I work in enterprise IT. Flash is used pretty commonly to differentiate from spinning disk. If I had meant a USB/thumb drive I would have said that.
-
@Christopher (Drashna)sorry what I mean is a flash SSD. Platform doesn't support NVME.
-
Figured it out. I re-scanned and was prompted to rebalance. It's now balancing the file types I selected out to the cache disk.
I've answered this question myself.
-
I think I figured it out. I made a rule with a pattern match of * and selected all of the existing drives. I left unselected "When a new drive is added to the pool, files matching this rule should be placed on that drive."
Now I will attempt to add the drive and craft the rest of the rules at a lower priority. Presumably everything will match to * at the top of the list and once I am ready I can remove that rule so new files will follow the rest of the rules.
Now I just need to figure out how to force rebalancing so that the existing files are offloaded to the cache disk.
I would still appreciate any thoughts or help.
-
Hello:
I want to add a flash drive to a pool for cache usage but since I can't create rules for that drive until it's created I want to add it but not use it. I need to filter only certain file types to it.
Any suggestions on how to do this?
Thanks!
-
Each disk in a pool has several reparse files 3-5 months old. I don't recall seeing them before then. I'm not using symlinking for anything I'm doing with this volume. Is it something CoveFS is doing internally? When I look in the contents I see (amongst the encoded characters) that they all appear to be related to stable diffusion models, some of which can get quite large.
Appreciate any thoughts.
-
@Shane@Christopher (Drashna)can I bug you for any thoughts here?
Is it worth completely removing and reinstalling scanner? Seems like maybe some permissions got confused somewhere? Only reason I can think of for things suddenly not persisting.
-
I just wanted to say that @Christopher (Drashna)has been very helpful each time I've created a topic. I have found him and the others I've worked with to be thoughtful and professional in their responses.
Thanks for all the work you all do.
Now we can all stop seeing that other thread previewed every time we look at the forum home.
- zed87, Rob Manderson, Shane and 1 other
-
4
-
Thanks @VapechiK for the info. I actually was able to recover the information from records I have. However, that doesn't recover the most recent scan information which also reset. Something has happened that is preventing that information from persisting for some reason. I'd like to get to the bottom of that.
As to UPS, I am on all (relatively affordable) consumer hardware so I'm not really worried about equipment failures due to power outage. I've got everything plugged into surge strips and worst case if a component fails I'll just replace it. Too many stories over the years of home UPSes catching fire. To me they're an unacceptable home fire risk. However, that power outage alarm you shared is pretty neat. Never seen one of those.
We definitely use large enterprise grade UPS and generators in our datacenters at work though
-
@Shane @Christopher (Drashna) So today we had some bad weather come through and the server experienced a power loss. All of the drive location information is once again gone. I didn't have to perform a recovery on the OS, other software is still current, no restore point rollback or anything. Any idea what could be preventing this information from persisting?
Some of the recent scan data is gone as well.
Thanks.
-
Thanks @Christopher (Drashna)for the feedback. No raid, no raid controller, just pooled jbod. Alas the 9207/9307 are not available with mPCIe interface that I can find. This is a mini itx case with a GA-Z97N-WIFI wherein I've removed the wireless adapter (mPCIe) and replaced it with a 2 port SATA card so I could install 8 total disks (1 OS 2.5, 1 cache 2.5, 6 data 3.5). I'm planning to remove the 6 3.5 disks replace with 10 all flash 2.5. Same for the external iSCSI attached parity. Then I'll just have 2 traditional spinning for system image/backups.
Built a custom bracket with rails to attach the existing storage, just going to redesign and do it again. Will give me a chance to inspect the wiring etc too.
Unnecessary, could just buy something new, but a fun challenge plus I like the case.
-
Hello:
Two of the disks in my pool are on a pci express mini to 2 port sata controller. I want to replace that controller with a 4 or 6 port one. Am I correct that I can do a straight replacement without informing DrivePool in any way? It should automatically recognize the 2 disks (poolpart) when the system boots after the card swap, correct?
Thanks.
-
On 6/20/2023 at 5:57 PM, Christopher (Drashna) said:
I'm sorry to hear that.
Though, does "previous versions" work here? It may be set up by default, and may have instances of the files. It's a long shot, but figured it was worth mentioning, at least.
That said, StableBit Cloud should sync this information, as well. I know it dosen't help now, but for the future, it may.
Thanks @Christopher (Drashna). I don't think that inconsideration of my preferred security posture and the limited use case for this software that the cloud solution is a good fit for me. Ideally the software would have preserved the information about past scans and existing disks during the upgrade process. But, I have added the pertinent files to nightly delta backups to mitigate future risk.
I did also manage to recover enough information through another tool I use and, aligning it with the information still present in Scanner I reconstructed everything without having to shut it all down.
Bugs happen, it's not a huge deal. Thank you for your help.
-
I don't have an earlier version of the files unfortunately, or I would have just pulled the info I need from them. The ProgramData folder is only included in the system image and only two of those are retained. Two backups had run since the version update so the info is gone. Oh well, I'll just have to shut the thing down and re-trace the serials.
-
Yeah, the information for those disks vanished during a software update. There aren't even any older files to recover from.
-
Thanka @Shane, but alas I checked every file in there and didn't find anything for these disks. @Christopher (Drashna)any other advice possibly? Should I just open a support ticket?
-
Hello,
Last week I was prompted to download and install an update to StableBit Scanner (and Drivepool, and CloudDrive), so I did. It reset my scan history so all volumes were unscanned. Annoying, but not a big deal, and as I see it is a long standing bug. However, it also reset my disk location information. This is more important, since I was using that field to keep track of the location of the physical disks. I have dug through all of the folders and files in Program Files, Program Files (x86), and ProgramData to try to reconstruct the disk location information by matching it to the serial numbers. However, having looked through dozens (or maybe hundreds) of log files and json configs, I can't find it anywhere.
Where can I find this information?
I do have backups going back a few weeks, so worst case I guess I can dig into those. But, I would prefer not to.
Thanks for any help.
Disk performance data isn't working since latest update
in General
Posted
Not sure why it was necessary but I after seeing the errors in the log I decided to reset the performance counters and restart WMI. Once I did that and reset the scanner service it started working.