Jump to content

JazzMan

Members
  • Posts

    72
  • Joined

  • Last visited

  • Days Won

    2

Everything posted by JazzMan

  1. Unless it's somewhat reproducible, this may be hard to track down, but doesn't necessarily seem like a DP issue. You could post some additional information about your configuration, but I'm not sure that would help either. Specific crucial product? Windows version? PC RAM? page file settings? How often are you maxing out the system when this happens? (CPU, RAM, background tasks, etc). You could also run something like CrystalDiskInfo to check the health of the SSDs. How is DP configured (No duplication, 2x duplication, etc.)? Are these SSDs just data or do they also have the OS/boot partition? The only time I've seen my system sluggish to open a file from SSD is due to a known issue in Office 2013. This doesn't sound like your problem as your example is media files.
  2. I can be corrected, but I don't think Scanner performs the same functions as Chkdsk. My understanding is Scanner is monitoring SMART data and exercising the drives to prevent bit rot. Chkdsk is intended to ensure that the various metadata and such of a file system (NTFS in this case) are all complete and consistent. The former is more of a hardware level operation, the latter more of an OS level operation. These days, chkdsk errors are more the result of programs crashing while writing to the disk than of issues with the physical media. It sounds lie you got past the error you posted about, although your post seems to imply you've been having other issues or frustrations with your setup. My two cents; (Assuming you don't have drive letters for each of the 10 drives) Create a folder on your C: drive and in it create NTFS mount points for each of the 10 individual drives. That way you can then easily see the contents of an individual drive or chkdsk the mount point. Create a *.bat script to chkdsk the 10 drives. Re-consider the DAS solution, especially before buying a second enclosure I don't know your use case, but having a JBOD enclosure hanging off a computer by USB/USBC/eSATA is always going to be less performant than having drives connected to internal SATA ports, and is also going to be more prone to drives dropping out under any sort of load. Without duplication, and with only one enclosure, you have also not mentioned what your backup strategy is. If you are tech savvy enough, I'd really recommend building a separate NAS computer, running DP on that, and serving up the files you need over the LAN. I've used Norco ITX-S8 cases in the past, but they're out of business now. It looks like Jonsbro makes cases with backplanes for NAS builds. Mostly they max out at 8x usually. I'm not sure if anyone makes 10x ones. You might have to get some larger drives or build in a non-backplane (non hot-swap) case for that.
  3. The pool is a collection of NTFS drives, but the file system the pool driver presents to windows isn't 100% NTFS. It's close, but there a few things native NTFS can do that the driver can't. Even if it says "NTFS" if you do a "Properties" on the pool's drive letter, behind the scenes it is technically "CoveFS" or something. This is why chkdsk isn't working. That isn't a problem. You can't CHKDSK the pool. The driver doesn't support that. You would CHKDSK the drives in the pool individually.
  4. The only other two things I can think of are not correctly putting quotes around [destination] if it has spaces, and some issue with the ACL (permissions) getting borked on some file(s) in the source. If you are in CMD and type your; copy * [destination] that gives the error, what then happens if you do a; dir [destination] Also, what happens if you do; copy *.* [destination] instead of just the single asterisk? Another thing you could try is mounting each drive in the pool as a separate drive letter or mountpoint and going through them one at a time with the copy command to see which disk "behind the scenes" is giving the error. I don't think it's a disk corruption or DP issue though from what you've said, especially if there isn't duplication. I think it's something about the way you are using the copy command.
  5. Thanks. I checked that service log but I don't see any errors. I think the problem is not necessarily DP's fault. If I look at Disk Administrator none of the drives for the pool are shown there. So I guess something in the BIOS or HBA isn't correctly resetting the drives on a Windows restart? As I say, I can do a full power shutdown and turn on and the drives and system come back up fine.
  6. Is the pool healthy? Is it using duplication? does chkdsk'ing the individual drives in the pool show any errors? Are there any hidden files you're trying to copy? Are there any extremely long paths/filenames or unicode characters involved? I get very sporadic errors like this if duplicated files are mismatched or before some error that a chkdsk /f fixes. I don't know exactly why copy would behave differently than xcopy or powershell, but I'm sure the code is different, so edge cases are being handled differently.
  7. Currently running DP 2.3.3.1505 on a Win 10 x64 22H2 NAS server system with an Intel Z370 chipset. Power ioptions are set to never sleep and hibernation is disabled. The advanced power settings say to turn off the hard disk after 20 minutes. The boot drive is an SSD and there are 8 HDDs as a mixture of Seagate Ironwolf, WD Red and WD Green drives. When I "Shut down" the system normally from the Start menu, and then turn it back on with the power butten all is ok. When I select "Restart" from the start menu, when the system restarts the pool drive is unavailable. The computer is mostly managed remotely via VNC, etc, so a trip to the computer room is not ideal for every reboot. This particular configuration is a bit of a new build, so I'm not sure if it was working and something changed or it never worked right. However, I've had this pool of drives in other systems/motherboards like a Z170 and Z77 without this symptom. I've also been a DP user for 10 years or so with multiple keys and installs. Thoughts?
  8. I got this resolved, but not using chkdsk. "chkdsk /r" got to about 95% complete and the computer did a BSOD style hard reboot. The SMART warning was still there. Instead, referring to this info about this SMART warning; https://harddrivegeek.com/current-pending-sector-count/ I removed the drive from the pool and formatted it with all zeroes. That process brought the Current Pending Sector Count back to 0 and did not increase the Reallocated Sectors Count or Reallocation Event Count, which are also still both zero. I don't know how frequently the Scanner information gets refreshed, but the message seemed to disappear sometime after the drive was 95% formatted. Although I'll continue to monitor the drive, for now I think this was more of a "false positive" warning than a true disk failure portent. If Scanner, Format, etc work from outer tracks to inner tracks, it seems like the offending sector was near the inner part of the disk and the warning would have stayed around for a long time until the drive got 95%+ full. It's unfortunate I had to evacuate the disk to do the format, then go through the rebalancing after adding the zeroed disk back, but because of the BSOD, I can't confirm if "chkdsk /r" would have fixed this or not. Because the drive apparently did not need to reallocate the sector, I'm having a hard time imagining the BSOD at about 95% and chkdsk hitting the potentially bad sector are related, but I didn't want to run it again to find out.
  9. I let the scan complete and still have the SMART error about this sector. I guess I';; have to try the chkdsk.
  10. Thanks, I'll proceed with this info. I find some of the UI confusing.
  11. I'm getting the following error: 1 Current Unstable Sector Count "There is currently 1 unstable sector on the hard disk. An unstable sector is a sector that can't be read. The drive will automatically swap the bad sector for a good one whenever new data is written to it, however, the original data may be lost." How can I either force a write to the sector for the drive to make up its mind to mark it bad, or force the drive to mark it bad even if its good so I don't keep getting this warning for this sector? I assume the scanning process doesn't "fix" this? Is there an easy way to run a scan on just one disk?
  12. I didn't name a brand, but the MediaSonic was the USB 3.0 JBOD I was having trouble with. I got rid of that and built a small ITX PC with internal drives. That was about 5 years ago. I agree eSATA was more stable, but isn't an option in my current setup. I don't have any experience with Thunderbolt (JBOD or otherwise) so was looking for some input in that area. Glad your USB 3.x setup is working for you.
  13. Can anyone comment on how well DP would work with a Win 10 laptop and a 4 bay TB3 JBOD? I've used DP for quie a while, but had most success with internal drives. I did have an external USB 3.0 JBOD some years ago but it was rather flaky, often dropping the pool under sustained load (say copying a few hundred MB in one operation), which would then (as I remember) lead to needing to reboot the computer (I don't think re-plugging the USB cable or power cycling the JBOD was usually enough) and DP wanting to rescan the pool before I could use it again. I blamed that mostly on the JBOD hardware/firmware though, and not DP. Will TB3 provide a more stable pool, or am I likely to face similar issues?
  14. Sorry, I haven't been working on that system in a while. When I left it it was still a sporadic issue. I never got to the bottom of why the system would hang, nor why when that happened DP felt it needed to re-scan all 150TB. I would suggest you collect the logs Chris asks for above and submit a support ticket specific to your situation.
  15. .I don't normally keep a keyboard connected to that server and access it through VNC. I'm still trying to get a dump from when this happens.
  16. In the wiki it mentions rebooting after turning the key combination on. You should also mention that "After you're done, you can disable the manual system crash key combination by double clicking on bugcheck_off.reg." you also need to reboot for the change to take effect.
  17. Ok, sorry. They did work for me.
  18. Occasionally my server does not shut down completely. It gets to a black screen but the power never actually goes off without holding the power button. When this happens, on reboot DP goes through the lengthy re-measuring/checking of the pool(s) again. I have not determined the root cause of why the system does not shut down cleanly; I don't see anything obvious in the logs, and don''t make any software updates I can relate to this; Windows Update is turned off. Is there something I can do before shutdown to ensure DP gets stopped cleanly? Can I stop the Stablebit service then shut down? Would that help? I'm guessing not? Is it the file system itself that is marking that the pool needs re-measured. Win 7 x64 SP1 DP 2.2.0.852
  19. http://www.45drives.com/products/ https://www.backuppods.com/collections/backblaze-storage-pod-6-0
  20. It isn't really about the login account(s), it is about the owner and permissions that have been assigned to each folder/file. NTFS tracks this as part of the file system. Some users and security groups are built-in to Windows with predefined Security IDs which are the same on all machines (such as Everyone), other users and groups have SIDs derived from the machine they're defined on. By default the owner and permissions NTFS assigns are at the group level and for built-in groups. If the old files were always on a single-user system where that user was in the Administrators group you should be fine. But, if any of the pool/files were exposed on a network share, multiple-account computer, copied/moved via a removable NTFS disk onto the current system, etc. then they may have stray unexpected permissions. Some software, e.g. where security is important, may also create files with special permissions. I found NTFS Permissions Reporter (http://www.cjwdev.com/Software/NtfsReports/Info.html) useful in tracking down files/folders that were not set with the default permissions and inheritance.
  21. I just did this, no problem. You should just be able to install DP, migrate or buy a new license, attach the drives and DP should recognize the pool. Someone else may know a few caveats like perhaps if you have complex duplication, placement, and balancing rules.
  22. JazzMan

    Sort Pools by Name

    Well it looks ok on my box now. Maybe something changed between *.848 and *.852. Gremlins.
  23. JazzMan

    My Storage Server

    I bought the Q30 including the mobo, raid card and power supply from them. They list a few sample configurations on their site, and have a configurator for more choices, but when I dealt with them they were super flexible in working with each clients' specific needs. The configurator can be a starting point but then you can order off the menu. In my use case I wanted a different CPU than what they had on the configuraator; they could not source the specific one I asked for but understood my requirements and suggested an appropriate alternative they could source. You can check out these articles if you are not familiar with storage pods; https://www.extremetech.com/computing/178757-how-to-build-your-own-180tb-raid6-storage-array-for-9305 https://www.backblaze.com/blog/open-source-data-storage-server/ or search the web for something like "backblaze storage pod" and maybe add "open source" if you really are interested in just acquiring a case from a metal shop and not all the internals. For some history as I understand it; 45Drives was an early supplier to BackBlaze but is no longer. I think BackBlaze is up to version 6 or higher of the pod. Around version 4 or so, BackBlaze switched to BackupPods.com and possibly others as suppliers of the pods. However the pod designs are open source and can be bought and put together from a parts list if one desires. I needed something that arrived working and was not a server build learning experience, so I bought a system assembled and tested sans drives. I then just dropped my drives in, installed Win 7 and DP and was basically ready to go. Most drives were moved from some other computers, one of which had been running DP, and I added a few blank drives, so I did have to move some files around to get them into the new pool and duplicated properly. http://www.45drives.com/ https://www.backuppods.com/ http://protocase.com/products/electronic-enclosures/45drives-storage-pods.php My perhaps faulty recollection was that 45Drives wouldn't necessarily sell you all the nuts and bolts and individual parts one by one like at Radio Shack of old but would be very flexible in putting together (or leaving out) the major electronic components that go into a server to a clients' needs, and that BackupBods was the opposite on either ends of that;.they would either sell you a completely built working machine with all the drives and little customization, or they would sell you all the nuts and bolts and individual parts a la carte to assemble yourself. I'd contact both companies and explain what you are looking for. (metal case, metal case with backplanes, etc.) Protocase is the metal fab shop for 45Drives, so if you really are just interested in the chassis and not the backplanes, etc, you could contact them. This info may have changed in the past 1.5 years. Cheers, David
  24. JazzMan

    Sort Pools by Name

    OK, I see that now. But when I open the UI, how does it decide which pool to display the graphical info for first? I think that is what threw me off. it always seems to default to displaying the graphical info for the second of my two pools on the popup list (it may be the first or last created or something) I guess I would expect it to not just sort the popup list but also either default to displaying the detailed pool info the first item in the popup list (my preference), or the last one displayed when the UI was closed.
  25. JazzMan

    My Storage Server

    Read and write speeds probably aren't that great, especially from the HighPoint card, but luckily most of the time I don't need them to be. In a quick unscientific test right now copying a 9GB file between two drives (mount points outside the pool) averaged 130MB/s. Copying that file into the pool (eg, from one of the 10TB drives into the 142 TB pool) averaged about 90 MB/s. I've seen some tasks run a lot slower though, like 30MB/s. I'm not sure what my expectations should be in this area and haven't been geeky enough to learn to benchmark and twiddle, but it certainly isn't performing at 600MB/s headline speed of the 6Gbps SATA. Perhaps I'll look into that sometime, as I would like the task that measures the pool organization of the large pool to run more quickly, as it takes a half a day or something and leaves the system very sluggish while it is happening.
×
×
  • Create New...