gregcaulder
-
Posts
24 -
Joined
-
Last visited
-
Days Won
1
Posts posted by gregcaulder
-
-
Greg,
(I'm assuming that's your name, I apologize if that's wrong).
Alex has taken a look at the dumps, and this issue doesn't look to be DrivePool related, directly.
The last dump you uploaded... it was pretty mangled. Something messed with the memory badly, which is definitely what caused the BSOD.
From that dump, though, it looks like you have PrimoCache loaded.
I mention this, because ... well, because the PrimoCache app seems to be what was activate at the time, and may be the cause of the issue.
I would recommend uninstalling or disabling it for now, and see if that helps fix the issue.
PrimoCache is installed, but it wasn't running at the time of the dump.
I will try some of your other suggestions for the burst test on the Scanner.
I will report back with what I find.
G
-
I absolutely understand the frustration, and I'm sorry that it's still occurring.
However, have you ran a memory test recently?
Sometimes, frequent BSODs are caused by memory issues.
Also, could you disable the read striping option (Pool Options -> performance).
Issue:
I had another restart, and this time the memdump had something different in it.
Here is the Zipped Memdump.
https://dl.dropboxusercontent.com/u/48061/StableBit/DrivePool/2015-03-16%2001-31-00%20MEMORY.zip
-
I absolutely understand the frustration, and I'm sorry that it's still occurring.
However, have you ran a memory test recently?
Sometimes, frequent BSODs are caused by memory issues.
Also, could you disable the read striping option (Pool Options -> performance).
Issue:
No RAM issues with all of the battery of tests i have run against it.
The servers ram is Registered ECC ram, and was stress test when the server was built.
I have since run many other tests today, and still no errors have been found in the RAM.
G
-
If you want, you can use the above link to take a look at Alex's analysis of the issue.
It's rather technical though. But it boils down to "really weird issue".
Either way, could you download the latest beta build and see if that helps?
http://dl.covecube.com/DrivePoolWindows/beta/download/StableBit.DrivePool_2.2.0.598_x64_BETA.exe
This build should fix the BSOD problem that you're seeing.
If it doesn't, it may indicate other hardware issues (running a memory test, and a CPU stress test may be a good idea just in case). And please upload the new dumps, in this case.
Tried the suggested beta, and CloveFS is still causing system to BlueScreen and restart.
Here is my Latest memory dump: https://dl.dropboxusercontent.com/u/48061/StableBit/DrivePool/2015-03-12_CloveFS_MEMORY.zip
Please let me know what Alex finds out, as this is very frustrating.
G
-
If you want, you can use the above link to take a look at Alex's analysis of the issue.
It's rather technical though. But it boils down to "really weird issue".
Either way, could you download the latest beta build and see if that helps?
http://dl.covecube.com/DrivePoolWindows/beta/download/StableBit.DrivePool_2.2.0.598_x64_BETA.exe
This build should fix the BSOD problem that you're seeing.
If it doesn't, it may indicate other hardware issues (running a memory test, and a CPU stress test may be a good idea just in case). And please upload the new dumps, in this case.
Can you provide release notes for this beta version?
I do have network boost enabled, and read stripping enabled. But the BSOD only happens during heavy
writing(correction reading and writing), and not reading. It generally happens when all of my servers are doing backups, and doing file systems to the system. -
What version of Windows are you using and what version of DrivePool?
Also, do you have any antivirus installed on the system?
No antivirus, DrivePool version 2.1.1.561. OS is windows Server 2012 R2.
-
I am having the same problem.
I analyzed the crashdump file, and it tells me that covefs.sys is causing the crash.
This happens quite frequently, and it is not very consistant.
I just uploaded my MEMORY.zip file from here http://wiki.covecube.com/StableBit_DrivePool_System_Crashes
-
That does look to be right. Are you using any of the throttling options in Scanner Settings, in the UI?
No, all of the settings have been un-checked.
-
To scan multiple disks on the same controller requires editing the config file. To do so:
http://wiki.covecube.com/StableBit_Scanner_Advanced_Settings
And set "Scanner_DirectIoScanMaximumConcurrent to the number of disks you want to scan concurrently, or "0" for unlimited.
However, that does require setting "Scanner_ScanWithDirectIo" to "True", and I believe that the setting doesn't throttle the scan.
Edit: eek, I forget the link! Sorry.
I have tried this, and i am still not able to scan more than one disk on the same controller. My controller reported by StableBit Scanner, has a Buss speed rated to 212MBps.
Here is my exact config file, maybe i am just missing something. I have also unchecked ALL settings in the Throttling tab of the scanner settings.
If anybody can help point out to me why it is not scanning more than one drive at a time on the same controller, that would help me out a lot.
<?xml version="1.0" encoding="utf-8" ?> <!-- Copy this file to Scanner.Service.exe.config in order to put into effect. You may also want to remove any extra "setting" tags that you're not altering so that the default will always take effect. --> <configuration> <configSections> <sectionGroup name="applicationSettings" type="System.Configuration.ApplicationSettingsGroup, System, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089"> <section name="ScannerServiceLib.My.MySettings" type="System.Configuration.ClientSettingsSection, System, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089" requirePermission="false"/> </sectionGroup> <sectionGroup name="userSettings" type="System.Configuration.UserSettingsGroup, System, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089"> <section name="CoveNativeSafe.My.MySettings" type="System.Configuration.ClientSettingsSection, System, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089" allowExeDefinition="MachineToLocalUser" requirePermission="false"/> </sectionGroup> </configSections> <system.diagnostics> <sources> <!-- This section defines the logging configuration for My.Application.Log --> <source name="DefaultSource" switchName="DefaultSwitch"> <listeners> <add name="FileLog"/> <!-- Uncomment the below section to write to the Application Event Log --> <!--<add name="EventLog"/>--> </listeners> </source> </sources> <switches> <add name="DefaultSwitch" value="Information" /> </switches> <sharedListeners> <add name="FileLog" type="Microsoft.VisualBasic.Logging.FileLogTraceListener, Microsoft.VisualBasic, Version=8.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a, processorArchitecture=MSIL" initializeData="FileLogWriter"/> <!-- Uncomment the below section and replace APPLICATION_NAME with the name of your application to write to the Application Event Log --> <!--<add name="EventLog" type="System.Diagnostics.EventLogTraceListener" initializeData="APPLICATION_NAME"/> --> </sharedListeners> </system.diagnostics> <applicationSettings> <ScannerServiceLib.My.MySettings> <setting name="ErrorReportingOverride" serializeAs="String"> <value>False</value> </setting> <setting name="DirectIOOverride" serializeAs="String"> <value>True</value> </setting> <setting name="SmartOverride" serializeAs="String"> <value>True</value> </setting> <setting name="NotificationOverride" serializeAs="String"> <value>True</value> </setting> <setting name="GoodIdentifyOverride" serializeAs="String"> <value/> </setting> <setting name="Scanner_DirectIoScanMaximumConcurrent" serializeAs="String"> <value>4</value> </setting> <setting name="Scanner_ScanWithDirectIo" serializeAs="String"> <value>True</value> </setting> </ScannerServiceLib.My.MySettings> </applicationSettings> <userSettings> <CoveNativeSafe.My.MySettings> <setting name="UnsafeDirectIo" serializeAs="String"> <value>True</value> </setting> </CoveNativeSafe.My.MySettings> </userSettings> </configuration> -
Good afternoon,
Do we have any progress on being able to use Win 2012R2 drive quotas?
My coworkers are the dullest bulbs in the box, and they are killing me on putting duplicate files everywhere.
This is a mission critical issue/topic for me.
-
I imagine the other backup software vendors do not use VSS. AFAIK, it is the server backup solution that relies on VSS and I assume Alex would have to understand how VSS works so that he can determine what he needs to do in the CoveFS filesystem/virtual drive setup so that VSS will run well on it. (Or, otherwise put, what would a Pool drive need to do for it to support VSS?) But I could be very wrong on this.
Here are a couple off the top of my head that use VSS, Consumer versions and server versions that CAN use VSS, but Starred items (*) are not required to only use VSS.
Norton Ghost
Symantec Backup Exec*
Acronis Backup & Recovery*
The list can go on and on, but i really dont want to look up all of the windows compatible backup software list off Wiki, and see if they use windows VSS.
http://en.wikipedia.org/wiki/List_of_disk_cloning_software
http://en.wikipedia.org/wiki/List_of_backup_software
Yes and no. Alex is very busy "at home" right now (if he wishes to go into detail, he can, but I'm not in the habit of divulging personal information), and once he's settled everything down, he does plan on "hitting the code hard" and fixing most of the current issues, and yes, pushing out release builds. But I can't give an ETA on that, sorry.
As for VSS support, there is documentation on how to connect to the VSS service, and how to use it, and write filters for it and the like.
But there is ABSOLUTELY NO information on how to support it on the file system level. Which means figuring out how to write a driver to support it is extremely difficult, at best.
And just to make you feel better, I do keep on bugging Alex about VSS support, because it would be very nice to have.
I just posted this in another form, but there is info about how to use it in the Windows Software Development kit that you can download from Tech-net.
He doesn't need to explain any details, i know and understand that he has a life and or a family, and sometimes shit just happens.
I would like to offer my help in any way if I can.
At my company i am the CTO, so I do quite a but with everything computer related.
Here is where i also posted it:
http://community.covecube.com/index.php?/topic/503-srvr2012-r2-backup-fails-on-pool/?p=3142
"""I am sorry but i just dong believe this.
You can download the Windows Software Development Kit (SDK) to get info, and build for VSS. All of the info you need to know how to use it and implement if should be in the SDK.
Here are some useful links:
http://msdn.microsof...9(v=vs.85).aspx
http://code.google.com/p/libvshadow/
And since the drivepool disk itself is a virtual disk, im pretty sure that microsoft has made something that can effectively allow you to implement VSS.
http://msdn.microsof...4(v=vs.85).aspx
If i am wrong that the SDK is not what you need, then please tell me what you are actually missing."""
-
That's a loaded question.
The specific reason is that the built in Windows Backup relies solely/exclusiviely on the "Volume Shadowcopy Services". This feature is not documented at all by Microsoft. So adding support for it is nearly impossible by itself. Because of that, we cannot support backups or previous versions on the Pool volume, unfortunately.
But don't get us wrong, we would love to, but it will be a serious investiture of time even figure out how to support it, let alone implementing it properly.
I am sorry but i just dong believe this.
You can download the Windows Software Development Kit (SDK) to get info, and build for VSS. All of the info you need to know how to use it and implement if should be in the SDK.
Here are some useful links:
http://msdn.microsoft.com/en-us/library/windows/desktop/aa384649%28v=vs.85%29.aspx
http://code.google.com/p/libvshadow/
And since the drivepool disk itself is a virtual disk, im pretty sure that microsoft has made something that can effectively allow you to implement VSS.
http://msdn.microsoft.com/en-us/library/windows/desktop/dd323654(v=vs.85).aspx
If i am wrong that the SDK is not what you need, then please tell me what you are actually missing.
-
"Out". If you head to the download page, the 2.1.0.432 BETA build supports reparse points.
https://stablebit.com/DrivePool/Download
Change log: https://stablebit.com/DrivePool/ChangeLog?Platform=win
And Alex has released a blog post about support for it as well:
http://blog.covecube.com/2013/11/stablebit-drivepool-2-1-0-432-beta-reparse-points/
But no quota support, yet.
And no VSS support. I talk to alex about this regularly, but it would be complicated at best. There is no documentation on how to implement it. At all. And even if we could, it may not be stable anyways.
I already knew about the reparse points beta release and have been running it for a while.
I was asking if this build will be heading out of beta to move onto other things on the to-do list (wink wink, quotas and VSC).
And as for the Volume Shadow copy, about no documentation. That just seems very unlikely, how would all of the other backup software vendors write their software for it with no documentation.
-
Okay, noted. I will bring this up with Alex.
But it may be "back burnered" until Reparse point support is stable (it's not a small feat to get it working). But I agree, it's definitely an important feature.
Good afternoon,
How is the beta progress on Reparse points going?
I haven't heard much, if any chatter about the progress of bug fixes or tweaks or new beta release for re-parse points.
I'm curious because I would like to be able to get quotas to work. And Volume shadow copy to work so i can use backup software that requires VSS.
-
Okay, good to know.
VSS not working is not surprising. We'd have to implement that first.
But as for deduplication, Alex will probably have to take a look at that to see how it works before we can implement it (if we can).
To be honest I would rather have the Quotas work over the deduplication.
It would be nice to have it, but to be honest, it isn't something that is absolutely urgent like the Quota's is for me, and the ability to get VSS enabled.
-
Depending on how Quota's work on the file system level (and I suspect I have a good idea how now)... It's because of how the DrivePool volume works. It doesn't fully emulate all of the file system properties (such as reparse points, for example).
Could you submit a ticket, that way it ends up on alex's to do list?
right now, he's busy trying to add Reparse Point support, which isn't simple. But it may make it every easy to add quota support, but don't .... quote me. I'm soo sorry for really bad, unintentional pun.
Also, by default, DrivePool should report as NTFS anymore (for compatibility reasons).
I tried the latest beta that has re-parse points (2.1.0.432). And Quotas still does not work.
Neither does VSS or file deduplication.
-
The next BETA of StableBit DrivePool with reparse point support is here!
Download: http://stablebit.com/DrivePool/Download
Read about it: http://blog.covecube.com/2013/11/stablebit-drivepool-2-1-0-432-beta-reparse-points/
Excellent, now that this beta has been released, should a new thread to this specific beta release be created in to forum? I already have questions, but don't really need to keep adding it to this chain.
-
There was a post about the drive not showing NTFS when i right click on the drive (I don't know what happen to the post). But i can confirm that it is telling me NTFS everywhere.
Any more suggestions?
-
Have you modified the config to have the pool report as NTFS?
"CoveFs_ReportAsNtfs - Report as "NTFS" to most applications that ask."
http://wiki.covecube.com/StableBit_DrivePool_2.X_Advanced_Settings
I did not modify the config file. but i have already checked, and it is set to True for the parameter you suggested.
-
Let me know when you have a suitable beta, and I would more than happy to test it out for you.
-
I recently moved our main network storage server to Windows Server 2012 R2 Standard with the Server Essentials role added.
I then went ahead and created a pool of 4 500GB 10k drives, and used the Dashborad manager to move the shares to the new drive pool.
I had noticed that my Quotas were not longer enabled for the shares. So i went into the File Server Resource manager and tried to reapply the quotes. But no dice.
The error that comes up says "The selected path is not on a NTFS volume. Only NTFS volumes are supported".
What gives with this? Am i not going to be able to use Quotas? This is a deal breaker for me, as users on our network get carried away with not cleaning anything up. And would soon full it up, and effect overall performance.
-
It's not that I don't understand it, it's that there are a number of ways that it is done. And since I haven't really paid close attention to it (as I'm not really a fan), I wasn't sure how microsoft implemented it.
As for DrivePool, the linked article implies that it uses NTFS Reparse points for the files. DrivePool doesn't support that right now. But Alex is working hard to add support for them. Once that's added, DeDup *may* work. If it doesn't, let us know and Alex will take a look at it.
Does this mean that Volume Shadow Copy will be able to work if/when reparse points are added to Drive Pool?
Not quite sure how VSS works exactly, but I know that is uses the "System Volume Information" folder.
The would be a huge plus if i could get VSS.
-
Actually, alex and I were just talking about this. And funny enough, disk compression came up.
As for the de-duplication, you hit on the biggest issue. If a drive fails, you could lose a good chunk of data. Which is the opposite point of Duplication in StableBit DrivePool.
However, there is an Addin for "WHS2011" that you may want to look into: Snoop-de-Dupe (http://www.snoopdedupe.com/). It specifically looks for duplicate files and lets decide how to handle them. Sounds like something you may be interested it.
As for figuring out, well, he's already got a few very challenging things on his plate for DrivePool already. But this may be on his to-do list already.
http://community.covecube.com/index.php?/topic/252-future-developments/
I think your mising the understanding of how the De-Duplication process/method is supposed to work.
De-Duplication should be directly processed on the PoolDrive itself, and not the independant drives that make up the pool.
DrivePool's operations to the individual disk should be completely transparent to any actions done to the Pooled disk.
De-duplication should perform the deduplication on the mounted virtual DrivePool disk, it does this I believe by some sort of hard links of junctions to files data blocks.
But as for your issue with folder sizes not showing properly, this link will explain to you why that is: http://social.technet.microsoft.com/Forums/en-US/fa6f6329-f710-4c5e-9538-942045df68a3/windows-server-2012-with-deduplication-show-wrong-size-on-disk?forum=winserver8gen
Duplicated files are stored in the "System Volume Information" folder, and since it is not displayed you wont know the actual size on disk. Hard links are created to those files that were moved so they can still be accessed.
If DrivePool allowed for this folder, and was handeled by the virtual disk driver you use to manage what disks the actual data get moved to, then DeDuplication could be done. But right now when you try to add the DeDuplication setting to the DrivePool disk it give some strange error: https://dl.dropboxusercontent.com/u/48061/DrivePool/UnabletoDedupeDrivePool.png
It seems that however the virtual disk driver that is used does not allow proper access to it. I have no clue as to why that is, since i didn't make the DrivePool Software. Aslo what is the deal with Volume Shadow Copy not being supported on a Drive Pool? Is it a possibility of the driver that makes the DrivePool virtual disk has major incompatibilities to be able to do that, and not being able to write to the "System Volume Information" directory?
Anyone please let me know your thoughts.
Server 2012 R2 Deduplication and DrivePool
in General
Posted
Its been almost 2 years, and there is still no update on this.
Can we please get an update on this, would really like to use VSS and Deduplication features built into windows, along with other features that are built in that don't work with DrivePool.