Spider99

ok cool if its not just me then i will wait as its not a major issue just annoying

Looks similar to the LSI card - there are a lot of manufacturer branded cards around that use the main controller of the lsi but may or may not take the bios from the LSI if thats what you were thinking Check the hardware forums to see if anybody has already done it. For 20 quid extra i went with a true LSI as i wanted it to just work initially as had trouble with other cards - not lsi based

Just for info - i filled up my cache yesterday copying more data than the cache could hold - i got disk is full error on one file that was large - video file - because the space left was smaller than that file needed to copy across - but the copy continued and other large files did copy across but went to archive drives - the remaining space on the cache continued to fill up with other smaller files and went beyond the 95% limit i had set. An observation as you have duplication on and have only a few drives with ample space - maybe the error is because dp is having trouble finding enough space for two copies etc and /or its not responding quick enough for the copy process as it has 30 drives to run though looking for space and you get the error?

ok will be interesting to see what he posts its only at the moment giving live info for all - more interesting is the history for all error is that pesky sys vol info folder!!!!! which also happens to be where most of the "other" data lives for me anyway

@Christopher thanks for coming back and i hope you feel better soon Yes the placement rules are set in ssd optimiser - disks are set with order placement 01 to 24 in both duplicated and unduplicated What i just noticed is that the SSD Opt "drives" list which has always been random has the "empty" drives as the last three in the list - this might account for the no files - as 19 has just been allowed to have a few gb after copying another 0.5tb to the pool - 9 and 10 were also given some when i deliberately over whelmed the cache - but they were then emptied again and before the ssd'd??? What changed in 734 over the previous versions - did the rules get changed at all? Pool is set to balance ever 4 hours - not that things are changing

hmm - not good news - thought they had sorted it obviously not!!!

calling @Christopher any ideas poll still lopsided and the balance is not changing over time?

if its windows 10 and i assume 2016 there is a new switch to allow files paths longer than 260 in explorer etc

have you tried to just copy via a smb/samba share rather than mounting the folder or pull the data from the zfs box to windows via a share no need for rsync unless its over a wan

cheapest solution is your old pc stripped down to a minimal setup and add the LSI card if low power is you thing then maybe not - as for 25w - you are forgetting the HDD and LSI power draw - at least double that i would estimate the silverstone case is your limiting factor here as its pushing you to a itx m/b which is never going to have much in the way of "power" features dont go too low on the cpu power front or you will cripple the disk i/o as the cpu will not keep up

Hi 1. File placement rules should be able to accommodate what you need - there are threads on this 2. See above - minimal management i suspect 3. probably as you are asking for all info 4. delete as you would on any drive rather than speculating i would use the 30 trial and try out the options available

that sounds odd long shot but is it something to do with only being one character directory name? i know it worked before but.... i assume the permissions are the same?

sorry dont no the answer to that - a guess would be lower performance and no other issues - as you say like a gpu card diff m/b perhaps with better pci-e support - they tend to be more expensive the newer the features though Just looking around and most boards only have a 4x pcie slot which the lsi is not going to fit in as its too short

see post 4 - several to choose from - 6th one down is where i got mine using the link

possibly change the order of you disk in settings - i.e. which disk gets filled up first

I would stay well clear of the SYBA card they are awful cards - tried a couple 8 port and 4 port - windows/linux etc could not see them i would add a little more and get the LSI card from china for £55 (take a couple of weeks to arrive) and buy two good quality SAS cables and run all your 8 bays of the the LSI As its an HBA it will present all 8 drives to the os - out of the box

i think you may be missing the obvious that IcyBox must have a port mulitpier in their box to present the disks to the host machine - or you have to raid them to present one "disk" to the host - doubt its that though But there is another basic way you could set this up get a sas hba like the LSI 9211-8i - run the cables to the existing box you have the disks in and power them from the old psu or get power extension cables as well - so your old pc box is just an enclosure http://www.ebay.co.uk/itm/New-LSI-Internal-SAS-SATA-9211-8i-6Gbps-8-Ports-HBA-PCI-E-RAID-Controller-Card- i got 2 of these and they are new cards plus a couple of long forward breakout cables and you are sorted with the benefit of more bandwidth etc

Hi you can get this message if say your SSD cache is not big enough to take your movie files or does not have enough free space to hold the files to complete the copy. equally if you do not have a cache and the "landing" archive disk is almost full then the same would apply i have had this once or twice when filling up my pool first time - but if you leave it a couple of hours (yes its slow) then i was able to copy the files over once my ssd cache cleared out

Have pushed 250GB plus at the pool tonight - its still balancing but no change in profile three archive drives empty

Ha thought so - no point having two db of the same thing Yes i am interested - as i can see a few useful utilities/routines that would be of use to all - i hope 1. Which drive has x file - also what drives has it been on might be useful history in some circumstances - cough cough - like a pool that does not balance properly 2. Where is directory x and which drives are its files and sub directories on 3. What errors do i have - i was surprised i had one - as dp had not notified me of it - unless i missed it 4. what files are inconsistent and where are they etc just a few of the top of my head have a few others in mind as well if Alex can give me a few pointers/guidance on what parameters the sys file will take and what it will respond with it would be good to get a basic trial done so i know where to invest time. The parsing of the file is fiddly but trivial and fill have it fully refined in a day or so - just sorting a memory leak in the db code (not mine!!) awaiting call back from dev's think i know what it is but just been diverted to sort this. As for the script its chugging through the nightly workload fine - have two zips now and its working on the third log at the moment - combined takes about 4 hours on Boris with his I5

@gj80 if there is a db (i dont think there is from a bit of poking around - master file record table perhaps???) then yes that could be used as the back end - assuming its quick and responsive and support queries etc I'm currently not using SQLite but Absolute Db from Componentace - it compiles into the exe file and has all the features you would expect of a sql db. Exe is only 1.5meg at the moment so minimal foot print. Just refining the import routines and refining the data structure - got the import down to less than a minute for 500k of log file records - bit more work to do to speed that up a bit.

Manual balance did not change anything

ah Alex quote makes sense as they generally are small files thanks

nope its stayed the same for a few days now had just ssd plugin for a while - then turned scanner back on - no change - turned on drive space equal - no change dp is happy the drives are balanced although have three drives empty and one full to the brim images above are still close to what i see now - differences are ssd's empty and drive 19 is also empty along with 9 and 10 i changed the max fill level to try and kick dp into balancing up disk 1 but it just moved 90GB off to drive 2. I have kicked off another manual balance to see if it will do anything - i will report back any ideas on what to try??

aaaand it works CSV is approx twice the size it was pre unicode c250mb - took almost three hours to produce though?? 500k of files per disk is quite likely - i have over 500k of photos and they take up 350GB or so.... Multiple drive csv's would work for most situations @Christopher this option to programmatically talk to drive pool would be a good option to explore - i am working on a gui to take the log file/csv and put it in a database if i could do it "directly" without the dpcmd log file or create a slightly easier file format to read in that would be good as its a tad fiddly at the moment and that slows things down when you have 2.5m lines of data to read. I bet i do not have the biggest file collection out of dp users. What i have in mind/working on is a database thats not dependant on anything else to run - i.e. no drivers or software install - just one exe file and maybe an empty database file - so its simple for people to use - adding export functions to say csv/excel would be no problem and as its sql compliant adding query functionality is simple as well. So how long would it take to get some documentation to talk directly to DP to pull the data directly??? Is this something i should wait for or would it be a long time coming ?