[Best strategy to migrate 20TB to drivepool]

Well i copied all the data to five disks via USB3 and have now just used the quick and dirty method to add the data to the pool - works a treat

 

One thing though the i think http://wiki.covecube.com/StableBit_DrivePool_Q2299585Bneeds updating as i could not find any troubleshooting section to reset the options

 

As it turned out setting the ssd cache kicked things into life

 

Drivepool is digesting 18TB of data at the moment - not much happening but i have just given it the best part of 1M files to figure out - will leave it to get on with it and turn on duplication later

[Macrium Reflect Reporting Out of Disk Space Mid-Way Through Backup]

Hi i'm new to this as well - but the thought that comes to mind is that the backup is a single file and you dont have enough space on two drives to hold the single file. So i suspect the out of disk space warning is when one of the drives with very low space fills up as MR probably does not reserve the full file size initially on the system(if it did then the backup would probably fail almost immediately) because it does not know how big the backup is going to be and just incrementally expands the backup file as it goes later it will know when the process nears completion. DP therefore just decides to pick a disk and wait for the process to finish hence why you get variable completions of 20% and 40% as the "primary" or "secondary" DP disk fills up.

 

Drive 6 looks like it has enough space but the others look to have a lot less space.

 

If you can chop it up into more manageable pieces then I would expect it to work. Or just do an image of your system drive and do a file backup of the rest to keep the biggest file size down to something more manageable

[Plex Cloud and Stablebit]

Yes marketing <> does not equal reality

 

yes i was asking if you found anything extra over and above the TOS from Plex

[Plex Cloud and Stablebit]

Oh yes i know its from their TOS  i have no idea who Fred is ... i was asking for a friend ..lol

[Plex Cloud and Stablebit]

One thing i'm not clear on is the whole copyright material thing - any movie or TV show etc is copyrighted - so any rip is technically an infringement - so how are Amazon going to know if you .... cough... borrowed a copy of X DVD from Fred down the road vs bought it from a shop.

 

Also if you are in different parts of the world different versions of the copyrights apply.

 

If you Stream content via Plex currently to say your parents house so they can watch the latest addition to you collection - i believe that's a violation of copyright - if you believe the FBI feel the love screen at the beginning of your latest Blu-Ray. No they a not going to chase you for this - but with the Amazon/Plex deal the info on who you streamed it to and when is readily available etc etc.

 

@Royce

 

"You continue to retain any ownership rights you have in content you make available via the Services, or otherwise use in conjunction with the Services. However, by using the Services with particular content, for example by using the Services to share particular content or access particular content, you grant to Plex (and to each of the third parties with whom we work to provide you with the Services) a worldwide license to reproduce, modify, create derivative works, transmit, publish, publicly perform, publicly display, distribute, and otherwise use the particular content and metadata associated with the content, such as images of you or images otherwise associated with your account. The rights you grant us in this license are only for the limited purpose of providing you with our Services. You may not use the Services in connection with any content for which you do not have the right to grant us this license."

 

I have seen this before or something very similar and some people blow this off as just standard boiler plate and it is to some extent - right up until a Judge says "nah its real". Did you find anything interesting in your search?

[Plex Cloud and Stablebit]

i have a suspicion that this might get messy very quickly

 

terms and conditions say don't "share with others" etc as if thats going to stop people doing exactly that - as thats part of the point of Plex and other media servers

 

so Plex and Amazon have in effect made it easier/better to stream media to multiple users who might not - shock horror - own the copyrighted media

 

I suspect a few copyright lawyers may have a problem or two with the concept even if Plex and Amazon have done their homework

 

As for encryption of the data stored on Amazon - well plex needs to able to read it to stream/transcode/update metadata etc so at some point you are going to have to give it the key

 

Might be fun to watch bit like Google/Oracle

[Plex Cloud and Stablebit]

is plex trancoding (well amazon) in the cloud then streaming to a device? or is it downloading to the plex server being transcoded and then sent to the device

 

from what i have read not clear to me - but i can only see the marketing bumf  

[Windows 10 Recycle bin]

Thanks - yes the recycle bin is "just" a hidden folder to "restore" from

 

Still not sure what happens in these cases though

 

"Windows thinks its one recycle bin but if i had a drive failure could some of the "deleted" files be in part of the bin on that drive and be "lost" so trying to recover a file out of the recycle bin after the drive is removed would not be possible?

 

Also adding a ssd cache would that also have part of the recycle bin as well?"

[Windows 10 Anniversary Update and Long File Paths]

Good - just wanted to check

 

dont have any long paths yet but good to know its ok if i do

[Slow Copying speed after Fast Copying]

"Are the pool drives on the same sata controller to the D : Drive - has the driver(s) been updated in the recent past - by say windows update rather than you directly - have you checked what updates windows update has installed recently - i.e. anything to do with the system?"

 

no i was meaning sata drivers not drive firmware but that would have been an option had you updated the firmware

 

Ok another idea

 

copy from the D drive to the disks in the pool individually but NOT into the pool - doing this will by pass the pool driver (if its the cause) and if everything is working correctly you should get the same speed from each drive making up the pool

 

do you have a spare drive to swap D: with - if you can that's the quickest way to check the disk is not the problem

 

you haven't got encryption running have you? the drive is not compressed?

 

When doing the copy check system resources to see what the computer is doing etc

[Slow Copying speed after Fast Copying]

A couple of ideas that i don't think you have tried

 

the files you are copying are large i believe - i.e. multi gigabyte in size? so you should get maximum speed from the source drive

 

what type of drive is the D: drive - have you run any checks/speed tests/checked the smart records for the drive? is the D: drive full or "empty" when you do the transfer. if its an ssd is it getting hot and thermal throttling coming into play?

 

does the d: drive do anything else besides "copy" files over - it looks like you call it "database" have you got processes accessing the disk when doing the copy? Have the processes been updated recently and are hogging the disk?

 

Are the pool drives on the same sata controller to the D : Drive - has the driver(s) been updated in the recent past - by say windows update rather than you directly - have you checked what updates windows update has installed recently - i.e. anything to do with the system?

 

Can you swap the D: drive for another disk if possible a different type?

 

Might have some more ideas depending on the above

 

Have fun

[Windows 10 Recycle bin]

Was wondering how Drivepool deals with the Recycle Bin - having just created a pool of 16TB - windows decided it needed a 800gb+ recycle bin!

 

My question is how is the bin distributed across the pool - each drive gets its proportion?

 

I assume its not duplicated?

 

Windows thinks its one recycle bin but if i had a drive failure could some of the "deleted" files be in part of the bin on that drive and be "lost" so trying to recover a file out of the recycle bin after the drive is removed would not be possible?

 

Also adding a ssd cache would that also have part of the recycle bin as well?

 

Thanks

[Windows 10 Anniversary Update and Long File Paths]

Microsoft has finally, in the Windows 10 Anniversary Update, "fixed" the limitation of 260 characters for the file path

 

Before i enable this does StableBit already support this or perhaps will in the future as an application has to explicitly support it for it to work?

 

 

 

Quote

Enabling NTFS long paths will allow manifested Win32 applications and Windows Store applications to access paths beyond the normal 260 char limit per node. Enabling this setting will cause the long paths to be accessible within the process.

This actually means that an application has to have the following line in its manifest: <longPathAware>true</longPathAware>

 

Article http://winaero.com/b...-in-windows-10/

[Windows 10 support etc]

I have in the last couple of days moved to 1607 on one of my machines

 

as i was having trouble with veeam installing - has major strop when it sees the drive pool - i had disabled the stablebit services in windows 10 64bit to get Veeam to install fully

 

while i was at it i let windows upgrade and it went through without a hitch - not saying its a problem with stablebit - but might get you past whatever errors you are getting

 

previously had problems on day one of Anniversary release with Avast and vt-x causing errors on upgrade but thats fixed now

 

if its just not giving you the option to update - search for the migrate tool from MS which will force the upgrade to happen - http://go.microsoft.com/fwlink/p/?LinkId=821403

[Best strategy to migrate 20TB to drivepool]

Thanks

 

Quick and dirty would be nice but the data is on raid5 ext4 drives  so network for direct copy

 

but am thinking maybe copying the data to a usb drive formatted as ntfs and then do the quick and dirty method as usb3 is a bit faster than Ethernet

 

So basically copy first - duplicate/balance - then add ssd(s) to pool then turn on optimiser.

 

Whats the rule of thumb for ssd's added to a pool is there some size/ratio or number of drives to add?

[Best strategy to migrate 20TB to drivepool]

Hi

 

Just planning to move 20TB to a new drivepool setup

 

i have the option to add a SSD cache to the pool(s) and I am wondering if i should not enable the ssd cache until after the transfer is complete - as it appears if you do not have the settings quite right (as i'm new at this) you can fill up the ssd before they have a chance to move the data into the pool and hence complicate the issue. I obviously want this to run unattended as its probably going to take more than a day to complete.

 

From experience should i also disable duplication until its complete to speed things up?

 

A test copy(samba/smb) shows the transfer will happen at ~ 117/120 MB/s which is about the max you can expect for large files anyway

 

Anything else to be away of/consider?

 

Thanks

[Drivepool and Drive letters - maximum number of drives?]

or not mount them at all appears to work fine as well - swapped to win 10 pro 64bit now - as clean install the mount points were lost but drivepool picked the drives up on reinstall without re mounting them

 

just have the os drive and a test pool working well so far - interesting watching the pool fill up for the first time and turned on duplication half way through a backup job - handled very well by the app

 

its also interesting to see that in task manager the "pool" has no disk activity reported while the underlying disks are running around moving data - i assume this is normal?

[Drivepool and Drive letters - maximum number of drives?]

Thanks

 

Have mounted then and removed drive letters and Drivepool picked up the changes

[Drivepool and Drive letters - maximum number of drives?]

Hi

 

Just trying out Drivepool and first question i have is Drive letters and what happens when you run out of them

 

I am building a large storage/backup server and its likely i will add more than 20 hdd 

 

Just experimenting with 4 hdd plus OS drive - created a pool which is assigned a drive letter but also the four drives that make up the pool are also assigned drive letters

 

The drives were not assigned drive letters before adding to the pool (un-formatted)

 

So what happens when you want multiple pools and have a large number of drives - do you have to use mount points?

 

Currently i am testing on win7 64bit

 

Any pointers or advice would be good

 

Thanks