Have done the same, found that rsync seems to not natively parallelize itself, s... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

spydum on Sept 12, 2014 | parent | context | favorite | on: My experience with using cp to copy 432 million fi...

Have done the same, found that rsync seems to not natively parallelize itself, so spread across 20 cores, it really screamed.

rimantas on Sept 12, 2014 [–]

Damn, I could use some advice there. Right now I have a system which uses rsync to backup some files. It takes about 8 hours to go over 7+ million files (~3.5TB). I'd love to speed up this. I should mention that copy is done over curlftpfs :(.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact