howtos:how_to_parallelize_rsync
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revision | |||
| howtos:how_to_parallelize_rsync [2026-10-15 12:17 pm] – hcho | howtos:how_to_parallelize_rsync [2026-10-15 12:34 pm] (current) – hcho | ||
|---|---|---|---|
| Line 4: | Line 4: | ||
| ===== Usage ===== | ===== Usage ===== | ||
| + | |||
| + | This command: | ||
| <code bash> | <code bash> | ||
| Line 11: | Line 13: | ||
| </ | </ | ||
| - | This command | + | is approximately |
| <code bash> | <code bash> | ||
| Line 25: | Line 27: | ||
| * '' | * '' | ||
| - | Similarly, | + | Similarly, |
| <code bash> | <code bash> | ||
| Line 33: | Line 35: | ||
| </ | </ | ||
| - | This command | + | is approximately |
| <code bash> | <code bash> | ||
| rsync -avP path/to/src dest/ | rsync -avP path/to/src dest/ | ||
| + | </ | ||
| + | |||
| + | This command: | ||
| + | |||
| + | <code bash> | ||
| + | find path/to/src -type f -print0 | | ||
| + | parallel -0 -j 4 -N 100 --eta rsync -aR {} dest/ && | ||
| + | rsync -avRP path/to/src dest/ | ||
| + | </ | ||
| + | |||
| + | is approximately equivalent to: | ||
| + | |||
| + | <code bash> | ||
| + | rsync -avRP path/to/src dest/ | ||
| </ | </ | ||
howtos/how_to_parallelize_rsync.1792066651.txt.gz · Last modified: by hcho