Archive with live progress

Show bytes/ETA via pv while streaming into zstd; du -sb supplies total size for the bar

tar cf - /data | pv -s $(du -sb /data | awk '{print $1}') | zstd -T0 > data.tar.zst
tool
tar3 commands
tags
tarmonitoringperformance

More tar commands

  • Incremental snapshot archives
    tar -czg snapshot.snar -f backup-$(date +%F).tgz /data

    Level-based incremental backups: snapshot.snar tracks state so only changed files are archived

  • Stream directory over SSH
    tar c -C /src . | ssh user@<host> 'tar x -C /dst'

    Copy a tree without intermediate file, preserving perms; add zstd in pipe for slow links

all 3 tar commands