How To Quickly Transfer Large Files Over Network In Linux And Unix

Transfer Large Files Over Network In Linux

You may also like...

  • IJK

    It would be nice if you could publish some figures comparing this mechanism against FTP or SCP in the same network.

    • SK

      Good point. I will try.

      • hi.itsme

        And how about writing a bash script to completely automatize so that you can fetch the files using only the client machine. For example, I have generated my data on my computing server (I maintain it) and I want to transfer important data to results directory of a production machine where analyse it for further usage. You once run the script and forget about it.

        • SK

          Yes, It would be very helpful. If I find anything, I will share it for sure.

  • ppnman

    don’t know dude…. security is so important to me. I prefer rsync -ravz /path/to/source/files/ destination-ip:/path/on/destiny
    fast,secure and easy 😁

  • William Chipman

    Tried this from Oracle 6 box to Centos 7 box and ran into a few issues:
    1. Had to install the EPEL repository to get pv.
    2. Had to add the port to the iptables / firewall-cmd on the target system. This could also be used to control possible source systems for improved security.
    3. command name was changed to “nc” on both systems, not netcat.
    After those changes, worked as advertised and very quick.

    • SK

      Happy to hear that it helped you. I added your notes to the guide now. Thanks.