In the past, I have used a USB to transfer a few video files from one computer to another. This time I have over 1 terabyte of movies and shows I’d like to transfer. What is the best method?

I know it will take a very long time

  • cmnybo@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    3
    ·
    9 months ago

    Connect both computers over ethernet and rsync the data across. It will still take several hours over gigabit ethernet though.

  • Bob_Spud@alien.topB
    link
    fedilink
    English
    arrow-up
    3
    ·
    9 months ago

    Quickest -

    1. Take the lid off the source PC put the HDD in it
    2. Copy the stuff.
    3. Pull it out
    4. Put it the other PC,
    5. Your done

    Formatting the HDD my be optional.

  • beholdthepineapple@alien.topB
    link
    fedilink
    English
    arrow-up
    2
    ·
    9 months ago

    Parallel port would be faster than serial, but if you’re using serial I’d go with Z modem for the compression and error correction.

  • 4thelulzgamer@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 months ago

    If you want the bare minimum fast transfer and both PC are in local network, use Dukto-R6. It’s super basic file copying, you just need to drag and drop.

    For more advanced options,the others have already pointed it out.

  • diamondsw@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 months ago

    Fastest “normal” way would be write it to a USB 3 drive on machine 1, read from drive later on machine 2. An SSD would be best. Even with having to do the write and read in two phases, I’d still expect it to be faster than a 1G network.

    (Less normal ways would be things like Thundrerbolt SSDs, 10G or 40G ethernet for direct transfer, etc. But if you have that kind of tech already in place, then you’re not asking. ;)

  • ZeroSulu@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 months ago

    Over LAN with flavored solution of your choice.
    Other than that, I use one of my spare drives and my USB docking station if I need to move it outside of my own house. I never really had a need for dedicated external drives but a docking station is handy for many things, this being one of them.

  • p3dal@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 months ago

    I’ve been sending 10TB from one PC to another on my network over the last 2 days, it’s nearly done. It’s a wired network, and while sometimes I use tools like robocopy for more granular control over the the copy settings and logging of any copy errors, I generally find the standard windows copy tool to be faster.

  • WikiBox@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 months ago

    USB 3.1 Gen2 is hard to beat. 10Gbps. But for HDDs the HDDs themselves will be the bottleneck. For sustained file transfers, perhaps no more than up to 3Gbps, even if installed in the same PC. Good SATA SSDs may manage closer to 6Gbps. NVMe SSDs are likely to saturate USB 3.1 Gen2. Then PCI-e directly between installed drives is the fastest. Normal cabled network is only 1Gbps.

    File transfers to/from external multibay USB DAS can be done in parallel, involving multiple HDDs, and come close to saturating 10Gbps USB3.1 Gen2 speeds.

    Then there is thunderbolt.

    Start a rsync transfer when you go to bed. In the morning it will most likely be done.

  • fediverser@alien.top
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 months ago

    This post is an automated archive from a submission made on /r/DataHoarder, powered by Fediverser software running on alien.top. Responses to this submission will not be seen by the original author until they claim ownership of their alien.top account. Please consider reaching out to them let them know about this post and help them migrate to Lemmy.

    Lemmy users: you are still very much encouraged to participate in the discussion. There are still many other subscribers on !datahoarder@selfhosted.forum that can benefit from your contribution and join in the conversation.

    Reddit users: you can also join the fediverse right away by getting by visiting https://portal.alien.top. If you are looking for a Reddit alternative made for and by an independent community, check out Fediverser.

  • TADataHoarder@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 months ago

    What is the best method?

    Sometimes the best method isn’t a transfer at all. Don’t forget transporting is an option.
    Do you need to transfer the files? or could you just use an external you share between different PCs?
    If an external works, but seems inconvenient, you can fix that by having the drive connected to a USB switch. When connected to a switch you can press a button or use a remote to change which PC the drive is connected to giving you instant access to the drive contents without having to sync/copy anything over.

    Links below for examples of USB switches
    https://www.amazon.com/Cable-Matters-Sharing-Computers-Peripherals/dp/B083JKDNRJ/
    https://www.amazon.com/Sabrent-Computers-Peripherals-Indicators-USB-SW30/dp/B074TYDJK2/

  • RedEyed__@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 months ago

    rsync over sshfs over Ethernet.
    I transferred 10 Tb over night, but it depends on how many files do you have.