For context:

I’m copying the same files to the same USB drive for comparison from Windows and from my Fedora 41 Workstation.

Around 10k photos.

Windows PC: Dual Core AMD Athlon from 2009, 4GB RAM, old HDD, takes around 40min to copy the files to USB

Linux PC: 5800X3D, 64GB RAM, NVMe SSD, takes around 3h to copy the same files to the same USB stick

I’ve tried chagning from NTFS to exFAT but the same result. What can I do to improve this? It’s really annoying.

  • AnAmericanPotato@programming.dev
    link
    fedilink
    English
    arrow-up
    23
    ·
    edit-2
    3 days ago

    Silly question perhaps, but are you sure you’re using the correct port on your Linux system? If I plug my external HD into a USB2 port, I’m stuck at 30-40MB/sec, while on a USB3 port I get ~150-180MB/sec. That’s proportionally similar to the difference you described so I wonder if that’s the culprit.

    You can verify this in a few different ways. From Terminal, if you run lsusb you’ll see a list of all your USB hubs and devices.

    It should look something like this:

    Bus 002 Device 001: ID xxxx:yyyy Linux Foundation 3.0 root hub
    Bus 002 Device 002: ID xxxx:yyyy <HDD device name>
    Bus 003 Device 001: ID xxxx:yyyy Linux Foundation 2.0 root hub
    Bus 004 Device 001: ID xxxx:yyyy Linux Foundation 3.0 root hub
    

    So you can see three hubs, one of which is 2.0 and the other two are 3.0. The HDD is on bus 002, which we can see is a USB 3.0 hub by looking at the description of Bus 002 Device 001. That’s good.

    If you see it on a 2.0 bus, or on a bus with many other devices on it, that’s bad and you should re-organize your USB devices so your low-speed peripherals (mouse, keyboard, etc.) are on a USB2 bus and only high-speed devices are on the USB3 bus.

    You can also consult your motherboard’s manual, or just look at the colors of your USB ports. By convention, gray ports are USB 1.0, blue ports are 2.0, and green ports are 3.x.

    If you’re running KDE, you can also view these details in the GUI with kinfocenter. Not sure what the Gnome equivalent is.

    • WereCat@lemmy.worldOP
      link
      fedilink
      arrow-up
      8
      ·
      2 days ago

      For sanity check I’ve tried.

      Bus 004 Device 004 and it’s USB 3.0 as it should be.

      Also I’ve disabled caching and I’m now copying 6 video files at only just 15MB/s (and it’s slowing down, byt the time I went to make screenshot for this post it dropped again). And it’s quite a bit slower than on Windows still.

            • jollyrogue@lemmy.ml
              link
              fedilink
              arrow-up
              6
              ·
              1 day ago

              Did the USB drive get excessively warm during this because it looks like the drive is throttling?

              Incidentally, this is why I switched to using external SSDs. A group of 128GB flash drives I had would slowly fall over when I would write 100GB off files to it.

              • bastion@feddit.nl
                link
                fedilink
                arrow-up
                3
                ·
                1 day ago

                This is a really good point. I generally have the opposite experience re: Linux vs windows file handling speed. But I have been throttled before by heat.

                OP, start again tomorrow and try the reverse, and tell us the results.

    • WereCat@lemmy.worldOP
      link
      fedilink
      arrow-up
      5
      ·
      2 days ago

      I’m using USB 3 10Gbps on my Linux system. The USB stick is USB 3-1.0 and the Windows PC only has USB 2.0 so it should be the slowest but it’s actually several times faster.