Transferring large (8 GB) files over ssh

eimrek

I tried it with SCP, but it says "Negative file size".

>scp matlab.iso xxx@xxx:/matlab.iso
matlab.iso: Negative file size

Also tried using SFTP, worked fine until 2 GB of the file had transferred, then stopped:

sftp> put matlab.iso
Uploading matlab.iso to /home/x/matlab.iso
matlab.iso                                           -298% 2021MB -16651.-8KB/s   00:5d
o_upload: offset < 0

Any idea what could be wrong? Don't SCP and SFTP support files that are larger than 2 GB? If so, then how can I transfer bigger files over SSH?

The destination file system is ext4. The Linux distribution is CentOS 6.5. The filesystem currently has (accessible) large files on it (up to 100 GB).

arielf

The original problem (based on reading all comments to the OP question) was that the scp executable on the 64-bit system was a 32-bit application. A 32-bit application that isn't compiled with "large-file support" ends up with seek pointers that are limited to 2^32 =~ 4GB.

You may tell if scp is 32-bit by using the file command:

file `which scp`

On most modern systems it will be 64-bit, so no file truncation would occur:

$ file `which scp`
/usr/bin/scp: ELF 64-bit LSB  shared object, x86-64 ...

A 32-application should still be able to support "large files" but it has to be compiled from source with large-file support which this case apparently wasn't.

The recommended solution is perhaps to use a full standard 64-bit distribution where apps are compiled as 64-bit by default.

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at
0

Comments

0 comments
Login to comment

Related

From Dev

Transferring large files over TCP in Qt

From Dev

Encrypting/Decrypting(Using AES) Large files and transferring over HTTP

From Dev

Jenkins transferring 0 files using publish over SSH plugin

From Dev

transferring files over two-hop SSH session

From Dev

rsync on Windows not transferring large files

From Dev

Streaming large files (>2GB over IIS) using WebAPI

From Dev

Transferring files over TCP with CopyTo()

From Dev

Transferring files over home network WiFi

From Java

Unable to Translate large compressed files such as 5GB and 8GB

From Dev

Transferring large files: combining streamed transfer and content-length

From Dev

Transferring large files between an Ubuntu machine and a windows machine

From Dev

Transferring large files using scp with CPU and memory considerations

From Dev

C# transferring lots of small files over a network

From Dev

Script for transferring files over the internet via a Cron task

From Dev

Is there a speed difference between transferring files over FTP and Samba?

From Dev

Does transferring files over a local network use up internet bandwidth

From Dev

How to Find the Bottleneck when Transferring Files over WAN

From Dev

Transferring files from remote Mac SSH to school Linux Server

From Dev

Processing Large Files in Python [ 1000 GB or More]

From Dev

Splitting and Merging large files (size in GB) in Java

From Dev

DownloadManager downloading files over 2.1 GB

From Dev

Downloading Error With Files over 1.0GB

From Dev

sh startup files over ssh

From Dev

Remove a list of files over SSH

From Dev

Transferring files from Ubuntu via inner server (ssh-> ssh) with FileZilla

From Dev

Transmitting Images (or large files) over Message Queues

From Dev

Memory problems when compressing and transferring a large number of small files (1TB in total)

From Dev

Is there a faster alternative to cp for copying large files (~20 GB)?

From Dev

Python - Convert Very Large (6.4GB) XML files to JSON

Related Related

  1. 1

    Transferring large files over TCP in Qt

  2. 2

    Encrypting/Decrypting(Using AES) Large files and transferring over HTTP

  3. 3

    Jenkins transferring 0 files using publish over SSH plugin

  4. 4

    transferring files over two-hop SSH session

  5. 5

    rsync on Windows not transferring large files

  6. 6

    Streaming large files (>2GB over IIS) using WebAPI

  7. 7

    Transferring files over TCP with CopyTo()

  8. 8

    Transferring files over home network WiFi

  9. 9

    Unable to Translate large compressed files such as 5GB and 8GB

  10. 10

    Transferring large files: combining streamed transfer and content-length

  11. 11

    Transferring large files between an Ubuntu machine and a windows machine

  12. 12

    Transferring large files using scp with CPU and memory considerations

  13. 13

    C# transferring lots of small files over a network

  14. 14

    Script for transferring files over the internet via a Cron task

  15. 15

    Is there a speed difference between transferring files over FTP and Samba?

  16. 16

    Does transferring files over a local network use up internet bandwidth

  17. 17

    How to Find the Bottleneck when Transferring Files over WAN

  18. 18

    Transferring files from remote Mac SSH to school Linux Server

  19. 19

    Processing Large Files in Python [ 1000 GB or More]

  20. 20

    Splitting and Merging large files (size in GB) in Java

  21. 21

    DownloadManager downloading files over 2.1 GB

  22. 22

    Downloading Error With Files over 1.0GB

  23. 23

    sh startup files over ssh

  24. 24

    Remove a list of files over SSH

  25. 25

    Transferring files from Ubuntu via inner server (ssh-> ssh) with FileZilla

  26. 26

    Transmitting Images (or large files) over Message Queues

  27. 27

    Memory problems when compressing and transferring a large number of small files (1TB in total)

  28. 28

    Is there a faster alternative to cp for copying large files (~20 GB)?

  29. 29

    Python - Convert Very Large (6.4GB) XML files to JSON

HotTag

Archive