Splitting a large VM

user9623

I have a large virtualBox virtual machine 55GB approx. This is currently on my external harddrive. The problem is I am not able to copy it from my external USB hard drive into my pc. At around 75% it just fails the copy. I cant clone it either since its attempting to clone from hard drive to my pc. This must be due to some limitations of my external hard drive, although I cant be so sure. Its only a year old. The only thing I can think of right now is to copy it in pieces of 25GB each and then copy it over and join it back into one. Does anyone have any other options I can try? and if file splitting is the only option, what kind of file splitters would you recommend for splitting and joining large Virtual machine files?

Robin Hood

You might have success using a different program to copy the V.M. folder. If not you could always make a split archive of the V.M. folder, copy the archive over in chunks, and then extract it.

Alternative Ways To Copy Data:

Using Xcopy To Copy Directories:

xcopy "C:\vmfolder" "D:\vmfolder" /E /V /I /F /H /-Y /J

Substitute C:\vmfolder for the location of the V.M. folder, and D:\vmfolder for the place you want to copy it.

/E Copies directory, subdirectories, and all the files in them.

/V Will verify the file sizes afterwards.

/I Allows specifying destination directory.

/F Shows what's being copied while copying.

/H Copies hidden files, and system files too.

/-Y Prompts you if you're going to overwrite an existing file.

/J No input/output buffer is used. Ideal when dealing with large files.

Here's an example:

xcopy "E:\Virtual Machines\VMware Player\Ubuntu 14.04.1 - Core X86-64" "F:\Temp\Ubuntu 14.04.1 - Core X86-64" /E /V /I /F /H /-Y /J

Using Robocopy To Copy Directories:

robocopy "C:\vmfolder" "D:\vmfolder" /E /J /SL /MT[:1] /V /FP /ETA /TEE

Substitute C:\vmfolder for the location of the V.M. folder, and D:\vmfolder for the place you want to copy it. You can leave /MT[:1] as is or if your computer can handle more threads you can increase it.

/E Copies subdirectories.

/J No buffer is used for inputs/outputs, which is helpful for large files.

/SL If symbolic links are used, copy the link not the target.

/MT[:n] Multi-threaded copying; min threads is 1, and max is 128. Use a number your system can handle.

/V Verbose outputs.

/FP Adds fullpath to outputs.

/ETA Estimates time to completion.

/TEE Output to console in addition to log file.

Here's an example:

robocopy "E:\Virtual Machines\VMware Player\Ubuntu 14.04.1 - Core X86-64" "F:\Temp\Ubuntu 14.04.1 - Core X86-64" /E /J /SL /MT[:1] /V /FP /ETA /TEE

Creating An Archive, Copying It, And Extracting It

Using 7-zip Command Line Version To Create A Split Archive:

C:

Substitute C: for the drive you wish to save the archive to.

cd "C:\savelocation"

Substitute C:\savelocation for the spot on the drive you wish to save the archive to. All because 7zip doesn't support specifying an output path when creating archives (though it does for extracting with e).

7za a -tzip -r -mx0 -mmt -v5g "vmfolder.zip" "C:\vmfolder"

Substite vmfolder.zip for the archive name, and C:\vmfolder for the V.M. folder path.

a Adds files to an archive.

-r Recursively adds sub-directories.

-mx0 Sets compression to none.

-mmt Enables multi-threading.

-v Splits archive into chunks, g is for gigabytes, m is for megabytes, k is for kilobytes, and b is for bytes.

t Choose archive type, zip is for zip archives.

For example:

E:

cd "E:\Virtual Machines\VMware Player"

7za a -tzip -r -mx0 -mmt -v300m "Ubuntu 14.04.1 - Core X86-64.zip" "E:\Virtual Machines\VMware Player\Ubuntu 14.04.1 - Core X86-64"

Using Xcopy To Copy Files:

xcopy "C:\savelocation*.zip*" "D:\savelocation" /V /I /F /H /-Y /J

Substitute C:\savelocation for the location of the archives, and D:\savelocation for the place you want to copy them.

/V Will verify the file sizes afterwards.

/I Allows specifying destination directory.

/F Shows what's being copied while copying.

/H Copies hidden files, and system files too.

/-Y Prompts you if you're going to overwrite an existing file.

/J No input/output buffer is used. Ideal when dealing with large files.

For example:

xcopy "E:\Virtual Machines\VMware Player*.zip*" "F:\test" /V /I /F /H /-Y /J

Using 7-zip Command Line Version To Extract A Split Archive:

D:

Subsitute D: for the drive you wish to extract the archive to.

cd "D:\extractionlocation"

Subsitute C:\extractionlocation for the location on the drive you wish to extract to.

7za x -mmt "D:\savelocation\vmfolder.zip.001"

Substiute D:\savelocation\vmfolder.zip.001 for the location of the archives. When 7-zip creates split archives it a appends 001, 002, and so on to the seperate pieces.

x Extracts files, and folders normally.

-mmt Enables mult-threading.

For example:

F:

cd "F:\test"

7za x -mmt "F:\Virtual Machines\VMware Player\Ubuntu 14.04.1 - Core X86-64.zip.001"

Notes:

  • Failed file transfers under high loads can be an indicator of an underpowered drive.
  • 7-zip is released in 2 versions: 7-zip, and 7-zip Command Line Version. 7-zip is G.U.I. only, and 7-zip Command Line Version is C.L.I. only.

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at
0

Comments

0 comments
Login to comment

Related

From Dev

Biopython Large Sequence splitting

From Dev

Splitting large file by user

From Dev

FFmpeg splitting large files

From Dev

Splitting out a large file

From Dev

Is this the correct way of splitting a large file?

From Dev

Splitting a large vector into intervals in R

From Dev

Splitting up a large class with modules

From Dev

Strategy for splitting a large JSON file

From Dev

Splitting large data file in python

From Dev

Splitting a very large string in part

From Dev

Splitting out very large enums in java/groovy

From Dev

Splitting large chunk of text into individual words

From Dev

Splitting a large Pandas Dataframe with minimal memory footprint

From Dev

Splitting and Merging large files (size in GB) in Java

From Dev

Splitting a String of a large negative number and putting it into a LinkedList

From Dev

Splitting a large log file in to multiple files in Scala

From Dev

Python - Splitting a large string by number of delimiter occurrences

From Dev

how to splitting a large array into smaller arrays

From Dev

Split large file into chunks without splitting entry

From Dev

Splitting a large text file to form a table

From Dev

Splitting a String of a large negative number and putting it into a LinkedList

From Dev

Splitting Large Strings in Excel an Arbitrary Number of Times

From Dev

Splitting large files efficiently (currently using awk)

From Dev

Splitting large html file in several files

From Dev

Splitting a large Pdf file with PDFBox gets large result files

From Dev

Splitting large typescript file into module across multiple files

From Dev

Java - Splitting Large SQL Text File on Delimeter Using Scanner (OutOfMemoryError)

From Dev

Splitting large table into 2 dataframes via JDBC connection in RStudio

From Dev

Splitting up large requests due to payload size issues

Related Related

  1. 1

    Biopython Large Sequence splitting

  2. 2

    Splitting large file by user

  3. 3

    FFmpeg splitting large files

  4. 4

    Splitting out a large file

  5. 5

    Is this the correct way of splitting a large file?

  6. 6

    Splitting a large vector into intervals in R

  7. 7

    Splitting up a large class with modules

  8. 8

    Strategy for splitting a large JSON file

  9. 9

    Splitting large data file in python

  10. 10

    Splitting a very large string in part

  11. 11

    Splitting out very large enums in java/groovy

  12. 12

    Splitting large chunk of text into individual words

  13. 13

    Splitting a large Pandas Dataframe with minimal memory footprint

  14. 14

    Splitting and Merging large files (size in GB) in Java

  15. 15

    Splitting a String of a large negative number and putting it into a LinkedList

  16. 16

    Splitting a large log file in to multiple files in Scala

  17. 17

    Python - Splitting a large string by number of delimiter occurrences

  18. 18

    how to splitting a large array into smaller arrays

  19. 19

    Split large file into chunks without splitting entry

  20. 20

    Splitting a large text file to form a table

  21. 21

    Splitting a String of a large negative number and putting it into a LinkedList

  22. 22

    Splitting Large Strings in Excel an Arbitrary Number of Times

  23. 23

    Splitting large files efficiently (currently using awk)

  24. 24

    Splitting large html file in several files

  25. 25

    Splitting a large Pdf file with PDFBox gets large result files

  26. 26

    Splitting large typescript file into module across multiple files

  27. 27

    Java - Splitting Large SQL Text File on Delimeter Using Scanner (OutOfMemoryError)

  28. 28

    Splitting large table into 2 dataframes via JDBC connection in RStudio

  29. 29

    Splitting up large requests due to payload size issues

HotTag

Archive