Friday, December 31, 2010

How to split big files in to small chunks or in small parts ?

How to split big files in to small chunks or in small parts ?


What to do if you dont have much space on a drive to store any big file & you want to split and store it in to some small size parts.


A. First check md5sum hash of file, and make a note of it;

#md5sum <Big File Name>
e.g.
#md5sum Linux-pdf-HOWTOs.tar.bz2


B. Split file in to small managable chunks,

#split --bytes=<Size of each chunk>m <Big File Name> <Chunk File Prefix>
e.g.
#split --bytes=10m Linux-pdf-HOWTOs.tar.bz2 Linux-pdf-

  Note : Here it'll make 10-10 MB file chunks.


C. Now if you want to reassemble chunk files in to Big File,

#cat <File Chunk Prefix>* > <Big File Name>
e.g.
#cat Linux-pdf-a* > Linux_PDF_HOWTOS.tar.bz2


D. Check md5sum hash of file,

#md5sum <Big File Name>
e.g.
#md5sum Linux_PDF_HOWTOS.tar.bz2


E. Compare md5sum of "Step A" & "Step D", If both the md5sum are same then your big file is OK.

3 comments:

  1. very nice .
    i once needed to backup a big files folder .. if i only knew about this guide .. lol ..
    anyways keep up the good work .

    ReplyDelete
  2. Thanks for this fantastic info. I am looking for some help from your blog articles as I learn more about these things.
    data doctors houston

    ReplyDelete