How to split big files in to small chunks or in small parts ?
How to split big files in to small chunks or in small parts ?
What to do if you dont have much space on a drive to store any big file & you want to split and store it in to some small size parts.
A. First check md5sum hash of file, and make a note of it;
#md5sum <Big File Name>
e.g.
#md5sum Linux-pdf-HOWTOs.tar.bz2
B. Split file in to small managable chunks,
#split --bytes=<Size of each chunk>m <Big File Name> <Chunk File Prefix>
e.g.
#split --bytes=10m Linux-pdf-HOWTOs.tar.bz2 Linux-pdf-
Note : Here it'll make 10-10 MB file chunks.
C. Now if you want to reassemble chunk files in to Big File,
#cat <File Chunk Prefix>* > <Big File Name>
e.g.
#cat Linux-pdf-a* > Linux_PDF_HOWTOS.tar.bz2
D. Check md5sum hash of file,
#md5sum <Big File Name>
e.g.
#md5sum Linux_PDF_HOWTOS.tar.bz2
E. Compare md5sum of "Step A" & "Step D", If both the md5sum are same then your big file is OK.
What to do if you dont have much space on a drive to store any big file & you want to split and store it in to some small size parts.
A. First check md5sum hash of file, and make a note of it;
#md5sum <Big File Name>
e.g.
#md5sum Linux-pdf-HOWTOs.tar.bz2
B. Split file in to small managable chunks,
#split --bytes=<Size of each chunk>m <Big File Name> <Chunk File Prefix>
e.g.
#split --bytes=10m Linux-pdf-HOWTOs.tar.bz2 Linux-pdf-
Note : Here it'll make 10-10 MB file chunks.
C. Now if you want to reassemble chunk files in to Big File,
#cat <File Chunk Prefix>* > <Big File Name>
e.g.
#cat Linux-pdf-a* > Linux_PDF_HOWTOS.tar.bz2
D. Check md5sum hash of file,
#md5sum <Big File Name>
e.g.
#md5sum Linux_PDF_HOWTOS.tar.bz2
E. Compare md5sum of "Step A" & "Step D", If both the md5sum are same then your big file is OK.
very nice .
ReplyDeletei once needed to backup a big files folder .. if i only knew about this guide .. lol ..
anyways keep up the good work .
Thanks for this fantastic info. I am looking for some help from your blog articles as I learn more about these things.
ReplyDeletedata doctors houston
Thank you
ReplyDelete