[gentoo-user] Create mutli-file .zip archives from the command line?

[gentoo-user] Create mutli-file .zip archives from the command line?

[Stroller]

Hi there,

Anyone got any suggestions on this, please?

I have a honking great big DVD image on one of my servers & seem to  
be having problems transferring it to a Windows box over a flakey  
wireless connection. I'm wondering if the reason is because it's over  
4gb in size.

What I thought to do was to break the .iso into a multi-part .zip  
archive, transfer the separate files over to the Windows PC and then  
unzip them back into the original big file using Explorer's built-in  
(XP) zip file handling.

I know I could do this by using RAR - or some other untility -  
instead, but that would require me to install additional software on  
the PC, which I'd rather not do. Besides, I'm surprised to find that  
app-arch/zip - nor any other utility I can immediately find in  
Portage - doesn't seem to handle this.

Thanks in advance for any comments,

Stroller.
-- 
gentoo-user@lists.gentoo.org mailing list

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[Renat Golubchyk]

[-- Attachment #1: Type: text/plain, Size: 1077 bytes --]

Hi!

On Sun, 13 Jan 2008 14:21:30 +0000 Stroller
<stroller@stellar.eclipse.co.uk> wrote:
> What I thought to do was to break the .iso into a multi-part .zip  
> archive, transfer the separate files over to the Windows PC and then  
> unzip them back into the original big file using Explorer's built-in  
> (XP) zip file handling.
> 
> I know I could do this by using RAR - or some other untility -  
> instead, but that would require me to install additional software on  
> the PC, which I'd rather not do. Besides, I'm surprised to find that  
> app-arch/zip - nor any other utility I can immediately find in  
> Portage - doesn't seem to handle this.

I don't know whether zip can do this, but you could use "split" to
split the .iso into smaller pieces and then combine them on your
Windows box with "copy" [1].


Cheers,
Renat

[1] http://technet.microsoft.com/en-us/library/bb490886.aspx


-- 
Probleme kann man niemals mit derselben Denkweise loesen,
durch die sie entstanden sind.
                                              (Einstein)

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 197 bytes --]

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[kei.mailinglists]

Am Sonntag, 13. Januar 2008 schrieb Stroller:
> I know I could do this by using RAR - or some other untility -
> instead, but that would require me to install additional software on
> the PC, which I'd rather not do.
You could use 7-Zip e.g. from portableapps.com So you don't need to install 
it.

> Besides, I'm surprised to find that 
> app-arch/zip - nor any other utility I can immediately find in
> Portage - doesn't seem to handle this.
Well, there is zipsplit which belongs to app-arch/zip. But I never used it. 
Maybe it does the trick for you.


Regards,
Jens
-- 
gentoo-user@lists.gentoo.org mailing list

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[KH]

Hi,

some file systems are not able to handle files bigger than size X. Fat32
for example only handles 4GB. Win often uses Fat32. Maybe this is your
problem.

Kons


Renat Golubchyk wrote:
> Hi!
>
> On Sun, 13 Jan 2008 14:21:30 +0000 Stroller
> <stroller@stellar.eclipse.co.uk> wrote:
>   
>> What I thought to do was to break the .iso into a multi-part .zip  
>> archive, transfer the separate files over to the Windows PC and then  
>> unzip them back into the original big file using Explorer's built-in  
>> (XP) zip file handling.
>>
>> I know I could do this by using RAR - or some other untility -  
>> instead, but that would require me to install additional software on  
>> the PC, which I'd rather not do. Besides, I'm surprised to find that  
>> app-arch/zip - nor any other utility I can immediately find in  
>> Portage - doesn't seem to handle this.
>>     
>
> I don't know whether zip can do this, but you could use "split" to
> split the .iso into smaller pieces and then combine them on your
> Windows box with "copy" [1].
>
>
> Cheers,
> Renat
>
> [1] http://technet.microsoft.com/en-us/library/bb490886.aspx
>
>
>   

-- 
gentoo-user@lists.gentoo.org mailing list

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[Jesús Guerrero]

On Sun, 13 Jan 2008 15:59:04 +0100
Renat Golubchyk <ragermany@gmx.net> wrote:

> Hi!
> 
> On Sun, 13 Jan 2008 14:21:30 +0000 Stroller
> <stroller@stellar.eclipse.co.uk> wrote:
> > What I thought to do was to break the .iso into a multi-part .zip  
> > archive, transfer the separate files over to the Windows PC and then  
> > unzip them back into the original big file using Explorer's built-in  

The problem is that fat32 can't handle files that are larger than
4gb-1byte. So, will still be unable to unzip or unrar that iso image.

Unzip would just stop with an error when it reaches that limit. This
is a technical limitation of fat32 itself. There is nothing unzip or
unrar could do about this. Fat32 just can't index more than 2^32
(4294967296) bytes. It uses 32 bits to index a given file, and any
number above that (well, above 4294967295, since we start at 0) just
doesn't fit into a 32 bits word. Which means that fat32 can't handle
it.

You have many other alternatives: use ntfs or even ext3/2. I know that
there are drivers to use these filesystems on windows, I don't know
how good or bad they are, though. :)

-- 
Jesús Guerrero <i92guboj@terra.es>
--
gentoo-user@lists.gentoo.org mailing list

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[Stroller]

On 13 Jan 2008, at 15:13, Jesús Guerrero wrote:
> On Sun, 13 Jan 2008 14:21:30 +0000 Stroller
> <stroller@stellar.eclipse.co.uk> wrote:
>> What I thought to do was to break the .iso into a multi-part .zip
>> archive, transfer the separate files over to the Windows PC and then
>> unzip them back into the original big file using Explorer's built-in
>
> The problem is that fat32 can't handle files that are larger than
> 4gb-1byte. So, will still be unable to unzip or unrar that iso image.

I believe you're mistaken in the direct cause of my problem. I'm  
using NTFS on the Windows XP machine.

The file is the same size in bytes (8056211212) on the destination XP  
machine as it is on the Samba host, but the md5sums (using Sumemr  
Properties under XP) don't match.

The reason I mentioned 4gb is kinda off-topic here, but I've had  
problems in the past running BitTorrent on Linux box, saving files to  
a directory which was samba mounted from another Linux box. I assumed  
that there was some kind of 4gb limitation of SMB - and a friend  
remarked the same problems (using a Mac) - but googling does not seem  
to support this.

Thanks to the other posters for their excellent suggestions - I'll  
try them later today & report back.

Stroller.
--
gentoo-user@lists.gentoo.org mailing list

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[Jesús Guerrero]

On Sun, 13 Jan 2008 16:34:01 +0000
Stroller <stroller@stellar.eclipse.co.uk> wrote:

> 
> On 13 Jan 2008, at 15:13, Jesús Guerrero wrote:
> > On Sun, 13 Jan 2008 14:21:30 +0000 Stroller
> > <stroller@stellar.eclipse.co.uk> wrote:
> >> What I thought to do was to break the .iso into a multi-part .zip
> >> archive, transfer the separate files over to the Windows PC and then
> >> unzip them back into the original big file using Explorer's built-in
> >
> > The problem is that fat32 can't handle files that are larger than
> > 4gb-1byte. So, will still be unable to unzip or unrar that iso image.
> 
> I believe you're mistaken in the direct cause of my problem. I'm  
> using NTFS on the Windows XP machine.
> 
> The file is the same size in bytes (8056211212) on the destination XP  
> machine as it is on the Samba host, but the md5sums (using Sumemr  
> Properties under XP) don't match.
> 
> The reason I mentioned 4gb is kinda off-topic here, but I've had  
> problems in the past running BitTorrent on Linux box, saving files to  
> a directory which was samba mounted from another Linux box. I assumed  
> that there was some kind of 4gb limitation of SMB - and a friend  
> remarked the same problems (using a Mac) - but googling does not seem  
> to support this.

Well, that is new info.

If you are using ntfs then the issue is not the one I suspected. I
know nothing about samba+big files, I did never use it with big files,
but I haven't hear of such a problem before. I'd blame the wireless
connection, but if the problem is only with that file, then that should
not the be proble either.

Anyway, I don't know if the winxp builtin feature supports multi
part zip files, so I would bet that using split+copy would be the 
easiest thing to do. You can still compress it into a single zip file
before splitting it, that way you might save some bandwidth (or not,
since most of the dvd contents is already compressed via codecs
anyway).

-- 
Jesús Guerrero <i92guboj@terra.es>
--
gentoo-user@lists.gentoo.org mailing list

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[Florian Philipp]

[-- Attachment #1: Type: text/plain, Size: 883 bytes --]


On Sun, 2008-01-13 at 16:04 +0100, kei.mailinglists@arcor.de wrote:
> Am Sonntag, 13. Januar 2008 schrieb Stroller:
> > I know I could do this by using RAR - or some other untility -
> > instead, but that would require me to install additional software on
> > the PC, which I'd rather not do.
> You could use 7-Zip e.g. from portableapps.com So you don't need to install 
> it.
> 
> > Besides, I'm surprised to find that 
> > app-arch/zip - nor any other utility I can immediately find in
> > Portage - doesn't seem to handle this.
> Well, there is zipsplit which belongs to app-arch/zip. But I never used it. 
> Maybe it does the trick for you.
> 
> 
> Regards,
> Jens

7zip / p7zip can also create splitted zip-archives which you can unzip
with any normal zip. Or you could create self extracting versions. 7z
can create these, too (although I never tried).

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[Florian Philipp]

[-- Attachment #1: Type: text/plain, Size: 1083 bytes --]


On Sun, 2008-01-13 at 16:13 +0100, Jesús Guerrero wrote:
> On Sun, 13 Jan 2008 15:59:04 +0100
> Renat Golubchyk <ragermany@gmx.net> wrote:
> 
> > Hi!
> > 
> > On Sun, 13 Jan 2008 14:21:30 +0000 Stroller
> > <stroller@stellar.eclipse.co.uk> wrote:
> > > What I thought to do was to break the .iso into a multi-part .zip  
> > > archive, transfer the separate files over to the Windows PC and then  
> > > unzip them back into the original big file using Explorer's built-in  
> 
> The problem is that fat32 can't handle files that are larger than
> 4gb-1byte. So, will still be unable to unzip or unrar that iso image.
[...]
> You have many other alternatives: use ntfs or even ext3/2. I know that
> there are drivers to use these filesystems on windows, I don't know
> how good or bad they are, though. :)
> 
> -- 

Ext2 is supposed to be on the same level with fat32 in terms of speed
and stability. It doesn't care much about own and mod but that's it.

AFAIK there is no ext3 driver,yet. But you can still mount these as
ext2.

Reiserfs is readonly.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[Renat Golubchyk]

[-- Attachment #1: Type: text/plain, Size: 669 bytes --]

On Sun, 13 Jan 2008 17:45:53 +0100 Jesús Guerrero <i92guboj@terra.es>
wrote:
> I know nothing about samba+big files, I did never use it with big
> files, but I haven't hear of such a problem before.

As far as I know, Samba doesn't have problems with big files. I've
burned large (>4GB) DVD images on an XP box with not enough space on it
requiring me to store the .iso on my Linux box connected over Samba.
That is, the data was streamed over the network directly to the DVD
drive.


Cheers,
Renat

-- 
Probleme kann man niemals mit derselben Denkweise loesen,
durch die sie entstanden sind.
                                              (Einstein)

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 197 bytes --]

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[Stroller]

On 13 Jan 2008, at 16:45, Jesús Guerrero wrote:
>>> ...
>>> The problem is that fat32 can't handle files that are larger than
>>> 4gb-1byte. So, will still be unable to unzip or unrar that iso  
>>> image.
>>
>> I believe you're mistaken in the direct cause of my problem. I'm
>> using NTFS on the Windows XP machine.
>> ...
>
> Well, that is new info.
>
> If you are using ntfs then the issue is not the one I suspected.

Well, it didn't occur to mention NTFS vs FAT32 in my original post  
because it didn't occur to me that anyone might use FAT32 these days  
(except for portable devices, of course).

> ... I'd blame the wireless
> connection, but if the problem is only with that file, then that  
> should
> not the be proble either.

At the time of posting this morning I had no way to say whether or  
not I could reproduce the problem - this Windows PC gets switched on  
perhaps once every 3 months, and the original file took so long  
copying (over two hours yesterday) that I left it running overnight.

I started another copy going this morning before I made my original  
post on this subject, and when I come back to the machine this  
evening it seems to have finished successfully - that is to say the  
md5sum matches up.

So I apologise to the list for wasting it's time, but having said  
that I know I'm going to want to split & recombine files cross- 
platform again sometime in the future, so I will remember this thread  
for reference. I won't go through making on line posts saying  
"thanks! great idea!" in reply to everyone who posted, but I'd like  
to thank everyone who has replied to my question. (For the record  
Renat Golubchyk's suggestion of split/copy was top of my list until I  
read Florian Philipp's reply, which is obviously pretty much exactly  
what I had in mind in the first place (and therefore requiring no  
additional thinking, always a priority); I am thankful to Jens for  
pointing me at portableapps.com)

Stroller.
--
gentoo-user@lists.gentoo.org mailing list

Re: [gentoo-user] Create mutli-file .zip archives from the command line?

[Hans-Werner Hilse]

Hi,

On Sun, 13 Jan 2008 16:34:01 +0000 Stroller
<stroller@stellar.eclipse.co.uk> wrote:

> The file is the same size in bytes (8056211212) on the destination
> XP machine as it is on the Samba host, but the md5sums (using Sumemr  
> Properties under XP) don't match.

There is also the slight possibility that your md5sum util in Windows
isn't dealing well with file offsets > 4GB. Re-check using a different
one, I'd say.

-hwh
-- 
gentoo-user@lists.gentoo.org mailing list