Unix Technical Forum

large file problem in older slackware setups

This is a discussion on large file problem in older slackware setups within the Slackware Linux Support forums, part of the Unix Operating Systems category; --> My newer slackware machines (I guess 9.0 or later, but maybe 8.1) are OK with large files. I have ...


Go Back   Unix Technical Forum > Unix Operating Systems > Slackware Linux Support

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 02-19-2008, 03:20 PM
mack
 
Posts: n/a
Default large file problem in older slackware setups

My newer slackware machines (I guess 9.0 or later, but
maybe 8.1) are OK with large files.

I have a set of older machines that have been continuously
upgraded from 3.2 (now at glibc-2.3.2, kernel-2.4.26,
gcc-3.2.2, binutils-2.13.2.1 etc, all of which have
been compiled from source).
These machines will only write files about 1073M.
This is 1G and not the supposed 2G limit.

I upgrade all machines in step by compiling from source,
the only difference (that I know of) in the two sets
of machines is that some started at 8.1/9.0 and the
rest started at 3.2.

The test is

dd if=/dev/zero of=./zero.zero bs=1000000 count=3000

the test will either run to completion with a 3G file
or exit with an error like "file too big" leaving a 1G file.

o dd seems to be OK
running dd under strace I see that it has largefile support.

o the file system seems to be OK
I can nfs export the filesystem and have another machine write a
file larger than 1G.

Since the only libraries that dd depend on are from glibc, I installed
glibc binaries from the tgz file from slackware-9.1 but still the largest
file I can make is 1G.

I've looked in google, at all the sites telling how to upgrade to
large file support (all seem to need flags in the compiles, but
I can't figure out how to set those flags for the glibc compile
since glibc has its own configure script - I did spend a few
days trying though).

Anyone know why I have a 1G file limit and how to fix it?

Thanks Joe

--
Joseph Mack NA3T EME(B,D), FM05lw North Carolina
jmack (at) wm7d (dot) net - azimuthal equidistant map
generator at http://www.wm7d.net/azproj.shtml
Homepage http://www.austintek.com/ It's GNU/Linux!
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 02-19-2008, 03:20 PM
NeoSadist
 
Posts: n/a
Default Re: large file problem in older slackware setups

mack wrote:

> My newer slackware machines (I guess 9.0 or later, but
> maybe 8.1) are OK with large files.
>
> I have a set of older machines that have been continuously
> upgraded from 3.2 (now at glibc-2.3.2, kernel-2.4.26,
> gcc-3.2.2, binutils-2.13.2.1 etc, all of which have
> been compiled from source).
> These machines will only write files about 1073M.
> This is 1G and not the supposed 2G limit.
>
> I upgrade all machines in step by compiling from source,
> the only difference (that I know of) in the two sets
> of machines is that some started at 8.1/9.0 and the
> rest started at 3.2.
>
> The test is
>
> dd if=/dev/zero of=./zero.zero bs=1000000 count=3000
>
> the test will either run to completion with a 3G file
> or exit with an error like "file too big" leaving a 1G file.
>
> o dd seems to be OK
> running dd under strace I see that it has largefile support.
>
> o the file system seems to be OK
> I can nfs export the filesystem and have another machine write a
> file larger than 1G.
>
> Since the only libraries that dd depend on are from glibc, I installed
> glibc binaries from the tgz file from slackware-9.1 but still the largest
> file I can make is 1G.
>
> I've looked in google, at all the sites telling how to upgrade to
> large file support (all seem to need flags in the compiles, but
> I can't figure out how to set those flags for the glibc compile
> since glibc has its own configure script - I did spend a few
> days trying though).
>
> Anyone know why I have a 1G file limit and how to fix it?
>
> Thanks Joe


You must have 4k block sizes.

--
A great many people think they are thinking when they are merely
rearranging their prejudices.
-- William James

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 02-19-2008, 03:21 PM
mack
 
Posts: n/a
Default Re: large file problem in older slackware setups

NeoSadist wrote:
>


> You must have 4k block sizes.


Thanks for the reply.

I assume you mean that to get files >1GB I need to be
using 4k block sizes.

I hadn't thought of that, but it turns out that I already
am using 4k blocks.

eg a disk with 4k block size on a machine that will only
write a 1GB file - if I then nfs export to a machine that will
write a file >2GB on its own file systems, the disk will now
accept files >2G when written by the other machine.
So it doesn't seem to be a function of the filesystem.

All machines are using e2fsprogs v1.32 from Nov 2002

Any other suggestions?

Thanks
Joe

--
Joseph Mack NA3T EME(B,D), FM05lw North Carolina
jmack (at) wm7d (dot) net - azimuthal equidistant map
generator at http://www.wm7d.net/azproj.shtml
Homepage http://www.austintek.com/ It's GNU/Linux!
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 10:29 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.2.0
www.UnixAdminTalk.com