| View previous topic :: View next topic |
| Author |
Message |
cmay4
Tux's lil' helper
Joined: 18 May 2002
Posts: 109
|
 Posted: Mon Jan 20, 2003 3:42 am Post subject: Samba and 2Gig file size limit |
 |
|
I have Gentoo running a samba server (ext3), and mounting a WinXP NTFS partition with the following line in /etc/fstab:
| Code: | | //winxp/backup /backup smbfs defaults,credentials=/home/may/.smbpasswd,uid=may,gid=users 0 0 |
I use this setup to run nightly backups to the NTFS drive. Once the backup files got bigger than 2GIG, the jobs would fail. I've had files > 2GIG on both the gentoo and winxp boxes, so I know the filesystems will support it. I figure it must be Samba. I am running the newest version of samba in portage, which I though had no file size limitations.
Does anyone know how to get around this problem?
Chuck |
|
| Back to top |
|
 |
krt
Tux's lil' helper
Joined: 27 Nov 2002
Posts: 102
Location: Earth
|
| Posted: Mon Jan 20, 2003 4:00 am Post subject: Re: Samba and 2Gig file size limit |
|
|
| cmay4 wrote: | I have Gentoo running a samba server (ext3), and mounting a WinXP NTFS partition with the following line in /etc/fstab:
| Code: | | //winxp/backup /backup smbfs defaults,credentials=/home/may/.smbpasswd,uid=may,gid=users 0 0 |
I use this setup to run nightly backups to the NTFS drive. Once the backup files got bigger than 2GIG, the jobs would fail. I've had files > 2GIG on both the gentoo and winxp boxes, so I know the filesystems will support it. I figure it must be Samba. I am running the newest version of samba in portage, which I though had no file size limitations.
Does anyone know how to get around this problem?
Chuck |
I've had this problem before ( never did find the answer ), but I can confirm your logic that it is samba causing the error.
_________________
Everyone has something clever for a signature but me. |
|
| Back to top |
|
|
cmay4
Tux's lil' helper
Joined: 18 May 2002
Posts: 109
|
| Posted: Mon Jan 20, 2003 4:05 am Post subject: Hmmm... |
|
|
| Maybe this is just a Samba limitation, although I'm suprised that it would have existed for this long. I have run across many references to this problem, but no answers. I'll keep searching... |
|
| Back to top |
|
|
col
l33t
Joined: 08 May 2002
Posts: 820
Location: Melbourne - Australia
|
| Posted: Mon Jan 20, 2003 4:55 am Post subject: |
|
|
| I had this problem as well but I could not find a solution |
|
| Back to top |
|
|
zhenlin
Veteran
Joined: 09 Nov 2002
Posts: 1361
|
| Posted: Mon Jan 20, 2003 7:39 am Post subject: |
|
|
| User mode programs get 2G in linux, unless I'm mistaken. If using gentoo-sources, you can raise this to 3.5, but if it is a built-in limitation, too bad. |
|
| Back to top |
|
|
xuttuh
n00b
Joined: 05 Jan 2003
Posts: 26
|
| Posted: Mon Jan 20, 2003 9:03 am Post subject: |
|
|
I have seen this limitation with Windows shares. I was creating a image of my gentoo box with ghost. I thought it was just a limitation with ghost since it runs from dos.
_________________
"Bad spellers of the world untie" |
|
| Back to top |
|
|
steveb
Advocate
Joined: 18 Sep 2002
Posts: 4564
|
| Posted: Mon Jan 20, 2003 9:25 am Post subject: Re: Samba and 2Gig file size limit |
|
|
| cmay4 wrote: | I have Gentoo running a samba server (ext3), and mounting a WinXP NTFS partition with the following line in /etc/fstab:
| Code: | | //winxp/backup /backup smbfs defaults,credentials=/home/may/.smbpasswd,uid=may,gid=users 0 0 |
I use this setup to run nightly backups to the NTFS drive. Once the backup files got bigger than 2GIG, the jobs would fail. I've had files > 2GIG on both the gentoo and winxp boxes, so I know the filesystems will support it. I figure it must be Samba. I am running the newest version of samba in portage, which I though had no file size limitations.
Does anyone know how to get around this problem?
Chuck |
i think it is your backup application wich has the limit and not samba. if you are using tar, then it could be tar wich does not allow you to have a >2GB file.
if you want to try if samba has a 2gb limit, try: | Code: | | dd if=/dev/nul of=/backup/bigfile bs=1024k count=2560 |
i would be surpriced, if samba would not produce this ~2.5gb file! but maybe the ntfs filesystem implementation in linux has a 2gb limit?!?
cheers
SteveB |
|
| Back to top |
|
|
cmay4
Tux's lil' helper
Joined: 18 May 2002
Posts: 109
|
| Posted: Mon Jan 20, 2003 7:41 pm Post subject: Big files |
|
|
The dd command didn't work for me (just created a zero byte file on local or samba shares), so I used "cat" to create a large file. It still didn't work:
| Code: | $ ll bigfile
-rw-r--r-- 1 may users 2524065396 Jan 20 14:26 bigfile
$ cp bigfile /backup
File size limit exceeded
|
Does anyone have any ideas? Really seems like a Samba limitation to me.
Chuck |
|
| Back to top |
|
|
col
l33t
Joined: 08 May 2002
Posts: 820
Location: Melbourne - Australia
|
| Posted: Mon Jan 20, 2003 9:43 pm Post subject: |
|
|
| zhenlin wrote: | | User mode programs get 2G in linux, unless I'm mistaken. If using gentoo-sources, you can raise this to 3.5, but if it is a built-in limitation, too bad. |
where in the kernel can you change this ? |
|
| Back to top |
|
|
steveb
Advocate
Joined: 18 Sep 2002
Posts: 4564
|
| Posted: Mon Jan 20, 2003 10:24 pm Post subject: Re: Big files |
|
|
| cmay4 wrote: | The dd command didn't work for me (just created a zero byte file on local or samba shares), so I used "cat" to create a large file. It still didn't work:
| Code: | $ ll bigfile
-rw-r--r-- 1 may users 2524065396 Jan 20 14:26 bigfile
$ cp bigfile /backup
File size limit exceeded
|
Does anyone have any ideas? Really seems like a Samba limitation to me.
Chuck |
sorry!!! i was this morning not 100% awake 
| Code: | | dd if=/dev/random of=/backup/bigfile bs=1024k conv=sync count=2560 |
cheers
SteveB |
|
| Back to top |
|
|
chardros
Tux's lil' helper
Joined: 18 Apr 2002
Posts: 136
Location: Andromeda
|
| Posted: Tue Jan 21, 2003 1:03 am Post subject: |
|
|
I am dealing with this very issue now. I've found a few patches and so forth, and was going to hack up the samba ebuild or something to get LFS support going, but I wanted to see if anyone else had solved it...
The patches I found for smbfs and smbmount are here:
http://www.hojdpunkten.ac.se/054/samba/
Thoughts? Thanks in advance. |
|
| Back to top |
|
|
cmay4
Tux's lil' helper
Joined: 18 May 2002
Posts: 109
|
| Posted: Tue Jan 21, 2003 3:58 am Post subject: |
|
|
| steveb wrote: | sorry!!! i was this morning not 100% awake
| Code: | | dd if=/dev/random of=/backup/bigfile bs=1024k conv=sync count=2560 |
|
| Code: | $ dd if=/dev/random of=/backup/bigfile bs=1024k conv=sync count=2560
File size limit exceeded |
No difference. Definitely the smbfs.
| chardros wrote: | I am dealing with this very issue now. I've found a few patches and so forth, and was going to hack up the samba ebuild or something to get LFS support going, but I wanted to see if anyone else had solved it...
The patches I found for smbfs and smbmount are here:
http://www.hojdpunkten.ac.se/054/samba/
Thoughts? Thanks in advance. |
No thoughts, but I'd love to hear your results. Didn't see any 2.4.19 patches, just 2.4.18.
Chuck |
|
| Back to top |
|
|
cmay4
Tux's lil' helper
Joined: 18 May 2002
Posts: 109
|
| Posted: Thu Jan 23, 2003 5:14 am Post subject: NFS |
|
|
| Does anyone know if NFS has the same limitation? |
|
| Back to top |
|
|
Rhiz()m3
n00b
Joined: 31 Aug 2002
Posts: 41
|
| Posted: Fri Jan 24, 2003 3:13 am Post subject: add these cflags to your makefile |
|
|
add these cflags to your samba makefile: -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64?
this will enable large file support for samba.
http://www.lrz-muenchen.de/services/compute/linux-cluster/develop/LF.html
_________________
--------> Why don't you bastards start wearing human skins?<-------- |
|
| Back to top |
|
|
cmay4
Tux's lil' helper
Joined: 18 May 2002
Posts: 109
|
| Posted: Sat Jan 25, 2003 7:09 pm Post subject: Re: add these cflags to your makefile |
|
|
Thanks for the tip. If I am using the ebuild of Samba, can I just set my CFLAGS environment variable before doing an emerge -u samba? If not, does anyone know how to enable these flags in the ebuild? Thanks. |
|
| Back to top |
|
|
|
Networking & Security
