Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Comparsion of different filesystems for portage. Save space!
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Gentoo Chat
View previous topic :: View next topic  
Author Message
Phlogiston
Veteran
Veteran


Joined: 27 Jan 2004
Posts: 1925
Location: Europe, Swizerland

PostPosted: Thu Mar 02, 2006 10:59 am    Post subject: Comparsion of different filesystems for portage. Save space! Reply with quote

Hi guys

I wrote a report about different filesystems for the portage directory. Some parts of it might be quite interesting for you. Although I'm not sure if I shall post it in the Tips and Tricks section.

You can find the report on my homepage.

Thanks for having a look at it.

I'm looking forward to every comment and feedback, so I can improve it or correct mistakes.

Phlogiston
_________________
Workstation: 5.1 SurroundSound, LIRC remote control; Laptop [IBM-T43]: patched sources, s2disk/ram, fingerprint sensor
Back to top
View user's profile Send private message
pjp
Administrator
Administrator


Joined: 16 Apr 2002
Posts: 18293

PostPosted: Thu Mar 02, 2006 6:10 pm    Post subject: Reply with quote

Hmm. I skipped to the charts, then went back to where you covered what fses were being tested. I'm not interested in reiser or xfs, so can't say its helpful to me.

With the cost of disk space these days, 'saving space' seems about as pointless as 'not needing a journaling fs for portage, because you can just sync.'

It'd be handy if you could add ext3 along with some others, just as points of reference. At any rate, a generally interesting topic.
_________________
Don't even pause and ask them why. Turn around and say goodbye.
Back to top
View user's profile Send private message
Genone
Retired Dev
Retired Dev


Joined: 14 Mar 2003
Posts: 9236
Location: beyond the rim

PostPosted: Thu Mar 02, 2006 10:03 pm    Post subject: Reply with quote

Would be interesting to see how squashfs would fit into this speedwise (it would definitely win the size contest ;))
Back to top
View user's profile Send private message
Monkeh
Veteran
Veteran


Joined: 06 Aug 2005
Posts: 1656
Location: England

PostPosted: Thu Mar 02, 2006 11:02 pm    Post subject: Reply with quote

Genone wrote:
Would be interesting to see how squashfs would fit into this speedwise (it would definitely win the size contest ;))


Doubt it could be much slower than ReiserFS.. (my old machine's install using reiser for / is unusably slow)
Back to top
View user's profile Send private message
Phlogiston
Veteran
Veteran


Joined: 27 Jan 2004
Posts: 1925
Location: Europe, Swizerland

PostPosted: Thu Mar 02, 2006 11:20 pm    Post subject: Reply with quote

Genone wrote:
Would be interesting to see how squashfs would fit into this speedwise (it would definitely win the size contest ;))


I'm sorry but where can I find squashfs? Whats the point about it? I'll read some docs... 8)

/edit: Ok I found it in menuconfig :wink: So now I need some infos about how to use it...
_________________
Workstation: 5.1 SurroundSound, LIRC remote control; Laptop [IBM-T43]: patched sources, s2disk/ram, fingerprint sensor
Back to top
View user's profile Send private message
Phlogiston
Veteran
Veteran


Joined: 27 Jan 2004
Posts: 1925
Location: Europe, Swizerland

PostPosted: Thu Mar 02, 2006 11:24 pm    Post subject: Reply with quote

pjp wrote:


With the cost of disk space these days, 'saving space' seems about as pointless as 'not needing a journaling fs for portage, because you can just sync.'

It'd be handy if you could add ext3 along with some others, just as points of reference. At any rate, a generally interesting topic.


I really agree to the first point.

About ext3, I have some data about ext3, but they are nearly the same as ext2, because in general ext3 is just ext2 with journal 8)
_________________
Workstation: 5.1 SurroundSound, LIRC remote control; Laptop [IBM-T43]: patched sources, s2disk/ram, fingerprint sensor
Back to top
View user's profile Send private message
Phlogiston
Veteran
Veteran


Joined: 27 Jan 2004
Posts: 1925
Location: Europe, Swizerland

PostPosted: Fri Mar 03, 2006 12:16 am    Post subject: Reply with quote

Phlogiston wrote:
Genone wrote:
Would be interesting to see how squashfs would fit into this speedwise (it would definitely win the size contest ;))


I'm sorry but where can I find squashfs? Whats the point about it? I'll read some docs... 8)

/edit: Ok I found it in menuconfig :wink: So now I need some infos about how to use it...


/edit2: Of course squashfs could be intersting but all in all it does not seem like it would be usable:
Quote:
[...] Squashfs is a read-only file system that lets you compress whole file systems or single directories, write them to other devices/partitions or to ordinary file [...]

_________________
Workstation: 5.1 SurroundSound, LIRC remote control; Laptop [IBM-T43]: patched sources, s2disk/ram, fingerprint sensor
Back to top
View user's profile Send private message
Genone
Retired Dev
Retired Dev


Joined: 14 Mar 2003
Posts: 9236
Location: beyond the rim

PostPosted: Fri Mar 03, 2006 12:21 am    Post subject: Reply with quote

Well, if we ever figure out a way to create usable deltas between two squashfs images it could become very useful.
Back to top
View user's profile Send private message
truekaiser
l33t
l33t


Joined: 05 Mar 2004
Posts: 762

PostPosted: Fri Mar 03, 2006 1:13 am    Post subject: Reply with quote

hmm i think this is a good idea for the perfomance alone.
*keeps this thread in mind for next install.
Back to top
View user's profile Send private message
PaveQ
Apprentice
Apprentice


Joined: 11 Feb 2005
Posts: 225
Location: Finland

PostPosted: Fri Mar 03, 2006 12:39 pm    Post subject: Reply with quote

What about unionfs?
Back to top
View user's profile Send private message
Phlogiston
Veteran
Veteran


Joined: 27 Jan 2004
Posts: 1925
Location: Europe, Swizerland

PostPosted: Fri Mar 03, 2006 4:14 pm    Post subject: Reply with quote

PaveQ wrote:
What about unionfs?


Would unionfs have a purpose for using it for portage?

I don't know much about unionfs.
Quote:

Unionfs is a stackable unification file system, which can
appear to merge the contents of several directories (branches),
while keeping their physical content separate.

<http://www.fsl.cs.sunysb.edu/project-unionfs.html>

_________________
Workstation: 5.1 SurroundSound, LIRC remote control; Laptop [IBM-T43]: patched sources, s2disk/ram, fingerprint sensor
Back to top
View user's profile Send private message
Gergan Penkov
Veteran
Veteran


Joined: 17 Jul 2004
Posts: 1464
Location: das kleinste Kuhdorf Deutschlands :)

PostPosted: Sat Mar 04, 2006 1:17 am    Post subject: Reply with quote

Probably using some fuse-fs, there are two or three possibilities, but the idea is interesting.
Portage should be much faster using compressed fs - I'm going to experiment a little bit with the alternatives :)
ref:
http://parallel.vub.ac.be/~johan/compFUSEd/
http://north.one.pl/~kazik/pub/LZOlayer/
http://www.miio.net/fusecompress/
_________________
"I knew when an angel whispered into my ear,
You gotta get him away, yeah
Hey little bitch!
Be glad you finally walked away or you may have not lived another day."
Godsmack
Back to top
View user's profile Send private message
makomk
n00b
n00b


Joined: 15 Jul 2005
Posts: 46
Location: Not all there

PostPosted: Sat Mar 04, 2006 7:40 pm    Post subject: Reply with quote

Genone wrote:
Would be interesting to see how squashfs would fit into this speedwise (it would definitely win the size contest ;))


It does - about 30M for a complete copy of Portage. The speed doesn't seem too bad, either (though I haven't carried out any formal tests) - could be because, in Squashfs 2.1, the directories are apparently sorted and (optionally) indexed. I eventually gave up on it because my hacked mksquashfs (which supported reading from uncompressed tarballs) truncated long paths.

Genone wrote:
Well, if we ever figure out a way to create usable deltas between two squashfs images it could become very useful.


Should be theoretically possible; I keep meaning to figure out the structure of squashfs and create a delta-generator, but never find the time. It'd be very neat - you could just download a small delta file, apply it to the old squashfs image, and use the result as-is.

Edit:
Phlogiston wrote:
Would unionfs have a purpose for using it for portage?


One of the ways you could produce an updated squashfs image is to mount a read-write filesystem over the top using unionfs, run "emerge --sync", and then use mksquashfs to generate the new image. I'm not sure how well this works in practice; IIRC some people tried this and had problems with it for some reason.


Last edited by makomk on Sat Mar 04, 2006 7:44 pm; edited 1 time in total
Back to top
View user's profile Send private message
Phlogiston
Veteran
Veteran


Joined: 27 Jan 2004
Posts: 1925
Location: Europe, Swizerland

PostPosted: Sat Mar 18, 2006 1:41 pm    Post subject: Reply with quote

There's a howto for squashfs here. It takes about 50Mb's 8)
_________________
Workstation: 5.1 SurroundSound, LIRC remote control; Laptop [IBM-T43]: patched sources, s2disk/ram, fingerprint sensor
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Gentoo Chat All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum