Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
[NEWS] Final step to smaller, better Portage tree
View unanswered posts
View posts from last 24 hours

Goto page 1, 2  Next  
Reply to topic    Gentoo Forums Forum Index Gentoo Chat
View previous topic :: View next topic  
Author Message
dberkholz
Developer
Developer


Joined: 18 Mar 2003
Posts: 1008
Location: Minneapolis, MN, USA

PostPosted: Tue Feb 05, 2008 7:13 am    Post subject: [NEWS] Final step to smaller, better Portage tree Reply with quote

This forums thread is for discussion of the www.gentoo.org posting, "Final step taken in migration to smaller, better Portage tree." Post your comments and suggestions here.
Quote:
Each ebuild in the Portage tree used to come with its own digest file. When you emerged a package, this digest was used to verify that you had the same files the developer did.

A few days ago, all digest files were erased from the Portage tree in CVS as part of the final work to implement GLEP 44. This migrates that information to a single Manifest file per package instead of one digest for every ebuild of that package.

...
(more on gentoo.org)


Correction: This was just the final step in a long-term migration that actually reduced the size of your Portage tree last February. Thanks to Daniel Drake, Petteri Räty and Jan Kundrat for pointing this out.


Last edited by dberkholz on Wed Feb 06, 2008 7:45 am; edited 2 times in total
Back to top
View user's profile Send private message
yoshi314
l33t
l33t


Joined: 30 Dec 2004
Posts: 819
Location: PL

PostPosted: Tue Feb 05, 2008 8:05 am    Post subject: Reply with quote

nice move.

i still prefer keeping it tucked together on squashfs + aufs mount - there's so many files that copying it over to another pc or just making a compressed backup takes an awful amount of time, though.
_________________
~amd64, ~x86
shrink your /usr/portage with squashfs+aufs
Back to top
View user's profile Send private message
Naib
Advocate
Advocate


Joined: 21 May 2004
Posts: 4184
Location: Removed by Neddy

PostPosted: Tue Feb 05, 2008 8:15 am    Post subject: Reply with quote

niiiice
_________________
A free press is the unsleeping guardian of every other right that free men prize; it is the most dangerous foe of tyranny. Where men have the habit of liberty, the Press will continue to be the vigilant guardian of the rights of the ordinary citizen.
Back to top
View user's profile Send private message
StifflerStealth
l33t
l33t


Joined: 03 Jul 2002
Posts: 960

PostPosted: Tue Feb 05, 2008 9:49 am    Post subject: Reply with quote

If we do our own ebuilds, how do we have it so there is not digest file? ebuild foo manifest creates a blank digest file. What's the official command?
_________________
Nothing to read in this sig. Move along.
Back to top
View user's profile Send private message
Chewi
l33t
l33t


Joined: 01 Sep 2003
Posts: 789
Location: Edinburgh, Scotland

PostPosted: Tue Feb 05, 2008 10:00 am    Post subject: Reply with quote

Awesome! I've been thinking the tree is way too big for a couple of years now. This really helps.
Back to top
View user's profile Send private message
Voltago
Advocate
Advocate


Joined: 02 Sep 2003
Posts: 2550
Location: In the city of dreaming spires

PostPosted: Tue Feb 05, 2008 10:10 am    Post subject: Reply with quote

StifflerStealth wrote:
What's the official command?

Code:
emerge =portage-2.1.4.1
Back to top
View user's profile Send private message
likewhoa
l33t
l33t


Joined: 04 Oct 2006
Posts: 743
Location: Brooklyn, New York

PostPosted: Tue Feb 05, 2008 10:12 am    Post subject: Reply with quote

good progress into GLEP features.
Back to top
View user's profile Send private message
V-Li
Developer
Developer


Joined: 03 Jan 2006
Posts: 601

PostPosted: Tue Feb 05, 2008 10:14 am    Post subject: Reply with quote

StifflerStealth wrote:
If we do our own ebuilds, how do we have it so there is not digest file? ebuild foo manifest creates a blank digest file. What's the official command?


Put the file manifest1_obsolete in the root of your own tree.
_________________
Christian Faulhammer, Gentoo Lisp project, GNU Emacs wrangler
http://www.gentoo.org/proj/en/lisp/ #gentoo-lisp on FreeNode
Back to top
View user's profile Send private message
slackline
Veteran
Veteran


Joined: 01 Apr 2005
Posts: 1336
Location: /uk/sheffield

PostPosted: Tue Feb 05, 2008 10:32 am    Post subject: Reply with quote

Sweet, good work to those who've implemented this, great, simple way of saving space.
Back to top
View user's profile Send private message
Xake
Guru
Guru


Joined: 11 Feb 2004
Posts: 588
Location: Göteborg, the rainy part of scandinavia

PostPosted: Tue Feb 05, 2008 10:46 am    Post subject: Reply with quote

StifflerStealth wrote:
If we do our own ebuilds, how do we have it so there is not digest file? ebuild foo manifest creates a blank digest file. What's the official command?


Code:
touch  manifest1_obsolete
Back to top
View user's profile Send private message
jomen
Guru
Guru


Joined: 04 Jan 2006
Posts: 536
Location: Leipzig, Germany

PostPosted: Tue Feb 05, 2008 11:11 am    Post subject: Reply with quote

I was using "porthole" for a graphical overview of available and installed packages.
Never used it to actually install stuff.
About 3 weeks back from now I was irritated to see that every single ebuild on my system was suddenly marked as:
[bad/blank digest]
I suppose the news discussed here is the reason for this behaviour?
What would I need to do to let porthole show valid ebuilds again instead of [bad/blank digest]?
this?
Code:
touch  manifest1_obsolete

where?

[edit]
Its nice to save some disc-space by this - I have solved this issue for me in the past by having a small partition for /usr/portage (excluding /usr/portage/distfiles)
which I created like so:
mke2fs -j -m 0 -b 1024 -i 1024 /dev/hdXx
to not waste so much space on lots of small files
_________________
Cheers
Back to top
View user's profile Send private message
V-Li
Developer
Developer


Joined: 03 Jan 2006
Posts: 601

PostPosted: Tue Feb 05, 2008 12:21 pm    Post subject: Reply with quote

manifest1_obsolete is only for people preparing own ebuilds. The ebuild tool then does NOT create digest files anymore...for Porthole, I think you need an update.
_________________
Christian Faulhammer, Gentoo Lisp project, GNU Emacs wrangler
http://www.gentoo.org/proj/en/lisp/ #gentoo-lisp on FreeNode
Back to top
View user's profile Send private message
d2_racing
Moderator
Moderator


Joined: 25 Apr 2005
Posts: 13046
Location: Ste-Foy,Canada

PostPosted: Tue Feb 05, 2008 12:43 pm    Post subject: Reply with quote

Nice :)
_________________
Sysadmin of GentooQuébec.org
Wiki
Signature
IRC on Freenode : #gentoo-quebec
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5737
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Tue Feb 05, 2008 1:03 pm    Post subject: Reply with quote

likewhoa wrote:
good progress into GLEP features.


++

thanks a lot :)

this should also put less stress on the rsync mirrors 8)
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.3.0-r2
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
d2_racing
Moderator
Moderator


Joined: 25 Apr 2005
Posts: 13046
Location: Ste-Foy,Canada

PostPosted: Tue Feb 05, 2008 1:06 pm    Post subject: Reply with quote

And maybe the emerge --sync will be faster...
_________________
Sysadmin of GentooQuébec.org
Wiki
Signature
IRC on Freenode : #gentoo-quebec
Back to top
View user's profile Send private message
jlh
Tux's lil' helper
Tux's lil' helper


Joined: 06 May 2007
Posts: 144
Location: Switzerland::Zürich

PostPosted: Tue Feb 05, 2008 1:25 pm    Post subject: Reply with quote

Very nice! I keep my tree on a loop-mounted 1k-filesystem and even this way I saved over 20MB for a new total of about 240MB.

I hope to see even more improvements to the tree in the future. :)
Back to top
View user's profile Send private message
Mikachu
n00b
n00b


Joined: 03 Jan 2005
Posts: 2

PostPosted: Tue Feb 05, 2008 1:39 pm    Post subject: Reply with quote

and i have mine on an xfs fs with 512 byte blocks :).
155M /usr/portage/
Back to top
View user's profile Send private message
jomen
Guru
Guru


Joined: 04 Jan 2006
Posts: 536
Location: Leipzig, Germany

PostPosted: Tue Feb 05, 2008 1:39 pm    Post subject: Reply with quote

Quote:
...for Porthole, I think you need an update.

The latest version is 0.5 from December 2005 - no updates to reflect the changes to portage discussed here.
I already re-emerged it and nothing changed - it has just two USE-Flags ("nls" and "debug")
I think I'll go for "himerge" or "portato"...
_________________
Cheers
Back to top
View user's profile Send private message
Xake
Guru
Guru


Joined: 11 Feb 2004
Posts: 588
Location: Göteborg, the rainy part of scandinavia

PostPosted: Tue Feb 05, 2008 1:48 pm    Post subject: Reply with quote

jomen wrote:
Quote:
...for Porthole, I think you need an update.

The latest version is 0.5 from December 2005 - no updates to reflect the changes to portage discussed here.
I already re-emerged it and nothing changed - it has just two USE-Flags ("nls" and "debug")
I think I'll go for "himerge" or "portato"...


https://sourceforge.net/tracker/index.php?func=detail&aid=1729279&group_id=96324&atid=614397
The bugreport for your problem in question, and as you can see people has had this problem since at least 2007-05, and as the maintainer have not had the time to make a new release since then (he said 2007-08 that he have had the fix in CVS for some time) I believe you're better off with another pkg-manager until he does have the time. Or someone fork.

EDIT: On the other hand you may not give up on porthole yet, 4 days ago the NEWS file had text added for an upcoming 0.6.0 release. So we may just have to hope it will soon be released. On the other hand himerge and portato is installable and should work side by side with porthole if you do not want to wait...;)
Back to top
View user's profile Send private message
Betelgeuse
Developer
Developer


Joined: 10 Aug 2004
Posts: 12
Location: Finland

PostPosted: Tue Feb 05, 2008 1:57 pm    Post subject: Bit missleading Reply with quote

Portage has been filtering digests from --sync for quite a while so the only difference users are going to see is a potentially faster sync as the server side doesn't have the digests any more.
Back to top
View user's profile Send private message
i92guboj
Moderator
Moderator


Joined: 30 Nov 2004
Posts: 10117
Location: Córdoba (Spain)

PostPosted: Tue Feb 05, 2008 2:09 pm    Post subject: Reply with quote

Not that I care too much... I never used any graphical frontend for any serious portage stuff, but I don't know what the current state of porthole is. In any case, if you are really interested you should checkout from cvs, the released versions are really really old and will not work ok with current portage versions.
_________________
Gentoo Handbook | My website
Back to top
View user's profile Send private message
jomen
Guru
Guru


Joined: 04 Jan 2006
Posts: 536
Location: Leipzig, Germany

PostPosted: Tue Feb 05, 2008 2:18 pm    Post subject: Reply with quote

Quote:
The bugreport for your problem in question, and as you can see people has had this problem since at least 2007-05

The [Bad/Blank digest] thing is not that long ago (for me)...and I was searching to find out why I had this "problem".
Did not find the bugreport you directed me to though - thanks!
If I'd found it I'd have known about the change to portage which until now slipped by my attention.
Since I use Porthole only to have a better overview of what is in the repositories and do everything else on command-line I'll just keep using it - I like the clean Interface...or am just used to it.
_________________
Cheers
Back to top
View user's profile Send private message
timeBandit
Bodhisattva
Bodhisattva


Joined: 31 Dec 2004
Posts: 2672
Location: here, there or in transit

PostPosted: Tue Feb 05, 2008 2:32 pm    Post subject: Reply with quote

jomen wrote:
Since I use Porthole only to have a better overview of what is in the repositories and do everything else on command-line ....
Same here.

Kind of a non-event since the digest files have been gone for a while on the user side, but it's good to see the announcement in case of any problems. Either way, Commander Keen approves--he's all about saving space. :wink: (Or at least Earth.)
_________________
Plants are pithy, brooks tend to babble--I'm content to lie between them.
Super-short f.g.o checklist: Search first, strip comments, mark solved, help others.
Back to top
View user's profile Send private message
jancici
Apprentice
Apprentice


Joined: 27 Jan 2004
Posts: 284
Location: Slovakia

PostPosted: Tue Feb 05, 2008 3:23 pm    Post subject: Reply with quote

I did run two commands
Code:
du -s /usr/portage/
2633079   /usr/portage/
du -s /usr/portage/distfiles/
2161991   /usr/portage/distfiles/


so my tree is 471088 big cca 460MB
I dont know how big it was beffore
Back to top
View user's profile Send private message
yoshi314
l33t
l33t


Joined: 30 Dec 2004
Posts: 819
Location: PL

PostPosted: Tue Feb 05, 2008 5:19 pm    Post subject: Reply with quote

my squashfs image went down from ~42-45 mb do 38mb. not bad.
_________________
~amd64, ~x86
shrink your /usr/portage with squashfs+aufs
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Gentoo Chat All times are GMT
Goto page 1, 2  Next
Page 1 of 2

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum