| View previous topic :: View next topic |
| Author |
Message |
dberkholz
Developer
Joined: 18 Mar 2003
Posts: 1008
Location: Rochester, MN, USA
|
 Posted: Tue Feb 05, 2008 7:13 am Post subject: [NEWS] Final step to smaller, better Portage tree |
 |
|
This forums thread is for discussion of the www.gentoo.org posting, "Final step taken in migration to smaller, better Portage tree." Post your comments and suggestions here.
| Quote: | Each ebuild in the Portage tree used to come with its own digest file. When you emerged a package, this digest was used to verify that you had the same files the developer did.
A few days ago, all digest files were erased from the Portage tree in CVS as part of the final work to implement GLEP 44. This migrates that information to a single Manifest file per package instead of one digest for every ebuild of that package.
...
(more on gentoo.org) |
Correction: This was just the final step in a long-term migration that actually reduced the size of your Portage tree last February. Thanks to Daniel Drake, Petteri Räty and Jan Kundrat for pointing this out.
_________________
Do unto others as you would have them do unto you.
What goes around comes around.
Blog: http://dberkholz.com/
Last edited by dberkholz on Wed Feb 06, 2008 7:45 am; edited 2 times in total |
|
| Back to top |
|
 |
yoshi314
l33t
Joined: 30 Dec 2004
Posts: 782
Location: PL
|
| Posted: Tue Feb 05, 2008 8:05 am Post subject: |
|
|
nice move.
i still prefer keeping it tucked together on squashfs + aufs mount - there's so many files that copying it over to another pc or just making a compressed backup takes an awful amount of time, though.
_________________
~amd64, ~x86
shrink your /usr/portage with squashfs+aufs |
|
| Back to top |
|
|
Naib
Advocate
Joined: 21 May 2004
Posts: 3891
Location: UK - Birmingham
|
| Posted: Tue Feb 05, 2008 8:15 am Post subject: |
|
|
niiiice
_________________
| Quote: | | Voting holds no real power, he who counts the votes has the true power. |
Weaver Projects
whats the difference between 9/11 and a cow?
u stop milking a cow after 10 years |
|
| Back to top |
|
|
StifflerStealth
l33t
Joined: 03 Jul 2002
Posts: 954
|
| Posted: Tue Feb 05, 2008 9:49 am Post subject: |
|
|
If we do our own ebuilds, how do we have it so there is not digest file? ebuild foo manifest creates a blank digest file. What's the official command?
_________________
Nothing to read in this sig. Move along. |
|
| Back to top |
|
|
Chewi
l33t
Joined: 01 Sep 2003
Posts: 725
Location: Perth, Scotland
|
| Posted: Tue Feb 05, 2008 10:00 am Post subject: |
|
|
| Awesome! I've been thinking the tree is way too big for a couple of years now. This really helps. |
|
| Back to top |
|
|
Voltago
Advocate
Joined: 02 Sep 2003
Posts: 2482
Location: Hinter den Materiequellen
|
| Posted: Tue Feb 05, 2008 10:10 am Post subject: |
|
|
| StifflerStealth wrote: | | What's the official command? |
| Code: | | emerge =portage-2.1.4.1 |
|
|
| Back to top |
|
|
likewhoa
l33t
Joined: 04 Oct 2006
Posts: 693
Location: Brooklyn, New York
|
| Posted: Tue Feb 05, 2008 10:12 am Post subject: |
|
|
| good progress into GLEP features. |
|
| Back to top |
|
|
V-Li
Developer
Joined: 03 Jan 2006
Posts: 597
|
| Posted: Tue Feb 05, 2008 10:14 am Post subject: |
|
|
| StifflerStealth wrote: | | If we do our own ebuilds, how do we have it so there is not digest file? ebuild foo manifest creates a blank digest file. What's the official command? |
Put the file manifest1_obsolete in the root of your own tree.
_________________
Christian Faulhammer, Gentoo Lisp project, GNU Emacs wrangler
http://www.gentoo.org/proj/en/lisp/ #gentoo-lisp on FreeNode
http://gentoo.faulhammer.org/ |
|
| Back to top |
|
|
slack---line
Veteran
Joined: 01 Apr 2005
Posts: 1244
Location: /uk/sheffield
|
| Posted: Tue Feb 05, 2008 10:32 am Post subject: |
|
|
| Sweet, good work to those who've implemented this, great, simple way of saving space. |
|
| Back to top |
|
|
Xake
Guru
Joined: 11 Feb 2004
Posts: 587
Location: Göteborg, the rainy part of scandinavia
|
| Posted: Tue Feb 05, 2008 10:46 am Post subject: |
|
|
| StifflerStealth wrote: | | If we do our own ebuilds, how do we have it so there is not digest file? ebuild foo manifest creates a blank digest file. What's the official command? |
| Code: | | touch manifest1_obsolete |
|
|
| Back to top |
|
|
jomen
Guru
Joined: 04 Jan 2006
Posts: 536
Location: Leipzig, Germany
|
| Posted: Tue Feb 05, 2008 11:11 am Post subject: |
|
|
I was using "porthole" for a graphical overview of available and installed packages.
Never used it to actually install stuff.
About 3 weeks back from now I was irritated to see that every single ebuild on my system was suddenly marked as:
[bad/blank digest]
I suppose the news discussed here is the reason for this behaviour?
What would I need to do to let porthole show valid ebuilds again instead of [bad/blank digest]?
this?
| Code: | | touch manifest1_obsolete |
where?
[edit]
Its nice to save some disc-space by this - I have solved this issue for me in the past by having a small partition for /usr/portage (excluding /usr/portage/distfiles)
which I created like so:
mke2fs -j -m 0 -b 1024 -i 1024 /dev/hdXx
to not waste so much space on lots of small files
_________________
Cheers |
|
| Back to top |
|
|
V-Li
Developer
Joined: 03 Jan 2006
Posts: 597
|
| Posted: Tue Feb 05, 2008 12:21 pm Post subject: |
|
|
manifest1_obsolete is only for people preparing own ebuilds. The ebuild tool then does NOT create digest files anymore...for Porthole, I think you need an update.
_________________
Christian Faulhammer, Gentoo Lisp project, GNU Emacs wrangler
http://www.gentoo.org/proj/en/lisp/ #gentoo-lisp on FreeNode
http://gentoo.faulhammer.org/ |
|
| Back to top |
|
|
d2_racing
Moderator
Joined: 25 Apr 2005
Posts: 12867
Location: Ste-Foy,Canada
|
|
| Back to top |
|
|
kernelOfTruth
Watchman
Joined: 20 Dec 2005
Posts: 5345
Location: Vienna, Austria; Germany; hello world :)
|
|
| Back to top |
|
|
d2_racing
Moderator
Joined: 25 Apr 2005
Posts: 12867
Location: Ste-Foy,Canada
|
| Posted: Tue Feb 05, 2008 1:06 pm Post subject: |
|
|
And maybe the emerge --sync will be faster...
_________________
Sysadmin of Funtoo-Québec.org
Wiki
Signature
IRC on Freenode : #funtoo-quebec |
|
| Back to top |
|
|
jlh
Tux's lil' helper
Joined: 06 May 2007
Posts: 144
Location: Switzerland::Zürich
|
| Posted: Tue Feb 05, 2008 1:25 pm Post subject: |
|
|
Very nice! I keep my tree on a loop-mounted 1k-filesystem and even this way I saved over 20MB for a new total of about 240MB.
I hope to see even more improvements to the tree in the future.  |
|
| Back to top |
|
|
Mikachu
n00b
Joined: 03 Jan 2005
Posts: 2
|
| Posted: Tue Feb 05, 2008 1:39 pm Post subject: |
|
|
and i have mine on an xfs fs with 512 byte blocks :).
155M /usr/portage/ |
|
| Back to top |
|
|
jomen
Guru
Joined: 04 Jan 2006
Posts: 536
Location: Leipzig, Germany
|
| Posted: Tue Feb 05, 2008 1:39 pm Post subject: |
|
|
| Quote: | | ...for Porthole, I think you need an update. |
The latest version is 0.5 from December 2005 - no updates to reflect the changes to portage discussed here.
I already re-emerged it and nothing changed - it has just two USE-Flags ("nls" and "debug")
I think I'll go for "himerge" or "portato"...
_________________
Cheers |
|
| Back to top |
|
|
Xake
Guru
Joined: 11 Feb 2004
Posts: 587
Location: Göteborg, the rainy part of scandinavia
|
| Posted: Tue Feb 05, 2008 1:48 pm Post subject: |
|
|
| jomen wrote: | | Quote: | | ...for Porthole, I think you need an update. |
The latest version is 0.5 from December 2005 - no updates to reflect the changes to portage discussed here.
I already re-emerged it and nothing changed - it has just two USE-Flags ("nls" and "debug")
I think I'll go for "himerge" or "portato"... |
https://sourceforge.net/tracker/index.php?func=detail&aid=1729279&group_id=96324&atid=614397
The bugreport for your problem in question, and as you can see people has had this problem since at least 2007-05, and as the maintainer have not had the time to make a new release since then (he said 2007-08 that he have had the fix in CVS for some time) I believe you're better off with another pkg-manager until he does have the time. Or someone fork.
EDIT: On the other hand you may not give up on porthole yet, 4 days ago the NEWS file had text added for an upcoming 0.6.0 release. So we may just have to hope it will soon be released. On the other hand himerge and portato is installable and should work side by side with porthole if you do not want to wait... |
|
| Back to top |
|
|
Betelgeuse
Developer
Joined: 10 Aug 2004
Posts: 12
Location: Finland
|
| Posted: Tue Feb 05, 2008 1:57 pm Post subject: Bit missleading |
|
|
| Portage has been filtering digests from --sync for quite a while so the only difference users are going to see is a potentially faster sync as the server side doesn't have the digests any more. |
|
| Back to top |
|
|
i92guboj
Moderator
Joined: 30 Nov 2004
Posts: 9313
Location: Córdoba (Spain)
|
| Posted: Tue Feb 05, 2008 2:09 pm Post subject: |
|
|
Not that I care too much... I never used any graphical frontend for any serious portage stuff, but I don't know what the current state of porthole is. In any case, if you are really interested you should checkout from cvs, the released versions are really really old and will not work ok with current portage versions.
_________________
Gentoo Handbook |
|
| Back to top |
|
|
jomen
Guru
Joined: 04 Jan 2006
Posts: 536
Location: Leipzig, Germany
|
| Posted: Tue Feb 05, 2008 2:18 pm Post subject: |
|
|
| Quote: | | The bugreport for your problem in question, and as you can see people has had this problem since at least 2007-05 |
The [Bad/Blank digest] thing is not that long ago (for me)...and I was searching to find out why I had this "problem".
Did not find the bugreport you directed me to though - thanks!
If I'd found it I'd have known about the change to portage which until now slipped by my attention.
Since I use Porthole only to have a better overview of what is in the repositories and do everything else on command-line I'll just keep using it - I like the clean Interface...or am just used to it.
_________________
Cheers |
|
| Back to top |
|
|
timeBandit
Administrator
Joined: 31 Dec 2004
Posts: 2667
Location: here, there or in transit
|
| Posted: Tue Feb 05, 2008 2:32 pm Post subject: |
|
|
| jomen wrote: | | Since I use Porthole only to have a better overview of what is in the repositories and do everything else on command-line .... |
Same here.
Kind of a non-event since the digest files have been gone for a while on the user side, but it's good to see the announcement in case of any problems. Either way, Commander Keen approves--he's all about saving space. (Or at least Earth.)
_________________
Plants are pithy, brooks tend to babble--I'm content to lie between them.
Super-short f.g.o checklist: Search first, strip comments, mark solved, help others. |
|
| Back to top |
|
|
jancici
Apprentice
Joined: 27 Jan 2004
Posts: 284
Location: Slovakia
|
| Posted: Tue Feb 05, 2008 3:23 pm Post subject: |
|
|
I did run two commands
| Code: | du -s /usr/portage/
2633079 /usr/portage/
du -s /usr/portage/distfiles/
2161991 /usr/portage/distfiles/ |
so my tree is 471088 big cca 460MB
I dont know how big it was beffore |
|
| Back to top |
|
|
yoshi314
l33t
Joined: 30 Dec 2004
Posts: 782
Location: PL
|
|
| Back to top |
|
|
|
Gentoo Chat
