View previous topic :: View next topic |
Author |
Message |
dberkholz Retired Dev
Joined: 18 Mar 2003 Posts: 1008 Location: Minneapolis, MN, USA
|
Posted: Tue Feb 05, 2008 7:13 am Post subject: [NEWS] Final step to smaller, better Portage tree |
|
|
This forums thread is for discussion of the www.gentoo.org posting, "Final step taken in migration to smaller, better Portage tree." Post your comments and suggestions here.
Quote: | Each ebuild in the Portage tree used to come with its own digest file. When you emerged a package, this digest was used to verify that you had the same files the developer did.
A few days ago, all digest files were erased from the Portage tree in CVS as part of the final work to implement GLEP 44. This migrates that information to a single Manifest file per package instead of one digest for every ebuild of that package.
...
(more on gentoo.org) |
Correction: This was just the final step in a long-term migration that actually reduced the size of your Portage tree last February. Thanks to Daniel Drake, Petteri Räty and Jan Kundrat for pointing this out.
Last edited by dberkholz on Wed Feb 06, 2008 7:45 am; edited 2 times in total |
|
Back to top |
|
|
yoshi314 l33t
Joined: 30 Dec 2004 Posts: 850 Location: PL
|
Posted: Tue Feb 05, 2008 8:05 am Post subject: |
|
|
nice move.
i still prefer keeping it tucked together on squashfs + aufs mount - there's so many files that copying it over to another pc or just making a compressed backup takes an awful amount of time, though. _________________ ~amd64
shrink your /usr/portage with squashfs+aufs |
|
Back to top |
|
|
Naib Watchman
Joined: 21 May 2004 Posts: 6051 Location: Removed by Neddy
|
Posted: Tue Feb 05, 2008 8:15 am Post subject: |
|
|
niiiice _________________
Quote: | Removed by Chiitoo |
|
|
Back to top |
|
|
StifflerStealth Retired Dev
Joined: 03 Jul 2002 Posts: 968
|
Posted: Tue Feb 05, 2008 9:49 am Post subject: |
|
|
If we do our own ebuilds, how do we have it so there is not digest file? ebuild foo manifest creates a blank digest file. What's the official command? _________________ Nothing to read in this sig. Move along. |
|
Back to top |
|
|
Chewi Developer
Joined: 01 Sep 2003 Posts: 886 Location: Edinburgh, Scotland
|
Posted: Tue Feb 05, 2008 10:00 am Post subject: |
|
|
Awesome! I've been thinking the tree is way too big for a couple of years now. This really helps. |
|
Back to top |
|
|
Voltago Advocate
Joined: 02 Sep 2003 Posts: 2593 Location: userland
|
Posted: Tue Feb 05, 2008 10:10 am Post subject: |
|
|
StifflerStealth wrote: | What's the official command? |
Code: | emerge =portage-2.1.4.1 |
|
|
Back to top |
|
|
likewhoa l33t
Joined: 04 Oct 2006 Posts: 778 Location: Brooklyn, New York
|
Posted: Tue Feb 05, 2008 10:12 am Post subject: |
|
|
good progress into GLEP features. |
|
Back to top |
|
|
V-Li Retired Dev
Joined: 03 Jan 2006 Posts: 613
|
Posted: Tue Feb 05, 2008 10:14 am Post subject: |
|
|
StifflerStealth wrote: | If we do our own ebuilds, how do we have it so there is not digest file? ebuild foo manifest creates a blank digest file. What's the official command? |
Put the file manifest1_obsolete in the root of your own tree. |
|
Back to top |
|
|
slackline Veteran
Joined: 01 Apr 2005 Posts: 1471 Location: /uk/sheffield
|
Posted: Tue Feb 05, 2008 10:32 am Post subject: |
|
|
Sweet, good work to those who've implemented this, great, simple way of saving space. |
|
Back to top |
|
|
Xake Guru
Joined: 11 Feb 2004 Posts: 588 Location: Göteborg, the rainy part of scandinavia
|
Posted: Tue Feb 05, 2008 10:46 am Post subject: |
|
|
StifflerStealth wrote: | If we do our own ebuilds, how do we have it so there is not digest file? ebuild foo manifest creates a blank digest file. What's the official command? |
Code: | touch manifest1_obsolete |
|
|
Back to top |
|
|
jomen Guru
Joined: 04 Jan 2006 Posts: 536 Location: Leipzig, Germany
|
Posted: Tue Feb 05, 2008 11:11 am Post subject: |
|
|
I was using "porthole" for a graphical overview of available and installed packages.
Never used it to actually install stuff.
About 3 weeks back from now I was irritated to see that every single ebuild on my system was suddenly marked as:
[bad/blank digest]
I suppose the news discussed here is the reason for this behaviour?
What would I need to do to let porthole show valid ebuilds again instead of [bad/blank digest]?
this?
Code: | touch manifest1_obsolete |
where?
[edit]
Its nice to save some disc-space by this - I have solved this issue for me in the past by having a small partition for /usr/portage (excluding /usr/portage/distfiles)
which I created like so:
mke2fs -j -m 0 -b 1024 -i 1024 /dev/hdXx
to not waste so much space on lots of small files _________________ Cheers |
|
Back to top |
|
|
V-Li Retired Dev
Joined: 03 Jan 2006 Posts: 613
|
Posted: Tue Feb 05, 2008 12:21 pm Post subject: |
|
|
manifest1_obsolete is only for people preparing own ebuilds. The ebuild tool then does NOT create digest files anymore...for Porthole, I think you need an update. |
|
Back to top |
|
|
d2_racing Bodhisattva
Joined: 25 Apr 2005 Posts: 13047 Location: Ste-Foy,Canada
|
Posted: Tue Feb 05, 2008 12:43 pm Post subject: |
|
|
Nice |
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
|
Back to top |
|
|
d2_racing Bodhisattva
Joined: 25 Apr 2005 Posts: 13047 Location: Ste-Foy,Canada
|
Posted: Tue Feb 05, 2008 1:06 pm Post subject: |
|
|
And maybe the emerge --sync will be faster... |
|
Back to top |
|
|
jlh Tux's lil' helper
Joined: 06 May 2007 Posts: 145 Location: Switzerland::Zürich
|
Posted: Tue Feb 05, 2008 1:25 pm Post subject: |
|
|
Very nice! I keep my tree on a loop-mounted 1k-filesystem and even this way I saved over 20MB for a new total of about 240MB.
I hope to see even more improvements to the tree in the future. |
|
Back to top |
|
|
Mikachu n00b
Joined: 03 Jan 2005 Posts: 2
|
Posted: Tue Feb 05, 2008 1:39 pm Post subject: |
|
|
and i have mine on an xfs fs with 512 byte blocks :).
155M /usr/portage/ |
|
Back to top |
|
|
jomen Guru
Joined: 04 Jan 2006 Posts: 536 Location: Leipzig, Germany
|
Posted: Tue Feb 05, 2008 1:39 pm Post subject: |
|
|
Quote: | ...for Porthole, I think you need an update. |
The latest version is 0.5 from December 2005 - no updates to reflect the changes to portage discussed here.
I already re-emerged it and nothing changed - it has just two USE-Flags ("nls" and "debug")
I think I'll go for "himerge" or "portato"... _________________ Cheers |
|
Back to top |
|
|
Xake Guru
Joined: 11 Feb 2004 Posts: 588 Location: Göteborg, the rainy part of scandinavia
|
Posted: Tue Feb 05, 2008 1:48 pm Post subject: |
|
|
jomen wrote: | Quote: | ...for Porthole, I think you need an update. |
The latest version is 0.5 from December 2005 - no updates to reflect the changes to portage discussed here.
I already re-emerged it and nothing changed - it has just two USE-Flags ("nls" and "debug")
I think I'll go for "himerge" or "portato"... |
https://sourceforge.net/tracker/index.php?func=detail&aid=1729279&group_id=96324&atid=614397
The bugreport for your problem in question, and as you can see people has had this problem since at least 2007-05, and as the maintainer have not had the time to make a new release since then (he said 2007-08 that he have had the fix in CVS for some time) I believe you're better off with another pkg-manager until he does have the time. Or someone fork.
EDIT: On the other hand you may not give up on porthole yet, 4 days ago the NEWS file had text added for an upcoming 0.6.0 release. So we may just have to hope it will soon be released. On the other hand himerge and portato is installable and should work side by side with porthole if you do not want to wait... |
|
Back to top |
|
|
Betelgeuse Retired Dev
Joined: 10 Aug 2004 Posts: 12 Location: Finland
|
Posted: Tue Feb 05, 2008 1:57 pm Post subject: Bit missleading |
|
|
Portage has been filtering digests from --sync for quite a while so the only difference users are going to see is a potentially faster sync as the server side doesn't have the digests any more. |
|
Back to top |
|
|
i92guboj Bodhisattva
Joined: 30 Nov 2004 Posts: 10315 Location: Córdoba (Spain)
|
Posted: Tue Feb 05, 2008 2:09 pm Post subject: |
|
|
Not that I care too much... I never used any graphical frontend for any serious portage stuff, but I don't know what the current state of porthole is. In any case, if you are really interested you should checkout from cvs, the released versions are really really old and will not work ok with current portage versions. |
|
Back to top |
|
|
jomen Guru
Joined: 04 Jan 2006 Posts: 536 Location: Leipzig, Germany
|
Posted: Tue Feb 05, 2008 2:18 pm Post subject: |
|
|
Quote: | The bugreport for your problem in question, and as you can see people has had this problem since at least 2007-05 |
The [Bad/Blank digest] thing is not that long ago (for me)...and I was searching to find out why I had this "problem".
Did not find the bugreport you directed me to though - thanks!
If I'd found it I'd have known about the change to portage which until now slipped by my attention.
Since I use Porthole only to have a better overview of what is in the repositories and do everything else on command-line I'll just keep using it - I like the clean Interface...or am just used to it. _________________ Cheers |
|
Back to top |
|
|
timeBandit Bodhisattva
Joined: 31 Dec 2004 Posts: 2719 Location: here, there or in transit
|
Posted: Tue Feb 05, 2008 2:32 pm Post subject: |
|
|
jomen wrote: | Since I use Porthole only to have a better overview of what is in the repositories and do everything else on command-line .... | Same here.
Kind of a non-event since the digest files have been gone for a while on the user side, but it's good to see the announcement in case of any problems. Either way, Commander Keen approves--he's all about saving space. (Or at least Earth.) _________________ Plants are pithy, brooks tend to babble--I'm content to lie between them.
Super-short f.g.o checklist: Search first, strip comments, mark solved, help others. |
|
Back to top |
|
|
jancici Apprentice
Joined: 27 Jan 2004 Posts: 284 Location: Slovakia
|
Posted: Tue Feb 05, 2008 3:23 pm Post subject: |
|
|
I did run two commands
Code: | du -s /usr/portage/
2633079 /usr/portage/
du -s /usr/portage/distfiles/
2161991 /usr/portage/distfiles/ |
so my tree is 471088 big cca 460MB
I dont know how big it was beffore |
|
Back to top |
|
|
yoshi314 l33t
Joined: 30 Dec 2004 Posts: 850 Location: PL
|
|
Back to top |
|
|
|