View previous topic :: View next topic |
Author |
Message |
leifbk Guru
Joined: 05 Jan 2004 Posts: 415 Location: Bærum, Norway
|
Posted: Mon Oct 25, 2004 6:32 am Post subject: Emerge-webrsync borked my portage tree |
|
|
I've got a Gentoo computer at work. It's behind a firewall, and I can't use emerge sync. Emerge-webrsync usually does the job, but this morning it seems like the snapshot is totally borked. The following output is from a re-run of emerge-webrsync:
Code: | bombadil root # emerge-webrsync
Fetching most recent snapshot
Syncing local tree...
building file list ...
3705 files to consider
Number of files: 3705
Number of files transferred: 0
Total file size: 4218078 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 87500
Total bytes written: 87545
Total bytes read: 20
wrote 87545 bytes read 20 bytes 58376.67 bytes/sec
total size is 4218078 speedup is 48.17
*** Completed websync, please now perform a normal rsync if possible.
Update is current as of the of YYMMDD: 20041024
|
The first time through, it deleted a lot of files, almost my entire portage tree seems to have gone down the drain. When I try to run an emerge -avuD world now, all I get is:
Code: |
These are the packages that I would merge, in order:
!!! ARCH is not set... Are you missing the /etc/make.profile symlink?
!!! Is the symlink correct? Is your portage tree complete?
|
I've discovered a bugzilla entry describing the problem here: #61398.
Now, I wonder if I just can do an emerge-webrsync again in a few hours, and get the situation back to normal?
regards, Leif. |
|
Back to top |
|
|
michaelg n00b
Joined: 11 Jul 2004 Posts: 16
|
Posted: Mon Oct 25, 2004 6:41 am Post subject: I second that! |
|
|
Same here! |
|
Back to top |
|
|
TrangOul n00b
Joined: 19 Aug 2004 Posts: 3
|
Posted: Mon Oct 25, 2004 6:50 am Post subject: |
|
|
Hmpff..
Same here!! |
|
Back to top |
|
|
pestilence Apprentice
Joined: 05 Feb 2004 Posts: 213 Location: Athens / Greece
|
Posted: Mon Oct 25, 2004 7:37 am Post subject: |
|
|
Yap my profiles are also broken...seems a portage issue....any updates with this? _________________ Gentoo the rising hope |
|
Back to top |
|
|
rtshome n00b
Joined: 25 Oct 2004 Posts: 1
|
Posted: Mon Oct 25, 2004 7:39 am Post subject: Problems with Emerge-webrsync |
|
|
Same here! |
|
Back to top |
|
|
DawgG l33t
Joined: 17 Sep 2003 Posts: 866
|
Posted: Mon Oct 25, 2004 7:53 am Post subject: same prob |
|
|
same here... |
|
Back to top |
|
|
irf2003 Veteran
Joined: 10 Sep 2003 Posts: 1078
|
Posted: Mon Oct 25, 2004 7:55 am Post subject: |
|
|
it's a bad portage snpashot again!
if you look here http://gentoo.osuosl.org/snapshots/
portage-20041024.tar.bz2 is only 916K!
there must be something wrong with the snapshot tarbar generator.
Staturday's snapshot was also bad.
one way to correct this is to emerge sync. however, it is a good idea
to untar say http://gentoo.osuosl.org/snapshots/portage-20041023.tar.bz2
replacing the portage tree which you have, otherwise the emerge sync
will take forever, as the corresponding portage tree of portage-20041024.tar.bz2
is virtually empty.
someone ought to file a bug report to alert the developers about
the incmplete snapshots.
hth |
|
Back to top |
|
|
leifbk Guru
Joined: 05 Jan 2004 Posts: 415 Location: Bærum, Norway
|
Posted: Mon Oct 25, 2004 8:13 am Post subject: |
|
|
irf2003 wrote: |
one way to correct this is to emerge sync. however, it is a good idea
to untar say http://gentoo.osuosl.org/snapshots/portage-20041023.tar.bz2
replacing the portage tree which you have, otherwise the emerge sync
will take forever, as the corresponding portage tree of portage-20041024.tar.bz2
is virtually empty. |
Thanks for the tip. The handbook describes the initial setup of the portage tree like this:
Code: | # tar -xvjf /mnt/cdrom/snapshots/portage-20040710.tar.bz2 -C /mnt/gentoo/usr |
I guess that I untar the new one in mostly the same way:
Code: | # tar -xvjf /tmp/portage-20040710.tar.bz2 -C /usr |
Is this correct?
regards, Leif. |
|
Back to top |
|
|
irf2003 Veteran
Joined: 10 Sep 2003 Posts: 1078
|
Posted: Mon Oct 25, 2004 8:35 am Post subject: |
|
|
Code: |
#become root
su
#make sure you are in your home dir
cd $HOME
#grab the latest known good snapshot
wget http://gentoo.osuosl.org/snapshots/portage-20041023.tar.bz2
#untar it
tar -xvjf portage-20041023.tar.bz2 -C /usr
#regenerate dependency cache
emerge --regen
#update portage cache
emerge --metadata
#rsync
emerge sync
|
hth |
|
Back to top |
|
|
leifbk Guru
Joined: 05 Jan 2004 Posts: 415 Location: Bærum, Norway
|
Posted: Mon Oct 25, 2004 8:49 am Post subject: |
|
|
Thanks a lot.
I can't run emerge sync because of the bl**dy firewall, that's why I have to run emerge-webrsync.
I untarred the file, so I guess that I'm now up to date with the 20041023 portage? and now emerge -avuD world wants to update 25 packages. Most of it seems quite reasonable, but I'd like know if it's safe to update before I can run a new emerge-webrsync.
Leif. |
|
Back to top |
|
|
irf2003 Veteran
Joined: 10 Sep 2003 Posts: 1078
|
Posted: Mon Oct 25, 2004 9:03 am Post subject: |
|
|
leifbk wrote: | Thanks a lot.
I can't run emerge sync because of the bl**dy firewall, that's why I have to run emerge-webrsync.
I untarred the file, so I guess that I'm now up to date with the 20041023 portage? and now emerge -avuD world wants to update 25 packages. Most of it seems quite reasonable, but I'd like know if it's safe to update before I can run a new emerge-webrsync.
Leif. |
it should be safe, just in case, can you post the output of
hth |
|
Back to top |
|
|
leifbk Guru
Joined: 05 Jan 2004 Posts: 415 Location: Bærum, Norway
|
Posted: Mon Oct 25, 2004 9:17 am Post subject: |
|
|
irf2003 wrote: |
it should be safe, just in case, can you post the output of
hth |
I emerged the new portage 2.0.51, then I ran the emerge --regen and emerge --metadata.
Code: | bombadil root # emerge -uDp world
These are the packages that I would merge, in order:
Calculating world dependencies ...done!
[ebuild NS ] dev-java/blackdown-jre-1.4.1
[ebuild U ] dev-java/blackdown-jdk-1.4.2 [1.4.2_rc1-r1]
[ebuild U ] sys-apps/baselayout-1.9.4-r6 [1.9.4-r5]
[ebuild U ] media-libs/tiff-3.6.1-r2 [3.5.7-r1]
[ebuild U ] net-print/cups-1.1.20-r4 [1.1.20-r3]
[ebuild U ] dev-db/mysql-4.0.21 [4.0.20-r1]
[ebuild U ] dev-libs/glib-2.4.6 [2.4.5]
[ebuild U ] media-libs/libogg-1.1.2 [1.1]
[ebuild U ] media-libs/libvorbis-1.1.0 [1.0.1-r2]
[ebuild U ] net-www/apache-2.0.52 [2.0.51-r1]
[ebuild U ] dev-util/dialog-1.0.20040731 [0.9_beta20031002]
[ebuild U ] app-text/docbook-sgml-dtd-3.1-r2 [3.1-r1]
[ebuild U ] media-libs/t1lib-5.0.1 [5.0.0-r2]
[ebuild U ] app-text/xpdf-3.00-r3 [2.03]
[ebuild U ] dev-java/rhino-1.5.5 [1.5_rc5]
[ebuild U ] app-text/docbook-sgml-dtd-4.1-r2 [4.1-r1]
[ebuild U ] app-text/docbook-sgml-dtd-4.0-r2 [4.0-r1]
[ebuild U ] app-text/docbook-sgml-dtd-3.0-r2 [3.0-r1]
[ebuild NS ] sys-kernel/gentoo-dev-sources-2.6.9-r1
[ebuild U ] media-libs/freetype-1.3.1-r4 [1.3.1-r3]
[ebuild U ] media-libs/gd-2.0.28 [2.0.26]
[ebuild U ] kde-base/kdegraphics-3.3.0-r1 [3.3.0]
[ebuild U ] net-misc/curl-7.12.0-r2 [7.11.0] |
As I've tried to install Eclipse 3.x, I've got these packages in my /etc/portage/package.keywords:
Code: | bombadil root # cat /etc/portage/package.keywords
dev-java/java-sdk-docs ~x86
dev-java/blackdown-jdk ~x86
dev-libs/libIDL ~x86
dev-java/bsf ~x86
dev-java/log4j ~x86
dev-java/javacup ~x86
dev-java/jsch ~x86
dev-java/xalan ~x86
dev-java/antlr ~x86
dev-java/commons-beanutils ~x86
dev-java/jdepend ~x86
dev-util/eclipse-sdk ~x86
dev-java/java-config ~x86 |
Leif. |
|
Back to top |
|
|
irf2003 Veteran
Joined: 10 Sep 2003 Posts: 1078
|
Posted: Mon Oct 25, 2004 10:05 am Post subject: |
|
|
leifbk,
just to be sure that you have a clean
portage tree based on the 2004/10/23
snapshot do the followings:
Code: |
#backup the distfiles dir
mv /usr/portage/distfiles /distfiles
#nuke the portage tree
rm -Rf /usr/portage
#utar the good portage snapshot
#assume the good snapshot is at /root
tar -xvjf /root/portage-20041023.tar.bz2 -C /usr
restore the distfiles directory
mv /distfiles /usr/portage/distfiles
emerge --regen
emerge --metadata
|
hth
happy gentooing |
|
Back to top |
|
|
leifbk Guru
Joined: 05 Jan 2004 Posts: 415 Location: Bærum, Norway
|
Posted: Mon Oct 25, 2004 10:18 am Post subject: |
|
|
Uh-oh, it's a bit too late for that now. I'm halfway through the update already
I thought the package list looked quite sane and reasonable, after all. It's been some days since my last sync here.
BTW, the emerge --regen thingy took ages to complete on my 2.8G P4. It must be a really heavy-duty job. |
|
Back to top |
|
|
chostrander n00b
Joined: 16 Feb 2003 Posts: 10 Location: Moorestown,NJ
|
Posted: Mon Oct 25, 2004 12:17 pm Post subject: |
|
|
Yup! I got the same problem! I did notice something was strange when I went to "physically" download the portage snapshot and it was only 976 KB in size!
Any fixes for this?
Carl _________________ "Life is like installing and running windows... you never know what you're gonna get!" |
|
Back to top |
|
|
chostrander n00b
Joined: 16 Feb 2003 Posts: 10 Location: Moorestown,NJ
|
Posted: Mon Oct 25, 2004 12:25 pm Post subject: |
|
|
Oops! One more thing. I also cannot run 'emerge --sync' because I am behind a firewall.
Carl _________________ "Life is like installing and running windows... you never know what you're gonna get!" |
|
Back to top |
|
|
leifbk Guru
Joined: 05 Jan 2004 Posts: 415 Location: Bærum, Norway
|
Posted: Mon Oct 25, 2004 12:39 pm Post subject: |
|
|
The faulty snapshot seems to have disappeared from this server , so I thought that all you should have to do now is to run emerge-webrsync again -- which I just did, and broke portage again
At least, I'll get to try irf2003's advices in full with the new 20041024 snapshot. Nothing much to do here anyway |
|
Back to top |
|
|
irf2003 Veteran
Joined: 10 Sep 2003 Posts: 1078
|
Posted: Mon Oct 25, 2004 1:37 pm Post subject: |
|
|
leifbk wrote: | The faulty snapshot seems to have disappeared from this server , so I thought that all you should have to do now is to run emerge-webrsync again -- which I just did, and broke portage again :cry:
At least, I'll get to try irf2003's advices in full with the new 20041024 snapshot. Nothing much to do here anyway :wink: |
leifbk,
thanks for pointing out that a good 10/24 snapshot has been posted.
when you are done doing emerge -uD world follow it by
Code: |
emerge --newuse -uD world
|
before you do so can you please post the ouput of
Code: |
emerge -uDp world
emerge --newuse -p world
emerge --newuse -uDp world
|
this is un-related to the bad snapshot problem, but,
would appreciate if you can post the output of the above commands, as i'm intrigued by the --newuse coupled with the -uD
option of the emerge command, and would like to compare notes,
if at all possible.
TIA
happy gentooing
PS is the new (i.e. 16Meg one) http://gentoo.osuosl.org/snapshots/portage-20041024.tar.bz2
any good? or is it still broken? |
|
Back to top |
|
|
Aapzak n00b
Joined: 21 Mar 2003 Posts: 12
|
Posted: Mon Oct 25, 2004 1:50 pm Post subject: |
|
|
It seems to be fixed. I just ran emerge-webrsync and now I've got portage back. I allready used it to install some stuff. |
|
Back to top |
|
|
leifbk Guru
Joined: 05 Jan 2004 Posts: 415 Location: Bærum, Norway
|
Posted: Mon Oct 25, 2004 1:57 pm Post subject: |
|
|
irf2003 wrote: |
leifbk,
thanks for pointing out that a good 10/24 snapshot has been posted.
when you are done doing emerge -uD world follow it by
Code: |
emerge --newuse -uD world
|
|
I'm on my way home, but here's something:
Code: | bombadil root # emerge -avuD --newuse world
These are the packages that I would merge, in order:
Calculating world dependencies ...done!
[ebuild R ] sys-libs/ncurses-5.4-r5 -bootstrap -build -debug +doc* (-uclibc) -unicode 0 kB
[ebuild R ] sys-devel/binutils-2.14.90.0.8-r1 -bootstrap* -build -debug -multitarget +nls (-uclibc) 0 kB
[ebuild R ] media-libs/freetype-2.1.5-r1 -bindist -cjk -debug +doc* +zlib 0 kB
[ebuild R ] sys-libs/db-4.1.25_p1-r3 +doc* +java* +tcltk* 0 kB
[ebuild R ] dev-lang/perl-5.8.4-r1 +berkdb -debug +doc* +gdbm -ithreads -perlsuid (-uclibc) 0 kB
[ebuild R ] sys-devel/m4-1.4.1 -bootstrap* +nls 0 kB
[ebuild R ] sys-devel/gcc-3.3.4-r1 +X -bootstrap* -build -debug +f77* -gcj -hardened -multilib +nls -objc -pic -static (-uclibc) 0 kB
[ebuild R ] sys-kernel/linux-headers-2.4.21-r1 -build* 27,864 kB
[ebuild R ] sys-apps/sed-4.0.9 -bootstrap* -build -debug +nls -static 0 kB
[ebuild R ] dev-lang/nasm-0.98.38 -build +doc* 0 kB
[ebuild R ] x11-libs/qt-3.3.3 +cups -debug +doc* -firebird +gif -icc -immqt -immqt-bc -ipv6 +mysql -nas -odbc +opengl-postgres -sqlite -xinerama +zlib 0 kB
[ebuild R ] app-text/docbook-sgml-utils-0.6.12 +tetex* 0 kB
[ebuild R ] sys-kernel/gentoo-sources-2.4.26-r9 -build +doc* 0 kB
[ebuild R ] media-libs/pdflib-5.0.2 +java* +perl +python +tcltk* 0 kB
[ebuild R ] dev-php/php-4.3.9 +X +berkdb +crypt -curl -debug +doc -fdftk -firebird -flash -freetds -gd -gd-external +gdbm -gmp -hardenedphp -imap -informix -ipv6 +java* +jpeg -kerberos -ldap -mcal -memlimit -mssql +mysql +ncurses +nls -oci8-odbc +pam +pdflib +png -postgres +qt +readline -snmp +spell +ssl -tiff +truetype +xml2 -yaz 0 kB
[ebuild R ] dev-php/mod_php-4.3.9 +X +apache2 +berkdb +crypt -curl -debug +doc -fdftk -firebird -flash -freetds -gd -gd-external +gdbm -gmp -hardenedphp -imap -informix -ipv6 +java* +jpeg -kerberos -ldap -mcal -memlimit -mssql +mysql +nls -oci8 -odbc +pam +pdflib +png -postgres +qt -snmp +spell +ssl -tiff +truetype +xml2 -yaz 0 kB
[ebuild R ] media-gfx/graphviz-1.10 +tcltk* 0 kB
[ebuild R ] app-doc/doxygen-1.3.8 +doc +qt +tetex* 0 kB
[ebuild R ] kde-base/kdelibs-3.3.0 -alsa +arts +cups -debug +doc* -ipv6 -kerberos -ldap +ssl -tiff -xinerama 0 kB
[ebuild R ] app-crypt/gpgme-0.4.0 +doc* +nls 0 kB
[ebuild R ] kde-base/kdebase-3.3.0 +arts +cups -debug +java* -ldap +opengl +pam -samba +ssl -xinerama 0 kB
[ebuild R ] kde-base/kdewebdev-3.3.0-r1 +arts -debug +doc* -xinerama 0 kB
[ebuild R ] dev-util/kdevelop-3.1.0 +arts -debug +doc +java* +python -ruby -xinerama 0 kB
Total size of downloads: 27,864 kB
|
It's all OK. _________________ Grumpy old man |
|
Back to top |
|
|
irf2003 Veteran
Joined: 10 Sep 2003 Posts: 1078
|
Posted: Mon Oct 25, 2004 2:13 pm Post subject: |
|
|
leifbk,
that's very interesting!
so, i would not hesitate to execute the command below,
just to make sure that my system is consistant:
Code: |
emerge --newuse -uD world
|
many thanks for your input,
hth,
and happy gentooing
PS on second thoughts I would do the above on system first,
followed by world
Code: |
emerge --newuse -uD system
emerge --newuse -uD world
|
|
|
Back to top |
|
|
|