Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Emerge-webrsync borked my portage tree
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Portage & Programming
View previous topic :: View next topic  
Author Message
leifbk
Guru
Guru


Joined: 05 Jan 2004
Posts: 415
Location: Bærum, Norway

PostPosted: Mon Oct 25, 2004 6:32 am    Post subject: Emerge-webrsync borked my portage tree Reply with quote

I've got a Gentoo computer at work. It's behind a firewall, and I can't use emerge sync. Emerge-webrsync usually does the job, but this morning it seems like the snapshot is totally borked. The following output is from a re-run of emerge-webrsync:

Code:
bombadil root # emerge-webrsync
Fetching most recent snapshot
Syncing local tree...
building file list ...
3705 files to consider

Number of files: 3705
Number of files transferred: 0
Total file size: 4218078 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 87500
Total bytes written: 87545
Total bytes read: 20

wrote 87545 bytes  read 20 bytes  58376.67 bytes/sec
total size is 4218078  speedup is 48.17

 *** Completed websync, please now perform a normal rsync if possible.
     Update is current as of the of YYMMDD: 20041024


The first time through, it deleted a lot of files, almost my entire portage tree seems to have gone down the drain. When I try to run an emerge -avuD world now, all I get is:

Code:

These are the packages that I would merge, in order:

!!! ARCH is not set... Are you missing the /etc/make.profile symlink?
!!! Is the symlink correct? Is your portage tree complete?


I've discovered a bugzilla entry describing the problem here: #61398.

Now, I wonder if I just can do an emerge-webrsync again in a few hours, and get the situation back to normal?

regards, Leif.
Back to top
View user's profile Send private message
michaelg
n00b
n00b


Joined: 11 Jul 2004
Posts: 16

PostPosted: Mon Oct 25, 2004 6:41 am    Post subject: I second that! Reply with quote

Same here!
Back to top
View user's profile Send private message
TrangOul
n00b
n00b


Joined: 19 Aug 2004
Posts: 3

PostPosted: Mon Oct 25, 2004 6:50 am    Post subject: Reply with quote

Hmpff..

Same here!!
Back to top
View user's profile Send private message
pestilence
Apprentice
Apprentice


Joined: 05 Feb 2004
Posts: 213
Location: Athens / Greece

PostPosted: Mon Oct 25, 2004 7:37 am    Post subject: Reply with quote

Yap my profiles are also broken...seems a portage issue....any updates with this?
_________________
Gentoo the rising hope
Back to top
View user's profile Send private message
rtshome
n00b
n00b


Joined: 25 Oct 2004
Posts: 1

PostPosted: Mon Oct 25, 2004 7:39 am    Post subject: Problems with Emerge-webrsync Reply with quote

Same here!
Back to top
View user's profile Send private message
DawgG
l33t
l33t


Joined: 17 Sep 2003
Posts: 866

PostPosted: Mon Oct 25, 2004 7:53 am    Post subject: same prob Reply with quote

same here...
Back to top
View user's profile Send private message
irf2003
Veteran
Veteran


Joined: 10 Sep 2003
Posts: 1078

PostPosted: Mon Oct 25, 2004 7:55 am    Post subject: Reply with quote

it's a bad portage snpashot again!
if you look here http://gentoo.osuosl.org/snapshots/
portage-20041024.tar.bz2 is only 916K!

there must be something wrong with the snapshot tarbar generator.
Staturday's snapshot was also bad.

one way to correct this is to emerge sync. however, it is a good idea
to untar say http://gentoo.osuosl.org/snapshots/portage-20041023.tar.bz2
replacing the portage tree which you have, otherwise the emerge sync
will take forever, as the corresponding portage tree of portage-20041024.tar.bz2
is virtually empty.
someone ought to file a bug report to alert the developers about
the incmplete snapshots.
hth
Back to top
View user's profile Send private message
leifbk
Guru
Guru


Joined: 05 Jan 2004
Posts: 415
Location: Bærum, Norway

PostPosted: Mon Oct 25, 2004 8:13 am    Post subject: Reply with quote

irf2003 wrote:

one way to correct this is to emerge sync. however, it is a good idea
to untar say http://gentoo.osuosl.org/snapshots/portage-20041023.tar.bz2
replacing the portage tree which you have, otherwise the emerge sync
will take forever, as the corresponding portage tree of portage-20041024.tar.bz2
is virtually empty.


Thanks for the tip. The handbook describes the initial setup of the portage tree like this:

Code:
# tar -xvjf /mnt/cdrom/snapshots/portage-20040710.tar.bz2 -C /mnt/gentoo/usr


I guess that I untar the new one in mostly the same way:

Code:
# tar -xvjf /tmp/portage-20040710.tar.bz2 -C /usr


Is this correct?

regards, Leif.
Back to top
View user's profile Send private message
irf2003
Veteran
Veteran


Joined: 10 Sep 2003
Posts: 1078

PostPosted: Mon Oct 25, 2004 8:35 am    Post subject: Reply with quote

Code:

#become root
su
#make sure you are in your home dir
cd $HOME
#grab the latest known good snapshot
wget http://gentoo.osuosl.org/snapshots/portage-20041023.tar.bz2
#untar it
tar -xvjf portage-20041023.tar.bz2 -C /usr
#regenerate dependency cache
emerge --regen
#update portage cache
emerge --metadata
#rsync
emerge sync

hth
Back to top
View user's profile Send private message
leifbk
Guru
Guru


Joined: 05 Jan 2004
Posts: 415
Location: Bærum, Norway

PostPosted: Mon Oct 25, 2004 8:49 am    Post subject: Reply with quote

Thanks a lot.

I can't run emerge sync because of the bl**dy firewall, that's why I have to run emerge-webrsync.

I untarred the file, so I guess that I'm now up to date with the 20041023 portage? and now emerge -avuD world wants to update 25 packages. Most of it seems quite reasonable, but I'd like know if it's safe to update before I can run a new emerge-webrsync.

Leif.
Back to top
View user's profile Send private message
irf2003
Veteran
Veteran


Joined: 10 Sep 2003
Posts: 1078

PostPosted: Mon Oct 25, 2004 9:03 am    Post subject: Reply with quote

leifbk wrote:
Thanks a lot.

I can't run emerge sync because of the bl**dy firewall, that's why I have to run emerge-webrsync.

I untarred the file, so I guess that I'm now up to date with the 20041023 portage? and now emerge -avuD world wants to update 25 packages. Most of it seems quite reasonable, but I'd like know if it's safe to update before I can run a new emerge-webrsync.

Leif.

it should be safe, just in case, can you post the output of
Code:

emerge -uDp world

hth
Back to top
View user's profile Send private message
leifbk
Guru
Guru


Joined: 05 Jan 2004
Posts: 415
Location: Bærum, Norway

PostPosted: Mon Oct 25, 2004 9:17 am    Post subject: Reply with quote

irf2003 wrote:

it should be safe, just in case, can you post the output of
Code:

emerge -uDp world

hth


I emerged the new portage 2.0.51, then I ran the emerge --regen and emerge --metadata.

Code:
bombadil root # emerge -uDp world

These are the packages that I would merge, in order:

Calculating world dependencies ...done!
[ebuild  NS   ] dev-java/blackdown-jre-1.4.1
[ebuild     U ] dev-java/blackdown-jdk-1.4.2 [1.4.2_rc1-r1]
[ebuild     U ] sys-apps/baselayout-1.9.4-r6 [1.9.4-r5]
[ebuild     U ] media-libs/tiff-3.6.1-r2 [3.5.7-r1]
[ebuild     U ] net-print/cups-1.1.20-r4 [1.1.20-r3]
[ebuild     U ] dev-db/mysql-4.0.21 [4.0.20-r1]
[ebuild     U ] dev-libs/glib-2.4.6 [2.4.5]
[ebuild     U ] media-libs/libogg-1.1.2 [1.1]
[ebuild     U ] media-libs/libvorbis-1.1.0 [1.0.1-r2]
[ebuild     U ] net-www/apache-2.0.52 [2.0.51-r1]
[ebuild     U ] dev-util/dialog-1.0.20040731 [0.9_beta20031002]
[ebuild     U ] app-text/docbook-sgml-dtd-3.1-r2 [3.1-r1]
[ebuild     U ] media-libs/t1lib-5.0.1 [5.0.0-r2]
[ebuild     U ] app-text/xpdf-3.00-r3 [2.03]
[ebuild     U ] dev-java/rhino-1.5.5 [1.5_rc5]
[ebuild     U ] app-text/docbook-sgml-dtd-4.1-r2 [4.1-r1]
[ebuild     U ] app-text/docbook-sgml-dtd-4.0-r2 [4.0-r1]
[ebuild     U ] app-text/docbook-sgml-dtd-3.0-r2 [3.0-r1]
[ebuild  NS   ] sys-kernel/gentoo-dev-sources-2.6.9-r1
[ebuild     U ] media-libs/freetype-1.3.1-r4 [1.3.1-r3]
[ebuild     U ] media-libs/gd-2.0.28 [2.0.26]
[ebuild     U ] kde-base/kdegraphics-3.3.0-r1 [3.3.0]
[ebuild     U ] net-misc/curl-7.12.0-r2 [7.11.0]


As I've tried to install Eclipse 3.x, I've got these packages in my /etc/portage/package.keywords:

Code:
bombadil root # cat /etc/portage/package.keywords
dev-java/java-sdk-docs ~x86
dev-java/blackdown-jdk ~x86
dev-libs/libIDL ~x86
dev-java/bsf ~x86
dev-java/log4j ~x86
dev-java/javacup ~x86
dev-java/jsch ~x86
dev-java/xalan ~x86
dev-java/antlr ~x86
dev-java/commons-beanutils ~x86
dev-java/jdepend ~x86
dev-util/eclipse-sdk ~x86
dev-java/java-config ~x86


Leif.
Back to top
View user's profile Send private message
irf2003
Veteran
Veteran


Joined: 10 Sep 2003
Posts: 1078

PostPosted: Mon Oct 25, 2004 10:05 am    Post subject: Reply with quote

leifbk,
just to be sure that you have a clean
portage tree based on the 2004/10/23
snapshot do the followings:
Code:

#backup the distfiles dir
mv /usr/portage/distfiles /distfiles
#nuke the portage tree
rm -Rf /usr/portage
#utar the good portage snapshot
#assume the good snapshot is at /root
tar -xvjf /root/portage-20041023.tar.bz2 -C /usr
restore the distfiles directory
mv /distfiles /usr/portage/distfiles
emerge --regen
emerge --metadata

hth
happy gentooing
Back to top
View user's profile Send private message
leifbk
Guru
Guru


Joined: 05 Jan 2004
Posts: 415
Location: Bærum, Norway

PostPosted: Mon Oct 25, 2004 10:18 am    Post subject: Reply with quote

Uh-oh, it's a bit too late for that now. I'm halfway through the update already :roll:

I thought the package list looked quite sane and reasonable, after all. It's been some days since my last sync here.

BTW, the emerge --regen thingy took ages to complete on my 2.8G P4. It must be a really heavy-duty job.
Back to top
View user's profile Send private message
chostrander
n00b
n00b


Joined: 16 Feb 2003
Posts: 10
Location: Moorestown,NJ

PostPosted: Mon Oct 25, 2004 12:17 pm    Post subject: Reply with quote

Yup! I got the same problem! I did notice something was strange when I went to "physically" download the portage snapshot and it was only 976 KB in size!

Any fixes for this?

Carl
_________________
"Life is like installing and running windows... you never know what you're gonna get!"
Back to top
View user's profile Send private message
chostrander
n00b
n00b


Joined: 16 Feb 2003
Posts: 10
Location: Moorestown,NJ

PostPosted: Mon Oct 25, 2004 12:25 pm    Post subject: Reply with quote

Oops! One more thing. I also cannot run 'emerge --sync' because I am behind a firewall.

Carl
_________________
"Life is like installing and running windows... you never know what you're gonna get!"
Back to top
View user's profile Send private message
leifbk
Guru
Guru


Joined: 05 Jan 2004
Posts: 415
Location: Bærum, Norway

PostPosted: Mon Oct 25, 2004 12:39 pm    Post subject: Reply with quote

The faulty snapshot seems to have disappeared from this server , so I thought that all you should have to do now is to run emerge-webrsync again -- which I just did, and broke portage again :cry:

At least, I'll get to try irf2003's advices in full with the new 20041024 snapshot. Nothing much to do here anyway :wink:
Back to top
View user's profile Send private message
irf2003
Veteran
Veteran


Joined: 10 Sep 2003
Posts: 1078

PostPosted: Mon Oct 25, 2004 1:37 pm    Post subject: Reply with quote

leifbk wrote:
The faulty snapshot seems to have disappeared from this server , so I thought that all you should have to do now is to run emerge-webrsync again -- which I just did, and broke portage again :cry:

At least, I'll get to try irf2003's advices in full with the new 20041024 snapshot. Nothing much to do here anyway :wink:

leifbk,
thanks for pointing out that a good 10/24 snapshot has been posted.
when you are done doing emerge -uD world follow it by
Code:

emerge --newuse -uD world

before you do so can you please post the ouput of
Code:

emerge -uDp world
emerge --newuse -p world
emerge --newuse -uDp world

this is un-related to the bad snapshot problem, but,
would appreciate if you can post the output of the above commands, as i'm intrigued by the --newuse coupled with the -uD
option of the emerge command, and would like to compare notes,
if at all possible.
TIA
happy gentooing
PS is the new (i.e. 16Meg one) http://gentoo.osuosl.org/snapshots/portage-20041024.tar.bz2
any good? or is it still broken?
Back to top
View user's profile Send private message
Aapzak
n00b
n00b


Joined: 21 Mar 2003
Posts: 12

PostPosted: Mon Oct 25, 2004 1:50 pm    Post subject: Reply with quote

It seems to be fixed. I just ran emerge-webrsync and now I've got portage back. I allready used it to install some stuff.
Back to top
View user's profile Send private message
leifbk
Guru
Guru


Joined: 05 Jan 2004
Posts: 415
Location: Bærum, Norway

PostPosted: Mon Oct 25, 2004 1:57 pm    Post subject: Reply with quote

irf2003 wrote:

leifbk,
thanks for pointing out that a good 10/24 snapshot has been posted.
when you are done doing emerge -uD world follow it by
Code:

emerge --newuse -uD world



I'm on my way home, but here's something:
Code:
bombadil root # emerge -avuD --newuse world

These are the packages that I would merge, in order:

Calculating world dependencies ...done!
[ebuild   R   ] sys-libs/ncurses-5.4-r5  -bootstrap -build -debug +doc* (-uclibc) -unicode 0 kB
[ebuild   R   ] sys-devel/binutils-2.14.90.0.8-r1  -bootstrap* -build -debug -multitarget +nls (-uclibc) 0 kB
[ebuild   R   ] media-libs/freetype-2.1.5-r1  -bindist -cjk -debug +doc* +zlib 0 kB
[ebuild   R   ] sys-libs/db-4.1.25_p1-r3  +doc* +java* +tcltk* 0 kB
[ebuild   R   ] dev-lang/perl-5.8.4-r1  +berkdb -debug +doc* +gdbm -ithreads -perlsuid (-uclibc) 0 kB
[ebuild   R   ] sys-devel/m4-1.4.1  -bootstrap* +nls 0 kB
[ebuild   R   ] sys-devel/gcc-3.3.4-r1  +X -bootstrap* -build -debug +f77* -gcj -hardened -multilib +nls -objc -pic -static (-uclibc) 0 kB
[ebuild   R   ] sys-kernel/linux-headers-2.4.21-r1  -build* 27,864 kB
[ebuild   R   ] sys-apps/sed-4.0.9  -bootstrap* -build -debug +nls -static 0 kB
[ebuild   R   ] dev-lang/nasm-0.98.38  -build +doc* 0 kB
[ebuild   R   ] x11-libs/qt-3.3.3  +cups -debug +doc* -firebird +gif -icc -immqt -immqt-bc -ipv6 +mysql -nas -odbc +opengl-postgres -sqlite -xinerama +zlib 0 kB
[ebuild   R   ] app-text/docbook-sgml-utils-0.6.12  +tetex* 0 kB
[ebuild   R   ] sys-kernel/gentoo-sources-2.4.26-r9  -build +doc* 0 kB
[ebuild   R   ] media-libs/pdflib-5.0.2  +java* +perl +python +tcltk* 0 kB
[ebuild   R   ] dev-php/php-4.3.9  +X +berkdb +crypt -curl -debug +doc -fdftk -firebird -flash -freetds -gd -gd-external +gdbm -gmp -hardenedphp -imap -informix -ipv6 +java* +jpeg -kerberos -ldap -mcal -memlimit -mssql +mysql +ncurses +nls -oci8-odbc +pam +pdflib +png -postgres +qt +readline -snmp +spell +ssl -tiff +truetype +xml2 -yaz 0 kB
[ebuild   R   ] dev-php/mod_php-4.3.9  +X +apache2 +berkdb +crypt -curl -debug +doc -fdftk -firebird -flash -freetds -gd -gd-external +gdbm -gmp -hardenedphp -imap -informix -ipv6 +java* +jpeg -kerberos -ldap -mcal -memlimit -mssql +mysql +nls -oci8 -odbc +pam +pdflib +png -postgres +qt -snmp +spell +ssl -tiff +truetype +xml2 -yaz 0 kB
[ebuild   R   ] media-gfx/graphviz-1.10  +tcltk* 0 kB
[ebuild   R   ] app-doc/doxygen-1.3.8  +doc +qt +tetex* 0 kB
[ebuild   R   ] kde-base/kdelibs-3.3.0  -alsa +arts +cups -debug +doc* -ipv6 -kerberos -ldap +ssl -tiff -xinerama 0 kB
[ebuild   R   ] app-crypt/gpgme-0.4.0  +doc* +nls 0 kB
[ebuild   R   ] kde-base/kdebase-3.3.0  +arts +cups -debug +java* -ldap +opengl +pam -samba +ssl -xinerama 0 kB
[ebuild   R   ] kde-base/kdewebdev-3.3.0-r1  +arts -debug +doc* -xinerama 0 kB
[ebuild   R   ] dev-util/kdevelop-3.1.0  +arts -debug +doc +java* +python -ruby -xinerama 0 kB

Total size of downloads: 27,864 kB


Quote:
PS is the new (i.e. 16Meg one) http://gentoo.osuosl.org/snapshots/portage-20041024.tar.bz2
any good? or is it still broken?


It's all OK.
_________________
Grumpy old man
Back to top
View user's profile Send private message
irf2003
Veteran
Veteran


Joined: 10 Sep 2003
Posts: 1078

PostPosted: Mon Oct 25, 2004 2:13 pm    Post subject: Reply with quote

leifbk,
that's very interesting!
so, i would not hesitate to execute the command below,
just to make sure that my system is consistant:
Code:

emerge --newuse -uD world

many thanks for your input,
hth,
and happy gentooing
PS on second thoughts I would do the above on system first,
followed by world
Code:

emerge --newuse -uD system
emerge --newuse -uD world
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Portage & Programming All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum