emerge --sync problem

[hamayya]

I am trying to install gentoo from my already existing linux syste.
I was following the gentoo hand book,when i faced the following error on typing emerge --sync

s / # emerge --sync

Performing Global Updates: /usr/portage/profiles/updates/4Q-2004
(Could take a couple of minutes if you have a lot of binary packages.)
.='update pass' *='binary update' @='/var/db move'
s='/var/db SLOT move' S='binary SLOT move' p='update /etc/portage/package.*'
.............................
Notice: (-2, 'Name or service not known')
>>> starting rsync with rsync://rsync.gentoo.org/gentoo-portage...
>>> checking server timestamp ...
rsync: getaddrinfo: rsync.gentoo.org 873: Name or service not known
rsync error: error in socket IO (code 10) at clientserver.c(88)
>>> retry ...
Notice: (-2, 'Name or service not known')


>>> Starting retry 1 of 3 with rsync://rsync.gentoo.org/gentoo-portage
>>> checking server timestamp ...
rsync: getaddrinfo: rsync.gentoo.org 873: Name or service not known
rsync error: error in socket IO (code 10) at clientserver.c(88)
>>> retry ...
Notice: (-2, 'Name or service not known')


>>> Starting retry 2 of 3 with rsync://rsync.gentoo.org/gentoo-portage
>>> checking server timestamp ...
rsync: getaddrinfo: rsync.gentoo.org 873: Name or service not known
rsync error: error in socket IO (code 10) at clientserver.c(88)
>>> retry ...
Notice: (-2, 'Name or service not known')


>>> Starting retry 3 of 3 with rsync://rsync.gentoo.org/gentoo-portage
>>> checking server timestamp ...
rsync: getaddrinfo: rsync.gentoo.org 873: Name or service not known
rsync error: error in socket IO (code 10) at clientserver.c(88)

!!! Rsync has not successfully finished. It is recommended that you keep
!!! trying or that you use the 'emerge-webrsync' option if you are unable
!!! to use rsync due to firewall or other restrictions. This should be a
!!! temporary problem unless complications exist with your network
!!! (and possibly your system's filesystem) configuration.



I am behind a firewall which needs proxy authenication.Is that the trouble or is the trouble somewhere else?

TIA
hamayya

[papal_authority]

Maybe you need the proxy information in /etc/make.conf:

Code: Select all

FTP_PROXY="http://10.0.0.1:3328"
HTTP_PROXY="http://10.0.0.1:3328"

[hamayya]

Now,after you said,i added the same .
i tried both the following formats

http://xxx:3328 and http://username:passwd@xxx:3328

both failed with the same error

What else could be the problem>????
TIA
hamayya

[papal_authority]

DNS issue maybe? Is your /etc/resolv.conf setup correctly?

[Lasitus]

Are you behind a firewall that is blocking the rsync port? I get a similar message at work and have to use emerge-webrsync.

[hamayya]

Are you behind a firewall that is blocking the rsync port? I get a similar message at work and have to use emerge-webrsync.

I dont think so,because many of my friends use gentoo.......btw,how do we check whether the rsync port is blocked or not? which port does it correspond?(then,i may use nmap)

viswa

[masseya]

Make sure that all your rc files are properly sourced when you open your terminals. (i.e. check your environment variables for the proxy info)

The default rsync port is 873 (I believe) so make sure that you can get that through any firewalls you may be behind. If not, use emerge-webrsync as a backup method.

[DrWoland]

I had the same problem. Ping rsync.gentoo.org and tell me what IP it gives you. There are two possibilities, one didn't work for me, the other did. Just had to edit /etc/hosts a little.

[hamayya]

I dont think the problem is with the network because
#scripts/bootstrap.sh
worked fine and is presently downloading the linux headers...........
So,do I get any trouble later because I omitted that step??

TIA

[racoontje]

Have you tried emerge websync?

[hamayya]

yes,i tried it.i cant post the out put as ,presently,my gentoo system is being installed.............

[zit]

It seems to me you might be having a MTU problem on your eth interface. If so, you'll have further errors like this even though some downloads work ok. Then, try to lower your MTU.

[iancognito85]

for the record, i am also having identical problems. I have 3 gentoo boxes running, and a laptop. im just putting gentoo on the laptop, and that is the only one having the problems with syncing, complaining that there is no MD5 entry on the server. I am guessing that the rsync server has not been updated with the new portage snapshot information. The other 3 machines that i am running all sync fine, but are using portage releases about 5 months old.

cheers

offie

[gsohos]

I have similar problems. I am trying to rsync using emerge --sync and keep getting messages like the following:

Code: Select all

metadata/
metadata/cache/net-irc/
metadata/cache/net-mail/
metadata/cache/sci-biology/
metadata/dtd/
metadata/glsa/
net-irc/dircproxy/
net-mail/getmail/
sci-biology/bioperl/
sys-kernel/gentoo-dev-sources/
sys-kernel/xbox-sources/
rsync: connection unexpectedly closed (2407943 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(189)
>>> retry ...

I have tried

Code: Select all

mirrirselect -r

and

Code: Select all

mirrirselect -a -D -s4 -b10 -o

to update my mirrors, but I get the same message again. (BTW, the second mirrorselect command puts a lot of garbage on my screen.
emerge-webrsync seems to move a bit further, although it also breaks. In my case, the bahavior is like this:

emerge tries to contact a mirror, it succeeds getting through, says something about receiving a file list and considering 104102 files. It then starts doing something but getstuck at

Code: Select all

sys-kernel/xbox-sources/Manifest
        2080 100%    0.00kB/s    0:00:00
rsync: connection unexpectedly closed (2439381 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(189)
>>> retry ...

and moves to the next mirror where the same thing happens. This is reproducible. Any ideas?

Thanks,
George

[DrWoland]

Try this:

Code: Select all

nano -w /etc/hosts
140.211.166.165 rsync.gentoo.org    <--- add this line in there.

[gsohos]

Try this:

Code: Select all

nano -w /etc/hosts
140.211.166.165 rsync.gentoo.org    <--- add this line in there.

It burfs at a different point this time, but in the same way:

Code: Select all

x11-themes/ximian-artwork/ximian-artwork-0.2.29.0.6.3.ebuild
        1964 100%    0.00kB/s    0:00:00
rsync: connection unexpectedly closed (2352821 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(189)
>>> retry ...

emerge doesn't die immediately, it retries and gets to a different mirror (rsync22), but that causes the same error as well. How do you debug this? Do I need to know python? Can I start emerge in a debugger and step through that piece?

Thanks,
George

[boogerman]

Have you tried emerge websync?

Not to criticize, but isn't it emerge-websync. It might be the problem, although I'm pretty sure you figured that out.

[zit]

Dont want to repeat myself, but this kind of error can come from an improprer mtu setting.
Try:

Code: Select all

ifconfig eth0 mtu 1400

And tell us weither it works out or not.

[Olis]

Have you tried emerge websync?

Not to criticize, but isn't it emerge-websync. It might be the problem, although I'm pretty sure you figured that out.

You're both wrong

It's emerge-webrsync

Oliver

[PLo]

Thx DrWoland, worked fine for me...
strange thing, name server was correct... and half an hour before it worked fine.
But I think I am happy with this solution.

Greetz,

PLo

[rockfly]

it's a firewall issue

[Sven Vermeulen]

Try this:

Code: Select all

nano -w /etc/hosts
140.211.166.165 rsync.gentoo.org    <--- add this line in there.

It's not really recommended to hardset an IP in /etc/hosts like that. Chances are that you'll forget that it is set there and you'll have issues later on what that particular IP address is removed from our rsync rotation.

A better approach would be to look for an rsync server you find fast (local ones are good) and define that one in the SYNC variable inside /etc/make.conf.

[gsohos]

This still does not work. After trying emerge sync after a few days, I got several updates and finally (in updating xfce4-extras) an error like tihis

Code: Select all

receiving file list ...
107789 files to consider
rsync: connection unexpectedly closed (2383787 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(189)

This does not go away no matter how many times I retry emerge sync. I have also tried emerge'ing portage, etc-update, and trying again. Finally, I tried emerge-webrsync. This produces the following:

Code: Select all

xfce-extra/xfwm4-themes/files/
rsync: connection unexpectedly closed (2535466 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(189)
rsync: connection unexpectedly closed (7816 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(189)
cleaning up
transferring metadata/cache
 
 
Performing Global Updates: /usr/portage/profiles/updates/1Q-2005
(Could take a couple of minutes if you have a lot of binary packages.)
  .='update pass'  *='binary update'  @='/var/db move'
  s='/var/db SLOT move' S='binary SLOT move' p='update /etc/portage/package.*'
..................
skipping sync

Any ideas? (I have even tried setting the mtu as someone suggested, although I don't see the point. My connection settings have been working like this for a long time)

Thanks, George

[JjcampNR]

I've also been having a real lot of trouble trying to sync lately. I've been using Gentoo for a long time and have never had trouble syncing on any of my installs. The settings I've been using are the same as always but recently something has just not been working. I do run ~x86 keywords and I"ve noticed at work where I run a stable system this problem hasn't shown up. I'm beginning to wonder if something in one of the recent Portage updates is causing the problem. For reference, here's a few of the errors that I've been receiving:

Code: Select all

receiving file list ...
107803 files to consider
io timeout after 31 seconds - exiting
rsync error: timeout in data send/receive (code 30) at io.c(153)

and

Code: Select all

x11-libs/gtk+/files/
x11-misc/
x11-plugins/
x11-terms/
x11-themes/
x11-wm/
x11-wm/fluxbox/files/
rsync: connection unexpectedly closed (2493834 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(359)
>>> retry ...
emerge sync
>>> starting rsync with rsync://204.89.193.10/gentoo-portage...
>>> checking server timestamp ...
rsync: failed to connect to 204.89.193.10: Connection refused (111)
rsync error: error in socket IO (code 10) at clientserver.c(94)
>>> retry ...

and also:

Code: Select all

This machine is also called rsync24.us.gentoo.org

receiving file list ...
107804 files to consider
rsync error: timeout in data send/receive (code 30) at io.c(153)
rsync: connection unexpectedly closed (2494920 bytes received so far) [receiver]
rsync error: error in rsync protocol data stream (code 12) at io.c(359)
rsync: connection unexpectedly closed (2494920 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(359)

These are only some of the examples, if anyone needs more info I'm happy to post. For reference, here's some system info for you:

Code: Select all

 emerge info
Portage 2.0.51-r13 (default-linux/x86/2004.3, gcc-3.4.3, glibc-2.3.4.20041102-r0
, 2.6.10-gentoo-r3 i686)
=================================================================
System uname: 2.6.10-gentoo-r3 i686 Pentium III (Coppermine)
Gentoo Base System version 1.6.8
Python:              dev-lang/python-2.3.4 [2.3.4 (#1, Dec 18 2004, 01:28:51)]
dev-lang/python:     2.3.4
sys-devel/autoconf:  2.59-r6, 2.13
sys-devel/automake:  1.8.5-r2, 1.5, 1.4_p6, 1.6.3, 1.7.9, 1.9.4
sys-devel/binutils:  2.15.92.0.2-r2
sys-devel/libtool:   1.5.10-r2
virtual/os-headers:  2.6.8.1-r2
ACCEPT_KEYWORDS="x86 ~x86"
AUTOCLEAN="yes"
CFLAGS="-mtune=pentium3 -march=pentium3 -O3 -pipe -fomit-frame-pointer -fforce-a
ddr  -falign-functions=4 -fprefetch-loop-arrays"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/2/share/config /usr/kde/3.3/env /usr/kde/3.3/share
/config /usr/kde/3.3/shutdown /usr/kde/3/share/config /usr/lib/X11/xkb /usr/shar
e/config /var/qmail/control"
CONFIG_PROTECT_MASK="/etc/gconf /etc/terminfo /etc/env.d"
CXXFLAGS="-mtune=pentium3 -march=pentium3 -O3 -pipe -fomit-frame-pointer -fforce
-addr  -falign-functions=4 -fprefetch-loop-arrays"
DISTDIR="/usr/portage/distfiles"
FEATURES="autoaddcvs autoconfig ccache distlocks sandbox sfperms"
GENTOO_MIRRORS="ftp://ftp-stud.fht-esslingen.de/pub/Mirrors/gentoo/ http://mirrr.datapipe.net/gentoo http://mirror.datapipe.net/gentoo http://mirrors.acm.cs.ri.edu/gentoo/"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
SYNC="rsync://rsync.namerica.gentoo.org/gentoo-portage"
USE="X aalib, acl, aim, alsa, apm arts arts, audiofile, avi avi, berkdb berkdb,bitmap-fonts cdr cdr, crypt cups dga, directfb, divx4linux, doc, dvd, encode enode, esd f77 fam fbcon, flac flac, font-server foomaticdb fortran ftp, gd, gdbmgdbm, ggi, gif gif, ginac, gnome gpm gpm, gstreamer, gtk gtk, gtk2 gtk2, imagemgick imap, imlib imlib, ipv6 java, jpeg jpeg, kde kde, libg++ libg++, libwww liwww, mad mad, mikmod mime, mmx, mng, motif mpeg mpeg, mpi, nas, ncurses ncurses nls nls, odbc, offensive, oggvorbis oggvorbis, opengl opengl, oscar, oss pam pflib pdflib, perl png png, python python, qt qt, quicktime quicktime, readlineeadline, recode, ruby, samba, sasl, sdl sdl, slang slang, spell spell, sse, sslssl, svg, svga svga, tcltk, tcpd tcpd, tetex, tiff tiff, truetype truetype, trutype-fonts type1-fonts unicode, videos, wmf, x86 x86, xml, xml2 xml2, xmms xmms xsl, xv xv, xvid, zlib zlib,"
Unset:  LDFLAGS, PORTDIR_OVERLAY

Thanks for the help!
Josh

EDIT: I also should have mentioned that I'm not behind a firewall and that my settings have worked correctly for the last 4 months or so and nothing important has been changed except for package updates.

[fai]

seems that i am not alone, i have the same problem as hamayya's
i didn't update my gentoo for a long time, but when i try emerge rsync today, it dodn't work, showing the same messages as hamayya's,
but my machine is not behind firewall, and i didn't change any of my network settings since i had it installed.
any clue or link that i can follow? thx in adv.