Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
broken portage tree- can't emerge sync
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Portage & Programming
View previous topic :: View next topic  
Author Message
ajb128
n00b
n00b


Joined: 26 Sep 2002
Posts: 11
Location: Moo-town USA

PostPosted: Sun Mar 02, 2003 12:01 am    Post subject: broken portage tree- can't emerge sync Reply with quote

After hearing how great Gentoo is I decided to try it and got a fresh new install of Gentoo using a 1.4_rc3 live CD and the stage-3 tarball. The basic install went great, and I decided to I'd update the portage tree to get the newest apps and maybe upgrade my kernel. So I've been trying to do an emerge sync for the past 2 days, but it always fails in the middle:

rsync error: timeout in data send/receive (code 30) at io.c(85)
rsync: connection unexpectedly closed (877340 bytes read so far)

I have a fast connection through my aparmtent building, but sometimes get a pretty bad lag. Maybe this is why it fails? I don't know.

So I read that I could download the latest portage tree as a tar file. I did this, and then accidentally overwrote my /usr/portage directory with the one extracted from the downloaded tar file! :twisted: So now I have a portage tree with a bunch of files missing, i.e. when I try and emerge something I get an error:

/usr/portage/eclass/eutils.eclass: No such file or directory

I try and fix my portage tree by following the directions in /usr/portage/sys-apps/portage/files/README.RESCUE, problem one of the steps is to do an emerge rsync, which still does not work for me.

I decided before I mess things up any worse, I should ask some people who might now what they're doing.

So, how can I get an up to date portage tree? How can I get emerge rsync to work? Any advice at all would be awesome.

Thanks!

aj
Back to top
View user's profile Send private message
Sven Vermeulen
Retired Dev
Retired Dev


Joined: 29 Aug 2002
Posts: 1345
Location: Mechelen, Belgium

PostPosted: Sun Mar 02, 2003 12:14 pm    Post subject: Reply with quote

You should be able to remove /usr/portage and issue a "emerge sync". This will download a complete /usr/portage tree.

Don't forget to check if /etc/make.profile is a symlink to the correct /usr/portage/profile/ subdirectory.
Back to top
View user's profile Send private message
PT_LAmb
Guru
Guru


Joined: 22 Apr 2002
Posts: 332
Location: Lisboa (Lisbon), Portugal

PostPosted: Sun Mar 02, 2003 9:18 pm    Post subject: Reply with quote

There is also emerge-webrsync, but it does no more then fetching the latest snapshot and updating the tree, which you have done manually.

If you want to automate that task, you must first emerge gentoolkit

Good luck,
Ricardo Cordeiro :)
_________________
SETI@Home - http://setiathome.ssl.berkeley.edu/
Back to top
View user's profile Send private message
ajb128
n00b
n00b


Joined: 26 Sep 2002
Posts: 11
Location: Moo-town USA

PostPosted: Mon Mar 03, 2003 12:32 am    Post subject: Reply with quote

Thanks, the emerge-webrsync worked.

I'm still not sure why "emerge rsync" keeps failing. I tried to increase the timeout value, but it didn't help.
Back to top
View user's profile Send private message
Bogo
Tux's lil' helper
Tux's lil' helper


Joined: 04 May 2002
Posts: 98

PostPosted: Mon Mar 03, 2003 1:27 am    Post subject: Reply with quote

Yeah I started getting this problem too out of the blue. I can emerge things, but I can't rsync. The webrsync thing seemed to work though.
_________________
"I know it's only rock and roll but I like it."
Back to top
View user's profile Send private message
PT_LAmb
Guru
Guru


Joined: 22 Apr 2002
Posts: 332
Location: Lisboa (Lisbon), Portugal

PostPosted: Mon Mar 03, 2003 6:55 pm    Post subject: Reply with quote

ajb128, I have an ideia. I think that the problem maybe be caused by a bad Internet link, or a firewall.

You can test the first hypothesis by checking the ping times. Run:
Code:
host rsync.gentoo.org | awk '{print $4}' | xargs -l ping -c3

(you'll need net-misc/host)

And if the ping response are longer than 1 second, it might be a problem, or just contribute for it.

The other chance is if you have a firewall between you and the server. If that's true, the connection would even be made, so I don't think that's the case for what you've said.
ajb128 wrote:
but it always fails in the middle

Anyone has other ideias?

Good luck,
Ricardo Cordeiro :)
_________________
SETI@Home - http://setiathome.ssl.berkeley.edu/
Back to top
View user's profile Send private message
ajb128
n00b
n00b


Joined: 26 Sep 2002
Posts: 11
Location: Moo-town USA

PostPosted: Mon Mar 03, 2003 8:31 pm    Post subject: Reply with quote

I think the problem must be with my network connection and the rsync protocol. My network access is provided by my apartment through some sort of homePNA network. I usually get good speed (>30KB/sec) but will get loooong ping times every once in a while.

For instance, sometimes I attempt to load a web site that normally take ~1 second to load at it takes a minute or more.

I tried you command-
Quote:
host rsync.gentoo.org | awk '{print $4}' | xargs -l ping -c3

Most of the packets take around 190ms. However, sometimes a packet will be lost, or take >300ms. I think the rsync protocol doesn't handle these long lags or something.


Anyway, I got everything working using the webrsync, emerged Xfree 4.3.0 last night and I'm waiting for the KDE3.1 to build now. 8)

It might be usefull to put a reference to emerge-webrsync in the installation guide for people with my situation.

Thanks for the help!
Back to top
View user's profile Send private message
PT_LAmb
Guru
Guru


Joined: 22 Apr 2002
Posts: 332
Location: Lisboa (Lisbon), Portugal

PostPosted: Mon Mar 03, 2003 9:36 pm    Post subject: Reply with quote

ajb128 wrote:

Most of the packets take around 190ms. However, sometimes a packet will be lost, or take >300ms. I think the rsync protocol doesn't handle these long lags or something.
Packet lost is very bad, even more with UDP applications. I don't know if that's rsync case, but certainly the problem maybe caused by loosing packages.

ajb128 wrote:
It might be usefull to put a reference to emerge-webrsync in the installation guide for people with my situation.
Then file a bug.

ajb128 wrote:
Thanks for the help!


You're welcome! :)

Ricardo Cordeiro :)
_________________
SETI@Home - http://setiathome.ssl.berkeley.edu/
Back to top
View user's profile Send private message
scout
Veteran
Veteran


Joined: 08 Mar 2003
Posts: 1991
Location: France, Paris en Semaine / Metz le W-E

PostPosted: Sat Mar 08, 2003 10:40 pm    Post subject: Reply with quote

I experience the same problem. Do you use the firewall that is given in the Gentoo-security doc ?
Back to top
View user's profile Send private message
cavemanf16
n00b
n00b


Joined: 09 Mar 2003
Posts: 6
Location: New Albany, OH. USA

PostPosted: Sun Mar 09, 2003 4:27 am    Post subject: Me too! Reply with quote

I've had exactly the same problems, however I'm behind a Coyote Linux firewall system, which is probably contributing to my issues. I'll have to try that 'webrsync' trick later. Thanks everyone.
Back to top
View user's profile Send private message
rex
n00b
n00b


Joined: 06 Mar 2003
Posts: 25
Location: Mexico

PostPosted: Sun Mar 09, 2003 6:26 am    Post subject: Reply with quote

Can somebody please help me. I also cannot issue an 'emerge sync'. I get the following response:
Code:
# emerge sync
>>> Note: /etc/make.profile isn't available; an 'emerge sync' will probably fix this.
>>> starting rsync with rsync://rsync.gentoo.org/gentoo-portage...
rsync: getaddrinfo: rsync.gentoo.org 873: No address associated with hostname
rsync error: error in socket IO (code 10) at clientserver.c(83)
>>> Starting retry 1 of 3
rsync: getaddrinfo: rsync.gentoo.org 873: No address associated with hostname
rsync error: error in socket IO (code 10) at clientserver.c(83)
>>> Starting retry 2 of 3
rsync: getaddrinfo: rsync.gentoo.org 873: No address associated with hostname
rsync error: error in socket IO (code 10) at clientserver.c(83)
>>> Starting retry 3 of 3
rsync: getaddrinfo: rsync.gentoo.org 873: No address associated with hostname
rsync error: error in socket IO (code 10) at clientserver.c(83)

* An update to portage is available. It is _highly_ recommended
* that you update portage now, before any other packages are updated.
* Please do so and the update ALL of you configuration files.

BTW, I am not behind a firewall or proxy. I connect with a cable modem at home.

Sven Vermeulen wrote:

Don't forget to check if /etc/make.profile is a symlink to the correct /usr/portage/profile/ subdirectory.

I do not even have the /usr/portage/profile subdirectory (I do have the symlink though). Is this the reason 'emerge sync' is not working?
-------
I already ran the emerge-webrsync but got the following:
Code:
rsync error: some files could not be transferred (code 23) at main.c(620)

 *** Completed websync, please now perform a normal rsync if possible.

I just did another 'emerge sync', with the same negative results.
Any ideas would be greatly appreciated.

If it helps I am installing from a stage3 and have similar issues as AJ,

Rex
Back to top
View user's profile Send private message
Accipiter
Tux's lil' helper
Tux's lil' helper


Joined: 24 Feb 2003
Posts: 87
Location: Buffalo, NY

PostPosted: Sun Mar 09, 2003 2:50 pm    Post subject: Corroboration Reply with quote

I have the same problem. rsync.gentoo.org is consistently unresolvable. This appears to be an issue with the server itself.
Back to top
View user's profile Send private message
soulwarrior
Guru
Guru


Joined: 21 Oct 2002
Posts: 331

PostPosted: Sun Mar 09, 2003 9:45 pm    Post subject: Reply with quote

I have the same problem today (09.03.2003).

Emerge sync seems to only contact "rsync.gentoo.org".

Is there a method to fallback to another server for the emerge sync?
Back to top
View user's profile Send private message
slow
n00b
n00b


Joined: 01 Mar 2003
Posts: 7

PostPosted: Sun Mar 09, 2003 10:08 pm    Post subject: Reply with quote

:? me too
Code:
rsync: getaddrinfo: rsync.gentoo.org 873: No address associated with hostname
rsync error: error in socket IO (code 10) at clientserver.c(83)


that emerge-webrsync seems work for now, but I would like to get to the bottom of this problem.

no fire wall just going through a realtek nic and rca cable modem.
Back to top
View user's profile Send private message
rex
n00b
n00b


Joined: 06 Mar 2003
Posts: 25
Location: Mexico

PostPosted: Mon Mar 10, 2003 9:00 am    Post subject: Re: Corroboration Reply with quote

Accipiter wrote:
I have the same problem. rsync.gentoo.org is consistently unresolvable. This appears to be an issue with the server itself.

Completely agree. All other 'emerge <whatever>' commands work, except for 'sync'. Are we supposed to report it as a bug? :wink:
Back to top
View user's profile Send private message
cvk
Guru
Guru


Joined: 06 Jan 2003
Posts: 314
Location: Our house, in the middle of our street

PostPosted: Mon Mar 10, 2003 9:10 am    Post subject: Reply with quote

Same error here...
_________________
Adopt an unanswered post now.
Back to top
View user's profile Send private message
soulwarrior
Guru
Guru


Joined: 21 Oct 2002
Posts: 331

PostPosted: Mon Mar 10, 2003 6:56 pm    Post subject: Reply with quote

works again fine :D
Back to top
View user's profile Send private message
Accipiter
Tux's lil' helper
Tux's lil' helper


Joined: 24 Feb 2003
Posts: 87
Location: Buffalo, NY

PostPosted: Mon Mar 10, 2003 7:12 pm    Post subject: Some information Reply with quote

There are at least three threads that have been started pertaining to this particular problem (the moderators should merge them, or at least make one sticky so more posts go there).

That said, a solution was proposed in one of the parallel threads that (I believe) was not posted here. Either way, I reiterate it for those of you who have not searched enough.
Add the following line to /etc/make.conf:
Code:
SYNC="rsync://rsync.us.gentoo.org/gentoo-portage"

Where "us" may be replaced by the ISO two-letter country code of your choice (i.e. "jp" for Japan, "uk" for the United Kingdom, etc.). This should resolve properly and allow you to execute rsync as normal.

But that is only one workaround. Another solution was proposed (along with a rather technical, but accurate explanation that is accepted as the Administrators' point of view), which deals with the configuration of routers/firewalls for those who use them. ISPs and certain routers seem to be knocking down the DNS queries for the reason that post explains... but user "patan" can explain it better than I can. :)
Back to top
View user's profile Send private message
rex
n00b
n00b


Joined: 06 Mar 2003
Posts: 25
Location: Mexico

PostPosted: Tue Mar 11, 2003 11:16 pm    Post subject: Re: Some information Reply with quote

Accipiter wrote:
Add the following line to /etc/make.conf:
Code:
SYNC="rsync://rsync.us.gentoo.org/gentoo-portage"

Where "us" may be replaced by the ISO two-letter country code of your choice (i.e. "jp" for Japan, "uk" for the United Kingdom, etc.). This should resolve properly and allow you to execute rsync as normal.

This is a pretty good option that I have seen mentioned before in another post, but the administrator there suggested adding to make.config a number of IP addresses to replace the URL. I can't seem to find it though. :(
Back to top
View user's profile Send private message
pjp
Administrator
Administrator


Joined: 16 Apr 2002
Posts: 20067

PostPosted: Sun Mar 16, 2003 4:57 am    Post subject: Reply with quote

Code:
* An update to portage is available. It is _highly_ recommended
* that you update portage now, before any other packages are updated.
* Please do so and the update ALL of you configuration files.

In case anyone is wondering, this is explained in Portage version...
_________________
Quis separabit? Quo animo?
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Portage & Programming All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum