View previous topic :: View next topic |
Author |
Message |
ajb128 n00b
Joined: 26 Sep 2002 Posts: 11 Location: Moo-town USA
|
Posted: Sun Mar 02, 2003 12:01 am Post subject: broken portage tree- can't emerge sync |
|
|
After hearing how great Gentoo is I decided to try it and got a fresh new install of Gentoo using a 1.4_rc3 live CD and the stage-3 tarball. The basic install went great, and I decided to I'd update the portage tree to get the newest apps and maybe upgrade my kernel. So I've been trying to do an emerge sync for the past 2 days, but it always fails in the middle:
rsync error: timeout in data send/receive (code 30) at io.c(85)
rsync: connection unexpectedly closed (877340 bytes read so far)
I have a fast connection through my aparmtent building, but sometimes get a pretty bad lag. Maybe this is why it fails? I don't know.
So I read that I could download the latest portage tree as a tar file. I did this, and then accidentally overwrote my /usr/portage directory with the one extracted from the downloaded tar file! So now I have a portage tree with a bunch of files missing, i.e. when I try and emerge something I get an error:
/usr/portage/eclass/eutils.eclass: No such file or directory
I try and fix my portage tree by following the directions in /usr/portage/sys-apps/portage/files/README.RESCUE, problem one of the steps is to do an emerge rsync, which still does not work for me.
I decided before I mess things up any worse, I should ask some people who might now what they're doing.
So, how can I get an up to date portage tree? How can I get emerge rsync to work? Any advice at all would be awesome.
Thanks!
aj |
|
Back to top |
|
|
Sven Vermeulen Retired Dev
Joined: 29 Aug 2002 Posts: 1345 Location: Mechelen, Belgium
|
Posted: Sun Mar 02, 2003 12:14 pm Post subject: |
|
|
You should be able to remove /usr/portage and issue a "emerge sync". This will download a complete /usr/portage tree.
Don't forget to check if /etc/make.profile is a symlink to the correct /usr/portage/profile/ subdirectory. |
|
Back to top |
|
|
PT_LAmb Guru
Joined: 22 Apr 2002 Posts: 332 Location: Lisboa (Lisbon), Portugal
|
Posted: Sun Mar 02, 2003 9:18 pm Post subject: |
|
|
There is also emerge-webrsync, but it does no more then fetching the latest snapshot and updating the tree, which you have done manually.
If you want to automate that task, you must first emerge gentoolkit
Good luck,
Ricardo Cordeiro _________________ SETI@Home - http://setiathome.ssl.berkeley.edu/ |
|
Back to top |
|
|
ajb128 n00b
Joined: 26 Sep 2002 Posts: 11 Location: Moo-town USA
|
Posted: Mon Mar 03, 2003 12:32 am Post subject: |
|
|
Thanks, the emerge-webrsync worked.
I'm still not sure why "emerge rsync" keeps failing. I tried to increase the timeout value, but it didn't help. |
|
Back to top |
|
|
Bogo Tux's lil' helper
Joined: 04 May 2002 Posts: 98
|
Posted: Mon Mar 03, 2003 1:27 am Post subject: |
|
|
Yeah I started getting this problem too out of the blue. I can emerge things, but I can't rsync. The webrsync thing seemed to work though. _________________ "I know it's only rock and roll but I like it." |
|
Back to top |
|
|
PT_LAmb Guru
Joined: 22 Apr 2002 Posts: 332 Location: Lisboa (Lisbon), Portugal
|
Posted: Mon Mar 03, 2003 6:55 pm Post subject: |
|
|
ajb128, I have an ideia. I think that the problem maybe be caused by a bad Internet link, or a firewall.
You can test the first hypothesis by checking the ping times. Run: Code: | host rsync.gentoo.org | awk '{print $4}' | xargs -l ping -c3 |
(you'll need net-misc/host)
And if the ping response are longer than 1 second, it might be a problem, or just contribute for it.
The other chance is if you have a firewall between you and the server. If that's true, the connection would even be made, so I don't think that's the case for what you've said. ajb128 wrote: | but it always fails in the middle |
Anyone has other ideias?
Good luck,
Ricardo Cordeiro _________________ SETI@Home - http://setiathome.ssl.berkeley.edu/ |
|
Back to top |
|
|
ajb128 n00b
Joined: 26 Sep 2002 Posts: 11 Location: Moo-town USA
|
Posted: Mon Mar 03, 2003 8:31 pm Post subject: |
|
|
I think the problem must be with my network connection and the rsync protocol. My network access is provided by my apartment through some sort of homePNA network. I usually get good speed (>30KB/sec) but will get loooong ping times every once in a while.
For instance, sometimes I attempt to load a web site that normally take ~1 second to load at it takes a minute or more.
I tried you command-
Quote: | host rsync.gentoo.org | awk '{print $4}' | xargs -l ping -c3 |
Most of the packets take around 190ms. However, sometimes a packet will be lost, or take >300ms. I think the rsync protocol doesn't handle these long lags or something.
Anyway, I got everything working using the webrsync, emerged Xfree 4.3.0 last night and I'm waiting for the KDE3.1 to build now.
It might be usefull to put a reference to emerge-webrsync in the installation guide for people with my situation.
Thanks for the help! |
|
Back to top |
|
|
PT_LAmb Guru
Joined: 22 Apr 2002 Posts: 332 Location: Lisboa (Lisbon), Portugal
|
Posted: Mon Mar 03, 2003 9:36 pm Post subject: |
|
|
ajb128 wrote: |
Most of the packets take around 190ms. However, sometimes a packet will be lost, or take >300ms. I think the rsync protocol doesn't handle these long lags or something. | Packet lost is very bad, even more with UDP applications. I don't know if that's rsync case, but certainly the problem maybe caused by loosing packages.
ajb128 wrote: | It might be usefull to put a reference to emerge-webrsync in the installation guide for people with my situation. | Then file a bug.
ajb128 wrote: | Thanks for the help! |
You're welcome!
Ricardo Cordeiro _________________ SETI@Home - http://setiathome.ssl.berkeley.edu/ |
|
Back to top |
|
|
scout Veteran
Joined: 08 Mar 2003 Posts: 1991 Location: France, Paris en Semaine / Metz le W-E
|
Posted: Sat Mar 08, 2003 10:40 pm Post subject: |
|
|
I experience the same problem. Do you use the firewall that is given in the Gentoo-security doc ? |
|
Back to top |
|
|
cavemanf16 n00b
Joined: 09 Mar 2003 Posts: 6 Location: New Albany, OH. USA
|
Posted: Sun Mar 09, 2003 4:27 am Post subject: Me too! |
|
|
I've had exactly the same problems, however I'm behind a Coyote Linux firewall system, which is probably contributing to my issues. I'll have to try that 'webrsync' trick later. Thanks everyone. |
|
Back to top |
|
|
rex n00b
Joined: 06 Mar 2003 Posts: 25 Location: Mexico
|
Posted: Sun Mar 09, 2003 6:26 am Post subject: |
|
|
Can somebody please help me. I also cannot issue an 'emerge sync'. I get the following response:
Code: | # emerge sync
>>> Note: /etc/make.profile isn't available; an 'emerge sync' will probably fix this.
>>> starting rsync with rsync://rsync.gentoo.org/gentoo-portage...
rsync: getaddrinfo: rsync.gentoo.org 873: No address associated with hostname
rsync error: error in socket IO (code 10) at clientserver.c(83)
>>> Starting retry 1 of 3
rsync: getaddrinfo: rsync.gentoo.org 873: No address associated with hostname
rsync error: error in socket IO (code 10) at clientserver.c(83)
>>> Starting retry 2 of 3
rsync: getaddrinfo: rsync.gentoo.org 873: No address associated with hostname
rsync error: error in socket IO (code 10) at clientserver.c(83)
>>> Starting retry 3 of 3
rsync: getaddrinfo: rsync.gentoo.org 873: No address associated with hostname
rsync error: error in socket IO (code 10) at clientserver.c(83)
* An update to portage is available. It is _highly_ recommended
* that you update portage now, before any other packages are updated.
* Please do so and the update ALL of you configuration files.
|
BTW, I am not behind a firewall or proxy. I connect with a cable modem at home.
Sven Vermeulen wrote: |
Don't forget to check if /etc/make.profile is a symlink to the correct /usr/portage/profile/ subdirectory. |
I do not even have the /usr/portage/profile subdirectory (I do have the symlink though). Is this the reason 'emerge sync' is not working?
-------
I already ran the emerge-webrsync but got the following:
Code: | rsync error: some files could not be transferred (code 23) at main.c(620)
*** Completed websync, please now perform a normal rsync if possible.
|
I just did another 'emerge sync', with the same negative results.
Any ideas would be greatly appreciated.
If it helps I am installing from a stage3 and have similar issues as AJ,
Rex |
|
Back to top |
|
|
Accipiter Tux's lil' helper
Joined: 24 Feb 2003 Posts: 87 Location: Buffalo, NY
|
Posted: Sun Mar 09, 2003 2:50 pm Post subject: Corroboration |
|
|
I have the same problem. rsync.gentoo.org is consistently unresolvable. This appears to be an issue with the server itself. |
|
Back to top |
|
|
soulwarrior Guru
Joined: 21 Oct 2002 Posts: 331
|
Posted: Sun Mar 09, 2003 9:45 pm Post subject: |
|
|
I have the same problem today (09.03.2003).
Emerge sync seems to only contact "rsync.gentoo.org".
Is there a method to fallback to another server for the emerge sync? |
|
Back to top |
|
|
slow n00b
Joined: 01 Mar 2003 Posts: 7
|
Posted: Sun Mar 09, 2003 10:08 pm Post subject: |
|
|
me too
Code: | rsync: getaddrinfo: rsync.gentoo.org 873: No address associated with hostname
rsync error: error in socket IO (code 10) at clientserver.c(83) |
that emerge-webrsync seems work for now, but I would like to get to the bottom of this problem.
no fire wall just going through a realtek nic and rca cable modem. |
|
Back to top |
|
|
rex n00b
Joined: 06 Mar 2003 Posts: 25 Location: Mexico
|
Posted: Mon Mar 10, 2003 9:00 am Post subject: Re: Corroboration |
|
|
Accipiter wrote: | I have the same problem. rsync.gentoo.org is consistently unresolvable. This appears to be an issue with the server itself. |
Completely agree. All other 'emerge <whatever>' commands work, except for 'sync'. Are we supposed to report it as a bug? |
|
Back to top |
|
|
cvk Guru
Joined: 06 Jan 2003 Posts: 314 Location: Our house, in the middle of our street
|
Posted: Mon Mar 10, 2003 9:10 am Post subject: |
|
|
Same error here... _________________ Adopt an unanswered post now. |
|
Back to top |
|
|
soulwarrior Guru
Joined: 21 Oct 2002 Posts: 331
|
Posted: Mon Mar 10, 2003 6:56 pm Post subject: |
|
|
works again fine |
|
Back to top |
|
|
Accipiter Tux's lil' helper
Joined: 24 Feb 2003 Posts: 87 Location: Buffalo, NY
|
Posted: Mon Mar 10, 2003 7:12 pm Post subject: Some information |
|
|
There are at least three threads that have been started pertaining to this particular problem (the moderators should merge them, or at least make one sticky so more posts go there).
That said, a solution was proposed in one of the parallel threads that (I believe) was not posted here. Either way, I reiterate it for those of you who have not searched enough.
Add the following line to /etc/make.conf:
Code: | SYNC="rsync://rsync.us.gentoo.org/gentoo-portage" |
Where "us" may be replaced by the ISO two-letter country code of your choice (i.e. "jp" for Japan, "uk" for the United Kingdom, etc.). This should resolve properly and allow you to execute rsync as normal.
But that is only one workaround. Another solution was proposed (along with a rather technical, but accurate explanation that is accepted as the Administrators' point of view), which deals with the configuration of routers/firewalls for those who use them. ISPs and certain routers seem to be knocking down the DNS queries for the reason that post explains... but user "patan" can explain it better than I can. |
|
Back to top |
|
|
rex n00b
Joined: 06 Mar 2003 Posts: 25 Location: Mexico
|
Posted: Tue Mar 11, 2003 11:16 pm Post subject: Re: Some information |
|
|
Accipiter wrote: | Add the following line to /etc/make.conf:
Code: | SYNC="rsync://rsync.us.gentoo.org/gentoo-portage" |
Where "us" may be replaced by the ISO two-letter country code of your choice (i.e. "jp" for Japan, "uk" for the United Kingdom, etc.). This should resolve properly and allow you to execute rsync as normal.
|
This is a pretty good option that I have seen mentioned before in another post, but the administrator there suggested adding to make.config a number of IP addresses to replace the URL. I can't seem to find it though. |
|
Back to top |
|
|
pjp Administrator
Joined: 16 Apr 2002 Posts: 20067
|
Posted: Sun Mar 16, 2003 4:57 am Post subject: |
|
|
Code: | * An update to portage is available. It is _highly_ recommended
* that you update portage now, before any other packages are updated.
* Please do so and the update ALL of you configuration files. |
In case anyone is wondering, this is explained in Portage version... _________________ Quis separabit? Quo animo? |
|
Back to top |
|
|
|