Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
can't emerge --sync
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Installing Gentoo
View previous topic :: View next topic  
Author Message
concord
Apprentice
Apprentice


Joined: 02 Oct 2005
Posts: 191

PostPosted: Wed Jun 09, 2010 11:49 pm    Post subject: can't emerge --sync Reply with quote

Hi Friends:

At least 3 months, I have problem with --sync. The messages is always as:

Code:
# emerge --sync
>>> Starting rsync with rsync://134.68.240.59/gentoo-portage...
>>> Checking server timestamp ...
Welcome to hawk.gentoo.org / rsync.gentoo.org
 
Server Address : 134.68.240.59
Contact Name   : mirror-admin@gentoo.org
Hardware       : 1 x Intel(R) Pentium(R) 4 CPU 2.40GHz, 2024MB RAM
 
Please note: common gentoo-netiquette says you should not sync more
than once a day.  Users who abuse the rsync.gentoo.org rotation
may be added to a temporary ban list.

MOTD autogenerated by update-rsync-motd on Mon May 24 23:10:46 UTC 2010

receiving incremental file list
timestamp.chk

Number of files: 1
Number of files transferred: 1
Total file size: 32 bytes
Total transferred file size: 32 bytes
Literal data: 32 bytes
Matched data: 0 bytes
File list size: 27
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 98
Total bytes received: 572

sent 98 bytes  received 572 bytes  89.33 bytes/sec
total size is 32  speedup is 0.05
Welcome to hawk.gentoo.org / rsync.gentoo.org
 
Server Address : 134.68.240.59
Contact Name   : mirror-admin@gentoo.org
Hardware       : 1 x Intel(R) Pentium(R) 4 CPU 2.40GHz, 2024MB RAM
 
Please note: common gentoo-netiquette says you should not sync more
than once a day.  Users who abuse the rsync.gentoo.org rotation
may be added to a temporary ban list.

MOTD autogenerated by update-rsync-motd on Mon May 24 23:10:46 UTC 2010

io timeout after 180 seconds -- exiting
rsync error: timeout in data send/receive (code 30) at io.c(200) [receiver=3.0.6]
>>> Retrying...


>>> Starting retry 1 of 3 with rsync://134.68.240.58/gentoo-portage
>>> Checking server timestamp ...
timed out
rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(544) [receiver=3.0.6]
>>> Retrying...


>>> Starting retry 2 of 3 with rsync://88.198.83.250/gentoo-portage
>>> Checking server timestamp ...
timed out
rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(544) [receiver=3.0.6]
>>> Retrying...


>>> Starting retry 3 of 3 with rsync://91.186.30.235/gentoo-portage
>>> Checking server timestamp ...
timed out
rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(544) [receiver=3.0.6]
>>> Exceeded PORTAGE_RSYNC_RETRIES: 3


Help me please

Thanks in advance!
_________________
AMD64 Desktop
Pentium4 Laptop
Pentium3 Server


Last edited by concord on Fri Jun 11, 2010 7:20 am; edited 1 time in total
Back to top
View user's profile Send private message
cach0rr0
Moderator
Moderator


Joined: 13 Nov 2008
Posts: 4122
Location: Houston, Republic of Texas

PostPosted: Thu Jun 10, 2010 12:33 am    Post subject: Reply with quote

possible firewall change?

try

Code:

emerge-webrsync


see if that goes through successfully
_________________
Lost configuring your system?
dump lspci -n here | see Pappy's guide | Link Stash
Back to top
View user's profile Send private message
concord
Apprentice
Apprentice


Joined: 02 Oct 2005
Posts: 191

PostPosted: Fri Jun 11, 2010 7:22 am    Post subject: Reply with quote

cach0rr0 wrote:
possible firewall change?

try

Code:

emerge-webrsync


see if that goes through successfully


Thanks very much for your help. emerge -webrsync woks, but it's very slow. Why emerge --sync no work?
_________________
AMD64 Desktop
Pentium4 Laptop
Pentium3 Server
Back to top
View user's profile Send private message
cach0rr0
Moderator
Moderator


Joined: 13 Nov 2008
Posts: 4122
Location: Houston, Republic of Texas

PostPosted: Fri Jun 11, 2010 7:36 am    Post subject: Reply with quote

concord wrote:

Thanks very much for your help. emerge -webrsync woks, but it's very slow. Why emerge --sync no work?


Yeah, indeed it's a bit slow. The most obvious issues I can think of, would be either you're going through a proxy, or you have a firewall blocking off rsync access.

rsync.gentoo.org has multiple IP's - try doing a telnet to port 873 on a few of them and see if you can connect.

Code:

# host rsync.gentoo.org
rsync.gentoo.org has address 88.198.83.250
rsync.gentoo.org has address 88.198.83.249
rsync.gentoo.org has address 209.177.148.226
rsync.gentoo.org has address 140.211.166.189
rsync.gentoo.org has address 134.68.240.59
rsync.gentoo.org has address 134.68.240.58
rsync.gentoo.org has address 134.68.240.40
rsync.gentoo.org has address 91.186.30.235

_________________
Lost configuring your system?
dump lspci -n here | see Pappy's guide | Link Stash
Back to top
View user's profile Send private message
Genone
Retired Dev
Retired Dev


Joined: 14 Mar 2003
Posts: 9013
Location: beyond the rim

PostPosted: Fri Jun 11, 2010 11:41 am    Post subject: Reply with quote

I don't think it's a firewall issue (not a simple block anyway), as he can connect to the server fine and the timestamp check is successful. I'd rather suspect a general network performance or IO issue.
When you said that `emerge-webrsync` is "very slow", what does that mean exactly? One minute, five minutes, half an hour, ... ? Also is the slow part in fetching the snapshot or more in updating the tree afterwards?
Back to top
View user's profile Send private message
d2_racing
Moderator
Moderator


Joined: 25 Apr 2005
Posts: 13046
Location: Ste-Foy,Canada

PostPosted: Fri Jun 11, 2010 11:45 am    Post subject: Reply with quote

Can you post your /etc/make.conf concord ?

emerge-webrsync uses TCP 80, so if he's not behind a firewall, then maybe his current rsync mirroir is pretty slow.

Changing his rsync variable could do the trick.
_________________
Sysadmin of GentooQuébec.org
Wiki
Signature
IRC on Freenode : #gentoo-quebec
Back to top
View user's profile Send private message
Genone
Retired Dev
Retired Dev


Joined: 14 Mar 2003
Posts: 9013
Location: beyond the rim

PostPosted: Fri Jun 11, 2010 4:02 pm    Post subject: Reply with quote

d2_racing wrote:
Can you post your /etc/make.conf concord ?

emerge-webrsync uses TCP 80, so if he's not behind a firewall, then maybe his current rsync mirroir is pretty slow.

Changing his rsync variable could do the trick.

Well, he got timeouts with at least three different mirrors ...
Back to top
View user's profile Send private message
cach0rr0
Moderator
Moderator


Joined: 13 Nov 2008
Posts: 4122
Location: Houston, Republic of Texas

PostPosted: Fri Jun 11, 2010 7:48 pm    Post subject: Reply with quote

Genone wrote:
I don't think it's a firewall issue (not a simple block anyway), as he can connect to the server fine and the timestamp check is successful. I'd rather suspect a general network performance or IO issue.
When you said that `emerge-webrsync` is "very slow", what does that mean exactly? One minute, five minutes, half an hour, ... ? Also is the slow part in fetching the snapshot or more in updating the tree afterwards?


you're quite right. maybe another sort of filtering device - an IPS, who knows.

Don't know, this is where I bow out and defer to the experts! :)
_________________
Lost configuring your system?
dump lspci -n here | see Pappy's guide | Link Stash
Back to top
View user's profile Send private message
Hu
Watchman
Watchman


Joined: 06 Mar 2007
Posts: 9168

PostPosted: Sat Jun 12, 2010 2:51 am    Post subject: Re: can't emerge --sync Reply with quote

concord wrote:
At least 3 months, I have problem with --sync.
Obvious question: what did you change about 3 months ago? Did you move to a new residence, change ISPs, change method of connection to the Internet, etc.? Do other large transfers work correctly? For example, can you download a stage3 tarball at a speed consistent with what your Internet connection should be able to support?
Back to top
View user's profile Send private message
concord
Apprentice
Apprentice


Joined: 02 Oct 2005
Posts: 191

PostPosted: Tue Jun 15, 2010 7:52 am    Post subject: Reply with quote

Thank you very much.

Following is the make.conf for generic gentoo installed on USB-HDD:

Code:
# These settings were set by the catalyst build script that automatically built
# Please consult /etc/make.conf.example for a more detailed example
CFLAGS="-O2 -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
CXXFLAGS="${CFLAGS}"
MAKEOPTS="-j5"
SYNC="rsync://rsync.asia.gentoo.org/gentoo-portage"
USE="lm_seneor pmu apm cjk userlocales -apm -qt3 qt3support mysql qt4 kde sql w$
#VIDEO_CARDS="apm ark ast chips cirrus dummy epson fbdev geode glint i128 i740 $
VIDEO_CARDS="*"
ALSA_CARDS="*"
INPUT_DEVICES="evdev mouse keyboard"
LINGUAS="zh zh_CN en en_US en_GB"
CCACHE_SIZE="2G"
CCACHE_DIR="/var/tmp/ccache"
FEATURES="parallel-fetch ccache"
PORTDIR_OVERLAY="/usr/portage/sys-fs/"
SUPPORT_ALSA="1"
source /usr/portage/local/layman/make.conf


I will post make.conf in my desktop soon
_________________
AMD64 Desktop
Pentium4 Laptop
Pentium3 Server
Back to top
View user's profile Send private message
concord
Apprentice
Apprentice


Joined: 02 Oct 2005
Posts: 191

PostPosted: Tue Jun 15, 2010 11:05 pm    Post subject: Reply with quote

make.conf of my desktop:

Code:
# These settings were set by the catalyst build script that automatically
# built this stage.
# Please consult /etc/make.conf.example for a more detailed example.
CFLAGS="-march=k8 -O2 -pipe"
CXXFLAGS="${CFLAGS}"
# WARNING: Changing your CHOST is not something that should be done lightly.
# Please consult http://www.gentoo.org/doc/en/change-chost.xml before changing.
CHOST="x86_64-pc-linux-gnu"
# These are the USE flags that were used in addition to what is provided by the
# profile used for building.
USE="eds evo gnome gstreamer -ipv6 mmx sse sse2 xulrunner sql webkit mysql"
MAKEOPTS="-j2"
INPUT_DEVISES="evdev kerboard mouse"
VIDEO_CARDS="radeon"
ALSA_CARDS="via82xx"
LINGUAS="zh_CN en_US en_GB"
CCACHE_SIZE="2G"
CCACHE_DIR="/var/tmp/ccache"
FEATURES="parallel-fetch userfetch ccache"

_________________
AMD64 Desktop
Pentium4 Laptop
Pentium3 Server
Back to top
View user's profile Send private message
Caladon
n00b
n00b


Joined: 13 Oct 2012
Posts: 15
Location: Vasa/Vörå

PostPosted: Tue Dec 11, 2012 6:45 pm    Post subject: syncing stuff Reply with quote

Just got to mention webrsync helped me lots on recent update when some packages failed to fetch.

When stuff fails to fetch I generally panic and do stupid things like deleting important files in the hope

that it will solve something.

So in brief:

1) Don't panic

2) Use webrsync when system can't find right address

3) It even found some keyrings I knew were missing but never bothered about earlier as a bonus.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Installing Gentoo All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum