Gentoo Forums
Gentoo Forums
Quick Search: in
emerge sync does nothing
View unanswered posts
View posts from last 24 hours

rackathon
 
Reply to topic    Gentoo Forums Forum Index Portage & Programming
View previous topic :: View next topic  
Author Message
greg32
Apprentice
Apprentice


Joined: 26 Mar 2003
Posts: 259
Location: Australia

PostPosted: Thu Jun 10, 2004 4:03 am    Post subject: emerge sync does nothing Reply with quote

an emerge sync results in this:

>>> starting rsync with rsync://134.68.220.74/gentoo-portage...
>>> checking server timestamp ...
rsync: failed to connect to 134.68.220.74: Connection timed out
rsync error: error in socket IO (code 10) at clientserver.c(88)
>>> retry ...


Has been like this for a couple of days. I have not changed anything that I can think of. All other net related stuff works, just not emerge sync. I can emerge packages, and they download, so I am buggered if I can work it out - any ideas??

Cheers
Greg
_________________
Never get so busy making a living, that you forget to make a life.
Back to top
View user's profile Send private message
dhurt
Apprentice
Apprentice


Joined: 14 May 2003
Posts: 278
Location: Davis, CA

PostPosted: Thu Jun 10, 2004 4:27 am    Post subject: Reply with quote

Does this happen with all rsync servers? Have you tried rsyncing with one of the main mirrors like:

rsync://rsync.gentoo.org/gentoo-portage

or

rsync://rsync.us.gentoo.org/gentoo-portage
_________________
"And isn't sanity really just a one-trick pony, anyway? I mean, all you get is one trick, rational thinking, but when you're good and crazy, ooh ooh ooh, the sky's the limit!" -- The Tick
Back to top
View user's profile Send private message
greg32
Apprentice
Apprentice


Joined: 26 Mar 2003
Posts: 259
Location: Australia

PostPosted: Thu Jun 10, 2004 8:03 am    Post subject: Reply with quote

Hey dhurt,
I can't say I know how to get it to sync from a specified server. Can you tell me how please?

cheers
Greg
_________________
Never get so busy making a living, that you forget to make a life.
Back to top
View user's profile Send private message
kallamej
Administrator
Administrator


Joined: 27 Jun 2003
Posts: 4463
Location: Göteborg, Sweden

PostPosted: Thu Jun 10, 2004 9:10 am    Post subject: Reply with quote

You define the SYNC variable in /etc/make.conf appropriately. See /etc/make.conf.example if you don't have that variable defined in /etc/make.conf already.
_________________
Please read our FAQ Forum, it answers many of your questions.
irc: #gentoo-forums on irc.freenode.net
Back to top
View user's profile Send private message
dhurt
Apprentice
Apprentice


Joined: 14 May 2003
Posts: 278
Location: Davis, CA

PostPosted: Thu Jun 10, 2004 10:31 am    Post subject: Reply with quote

Those entries are taken directly from make.conf SYNC entry. So let me know if they work. Since you are from australia, you might want to try this one:

Code:

#   Australia:     "rsync://rsync.au.gentoo.org/gentoo-portage"

_________________
"And isn't sanity really just a one-trick pony, anyway? I mean, all you get is one trick, rational thinking, but when you're good and crazy, ooh ooh ooh, the sky's the limit!" -- The Tick
Back to top
View user's profile Send private message
nsahoo
l33t
l33t


Joined: 17 Jul 2003
Posts: 617

PostPosted: Thu Jun 10, 2004 11:05 am    Post subject: similar issue Reply with quote

happens with main rsync server too.

I am getting this error
Code:

rsync error: some files could not be transferred (code 23) at main.c(1048)


I get this about 22 times with different rsync servers, emerge keeps retrying. From 23rd times onwards, I am on the ban list for hitting the rsync servers too many times .. :evil: :(
Back to top
View user's profile Send private message
dhurt
Apprentice
Apprentice


Joined: 14 May 2003
Posts: 278
Location: Davis, CA

PostPosted: Thu Jun 10, 2004 11:26 am    Post subject: Reply with quote

From the #gentoo-dev IRC:

Quote:

anyone having sync problems this morning for rsync.namerica on a stable x86?


I think that there might be problems with the rsync mirrors. I am not sure, but I just synced 20 minutes ago, but with ~x86. I use:

rsync://rsync.us.gentoo.org/gentoo-portage

Though
_________________
"And isn't sanity really just a one-trick pony, anyway? I mean, all you get is one trick, rational thinking, but when you're good and crazy, ooh ooh ooh, the sky's the limit!" -- The Tick
Back to top
View user's profile Send private message
greg32
Apprentice
Apprentice


Joined: 26 Mar 2003
Posts: 259
Location: Australia

PostPosted: Thu Jun 10, 2004 5:13 pm    Post subject: Reply with quote

O.K., I set my local mirrors to the australian ones, and it still is a no go. I don't really know what to do from here. I use guarddog for my firewall, I diasabled this for a minute to try and I still had no success. So I don't think it is a firewall problem. sync uses ftp doesn't it? I have this allowed in my firewall config.
I emerged portage again, and this made no difference. Is the sync feature built into the portage package, or is it a separate package?
How would I go about definately checking that it is not getting blocked somewhere by a firewall or something?? Is there a command I can run to give me info on what ports are open, and which are blocked? If so, what ports does emerge need open to sync?
That error I get when the sync fails, does it mean it has contacted that server, and failed, or is this an internal failure?

Any other suggestions please.

Cheers Greg
_________________
Never get so busy making a living, that you forget to make a life.
Back to top
View user's profile Send private message
kallamej
Administrator
Administrator


Joined: 27 Jun 2003
Posts: 4463
Location: Göteborg, Sweden

PostPosted: Thu Jun 10, 2004 5:23 pm    Post subject: Reply with quote

The sync uses rsync, which is port 873. From your error it seems like your packets does not reach the server or that the server does not respond. Just for sanity, please post the output of
Code:
emerge --info

if the problems persist.
_________________
Please read our FAQ Forum, it answers many of your questions.
irc: #gentoo-forums on irc.freenode.net
Back to top
View user's profile Send private message
greg32
Apprentice
Apprentice


Joined: 26 Mar 2003
Posts: 259
Location: Australia

PostPosted: Thu Jun 10, 2004 6:56 pm    Post subject: Reply with quote

here is emerge info for you: cheers

beast root # emerge --info
Portage 2.0.50-r7 (default-x86-1.4, gcc-3.3.3, glibc-2.3.3.20040420-r0, 2.4.24-xfs-r5)
=================================================================
System uname: 2.4.24-xfs-r5 i686 Intel(R) Pentium(R) 4 CPU 2.60GHz
Gentoo Base System version 1.4.16
Autoconf: sys-devel/autoconf-2.59-r4
Automake: sys-devel/automake-1.8.5
ACCEPT_KEYWORDS="x86 ~x86"
AUTOCLEAN="yes"
CFLAGS="-march=pentium3 -O3 -pipe"
CHOST="i686-pc-linux-gnu"
COMPILER="gcc3"
CONFIG_PROTECT="/etc /usr/X11R6/lib/X11/xkb /usr/kde/2/share/config /usr/kde/3.1/share/config /usr/kde/3.2/share/config /usr/kde/3/share/config /usr/share/config /usr/share/texmf/dvipdfm/config/ /usr/share/texmf/dvips/config/ /usr/share/texmf/tex/generic/config/ /usr/share/texmf/tex/platex/config/ /usr/share/texmf/xdvi/ /var/qmail/control"
CONFIG_PROTECT_MASK="/etc/gconf /etc/terminfo /etc/env.d"
CXXFLAGS="-march=pentium3 -O3 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="autoaddcvs ccache sandbox"
GENTOO_MIRRORS="http://gentoo.oregonstate.edu http://distro.ibiblio.org/pub/Linux/distributions/gentoo"
MAKEOPTS="-j3"
PKGDIR="/usr/portage/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/bmg-main"
SYNC="rsync://rsync.au.gentoo.org/gentoo-portage"
USE="X aalib accessibility alsa apm arts avi berkdb bonobo breakme cdr crypt cups dvb dvd encode esd evo exif foomaticdb gdbm gif gnome gphoto2 gpm gtk gtk2 gtkhtml guile imlib java jpeg kde ldap libg++ libwww lirc mad mikmod mmx motif mozilla mpeg mysql ncurses nls oav oggvorbis opengl oss pam pdflib perl pic png ppds python qt quicktime readline sdl slang spell sse sse2 ssl svga tcltk tcpd tetex truetype usb x86 xinerama xml2 xmms xv zlib"

beast root #
_________________
Never get so busy making a living, that you forget to make a life.
Back to top
View user's profile Send private message
kallamej
Administrator
Administrator


Joined: 27 Jun 2003
Posts: 4463
Location: Göteborg, Sweden

PostPosted: Fri Jun 11, 2004 1:48 am    Post subject: Reply with quote

Try emerge-webrsync, that should fetch the most recent snapshot from your download mirror. Then try to open all outgoing traffic in your firewall and run emerge sync again. If you have ethereal or some other network analyser you could use that to see if traffic leaves and/or reaches your box.
_________________
Please read our FAQ Forum, it answers many of your questions.
irc: #gentoo-forums on irc.freenode.net
Back to top
View user's profile Send private message
nsahoo
l33t
l33t


Joined: 17 Jul 2003
Posts: 617

PostPosted: Fri Jun 11, 2004 1:59 pm    Post subject: Reply with quote

kallamej wrote:
Try emerge-webrsync, that should fetch the most recent snapshot from your download mirror. Then try to open all outgoing traffic in your firewall and run emerge sync again. If you have ethereal or some other network analyser you could use that to see if traffic leaves and/or reaches your box.


ok .. I did a emerge-webrsync (how is it different from emerge sync?) and then when I am trying to do a emerge sync again, it fails showing the same error

Code:
...
total size is 69990148  speedup is 35.98
rsync error: some files could not be transferred (code 23) at main.c(1048)
>>> retry ...
Back to top
View user's profile Send private message
nsahoo
l33t
l33t


Joined: 17 Jul 2003
Posts: 617

PostPosted: Fri Jun 11, 2004 2:17 pm    Post subject: Reply with quote

And here is MY emerge --info
Code:
$ emerge --info
Portage 2.0.50-r8 (default-x86-1.4, gcc-3.3.3, glibc-2.3.3.20040420-r0, 2.6.5-gentoo-r1)
=================================================================
System uname: 2.6.5-gentoo-r1 i686 Intel(R) Pentium(R) 4 CPU 2.80GHz
Gentoo Base System version 1.4.16
Autoconf: sys-devel/autoconf-2.59-r3
Automake: sys-devel/automake-1.8.3
ACCEPT_KEYWORDS="x86"
AUTOCLEAN="yes"
CFLAGS="-march=pentium4 -Os -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
COMPILER="gcc3"
CONFIG_PROTECT="/etc /usr/X11R6/lib/X11/xkb /usr/kde/2/share/config /usr/kde/3.1/share/config /usr/kde/3.2/share/config /usr/kde/3.3/share/config /usr/kde/3/share/config /usr/kde/cvs/share/config /usr/lib/mozilla/defaults/pref /usr/share/config /usr/share/texmf/dvipdfm/config/ /usr/share/texmf/dvips/config/ /usr/share/texmf/tex/generic/config/ /usr/share/texmf/tex/platex/config/ /usr/share/texmf/xdvi/ /var/qmail/control"
CONFIG_PROTECT_MASK="/etc/gconf /etc/terminfo /etc/env.d"
CXXFLAGS="-O2 -mcpu=i686 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="autoaddcvs buildpkg ccache distcc notitles sandbox userpriv usersandbox"
GENTOO_MIRRORS="ftp:///ftp-stud.fht-esslingen.de/pub/Mirrors/gentoo/ http://gentoo.mirrors.pair.com/ ftp://gentoo.mirrors.pair.com/ http://mirror.datapipe.net/gentoo"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage /usr/local/bmg-gnome-current"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="X aalib alsa apm arts avi berkdb bonobo cdr crypt cups encode esd foomaticdb gdbm gif gnome gphoto2 gpm gtk gtk2 gtkhtml imlib java jpeg kde ldap libg++ libwww mad mikmod motif mozilla mpeg mysql nas ncurses nls oggvorbis opengl oss pam pdflib perl png postgres ppds python qt quicktime readline scanner sdl slang spell ssl svga tcpd tetex truetype usb x86 xml2 xmms xv zlib"
Back to top
View user's profile Send private message
kallamej
Administrator
Administrator


Joined: 27 Jun 2003
Posts: 4463
Location: Göteborg, Sweden

PostPosted: Fri Jun 11, 2004 3:36 pm    Post subject: Reply with quote

Emerge-webrsync downloads a portage snapshot from your download mirror using http instead of rsync. If you're behind a firewall that doesn't allow rsync traffic, this is what you have to do to update your portage tree. Your tree will then be slightly outdated, but still better than not synced at all.

Your emerge --info seems OK to me. Do you manage to see what files, or how many that couldn't be transferred? You may have a file system problem.
_________________
Please read our FAQ Forum, it answers many of your questions.
irc: #gentoo-forums on irc.freenode.net
Back to top
View user's profile Send private message
nsahoo
l33t
l33t


Joined: 17 Jul 2003
Posts: 617

PostPosted: Fri Jun 11, 2004 6:34 pm    Post subject: Reply with quote

i am banned from the servers for the day .. attempting too many times :(

I'll do a reiserfsck -c for file system problem and let u know.
Back to top
View user's profile Send private message
nsahoo
l33t
l33t


Joined: 17 Jul 2003
Posts: 617

PostPosted: Sat Jun 12, 2004 3:39 am    Post subject: Reply with quote

kallamej wrote:
...
Your emerge --info seems OK to me. Do you manage to see what files, or how many that couldn't be transferred? You may have a file system problem.


dude, it WAS a file system error :( .. i don't trust reiserfs anymore :evil: did a reiserfsck --check and reiserfsck --rebuild-tree to find 'em and fix them .. fortunately they were just two digest files ..

now emerge sync works.

Thanks.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Portage & Programming All times are GMT - 5 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum