| View previous topic :: View next topic |
| Author |
Message |
Pearlseattle
Apprentice
Joined: 04 Oct 2007
Posts: 162
Location: Switzerland
|
 Posted: Wed Sep 24, 2014 6:40 pm Post subject: [SOLVED] Gentoo: all mirrors out-of-sync? |
 |
|
Hi
Is something weird going on with Gentoo?
Yesterday I did an "emerge --sync" and when trying to "emerge --update --deep --newuse world" I saw in "/var/log/emerge-fetch.log" A LOT of messages saying that files were not found in the mirror that I was using since years (http://mirror.switch.ch/ftp/mirror/gentoo/).
Even other stuff happened - e.g. for the package "sk1libs-0.9.1-r3" the checksum did not match the one of the ebuild.
I have now changed mirror (http://mirror.ovh.net/gentoo-distfiles/) and wanted to emerge "app-shells/bash-4.2_p48" (because of the latest security flaw with older versions of Bash) but even this one cannot be found on this mirror.
What's going on?
Are all mirrors out-of-sync?
Has something been hacked?
Thanks
EDIT: sorry, the first URL was "http://mirror.switch.ch/ftp/mirror/gentoo/" => have corrected it.
EDIT 2:
An example of what happened yesterday with other packages using "mirror.switch.ch" and today with "app-shells/bash-4.2_p48" using "mirror.ovh.net":
| Code: | >>> Downloading 'http://mirror.ovh.net/gentoo-distfiles/distfiles/bash42-048'
--2014-09-24 20:52:33-- http://mirror.ovh.net/gentoo-distfiles/distfiles/bash42-048
Resolving mirror.ovh.net... 91.121.124.139, 91.121.125.139, 2001:41d0:1:7b8b::1
Connecting to mirror.ovh.net|91.121.124.139|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2014-09-24 20:52:33 ERROR 404: Not Found.
>>> Downloading 'ftp://ftp.ring.gr.jp/pub/GNU/bash/bash-4.2-patches/bash42-048'
--2014-09-24 20:52:33-- ftp://ftp.ring.gr.jp/pub/GNU/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving ftp.ring.gr.jp... 133.243.3.209, 150.26.216.161, 160.26.2.178, ...
Connecting to ftp.ring.gr.jp|133.243.3.209|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /pub/GNU/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... done.
==> PASV ...
|
It immediately falls back to the coder's site because it cannot find the file on the mirror (and then I wait wait wait until the coder's site lets me download the file => maybe I have to wait for such a long time because I'm not the only one that is falling back to them?).
EDIT 3:
It's just weird: look at this - how can it be that it cannot find the file or cannot connect to so many sites?
| Code: | >>> Downloading 'http://mirror.ovh.net/gentoo-distfiles/distfiles/bash42-048'
--2014-09-24 20:52:50-- http://mirror.ovh.net/gentoo-distfiles/distfiles/bash42-048
Resolving mirror.ovh.net... 91.121.124.139, 91.121.125.139, 2001:41d0:1:7b8b::1
Connecting to mirror.ovh.net|91.121.124.139|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2014-09-24 20:52:50 ERROR 404: Not Found.
>>> Downloading 'http://mirror-fpt-telecom.fpt.net/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 20:52:50-- http://mirror-fpt-telecom.fpt.net/gnu/bash/bash-4.2-patches/bash42-048
Resolving mirror-fpt-telecom.fpt.net... 118.69.250.132
Connecting to mirror-fpt-telecom.fpt.net|118.69.250.132|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2014-09-24 20:52:51 ERROR 404: Not Found.
>>> Downloading 'ftp://ftp.isy.liu.se/pub/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 20:52:51-- ftp://ftp.isy.liu.se/pub/gnu/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving ftp.isy.liu.se... 130.236.48.59
Connecting to ftp.isy.liu.se|130.236.48.59|:21... failed: Connection refused.
>>> Downloading 'http://www.fyxm.net/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 20:52:51-- http://www.fyxm.net/gnu/bash/bash-4.2-patches/bash42-048
Resolving www.fyxm.net... 93.184.68.88
Connecting to www.fyxm.net|93.184.68.88|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2014-09-24 20:52:51 ERROR 404: Not Found.
>>> Downloading 'ftp://ftp.gnu.org.ua/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 20:52:51-- ftp://ftp.gnu.org.ua/gnu/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving ftp.gnu.org.ua... 193.186.15.43
Connecting to ftp.gnu.org.ua|193.186.15.43|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /gnu/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... done.
==> PASV ... couldn't connect to 193.186.15.43 port 53207: Connection timed out
Retrying.
--2014-09-24 20:53:53-- ftp://ftp.gnu.org.ua/gnu/bash/bash-4.2-patches/bash42-048
(try: 2) => '/usr/portage/distfiles/bash42-048'
Connecting to ftp.gnu.org.ua|193.186.15.43|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /gnu/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... done.
==> PASV ... couldn't connect to 193.186.15.43 port 41506: Connection timed out
Retrying.
--2014-09-24 20:54:56-- ftp://ftp.gnu.org.ua/gnu/bash/bash-4.2-patches/bash42-048
(try: 3) => '/usr/portage/distfiles/bash42-048'
Connecting to ftp.gnu.org.ua|193.186.15.43|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /gnu/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... done.
==> PASV ... couldn't connect to 193.186.15.43 port 42728: Connection timed out
Giving up.
>>> Downloading 'ftp://mirror.its.uidaho.edu/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 20:55:56-- ftp://mirror.its.uidaho.edu/gnu/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving mirror.its.uidaho.edu... failed: Name or service not known.
wget: unable to resolve host address 'mirror.its.uidaho.edu'
>>> Downloading 'ftp://mirrors.kernel.org/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 20:55:57-- ftp://mirrors.kernel.org/gnu/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving mirrors.kernel.org... 149.20.20.135, 149.20.4.71, 2001:4f8:1:10:0:1994:3:14, ...
Connecting to mirrors.kernel.org|149.20.20.135|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /gnu/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... 3258
==> PASV ... couldn't connect to 149.20.20.135 port 30862: Connection timed out
Retrying.
--2014-09-24 20:57:00-- ftp://mirrors.kernel.org/gnu/bash/bash-4.2-patches/bash42-048
(try: 2) => '/usr/portage/distfiles/bash42-048'
Connecting to mirrors.kernel.org|149.20.20.135|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /gnu/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... 3258
==> PASV ... couldn't connect to 149.20.20.135 port 30500: Connection timed out
Retrying.
--2014-09-24 20:58:03-- ftp://mirrors.kernel.org/gnu/bash/bash-4.2-patches/bash42-048
(try: 3) => '/usr/portage/distfiles/bash42-048'
Connecting to mirrors.kernel.org|149.20.20.135|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /gnu/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... 3258
==> PASV ... couldn't connect to 149.20.20.135 port 30291: Connection timed out
Giving up.
>>> Downloading 'ftp://ftp.ring.gr.jp/pub/GNU/bash/bash-4.2-patches/bash42-048'
--2014-09-24 20:59:05-- ftp://ftp.ring.gr.jp/pub/GNU/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving ftp.ring.gr.jp... 133.37.44.6, 130.34.11.132, 210.159.71.23, ...
Connecting to ftp.ring.gr.jp|133.37.44.6|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /pub/GNU/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... done.
==> PASV ... couldn't connect to 133.37.44.6 port 4029: Connection timed out
Retrying.
--2014-09-24 21:00:09-- ftp://ftp.ring.gr.jp/pub/GNU/bash/bash-4.2-patches/bash42-048
(try: 2) => '/usr/portage/distfiles/bash42-048'
Connecting to ftp.ring.gr.jp|133.37.44.6|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /pub/GNU/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... done.
==> PASV ... couldn't connect to 133.37.44.6 port 4076: Connection timed out
Retrying.
--2014-09-24 21:01:14-- ftp://ftp.ring.gr.jp/pub/GNU/bash/bash-4.2-patches/bash42-048
(try: 3) => '/usr/portage/distfiles/bash42-048'
Connecting to ftp.ring.gr.jp|133.37.44.6|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /pub/GNU/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... done.
==> PASV ... couldn't connect to 133.37.44.6 port 4068: Connection timed out
Giving up.
>>> Downloading 'http://mirrors.privatejetscharter.net/gnu/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:02:17-- http://mirrors.privatejetscharter.net/gnu/gnu/bash/bash-4.2-patches/bash42-048
Resolving mirrors.privatejetscharter.net... failed: Name or service not known.
wget: unable to resolve host address 'mirrors.privatejetscharter.net'
>>> Downloading 'http://ftp.twaren.net/Unix/GNU/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:02:17-- http://ftp.twaren.net/Unix/GNU/gnu/bash/bash-4.2-patches/bash42-048
Resolving ftp.twaren.net... 140.110.123.9, 2001:e10:5c00:5::9
Connecting to ftp.twaren.net|140.110.123.9|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2014-09-24 21:02:18 ERROR 404: Not Found.
>>> Downloading 'http://download.polytechnic.edu.na/pub/ftp.gnu.org/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:02:18-- http://download.polytechnic.edu.na/pub/ftp.gnu.org/gnu/bash/bash-4.2-patches/bash42-048
Resolving download.polytechnic.edu.na... 196.216.167.196
Connecting to download.polytechnic.edu.na|196.216.167.196|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2014-09-24 21:02:18 ERROR 404: Not Found.
>>> Downloading 'ftp://ftp.chg.ru/pub/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:02:18-- ftp://ftp.chg.ru/pub/gnu/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving ftp.chg.ru... 195.178.192.118, 193.233.9.194, 2001:640:20:ff00::194
Connecting to ftp.chg.ru|195.178.192.118|:21... failed: No route to host.
Connecting to ftp.chg.ru|193.233.9.194|:21... failed: Connection timed out.
Connecting to ftp.chg.ru|2001:640:20:ff00::194|:21... failed: Network is unreachable.
>>> Downloading 'ftp://mirrors.igsobe.com/gnuftp/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:03:20-- ftp://mirrors.igsobe.com/gnuftp/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving mirrors.igsobe.com... failed: Name or service not known.
wget: unable to resolve host address 'mirrors.igsobe.com'
>>> Downloading 'http://www.nic.funet.fi/pub/gnu/alpha/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:03:20-- http://www.nic.funet.fi/pub/gnu/alpha/gnu/bash/bash-4.2-patches/bash42-048
Resolving www.nic.funet.fi... 193.166.3.3, 2001:708:10:9::20:3
Connecting to www.nic.funet.fi|193.166.3.3|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2014-09-24 21:03:20 ERROR 404: Not Found.
>>> Downloading 'ftp://sunsite.cnlab-switch.ch/mirror/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:03:20-- ftp://sunsite.cnlab-switch.ch/mirror/gnu/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving sunsite.cnlab-switch.ch... 130.59.10.36, 2001:620:0:8::20
Connecting to sunsite.cnlab-switch.ch|130.59.10.36|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /mirror/gnu/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... done.
==> PASV ... couldn't connect to 130.59.10.36 port 55659: Connection timed out
Retrying.
--2014-09-24 21:04:22-- ftp://sunsite.cnlab-switch.ch/mirror/gnu/bash/bash-4.2-patches/bash42-048
(try: 2) => '/usr/portage/distfiles/bash42-048'
Connecting to sunsite.cnlab-switch.ch|130.59.10.36|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /mirror/gnu/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... done.
==> PASV ... couldn't connect to 130.59.10.36 port 55214: Connection timed out
Retrying.
--2014-09-24 21:05:24-- ftp://sunsite.cnlab-switch.ch/mirror/gnu/bash/bash-4.2-patches/bash42-048
(try: 3) => '/usr/portage/distfiles/bash42-048'
Connecting to sunsite.cnlab-switch.ch|130.59.10.36|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /mirror/gnu/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... done.
==> PASV ... couldn't connect to 130.59.10.36 port 56354: Connection timed out
Giving up.
>>> Downloading 'http://www.very-clever.com/download/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:06:24-- http://www.very-clever.com/download/gnu/bash/bash-4.2-patches/bash42-048
Resolving www.very-clever.com... 78.46.60.202
Connecting to www.very-clever.com|78.46.60.202|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2014-09-24 21:06:24 ERROR 404: Not Found.
>>> Downloading 'http://gnu.raffsoftware.com/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:06:24-- http://gnu.raffsoftware.com/bash/bash-4.2-patches/bash42-048
Resolving gnu.raffsoftware.com... 174.142.90.181
Connecting to gnu.raffsoftware.com|174.142.90.181|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2014-09-24 21:06:24 ERROR 404: Not Found.
>>> Downloading 'ftp://ftp.cw.net/pub/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:06:24-- ftp://ftp.cw.net/pub/gnu/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving ftp.cw.net... 195.27.236.210, 2001:5000:0:300::15
Connecting to ftp.cw.net|195.27.236.210|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /pub/gnu/bash/bash-4.2-patches ...
No such directory 'pub/gnu/bash/bash-4.2-patches'.
>>> Downloading 'ftp://ftp.informatik.rwth-aachen.de/pub/gnu/bash/bash-4.2-patches/bash42-048'
--2014-09-24 21:06:25-- ftp://ftp.informatik.rwth-aachen.de/pub/gnu/bash/bash-4.2-patches/bash42-048
=> '/usr/portage/distfiles/bash42-048'
Resolving ftp.informatik.rwth-aachen.de... 137.226.34.227
Connecting to ftp.informatik.rwth-aachen.de|137.226.34.227|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /pub/gnu/bash/bash-4.2-patches ... done.
==> SIZE bash42-048 ... 3258
==> PASV ...
|
Edit 4:
btw., you can test if your Bash shell is affected by the security vulnerability by running in your Bash shell:
| Code: | | test="() { echo Hello; }; echo Hacked" bash -c "" |
(from "http://www.golem.de/news/linux-shell-bash-sicherheitsluecke-erlaubt-codeausfuehrung-auf-servern-1409-109439.html")
Edit 5:
Ok, it seems to depend on the package.
Any simple way to compare the different mirrors? Which mirror is the "master"?
Last edited by Pearlseattle on Thu Sep 25, 2014 7:16 pm; edited 1 time in total |
|
| Back to top |
|
 |
a3li
Retired Dev
Joined: 02 Sep 2008
Posts: 122
Location: 독일
|
| Posted: Wed Sep 24, 2014 11:03 pm Post subject: Re: Gentoo: all mirrors out-of-sync? |
|
|
| Pearlseattle wrote: | Hi
Is something weird going on with Gentoo?
Yesterday I did an "emerge --sync" and when trying to "emerge --update --deep --newuse world" I saw in "/var/log/emerge-fetch.log" A LOT of messages saying that files were not found in the mirror that I was using since years (http://mirror.switch.ch/ftp/mirror/gentoo/).
Even other stuff happened - e.g. for the package "sk1libs-0.9.1-r3" the checksum did not match the one of the ebuild.
I have now changed mirror (http://mirror.ovh.net/gentoo-distfiles/) and wanted to emerge "app-shells/bash-4.2_p48" (because of the latest security flaw with older versions of Bash) but even this one cannot be found on this mirror.
What's going on?
|
Probably this: http://infra-status.gentoo.org/notice/20140920-distfiles
| Quote: | | Are all mirrors out-of-sync? |
Surely not.
| Quote: | | Has something been hacked? |
Probably not.
| Quote: |
It immediately falls back to the coder's site because it cannot find the file on the mirror (and then I wait wait wait until the coder's site lets me download the file => maybe I have to wait for such a long time because I'm not the only one that is falling back to them?).
EDIT 3:
It's just weird: look at this - how can it be that it cannot find the file or cannot connect to so many sites?
|
Simple: The package version is less than a few hours old. Not all mirrors sync instantly.
| Quote: | Edit 5:
Ok, it seems to depend on the package.
Any simple way to compare the different mirrors? Which mirror is the "master"? |
distfiles.gentoo.org is the nearest thing to a "master" the general public can access. It's not geographically near you though.
_________________
I am Confuism. Do not bother me. |
|
| Back to top |
|
|
Pearlseattle
Apprentice
Joined: 04 Oct 2007
Posts: 162
Location: Switzerland
|
| Posted: Thu Sep 25, 2014 7:16 pm Post subject: |
|
|
Thank you
Btw. the admin at switch.ch told me that was fixed by the Gentoo admins.
Apparently the master server lost all files (or just mounted an empty directory) and rsync still started up => all mirrors starting sync'ing and wiped out their directories 
More informations here:
http://thread.gmane.org/gmane.linux.gentoo.mirrors/119
Solved |
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
Portage & Programming
