Multiple SYNC sources in make.conf

[kipibenkipod]

Hi,
I would like to use two sync sources in make.conf like this:

Code: Select all

SYNC="rsync://MYLOCASERVER/gentoo-portage rsync://PUBLICSERVER/gentoo-portage/" 

This setup don't work if MYLOCALSERVER is down. It will just abort after 3 tries, and will not try to use PUBLICSERVER.
Why there is no support for redundant SYNC mirrors?

Regards,
Kfir

[John R. Graham]

It's true that Portage doesn't support fallback sync servers. I don't know why. However, if you're not averse to a little scripting, this is trivial to correct:

Code: Select all

#!/bin/bash

if ! SYNC="rsync://local_server_uri_or_ip" emerge --sync ; then
    SYNC="rsync://rsync.namerica.gentoo.org/gentoo-portage" emerge --sync
fi

- John

[d2_racing]

Indeed, I found that one too lately.

[kipibenkipod]

It's true that Portage doesn't support fallback sync servers. I don't know why. However, if you're not averse to a little scripting, this is trivial to correct:

Code: Select all

#!/bin/bash

if ! SYNC="rsync://local_server_uri_or_ip" emerge --sync ; then
    SYNC="rsync://rsync.namerica.gentoo.org/gentoo-portage" emerge --sync
fi

- John

Ok thanks,
I did this in my sync script:

Code: Select all

SYNC_SERVERS="rsync://HOME/gentoo-portage rsync://FIRST_INTERNET_SERVER/gentoo-portage/ rsync://SECOND_INTERNET_SERVER/gentoo-portage/"

for server in $SYNC_SERVERS
do
        SYNC="$server" eix-sync -q && break
done

Thanks for your help.
Now I would like to know, why there are no redundant sync servers in make.conf

Thanks,
Kfir

[Genone]

Because so far noone had a need for it, most people are happy with the round-robin DNS solution.

[kipibenkipod]

Because so far noone had a need for it, most people are happy with the round-robin DNS solution.

How does the DNS solution work?

[Genone]

The rsync.*.gentoo.org entries are actually groups of servers, so if one goes down you're just redirected to another one transparently. Of course that doesn't work if you want to use a private mirror as primary source.

[Timmer]

Is there a bug for this yet to vote for?

I have my desktop set up as a private rsync for my laptop, but then if I'm not home (on vacation, for example), i can't sync to my home server. It's got a different address in the outside world. This would be a useful feature.

[cappellaiomatto]

Actually there are two bug reports: the first is about the documentation that incorrectly reported that was possible to specify multiple servers in the SYNC variable (maybe in the beginning it was allowed) [bug=43778]bug 43778[/bug]

The second is more relevant, but the poster missed the point, and it was closed as invalid: [bug=159740]bug 159740[/bug]

There are other places where this idea is stressed: http://gentoo-what-did-you-say.blogspot ... rvers.html.

Gentoo users are encouraged to set up their own rsync mirror, but there isn't a trivial way to specify a fall-back for sync mirrors...

[someone19]

Is there a bug for this yet to vote for?

I have my desktop set up as a private rsync for my laptop, but then if I'm not home (on vacation, for example), i can't sync to my home server. It's got a different address in the outside world. This would be a useful feature.

My solution is this - My home router is also an rsync server, and I use dnsmasq as my DNS forwarding to local clients.

The laptop make.conf is set to rsync.us.gentoo.org, and dnsmasq.conf has

Code: Select all

address=/rsync.gentoo.org/192.168.9.1

When I'm home all the gentoo machines hit the local mirror for the tree, when I'm remote it hits the normal round-robbin list of servers.

Similar can be done with a re-direct depending on your home network setup.

[cappellaiomatto]

My solution is this - My home router is also an rsync server, and I use dnsmasq as my DNS forwarding to local clients.

The laptop make.conf is set to rsync.us.gentoo.org, and dnsmasq.conf has

Code: Select all

address=/rsync.gentoo.org/192.168.9.1

When I'm home all the gentoo machines hit the local mirror for the tree, when I'm remote it hits the normal round-robbin list of servers.

Similar can be done with a re-direct depending on your home network setup.

This solution is really neat, no rsync errors, no actual fall-back.
It is really far better than a client-side script, everything is managed server-side in a transparent way.

I'm already testing it!

BTW IIUC it should be

Code: Select all

address=/us.gentoo.org/192.168.9.1

or

Code: Select all

address=/rsync.us.gentoo.org/192.168.9.1

otherwise the client requests won't be intercepted.

[Bober2000]

Any updates here? Can I do a rollback to official SYNC server if my local is not aviable using new /etc/portage/repo.conf system?

[Apheus]

Th sync type is in repos.conf nowadays, but I think portage honors make.conf's GENTOO_MIRRORS anyway. Regardless of sync-type. So you should be able to use GENTOO_MIRRORS for fallbacks.

[Bober2000]

No portage says that GENTOO_MIRRORS is deprecated, and didn't respect any setting in it.

[krinn]

i think every sync define in repos.conf are run
so you could sync two time, if first fail, it will certainly try the second, and if first has work, it will bail out the tree is already sync.
try copying your gentoo.conf to some alt.conf and setup your sync uri in it, enable auto-sync and it should do what you wish.

[alt-sync]
location = /usr/portage
sync-uri = the alt uri
auto-sync = yes

give it a try.

[Apheus]

No portage says that GENTOO_MIRRORS is deprecated

Where does it say that? I have portage 2.2.20 here, and have not seen any message reagarding GENTOO_MIRRORS. And emerge --info lists it.