Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Creating copies of layman overlays for http mirrors
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Portage & Programming
View previous topic :: View next topic  
Author Message
Massimo B.
Veteran
Veteran


Joined: 09 Feb 2005
Posts: 1792
Location: PB, Germany

PostPosted: Wed Feb 11, 2015 11:43 am    Post subject: Creating copies of layman overlays for http mirrors Reply with quote

I followed https://wiki.gentoo.org/wiki/Project:Portage/Sync for the sys-apps/portage-2.2.16 plug-in sync migration...

In order to have http copy of a git-only overlay I add /etc/layman/overlays/raiagent_http.xml with a new name, but that complains
Code:
!!! Section 'raiagent_http' in repos.conf has name different from repository name 'raiagent' set inside repository

Whereas using the same name the http source is not available and default git is still used. How to do that?

If I just modify /var/lib/layman/installed.xml to the https source, it gets updated back at the next sync:
Code:
*
 * Warnings:
 * ------
 * The source of the overlay "raiagent" seems to have changed.
 * You currently sync from
 *
 *   https://github.com/leycec/raiagent.git
 *
 * while the remote lists report
 *
 *   git://github.com/leycec/raiagent.git
 *
 * as correct location.
 *
 * Repo: "raiagent" was automatically updated...


As the http mirrors of overlay.gentoo.org are down for a while now (see http://infra-status.gentoo.org/) and I also need some overlays in http-proxied environments I already asked for adding a fallback to the mirror http://cgit.gentooexperimental.org/user into layman's repositories.xml. This is done already.

But there are still some overlays missing on that mirror but have private github clones. These I like to add at least manually if layman's repositories.xml cannot maintain that as fallback.
_________________
HP ZBook Power 15.6" G8 i7-11800H|HP EliteDesk 800G1 i7-4790|HP Compaq Pro 6300 i7-3770
Back to top
View user's profile Send private message
dol-sen
Retired Dev
Retired Dev


Joined: 30 Jun 2002
Posts: 2805
Location: Richmond, BC, Canada

PostPosted: Thu Feb 12, 2015 5:57 am    Post subject: Reply with quote

Hmm, if it's changing your clone from the http url back to the git url, then that is a bug in the new auto-update capability.

Can you please file a bug with your emerge --info.
_________________
Brian
Porthole, the Portage GUI frontend irc@freenode: #gentoo-guis, #porthole, Blog
layman, gentoolkit, CoreBuilder, esearch...
Back to top
View user's profile Send private message
Massimo B.
Veteran
Veteran


Joined: 09 Feb 2005
Posts: 1792
Location: PB, Germany

PostPosted: Thu Feb 12, 2015 9:34 am    Post subject: Reply with quote

I don't think this detail is a bug. Having a installed.xml with a different sourced than the latest fetched repositories.xml it is correct to adapt to the new source.
_________________
HP ZBook Power 15.6" G8 i7-11800H|HP EliteDesk 800G1 i7-4790|HP Compaq Pro 6300 i7-3770
Back to top
View user's profile Send private message
Massimo B.
Veteran
Veteran


Joined: 09 Feb 2005
Posts: 1792
Location: PB, Germany

PostPosted: Wed Feb 18, 2015 1:01 pm    Post subject: Reply with quote

Any idea, what is the best way to create a copy of an existing overlay in order to change the default source if there is no http fallback. Where are layman developers to get in touch? I know, last instance is to file a bug report...
_________________
HP ZBook Power 15.6" G8 i7-11800H|HP EliteDesk 800G1 i7-4790|HP Compaq Pro 6300 i7-3770
Back to top
View user's profile Send private message
dol-sen
Retired Dev
Retired Dev


Joined: 30 Jun 2002
Posts: 2805
Location: Richmond, BC, Canada

PostPosted: Wed Feb 18, 2015 11:38 pm    Post subject: Reply with quote

If you make an xml definition for the different url, you need to change the overlay name, or layman will overwrite it again with a correct one. You can also change the overlay name in the repo and commit it, add --rebase to git_syncopts (or relevant vcs) to keep your change.

P.S. I am a layman developer (see sig), along with twitch153.
_________________
Brian
Porthole, the Portage GUI frontend irc@freenode: #gentoo-guis, #porthole, Blog
layman, gentoolkit, CoreBuilder, esearch...
Back to top
View user's profile Send private message
Massimo B.
Veteran
Veteran


Joined: 09 Feb 2005
Posts: 1792
Location: PB, Germany

PostPosted: Wed Mar 04, 2015 9:21 am    Post subject: Reply with quote

So how to add some local repository in general?
Like currently I try to sync the vaca Overlay which has no https:// fallback.

I tried a different approach without layman:
Code:
# cat /etc/portage/repos.conf/overlays.conf
[vaca]
priority = 50
location = /usr/local/overlays/vaca
layman-type = git
sync-type = laymansync
sync-uri = https://github.com/hashashin/gentoo-vaca-overlay.git
auto-sync = Yes

But eix-sync does not sync it with that eix-sync.conf:
Code:
-W
*

Next approach using layman:
Code:
# cat /etc/layman/overlays/vaca_http.xml
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE repositories SYSTEM "/dtd/repositories.dtd">
<repositories xmlns="" version="1.0">
  <repo quality="experimental" status="unofficial">
    <name>vaca_http</name>
    <description>Just another personal Gentoo overlay</description>
    <homepage>https://github.com/hashashin/gentoo-vaca-overlay</homepage>
    <owner>
      <email>gentoo.power@gmail.com</email>
      <name>hashashin</name>
    </owner>
    <source type="git">https://github.com/hashashin/gentoo-vaca-overlay.git</source>
    <feed>https://github.com/hashashin/gentoo-vaca-overlay/commits/master.atom</feed>
  </repo>
</repositories>

That seems to work, but still this warning:
Code:
# layman -s vaca_http
!!! Section 'vaca_http' in repos.conf has name different from repository name 'vaca' set inside repository

So how do I change the repos name now while still being able to sync it with github?
_________________
HP ZBook Power 15.6" G8 i7-11800H|HP EliteDesk 800G1 i7-4790|HP Compaq Pro 6300 i7-3770


Last edited by Massimo B. on Wed Mar 04, 2015 9:58 am; edited 1 time in total
Back to top
View user's profile Send private message
Massimo B.
Veteran
Veteran


Joined: 09 Feb 2005
Posts: 1792
Location: PB, Germany

PostPosted: Wed Mar 04, 2015 9:28 am    Post subject: Reply with quote

Isn't the new plug-in sync system in >=sys-apps/portage-2.2.16 replacing some parts of layman that is maintaining multiple overlay and syncing with remote, no?
Should the future of layman rather completely rely on that new portage repos.conf (currently only partially supporting repos.conf via USE flag) using portage sync types? Should the future layman rather be confined to only browsing existing overlays and maintaining repos.conf, that is dropping layman -s or just passing through to portage?
Currently it is confusing if eix will be using the portage sync for those overlays or calling layman's sync...
_________________
HP ZBook Power 15.6" G8 i7-11800H|HP EliteDesk 800G1 i7-4790|HP Compaq Pro 6300 i7-3770
Back to top
View user's profile Send private message
Massimo B.
Veteran
Veteran


Joined: 09 Feb 2005
Posts: 1792
Location: PB, Germany

PostPosted: Wed Mar 04, 2015 9:59 am    Post subject: Reply with quote

Massimo B. wrote:
That seems to work, but still this warning:
Code:
# layman -s vaca_http
!!! Section 'vaca_http' in repos.conf has name different from repository name 'vaca' set inside repository

So how do I change the repos name now while still being able to sync it with github?

No, it doesn't work due to that misalignment of names:
Code:
# emerge -autv unity-extra/glipper
!!! Section 'vaca_http' in repos.conf has name different from repository name 'vaca' set inside repository

These are the packages that would be merged, in reverse order:

Calculating dependencies... done!

emerge: there are no ebuilds to satisfy "unity-extra/glipper".

_________________
HP ZBook Power 15.6" G8 i7-11800H|HP EliteDesk 800G1 i7-4790|HP Compaq Pro 6300 i7-3770
Back to top
View user's profile Send private message
dol-sen
Retired Dev
Retired Dev


Joined: 30 Jun 2002
Posts: 2805
Location: Richmond, BC, Canada

PostPosted: Wed Mar 04, 2015 7:54 pm    Post subject: Reply with quote

Well, you could just make a commit in that repo changing the name.

But if these repos are all github based that you need to change. Why not just submit a bug/bugs for the alternate urls % protocols offered by github to be included in the official repositories.xml list. That way it won't need any fussing around with alternate lists. Layman can handle any number of alternates/mirrors in info for the overlay.

P.S. the latest layman has a new utility for creating overlay definitions. It automatically adds a supported url/protocol variations supported by github, and gentoo.org. Although the gentoo.org ones need a small change for the new anonymous/http git server.
_________________
Brian
Porthole, the Portage GUI frontend irc@freenode: #gentoo-guis, #porthole, Blog
layman, gentoolkit, CoreBuilder, esearch...
Back to top
View user's profile Send private message
Massimo B.
Veteran
Veteran


Joined: 09 Feb 2005
Posts: 1792
Location: PB, Germany

PostPosted: Thu Mar 05, 2015 9:18 am    Post subject: Reply with quote

Filing a bugreport to add the additional mirrors to the repositories.xml would be fine, indeed.
I was starting to look out for new mirrors after http mirrors of overlay.gentoo.org got offline, then I found the mentioned http://cgit.gentooexperimental.org/user and I already triggered adding to repositories.xml, but the mirror does not cover all overlays. Most overlays have their private github clone anyway.

Is there some change to repositories.xml required currently to use that new url/protocol variations supported by github and gentoo.org? Or is that already working?
I just need at least one http fallback for every overlay. I would start to collect http mirrors for some overlays I already use and file a bug report for that.

Anyway I wonder why that cloning and renaming of existing overlays does not work the way I tried and still depending on the internal repo name I cannot change without committing to the repo.
_________________
HP ZBook Power 15.6" G8 i7-11800H|HP EliteDesk 800G1 i7-4790|HP Compaq Pro 6300 i7-3770
Back to top
View user's profile Send private message
dol-sen
Retired Dev
Retired Dev


Joined: 30 Jun 2002
Posts: 2805
Location: Richmond, BC, Canada

PostPosted: Thu Mar 05, 2015 9:27 pm    Post subject: Reply with quote

Nope, no changes needed, layman has supported multiple urls for years. Just open a bug for the overlays you are concerned about, or one for all github ones...

Also Gentoo based repos now have a working annonymous server running again.
http://gitweb.gentoo.org/ From there you can look up the overlay and get the new urls.
I believe there is no https capability yet, but the systems are newly up just a few days now.

There is also a new mail archives system up and running now too.

See this announcement also this one
_________________
Brian
Porthole, the Portage GUI frontend irc@freenode: #gentoo-guis, #porthole, Blog
layman, gentoolkit, CoreBuilder, esearch...
Back to top
View user's profile Send private message
steveL
Watchman
Watchman


Joined: 13 Sep 2006
Posts: 5153
Location: The Peanut Gallery

PostPosted: Fri Mar 06, 2015 12:51 am    Post subject: Reply with quote

Nice one dol-sen; hope you don't mind I pushed the news to a new topic, as it's good :-)
Back to top
View user's profile Send private message
Massimo B.
Veteran
Veteran


Joined: 09 Feb 2005
Posts: 1792
Location: PB, Germany

PostPosted: Fri Mar 06, 2015 10:13 am    Post subject: Reply with quote

Some related bugs I opened: bug 542340, bug 542342
_________________
HP ZBook Power 15.6" G8 i7-11800H|HP EliteDesk 800G1 i7-4790|HP Compaq Pro 6300 i7-3770
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Portage & Programming All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum