Gentoo Package Repository now using Git

Message

a3li · Post by **a3li** » Wed Aug 12, 2015 6:28 am

This thread is for the discussion of the Git migration as announced. Post your comments here.

steveL · Post by **steveL** » Wed Aug 12, 2015 7:59 am

Yay! Finally! :-)

Well done to all involved, especially robbat for the manifest-signing work, patrick for pushing it forward, and ofc infra (sine qua non;)

Perfect Gentleman · Post by **Perfect Gentleman** » Wed Aug 12, 2015 8:04 am

what is the right url,

Code: Select all

sync-uri = git://anongit.gentoo.org/repo/gentoo.git

?

Yamakuzure · Post by **Yamakuzure** » Wed Aug 12, 2015 8:28 am

Perfect Gentleman wrote:what is the right url,
Code: Select all
sync-uri = git://anongit.gentoo.org/repo/gentoo.git
?

You should read the link provided above:

https://www.gentoo.org/news/2015/08/12/git-migration.html wrote:For users of our package repository, nothing changes: Updates continue to be available via the established mechanisms (rsync, webrsync, snapshots). Options to fetch the package tree via Git are to be announced later.

Perfect Gentleman · Post by **Perfect Gentleman** » Wed Aug 12, 2015 8:35 am

Yamakuzure,
I've been using the url mentioned above for 2 two on 2 PCs, and everything is alright.
I just wanna know if it is right url or not.

trippels · Post by **trippels** » Wed Aug 12, 2015 11:36 am

sync-uri = git://git.gentoo.org/repo/gentoo.git
also works for me.

What is the recommended /etc/eixrc/eixrc setting for git?
CACHE_METHOD="/portage/ parse|ebuild*#metadata-md5#metadata-assign#assign" ?

xaviermiller · Post by **xaviermiller** » Wed Aug 12, 2015 6:58 pm

Code: Select all

# emerge --sync
>>> Syncing repository 'gentoo' into '/usr/portage'...
/usr/bin/git clone --depth 1 git://anongit.gentoo.org/repo/gentoo.git .
fatal: destination path '.' already exists and is not an empty directory.
!!! git clone error in /usr/portage
q: Updating ebuild cache ... 
q: Finished 37171 entries in 0.113616 seconds

What did I wrong?

Code: Select all

[DEFAULT]
main-repo = gentoo

[gentoo]
location = /usr/portage
sync-type = git
sync-uri = git://anongit.gentoo.org/repo/gentoo.git
auto-sync = yes
sync-depth = 1

EDIT: fixed : I didn't cleaned up that repository, which was in "rsync" mode.

genoobish · Post by **genoobish** » Wed Aug 12, 2015 7:02 pm

amazing!
very thanks

edit:
I'm also getting that error described above after syncing once. I don't know how to use git so idk but it must be some parameter that's preventing it to sync to a non empty directory...?

edit2:
from their man page

Code: Select all

 git-clone(1)
           Clone a repository into a new directory.
git-pull(1)
           Fetch from and integrate with another repository or a local branch.

so it seems it's executing `git clone` when it should be `git pull`or something else?

Ant P. · Post by **Ant P.** » Wed Aug 12, 2015 7:17 pm

Thanks for that.

How will we switch over from webrsync-gpg? I'm already using a few git overlays with properly signed commits, so even if the main tree isn't ready for that I could still benefit from knowing how to secure those.

xaviermiller · Post by **xaviermiller** » Wed Aug 12, 2015 8:32 pm

genoobish,

To migrate from a rsync'ed repository to git, just remove it before the sync :

Code: Select all

cd /usr/portage && rm -rf * .gitignore
cd 
emerge --sync

genoobish · Post by **genoobish** » Wed Aug 12, 2015 8:40 pm

xaviermiller wrote:genoobish,

To migrate from a rsync'ed repository to git, just remove it before the sync :
Code: Select all
cd /usr/portage && rm -rf * .gitignore
cd 
emerge --sync

edit: the .gitignore is what I missed the first time it seems. works fine now.

edit2: but now there's this:

Code: Select all

$ eix-update
Reading Portage settings ..
Building database (/var/cache/eix/portage.eix) ..
[0] 'gentoo' /usr/portage/ (cache: metadata-md5-or-flat)
     Reading category 161|161 (100%) EMPTY!

it syncs ok, but the database turns out empty. too early maybe?

ak47wj · Post by **ak47wj** » Thu Aug 13, 2015 1:06 am

genoobish wrote:
edit2: but now there's this:
Code: Select all
$ eix-update
Reading Portage settings ..
Building database (/var/cache/eix/portage.eix) ..
[0] 'gentoo' /usr/portage/ (cache: metadata-md5-or-flat)
     Reading category 161|161 (100%) EMPTY!
it syncs ok, but the database turns out empty. too early maybe?

CACHE_METHOD="/usr/portage/ parse|ebuild*" eix-update
works for me, but it's extremely slow.

ct85711 · Post by **ct85711** » Thu Aug 13, 2015 1:15 am

if I recall correctly, when I originally setup my system to pull from git, I had to remove the old rsync repository (delete everything out of /usr/portage) and while in the /usr/portage, I did git-clone to establish a copy of the git version of the tree; afterwards, it works fine doing regular syncing.

Note: When I set my system up to sync via git, it was before gentoo did this transition, so I was syncing through their testing tree. That in mind, what I needed to do may not be necessary. I also remember, I did need to make a .gitignore file in /usr/portage, to have it exclude the distfiles folder.

genoobish · Post by **genoobish** » Thu Aug 13, 2015 1:27 am

ak47wj wrote:

CACHE_METHOD="/usr/portage/ parse|ebuild*" eix-update
works for me, but it's extremely slow.

works now, and it seems faster than eupdatedb, so it`s fine for me. thanks

trippels · Post by **trippels** » Thu Aug 13, 2015 2:42 am

Code: Select all

emerge --jobs 4 --regen

speeds up eix-update.

x17324 · Post by **x17324** » Thu Aug 13, 2015 2:51 am

sync-uri = git://anongit.gentoo.org/repo/gentoo.git also works for me

x17324 · Post by **x17324** » Thu Aug 13, 2015 6:58 am

trippels wrote:
Code: Select all
emerge --jobs 4 --regen
speeds up eix-update.

I have ran this command ,and my eix can not include /usr/portage into it's database, so please tell me how to resume this operating?

and this is my error

eix-update
Reading Portage settings ..
Building database (/var/cache/eix/portage.eix) ..
[0] 'gentoo' /usr/portage/ (cache: metadata-md5-or-flat)
Reading category 170|170 (100%) EMPTY!

it says EMPTY! ,and I cant use eix anymore;

trippels · Post by **trippels** » Thu Aug 13, 2015 7:37 am

x17324 wrote:
trippels wrote:
Code: Select all
emerge --jobs 4 --regen
speeds up eix-update.
I have ran this command ,and my eix can not include /usr/portage into it's database, so please tell me how to resume this operating?

and this is my error

eix-update
Reading Portage settings ..
Building database (/var/cache/eix/portage.eix) ..
[0] 'gentoo' /usr/portage/ (cache: metadata-md5-or-flat)
Reading category 170|170 (100%) EMPTY!

it says EMPTY! ,and I cant use eix anymore;

Like I wrote above you need to add something like:

Code: Select all

CACHE_METHOD="/usr/portage/ parse|ebuild*"

in your /etc/eixrc/eixrc .

Perfect Gentleman · Post by **Perfect Gentleman** » Thu Aug 13, 2015 7:44 am

FEATURES="metadata-transfer" is much better

steveL · Post by **steveL** » Thu Aug 13, 2015 11:08 am

Perfect Gentleman wrote:FEATURES="metadata-transfer" is much better

*groan* it took years to get that [post=3891968]turned off[/post] by default.

You're right though, it's better in the main, but I think at some point soon the rsync metadata cache should be sorted out.
Just bear in mind to switch back when that happens if you're a standard rsync user.

hasufell · Post by **hasufell** » Thu Aug 13, 2015 11:30 am

I'm cross-posting this here, because it is relevant to the git migration for users: https://forums.gentoo.org/viewtopic-p-7 ... ml#7797610

Logicien · Post by **Logicien** » Thu Aug 13, 2015 7:15 pm

One more step to the identity with Funtoo. I don't need the precompiled kernels and the 'super bootloader' of Funtoo. The network configuration way of Funtoo is interesting, but I can compose as well with the Gentoo way.

Yamakuzure · Post by **Yamakuzure** » Fri Aug 14, 2015 9:10 am

hasufell wrote:I'm cross-posting this here, because it is relevant to the git migration for users: https://forums.gentoo.org/viewtopic-p-7 ... ml#7797610

Unfortunately the usage of github you advise there does not work? I always get

Code: Select all

Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

freke · Post by **freke** » Fri Aug 14, 2015 10:27 am

Yamakuzure wrote:
hasufell wrote:I'm cross-posting this here, because it is relevant to the git migration for users: https://forums.gentoo.org/viewtopic-p-7 ... ml#7797610
Unfortunately the usage of github you advise there does not work? I always get
Code: Select all
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

using

Code: Select all

sync-uri = https://anongit.gentoo.org/git/repo/gentoo.git

seems to work for me.

Another thing though; GLSAs?

They're in/should be in metadata/glsa - right? but metadata is not synced via git?

hasufell · Post by **hasufell** » Fri Aug 14, 2015 11:48 am

freke wrote:Another thing though; GLSAs?

you can clone them directly into metadata, see https://gitweb.gentoo.org/data/glsa.git/

I wonder if we should make that a real submodule for the gentoo git repo.

same goes for news:
https://gitweb.gentoo.org/proj/gentoo-news.git/tree/
but the news repo currently has a broken format (you have to move the contents out of every subdir)... but there is already a GLSA update prepared to change that