Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
RESOLVED: emerge --sync fails presumably because it's unable
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Portage & Programming
View previous topic :: View next topic  
Author Message
beerbellyswan
Tux's lil' helper
Tux's lil' helper


Joined: 01 May 2004
Posts: 91
Location: mendon, ny

PostPosted: Tue May 15, 2018 8:45 pm    Post subject: RESOLVED: emerge --sync fails presumably because it's unable Reply with quote

Hi - when i run emerge --sync, it ultimately errors out with the following message:
Code:

sent 32.10K bytes  received 6.02M bytes  127.42K bytes/sec
total size is 221.06M  speedup is 36.52
!!! Unable to verify: gemato-11.0+ is required
q: Updating ebuild cache in /usr/portage ...
q: Finished 37068 entries in 0.154682 seconds

Action: sync for repo: gentoo, returned code = 127


what i don't understand is that my system HAS gemato-11.0+ (gemato-13 in fact):
Code:

office ~ # emerge -vp gemato

These are the packages that would be merged, in order:

Calculating dependencies... done!
[ebuild   R    ] app-portage/gemato-13.0::gentoo  USE="blake2 bzip2 gpg -lzma -sha3 {-test} -tools%" PYTHON_TARGETS="python2_7 python3_5 -pypy -python3_4 -python3_6" 0 KiB

Total: 1 package (1 reinstall), Size of downloads: 0 KiB
office ~ #


I updated to the latest portage today (portage-2.3.36), but no change. anyone know how to make it happy?

thanks

[Moderator edit: changed [quote] tags to [code] tags to preserve output layout. -Hu]


Last edited by beerbellyswan on Mon May 21, 2018 6:02 pm; edited 1 time in total
Back to top
View user's profile Send private message
arnvidr
Guru
Guru


Joined: 19 Aug 2004
Posts: 581
Location: Oslo, Norway

PostPosted: Wed May 16, 2018 8:05 pm    Post subject: Reply with quote

Do you have USE=rsync-verify on portage?
_________________
Noone wrote:
anything
Back to top
View user's profile Send private message
beerbellyswan
Tux's lil' helper
Tux's lil' helper


Joined: 01 May 2004
Posts: 91
Location: mendon, ny

PostPosted: Wed May 16, 2018 8:35 pm    Post subject: Reply with quote

Quote:

Do you have USE=rsync-verify on portage?


Not specifically - I never changed anything in my system after the announcement on the portage change to do the verification. As a test, I did just set the "-rsync-verify" USE to disable it, and emerge sync worked just fine. But that doesn't seem like the wise thing to do - i WANT the verification (i think).
Back to top
View user's profile Send private message
fedeliallalinea
Bodhisattva
Bodhisattva


Joined: 08 Mar 2003
Posts: 19950
Location: here

PostPosted: Thu May 17, 2018 5:59 am    Post subject: Reply with quote

Based on source code for check if gemato is installed portage try this
Code:
from gemato.exceptions import GematoException
import gemato.openpgp
import gemato.recursiveloader

Try to open a python console and run these lines in python2.7 and 3.5
_________________
Questions are guaranteed in life; Answers aren't.
Back to top
View user's profile Send private message
beerbellyswan
Tux's lil' helper
Tux's lil' helper


Joined: 01 May 2004
Posts: 91
Location: mendon, ny

PostPosted: Thu May 17, 2018 12:29 pm    Post subject: Reply with quote

@fedeliallalinea - both versions of python load gemato just fine from the shell:

Code:

office ~ # python2.7
Python 2.7.14 (default, Jan  5 2018, 16:17:02)
[GCC 5.4.0] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> from gemato.exceptions import GematoException
>>> import gemato.openpgp
>>> import gemato.recursiveloader
>>>


Code:

office ~ # python3.5
Python 3.5.5 (default, Apr 18 2018, 10:30:17)
[GCC 6.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from gemato.exceptions import GematoException
>>> import gemato.openpgp
>>> import gemato.recursiveloader
>>>
Back to top
View user's profile Send private message
zmedico
Developer
Developer


Joined: 02 Jan 2004
Posts: 334
Location: California USA

PostPosted: Fri May 18, 2018 3:28 am    Post subject: Reply with quote

What version of python does emerge --version show?
_________________
Zac
Back to top
View user's profile Send private message
mgorny
Developer
Developer


Joined: 27 Apr 2007
Posts: 80

PostPosted: Fri May 18, 2018 8:43 am    Post subject: Reply with quote

Edit /usr/lib*/python*/site-packages/portage/sync/modules/rsync/rsync.py (all of them, if necessary). Find 'except ImportError', and replace 'gemato = None' following it with 'raise', i.e.:

Code:

try:
   from gemato.exceptions import GematoException
   import gemato.openpgp
   import gemato.recursiveloader
except ImportError:
   raise


Note that Python is fragile to tab-vs-space game, so make sure to use tabs or convert the whole file to spaces.

Since you're modifying file in your live system, please remember to rebuild sys-apps/portage to rewrite the file once we've solved the problem.
Back to top
View user's profile Send private message
beerbellyswan
Tux's lil' helper
Tux's lil' helper


Joined: 01 May 2004
Posts: 91
Location: mendon, ny

PostPosted: Fri May 18, 2018 8:03 pm    Post subject: Reply with quote

@mgorny - i made the change you suggested, but now i get this message immediately:
Code:

office ~ # emerge --sync
Traceback (most recent call last):
  File "/usr/lib64/python3.4/site-packages/portage/util/_async/AsyncFunction.py", line 39, in _run
    result = self.target(*(self.args or []), **(self.kwargs or {}))
  File "/usr/lib64/python3.4/site-packages/portage/sync/controller.py", line 143, in sync
    tasks = [self.module_controller.get_class(repo.sync_type)]
  File "/usr/lib64/python3.4/site-packages/portage/module.py", line 149, in get_class
    mod = self._modules[modname]['parent'].get_class(modname)
  File "/usr/lib64/python3.4/site-packages/portage/module.py", line 77, in get_class
    module = __import__(kid['module_name'], [], [], ["not empty"])
  File "/usr/lib64/python3.4/site-packages/portage/sync/modules/rsync/rsync.py", line 35, in <module>
    from gemato.exceptions import GematoException
ImportError: No module named 'gemato'

Action: sync for repo: gentoo, returned code = 1

 * An update to portage is available. It is _highly_ recommended
 * that you update portage now, before any other packages are updated.

 * To update portage, run 'emerge --oneshot portage' now.



office ~ #


so i've reverted the change and re-implemented the "-rsync-verify" USE flag for now. ill keep my eyes peeled for your final solution - thanks!
Back to top
View user's profile Send private message
fedeliallalinea
Bodhisattva
Bodhisattva


Joined: 08 Mar 2003
Posts: 19950
Location: here

PostPosted: Mon May 21, 2018 11:06 am    Post subject: Reply with quote

You run emerge with python3.4 but gemato is compiled with no support for this python version
Code:
Calculating dependencies... done!
[ebuild   R    ] app-portage/gemato-13.0::gentoo  USE="blake2 bzip2 gpg -lzma -sha3 {-test} -tools%" PYTHON_TARGETS="python2_7 python3_5 -pypy -python3_4 -python3_6" 0 KiB

_________________
Questions are guaranteed in life; Answers aren't.
Back to top
View user's profile Send private message
beerbellyswan
Tux's lil' helper
Tux's lil' helper


Joined: 01 May 2004
Posts: 91
Location: mendon, ny

PostPosted: Mon May 21, 2018 12:56 pm    Post subject: Reply with quote

@fedeliallalinea - you nailed it! i added the "python_targets_python3_4" use flag to gemato:
Code:

office ~ # tail -2 /etc/portage/package.use
app-portage/gemato python_targets_python3_4

office ~ #


and removed the global "-rsync-verify" USE flag, recompiled both portage and gemato, and voila - success!
Code:

sent 34.84K bytes  received 4.06M bytes  101.11K bytes/sec
total size is 220.70M  speedup is 53.89
 * Manifest timestamp: 2018-05-20 22:38:38 UTC
 * Valid OpenPGP signature found:
 * - primary key: DCD05B71EAB94199527F44ACDB6B8C1F96D8BF6D
 * - subkey: E1D6ABB63BFCFB4BA02FDF1CEC590EEAC9189250
 * - timestamp: 2018-05-20 22:38:38 UTC
 * Verifying /usr/portage ...                                                                                                                                                                                                        [ ok ]
=== Sync completed for gentoo
q: Updating ebuild cache in /usr/portage ...
q: Finished 36981 entries in 0.151154 seconds

Action: sync for repo: gentoo, returned code = 0


office ~ #


so i guess my next question is - why do i have to do this? Shouldn't this be a dependency in gemato? The concern of course is when i upgrade python to the next rev, this will resurface....
Back to top
View user's profile Send private message
fedeliallalinea
Bodhisattva
Bodhisattva


Joined: 08 Mar 2003
Posts: 19950
Location: here

PostPosted: Mon May 21, 2018 2:57 pm    Post subject: Reply with quote

beerbellyswan wrote:
so i guess my next question is - why do i have to do this? Shouldn't this be a dependency in gemato? The concern of course is when i upgrade python to the next rev, this will resurface....

Theorically python3.4, if not for your choice, should not be installed because default now is python2.7 and python3.5.
Try to see what packages are installed with python3.4 support
Code:
$ eix --installed-with-use python_targets_python3_4
$ eix --installed-with-use python_single_target_python3_4

_________________
Questions are guaranteed in life; Answers aren't.
Back to top
View user's profile Send private message
beerbellyswan
Tux's lil' helper
Tux's lil' helper


Joined: 01 May 2004
Posts: 91
Location: mendon, ny

PostPosted: Mon May 21, 2018 3:04 pm    Post subject: Reply with quote

There are 11 packages found with python3.4:
Code:

office ~ # eix --installed-with-use python_targets_python3_4
[?] dev-lang/python-exec
     Available versions:  (2) 2.0.1-r1 ~2.0.2 **2.9999
       {PYTHON_TARGETS="jython2_5 jython2_7 pypy pypy3 python2_7 python3_3 python3_4"}
     Installed versions:  2.4.5(2)(01:20:45 PM 12/18/2017)(PYTHON_TARGETS="jython2_7 pypy pypy3 python2_7 python3_4 python3_5 python3_6")
     Homepage:            https://bitbucket.org/mgorny/python-exec/
     Description:         Python script wrapper

[?] dev-python/bsddb3
     Available versions:  6.0.1 ~6.1.0 {doc PYTHON_TARGETS="python2_7 python3_3 python3_4"}
     Installed versions:  6.2.4(01:31:15 PM 12/06/2017)(PYTHON_TARGETS="python2_7 python3_4 python3_5 -python3_6")
     Homepage:            http://www.jcea.es/programacion/pybsddb.htm https://pypi.python.org/pypi/bsddb3
     Description:         Python bindings for Berkeley DB

[?] dev-python/certifi
     Available versions:  14.05.14 ~2015.04.28 2015.9.6.2 {PYTHON_TARGETS="pypy pypy3 python2_7 python3_3 python3_4"}
     Installed versions:  2017.4.17(01:30:04 PM 12/06/2017)(PYTHON_TARGETS="python2_7 python3_4 python3_5 -pypy -pypy3 -python3_6")
     Homepage:            http://certifi.io/
     Description:         Python package for providing Mozilla's CA Bundle

[?] dev-python/html5lib
     Available versions:  0.99999 ~0.999999 ~0.9999999 {test PYTHON_TARGETS="pypy pypy3 python2_7 python3_3 python3_4"}
     Installed versions:  0.9999999(01:30:17 PM 12/06/2017)(-test PYTHON_TARGETS="python2_7 python3_4 python3_5 -pypy -pypy3 -python3_6")
     Homepage:            https://github.com/html5lib/html5lib-python/ https://html5lib.readthedocs.org
     Description:         HTML parser based on the HTML5 specification

[?] dev-python/isodate
     Available versions:  0.5.0 0.5.1 ~0.5.4 {PYTHON_TARGETS="pypy python2_7 python3_3 python3_4"}
     Installed versions:  0.5.4(01:31:35 PM 12/06/2017)(PYTHON_TARGETS="python2_7 python3_4 python3_5 -pypy -python3_6")
     Homepage:            https://pypi.python.org/pypi/isodate
     Description:         ISO 8601 date/time/duration parser and formater

[?] dev-python/pygments
     Available versions:  1.6 1.6_p20140324-r1 2.0.1 2.0.1-r1 ~2.0.2 {doc test PYTHON_TARGETS="pypy pypy3 python2_7 python3_3 python3_4"}
     Installed versions:  2.2.0(08:14:18 PM 12/27/2017)(-doc -test PYTHON_TARGETS="python2_7 python3_4 python3_5 -pypy -pypy3 -python3_6")
     Homepage:            http://pygments.org/ https://pypi.python.org/pypi/Pygments
     Description:         Pygments is a syntax highlighting package written in Python

[?] dev-python/pyparsing
     Available versions:  1.5.6 ~1.5.6-r2 2.0.1 2.0.3 {doc examples PYTHON_TARGETS="pypy python2_7 python3_3 python3_4"}
     Installed versions:  2.2.0^t(01:25:56 PM 12/06/2017)(-doc -examples PYTHON_TARGETS="python2_7 python3_4 python3_5 -pypy -pypy3 -python3_6")
     Homepage:            http://pyparsing.wikispaces.com/ https://pypi.python.org/pypi/pyparsing
     Description:         pyparsing is an easy-to-use Python module for text parsing

[?] dev-python/rdflib
     Available versions:  3.2.3-r1 4.1.2 ~4.2.0 ~4.2.1 {berkdb doc examples mysql redland sqlite test PYTHON_TARGETS="python2_7 python3_3 python3_4"}
     Installed versions:  4.2.2(01:33:42 PM 12/06/2017)(berkdb -doc -examples -mysql -redland -sqlite -test PYTHON_TARGETS="python2_7 python3_4 python3_5 -python3_6")
     Homepage:            https://github.com/RDFLib/rdflib https://pypi.python.org/pypi/rdflib
     Description:         RDF library containing a triple store and parser/serializer

[?] dev-python/setuptools
     Available versions:  2.2 7.0 ~8.0.1 ~8.2.1 ~9.1 12.0.1 ~12.0.3 ~12.0.5 ~15.0 ~15.2 ~16.0 ~17.0 ~17.1.1 ~18.0.1 ~18.1 ~18.2 ~18.2-r2 ~18.2-r3 ~18.3.1 **9999 {test PYTHON_TARGETS="pypy pypy3 python2_7 python3_3 python3_4"}
     Installed versions:  36.7.2(08:13:46 PM 12/27/2017)(-test PYTHON_TARGETS="python2_7 python3_4 python3_5 -pypy -pypy3 -python3_6")
     Homepage:            https://pypi.python.org/pypi/setuptools
     Description:         a collection of extensions to Distutils

[?] dev-python/six
     Available versions:  1.3.0 1.6.1 1.8.0 ~1.9.0 1.9.0-r1 **9999 {doc test PYTHON_TARGETS="pypy pypy3 python2_7 python3_3 python3_4"}
     Installed versions:  1.11.0(07:55:15 AM 04/01/2018)(-doc -test PYTHON_TARGETS="python2_7 python3_4 python3_5 -pypy -pypy3 -python3_6")
     Homepage:            https://bitbucket.org/gutworth/six https://pypi.python.org/pypi/six
     Description:         Python 2 and 3 compatibility library

[?] sys-apps/portage
     Available versions:  2.2.8-r2 2.2.14 2.2.18 2.2.20 2.2.20.1 **9999 {build doc epydoc +ipc linguas_ru pypy2_0 python2 python3 selinux xattr PYTHON_TARGETS="pypy pypy2_0 python2_6 python2_7 python3_2 python3_3 python3_4"}
     Installed versions:  2.3.38(08:44:09 AM 05/21/2018)(ipc native-extensions rsync-verify xattr -build -doc -epydoc -gentoo-dev -selinux PYTHON_TARGETS="python2_7 python3_4 python3_5 -pypy -python3_6")
     Homepage:            https://wiki.gentoo.org/wiki/Project:Portage
     Description:         Portage is the package management and distribution system for Gentoo

Found 11 matches
office ~ # eix --installed-with-use python_single_target_python3_4
No matches found
office ~ #


but regardless of the version, it seems that gemato requires a manually defined use flag that compiles that version in. that's the part i don't understand
Back to top
View user's profile Send private message
fedeliallalinea
Bodhisattva
Bodhisattva


Joined: 08 Mar 2003
Posts: 19950
Location: here

PostPosted: Mon May 21, 2018 3:21 pm    Post subject: Reply with quote

No gemato don't need to manually set python3.4 because python3.4 support is removed in favour of python3.5.
The probem is that you manually set python3.4 for these packages
Code:
dev-python/bsddb3
dev-python/certifi
dev-python/html5lib
dev-python/isodate
dev-python/pygments
dev-python/pyparsing
dev-python/rdflib
dev-python/setuptools
dev-python/six
sys-apps/portage

(see in your /etc/portage/package.use) and then portage can't remove python3.4 with depclean.

You also probably set python3.4 as default interpreter with eselect. You can change it for set python3.5 as default
_________________
Questions are guaranteed in life; Answers aren't.
Back to top
View user's profile Send private message
beerbellyswan
Tux's lil' helper
Tux's lil' helper


Joined: 01 May 2004
Posts: 91
Location: mendon, ny

PostPosted: Mon May 21, 2018 6:00 pm    Post subject: Reply with quote

OK - i get the problem now. you're right - for some reason (i can't remember anymore why) i had portage using python3.4:
Code:

sys-apps/portage python_targets_python3_4


and yes - i definitely had chosen python3.4 as default with eselect. So i've changed that to python3.5 and removed the definition of python_targets_python3_4 use flags in portage.use. after removing all of that and rebuilding portage/gemato - i'm back in business.

thanks a heap!
Back to top
View user's profile Send private message
mgorny
Developer
Developer


Joined: 27 Apr 2007
Posts: 80

PostPosted: Wed May 30, 2018 11:53 am    Post subject: Reply with quote

We're sorry for the trouble. Turns out it was an ebuild bug, and the current Portage versions should force correct flags on gemato.
Back to top
View user's profile Send private message
jezaustin
Tux's lil' helper
Tux's lil' helper


Joined: 22 Sep 2006
Posts: 96
Location: england

PostPosted: Mon Jun 04, 2018 9:44 am    Post subject: Reply with quote

If we can't sync, how should we install the new portage?
Back to top
View user's profile Send private message
bunder
Bodhisattva
Bodhisattva


Joined: 10 Apr 2004
Posts: 5724

PostPosted: Mon Jun 04, 2018 10:34 am    Post subject: Reply with quote

((post moved to relevant topic))
_________________
overlay | patches
Neddyseagoon wrote:
The problem with leaving is that you can only do it once and it reduces your influence.


Last edited by bunder on Tue Jun 05, 2018 3:48 am; edited 1 time in total
Back to top
View user's profile Send private message
fedeliallalinea
Bodhisattva
Bodhisattva


Joined: 08 Mar 2003
Posts: 19950
Location: here

PostPosted: Mon Jun 04, 2018 10:58 am    Post subject: Reply with quote

jezaustin wrote:
If we can't sync, how should we install the new portage?

If you have same problem is enough to chage default python used with eselect python set <python2.7_number_returned_by_list>
_________________
Questions are guaranteed in life; Answers aren't.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Portage & Programming All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum