Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
quietemerge -- provide pretty emerge output
View unanswered posts
View posts from last 24 hours

Goto page Previous  1, 2, 3, 4, 5, 6  Next  
Reply to topic    Gentoo Forums Forum Index Documentation, Tips & Tricks
View previous topic :: View next topic  
Author Message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Thu May 19, 2011 5:36 pm    Post subject: Reply with quote

krinn wrote:
that on left part it shown a per package eta of 12s, 6s, 9s, 26s, 23s, 18s and 11s and a total ETA of 49s
same for right side, same thing is seen. (it's even worst with a funky 15s)
Ah yes. I fixed that bug a while ago. :) I didn't realise until it gave me a 1min Total ETA for a total of 83 packages!
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Fri May 20, 2011 12:47 pm    Post subject: Reply with quote

Update: Version 20110520 "A midsummer night's dream release"
Changelog:
  • Major rewrite with --jobs support!
  • Don't create a temp file ($tmpT) if emerge -p exited with an error
  • Bug fix: "_ETA_ALL=1 quietemerge" wasn't working, i.e. ETA_ALL in config wasn't over-ridden
  • Bug fix: Fix sed expression in my_genlop. ETA was incorrect if pkgs like rox and rox-lib were both installed. rox would have the wrong ETA since it would also add and compute ETA for rox-lib.


Direct file link: http://quietemerge.googlecode.com/files/quietemerge-20110520

Please rename the file to quietemerge after downloading.

EDIT Please let me know if you find any bugs. I am unsure how --keep-going works with --jobs (with respect to skipped packages), since I haven't been able to emulate that behavior. If you do find bugs in the update mechanism, please copy /tmp/quietemerge.output.log file since I might need them to debug the script. Thanks! :)
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sat May 21, 2011 4:07 pm    Post subject: Reply with quote

Update: Version 20110521
It seems I broke the display that results from SHOW_MERGE_TIME=1 in the config, in trying to fix another bug. This update fixes the SHOW_MERGE_TIME=1 display also.

Changelog:
  • Bug fix: Revert sed expression for the case when SHOW_MERGE_TIME=1
  • Output the total time emerge took (at the end).


Direct file link: http://quietemerge.googlecode.com/files/quietemerge-20110521

Please rename the file to quietemerge after downloading.
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sat Jun 11, 2011 4:51 pm    Post subject: Reply with quote

Update: Version 20110611
Changelog:
  • Add support for --autounmask-write
  • export FEATURES="notitle" so that the term title can be updated less often


Direct file link: http://quietemerge.googlecode.com/files/quietemerge-20110611
Please rename the file to quietemerge after downloading.
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sun Jun 26, 2011 12:10 pm    Post subject: Reply with quote

Update: Version 20110617
It seems I forgot to upload these fixes from more than a week ago. Now, if you have configured config updater in the quietemerge.config file, then it will kick in after you run --autounmask-write the first time (unless you have /etc/portage in CONFIG_PROTECT_MASK).
  • Bugfix: --autounmask-write in EMERGE_DEFAULT_OPTS wasn't being honored.
  • Update the config update grep string to include config message from --autounmask-write

Direct file link: http://quietemerge.googlecode.com/files/quietemerge-20110617
Please rename the file to quietemerge after downloading.
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
Gordex
n00b
n00b


Joined: 10 Jul 2008
Posts: 19

PostPosted: Sun Jun 26, 2011 12:39 pm    Post subject: Reply with quote

looks great, thanks for sharing 8)
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sun Jun 26, 2011 12:42 pm    Post subject: Reply with quote

Gordex wrote:
looks great, thanks for sharing 8)
Thanks :D
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sat Aug 27, 2011 6:33 pm    Post subject: Reply with quote

Update: Version 20110827

Small bugfixes:
  • Now, easier to detect currently merging pkgs
  • Bugfix: Correct <num>/<total> in term title.
  • Bugfix: Detect "binary" @ emerge -K output.


Direct file link: http://quietemerge.googlecode.com/files/quietemerge-20110827
Please rename the file to quietemerge after downloading.

Do let me know if you find any bugs. This script is pretty much going into a maintenance stage since I can't think of any more features to add. Adding --jobs was the most difficult for me, but now that is done, and the script is stable. I would like to keep it stable which implies I should leave it as it is. :)
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sun Nov 13, 2011 5:39 am    Post subject: Reply with quote

Trivial update: Version 20111113
* Only change is the removal of -q option from emerge.

Direct file link: http://quietemerge.googlecode.com/files/quietemerge-20111113
Please rename the file to quietemerge after downloading.

The files have also been added retroactively to a git repository: http://code.google.com/p/quietemerge/source/list
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
Woofie
Tux's lil' helper
Tux's lil' helper


Joined: 11 Sep 2010
Posts: 83
Location: Czech Rep.

PostPosted: Sat Nov 26, 2011 10:47 pm    Post subject: Reply with quote

Hi, I noticed a small error when I try emerge my bin package (migrating throught wine version) I call quietemerge like this

Code:
quietemerge -avk wine


and I get this

Code:

------------------------------- Pretended emerge -------------------------------

These are the packages that would be merged, in order:

Calculating dependencies  ... done!
[binary   R   ~] app-emulation/wine-1.3.32  USE="X alsa cups dbus fontconfig gecko gnutls jpeg lcms ldap mp3 ncurses nls opengl oss perl png samba ssl threads truetype win32 xcomposite xinerama xml -capi -custom-cflags -gphoto2 -gsm -gstreamer -hardened -openal -opencl -scanner -test -v4l (-win64)"

Total: 1 package (1 reinstall, 1 binary), Size of downloads: 0 kB

                                   Total ETA:                                   

  * Continue with the emerge process? ([Yes]|No):


-------------------------------- Starting emerge -------------------------------

/usr/local/bin/quietemerge: line 768: 0 +  : syntax error: operand expected (error token is "+  ")
  * Installing app-emulation/wine-1.3.32.
/usr/local/bin/quietemerge: line 768: 0 +  : syntax error: operand expected (err
  * Install  app-emulation/wine-1.3.32.                                   Done!



Seems it doesn't harm :) only for info..
Maybe I missed something..
_________________
Sorry for my English. It's not my native language and I'm still learning it.
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sun Nov 27, 2011 3:36 am    Post subject: Reply with quote

Code:
/usr/local/bin/quietemerge: line 768: 0 +  : syntax error: operand expected (error token is "+  ")
Hi, what version of quietemerge are you using? You can get the version from the help quietemerge -h. In the latest version, line 768 is this:
Code:
        local p ptime
and there is no + operand on that line.

Version 20110617 has a + on that line. But in 20110827 I had put in some fixes to detect "binary" packages like this: [binary R ~]. So that might have fixed this + operand error.
Quote:
Seems it doesn't harm only for info..
Maybe I missed something..
As for not harming - that is how I have designed it to work :) Emerge itself runs as a separate process and if the script messes up, nothing happens to emerge itself.
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
Woofie
Tux's lil' helper
Tux's lil' helper


Joined: 11 Sep 2010
Posts: 83
Location: Czech Rep.

PostPosted: Sun Nov 27, 2011 9:41 am    Post subject: Reply with quote

Ah I foud what i missed :)
It was the older version 20110617 now when I updated to newest version yesterday I forgot copy it into my $PATH

Sorry, little mistake :)

Tested new version and no error :) keep up in this good work.

Is it posible don't count ETA of binary package to total ETA to have a better view of merging time? Because if I start merge package ( for example wine ) it's wrote that ETA will be 33 min and start to countdown, but after several seconds skip to Installing phase.
_________________
Sorry for my English. It's not my native language and I'm still learning it.
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sun Nov 27, 2011 12:25 pm    Post subject: Reply with quote

woofie wrote:
Ah I foud what i missed :)
It was the older version 20110617 now when I updated to newest version yesterday I forgot copy it into my $PATH

Sorry, little mistake :)

Tested new version and no error :) keep up in this good work.

Good! Otherwise I would have to search for a bug :P
Quote:
Is it posible don't count ETA of binary package to total ETA to have a better view of merging time? Because if I start merge package ( for example wine ) it's wrote that ETA will be 33 min and start to countdown, but after several seconds skip to Installing phase.
Actually you get the ETA also in your terminal title. So, after this binary package has been emerged, the ETA in the terminal titlebar will update and show you the correct ETA for the rest of the packages.

As for removing the count of binary packages, it is possible and small binary packages are emerged quickly. But larger binary packages will actually take quite some time to unpack and install. In that case, the Total ETA will show a gross underestimate of the time required. Is that desirable??

EDIT: Never mind. I will show both.
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sun Nov 27, 2011 2:15 pm    Post subject: Reply with quote

Trivial update: Version 20111127
* Show (additional) Total ETA without binary emerges

Direct file link: http://quietemerge.googlecode.com/files/quietemerge-20111127
Please rename the file to quietemerge after downloading.

EDIT: Fixed a silly mistake in the code. New file is uploaded.
EDIT 2: Fix the fix. The original code was correct!!
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
Woofie
Tux's lil' helper
Tux's lil' helper


Joined: 11 Sep 2010
Posts: 83
Location: Czech Rep.

PostPosted: Sun Nov 27, 2011 4:50 pm    Post subject: Reply with quote

Quote:

As for removing the count of binary packages, it is possible and small binary packages are emerged quickly. But larger binary packages will actually take quite some time to unpack and install. In that case, the Total ETA will show a gross underestimate of the time required. Is that desirable??


Good point I haven't consider that. Hardly say if it's desirebly then.. We'll see after some merges.
but if you want to show two line with ETA isn't be more readeble if the ETA without binary line appears only if some binary package are going to merge or something like that?
_________________
Sorry for my English. It's not my native language and I'm still learning it.
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sun Nov 27, 2011 4:57 pm    Post subject: Reply with quote

woofie wrote:
Quote:

As for removing the count of binary packages, it is possible and small binary packages are emerged quickly. But larger binary packages will actually take quite some time to unpack and install. In that case, the Total ETA will show a gross underestimate of the time required. Is that desirable??


Good point I haven't consider that. Hardly say if it's desirebly then.. We'll see after some merges.
but if you want to show two line with ETA isn't be more readeble if the ETA without binary line appears only if some binary package are going to merge or something like that?
Yes. Currently, the Total ETA is always shown. The ETA without binary is shown only if there is some binary emerge. So, you get the following behavior:
Code:
~> quietemerge -pk eet gvim
------------------------------- Pretended emerge -------------------------------

These are the packages that would be merged, in order:

Calculating dependencies  ... done!
[ebuild   R    ] app-editors/gvim-7.3.266
[binary   R   *] dev-libs/eet-9999

                                Total ETA: 4m 9s                               
                        Total ETA without binary: 3m 35s                       



~> quietemerge -p eet gvim
------------------------------- Pretended emerge -------------------------------

These are the packages that would be merged, in order:

Calculating dependencies  ... done!
[ebuild   R    ] app-editors/gvim-7.3.266
[ebuild   R   *] dev-libs/eet-9999

                                Total ETA: 4m 9s                               


_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
Woofie
Tux's lil' helper
Tux's lil' helper


Joined: 11 Sep 2010
Posts: 83
Location: Czech Rep.

PostPosted: Mon Nov 28, 2011 10:29 am    Post subject: Reply with quote

Oh sorry :) maybe I should test it first and ask later, my mistake :)
_________________
Sorry for my English. It's not my native language and I'm still learning it.
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sat Dec 24, 2011 6:31 am    Post subject: Reply with quote

Update: Version 20111224 "The Holiday Release!"
  • Execute emerge directly if unsupported command is detected. All the script setup is bypassed. This should get this script one step closer to being a wrapper for emerge :D
  • Show package name in terminal title if only number of jobs is 1.
  • Clean up help() function.
  • Bugfix: Get rid of "grep: Unmatched [ or [^"
  • Bugfix: Force --color=n on actual emerge.


Direct file link: http://quietemerge.googlecode.com/files/quietemerge-20111224
Please rename the file to quietemerge after downloading.
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Fri Dec 30, 2011 3:32 pm    Post subject: Reply with quote

Update: Version 20111230

Bugfix: Fix infinite recursion (for example with -1). This was an embarrassing bug :(

Direct file link: http://quietemerge.googlecode.com/files/quietemerge-20111230
Please rename the file to quietemerge after downloading.
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
Woofie
Tux's lil' helper
Tux's lil' helper


Joined: 11 Sep 2010
Posts: 83
Location: Czech Rep.

PostPosted: Sun Jan 15, 2012 1:49 pm    Post subject: Reply with quote

Hi when I upgraded yesterday I got this error

Quote:

* Install dev-python/pygobject-2.28.6-r51. Done!
* Install dev-python/pygobject-3.0.2. Done!
* Install >*/. Error!
* Install >*/. Error!
* Install net-libs/farsight2-0.0.29. Done!


but it seems that everything emerge ok. In quietemerge.output.log I foung only this section which should be connect to this

Quote:

>>> Completed installing pygobject-3.0.2 into /home/fox/Build/portage/dev-python/pygobject-3.0.2/image/

strip: i686-pc-linux-gnu-strip --strip-unneeded -R .comment
usr/lib/libpyglib-gi-2.0-python2.7.so.0.0.0
usr/lib/python2.7/site-packages/gi/_gobject/_gobject.so
usr/lib/python2.7/site-packages/gi/_gi.so
usr/lib/python2.7/site-packages/gi/_glib/_glib.so
usr/lib/python2.7/site-packages/gi/_gi_cairo.so
usr/lib/libpyglib-gi-2.0-python3.1.so.0.0.0
usr/lib/python3.1/site-packages/gi/_gobject/_gobject.so
usr/lib/python3.1/site-packages/gi/_gi.so
usr/lib/python3.1/site-packages/gi/_glib/_glib.so
usr/lib/python3.1/site-packages/gi/_gi_cairo.so
ecompressdir: bzip2 -9 /usr/share/doc

>>> Installing (12 of 31) dev-python/pygobject-3.0.2
* Compilation and optimization of Python modules for CPython 2.7 ...
[ ok ]
* Compilation and optimization of Python modules for CPython 3.1 ...
[ ok ]

>>> Emerging (13 of 31) net-libs/farsight2-0.0.29
* farsight2-0.0.29.tar.gz RMD160 SHA1 SHA256 size ;-) ... [ ok ]
>>> Unpacking source...


Problem is maybe with interpret installing proces for Python modules or something like that :)
_________________
Sorry for my English. It's not my native language and I'm still learning it.
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sun Jan 15, 2012 2:47 pm    Post subject: Reply with quote

Unfortunately, I am unable to reproduce this here:
Code:
~> quietemerge -av --buildpkg "pygobject:3"
------------------------------- Pretended emerge -------------------------------

These are the packages that would be merged, in order:

Calculating dependencies  ... done!
[ebuild  NS    ] dev-python/pygobject-3.0.2 [2.28.6-r51] USE="cairo threads -examples -test" 0 kB

Total: 1 package (1 in new slot), Size of downloads: 0 kB

                                 Total ETA: 40s                                 

  * Continue with the emerge process? ([Yes]|No):


-------------------------------- Starting emerge -------------------------------

  * Install  dev-python/pygobject-3.0.2.                                    34s
The full build output is in http://paste.pocoo.org/show/535127

I don't see anything in your logs which can trigger that output you saw. The "Error!" string is shown only when some package failed, and no part of the output matches the strings I search for in my script. I also tried emerging farsight2 to see if the errors are triggered by that, but I didn't see any errors there either.
Code:
~ [1] > quietemerge farsight2 $QEMERGE
------------------------------- Pretended emerge -------------------------------

These are the packages that would be merged, in order:

Calculating dependencies  ... done!
[ebuild  N     ] net-libs/libnice-0.1.0  USE="gstreamer -upnp"
[ebuild  N     ] media-libs/gst-plugins-bad-0.10.22  USE="orc"
[ebuild  N     ] net-libs/farsight2-0.0.29  USE="-msn -python -upnp"

                                Total ETA: 3m 33s                               

  * tmpfs is already mounted


-------------------------------- Starting emerge -------------------------------

  * Install  net-libs/libnice-0.1.0.                                        20s
  * Install  media-libs/gst-plugins-bad-0.10.22.                         1m 36s
  * Install  net-libs/farsight2-0.0.29.                                     33s
                            Total time taken: 2m 14s                           


"$QEMERGE" is simply some extra emerge options that is set in my zshrc (I use this when I want to use --jobs): "QEMERGE='--jobs=2 --load-average=5 --keep-going'"
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sun Jan 15, 2012 3:03 pm    Post subject: Reply with quote

woofie, thanks for the bug report! I have been able to reproduce the bug. I simply had to disable --jobs while emerging farsight2. The error stems from a string in the output in the build of farsight2 which matches an error string that I search for in my script.

It seems emerge is spewing out full build logs again (that is --quiet-build=y has been removed). I failed to notice that. I should re-enable the -q option to my emerge command. This will ensure that such incidents don't happen again.
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Sun Jan 15, 2012 3:23 pm    Post subject: Reply with quote

Update Version 20120115: Small bug fix for the problem faced by woofie. Just reintroducing -q to my emerge command is sufficient :)

Direct file link: http://quietemerge.googlecode.com/files/quietemerge-20120115
Please rename the file to quietemerge after downloading.
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
Woofie
Tux's lil' helper
Tux's lil' helper


Joined: 11 Sep 2010
Posts: 83
Location: Czech Rep.

PostPosted: Sun Jan 15, 2012 10:46 pm    Post subject: Reply with quote

Oh sorry for my very lame bug report, but I'm still learning :) I forgot to wrote that I don't use --jobs and so on..
I base it only on guessing. It's fine that you can reproduce it and find it there.
Keep up in this good work :)
_________________
Sorry for my English. It's not my native language and I'm still learning it.
Back to top
View user's profile Send private message
ppurka
Advocate
Advocate


Joined: 26 Dec 2004
Posts: 3208

PostPosted: Mon Jan 16, 2012 1:28 am    Post subject: Reply with quote

woofie wrote:
Oh sorry for my very lame bug report, but I'm still learning :) I forgot to wrote that I don't use --jobs and so on..
I base it only on guessing. It's fine that you can reproduce it and find it there.
Keep up in this good work :)
No problems. You didn't need to mention that. It is evident from your logs that --jobs is not used. :)
_________________
emerge --quiet redefined | E17 vids: I, II
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Documentation, Tips & Tricks All times are GMT
Goto page Previous  1, 2, 3, 4, 5, 6  Next
Page 5 of 6

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum