[HOWTO] Hassle-free emerge -uD world (update-world v1.8)

[count_zero]

Where can you get those sources?

Just try to emerge the package, and it gives instructions:

Code: Select all

emerge  =dev-java/sun-jdk-1.4.2.13
>>> cfg-update-1.8.0-r5: Building checksum index... (takes a few seconds) done!
Calculating dependencies... done!

>>> Emerging (1 of 1) dev-java/sun-jdk-1.4.2.13 to /

!!! dev-java/sun-jdk-1.4.2.13 has fetch restriction turned on.
!!! This probably means that this ebuild's files must be downloaded
!!! manually.  See the comments in the ebuild for more information.

 * Please download j2sdk-1_4_2_13-linux-i586.bin from:
 * http://javashoplm.sun.com/ECom/docs/Welcome.jsp?StoreId=22&PartDetailId=j2sdk-1.4.2_13-oth-JPR&SiteId=JSC&TransactionId=noreg
 * (first select 'Accept License', then click on 'self-extracting file'
 * under 'Linux Platform - Java(TM) 2 SDK, Standard Edition')
 * and move it to /usr/portage/distfiles

[count_zero]

Just updated the script to version 1.8, implementing a bunch of new features. I tried to get in most requests, but forgive me if I missed yours. Remind me and I'll try to get it into the next version.

Happy updating!

[d2_racing]

Pretty good script

[drjimmy42]

I think the addition of revdep-rebuild now makes this the single best gentoo script ever. This script alone increases stability and ease of frequent or infrequent updates enormously. Thanks a lot.

Feature request: Can you add a "-a" like flag that does what emerge -a does, where it shows you what its about to do and then you hit enter to do it. Holy crap am I lazy, but running the prepare and install in a single step makes it easier to script too. Instead of two whole lines, I can write only one:-) Thanks again.

[count_zero]

I think the addition of revdep-rebuild now makes this the single best gentoo script ever. This script alone increases stability and ease of frequent or infrequent updates enormously. Thanks a lot.

Feature request: Can you add a "-a" like flag that does what emerge -a does, where it shows you what its about to do and then you hit enter to do it. Holy crap am I lazy, but running the prepare and install in a single step makes it easier to script too. Instead of two whole lines, I can write only one:-) Thanks again.

Easily done. I'll include it in the next release (hopefully sometime next week).

[jeremykoppel]

I definitely want to try this out. When I do an 'update-world --prepare' however, I get 'WARNING: One of the specified packages doesn't exist'. How can I tell which package is causing the problem?

--Jeremy
'

[vinboy]

hi
can I do a

Code: Select all

emerge -uDNav world

using this script?


btw, very nice work.

[drjimmy42]

hi
can I do a

Code: Select all

emerge -uDNav world

using this script?


btw, very nice work.

It already does. It was added in version 1.4

[vinboy]

hi
can I do a

Code: Select all

emerge -uDNav world

using this script?


btw, very nice work.

It already does. It was added in version 1.4

thx for reply.

are those parameters implicit when I run update-world ?
or I have to specify it explicitly?

such as

Code: Select all

update-world -uDNav

[count_zero]

hi
can I do a

Code: Select all

emerge -uDNav world

using this script?


btw, very nice work.

It already does. It was added in version 1.4

thx for reply.

are those parameters implicit when I run update-world ?
or I have to specify it explicitly?

such as

Code: Select all

update-world -uDNav

They're assumed:
--prepare == -uDNpv
or
--empty == -evp


The next release is almost ready! It's got some great new features, including the return of USE flag management.
Just a little more testing to go...

[jerann]

I've used this script quite a bit - it is extremely helpful . One thing I noticed, though, is that if I try to install a large package (in this case, Gnome) by going emerge -p gnome | update-world, it gives me an error (Error: Invalid Command). I figured out that I had to do emerge -p gnome > temp, then nano temp and remove the first blank line. Then, I could cat temp | update-world, and it worked just fine. I can't imagine that using update-world to install large packages is done much, but it is handy in cases like this. I think it's a bug in the script here, so you might want to look into that. Just a thought - thanks!

[Borgond]

Hi there,

After running --prepare and trying to --install (after modifying the emerglist) the script is telling me that I have to "unmask" some packages. In a previous try it told me that I need to resolve issues with blocking packages.

What it doesn't tell are the packages (in both cases) in question. Am I the only one who would find that information useful?

What would be the easiest way to determine blockers and resolve them?

e.g. calling

Code: Select all

emerge -uvp world

and see what's blocking - unmerging those packages?

Any help is welcome!

Thanks in advance!

[baldo]

hi,

1.8 looks nice.

but doing an emerge -p xfce4 | update-world will result in:

Code: Select all

$ emerge -p xfce4 | update-world 
No arguments supplied.  If you're piping from the emerge command (emerge -p <package> | update-world), this is fine.  Otherwise, cancel and type 'update-world --help' for usage information.
Error: Invalid Command.
Run 'update-world --help' for usage.

[count_zero]

@Borgond:
I'm working on a better handling of blocked packages, it'll be in the next release.

@jerann & baldo:
I've improved the code for piped emerges, hopefully it will produce fewer errors now.

[steveL]

I'm working on a better handling of blocked packages, it'll be in the next release.

Perhaps we could [topic=546828]collaborate[/topic]?

[mrscratch]

I try to use the script, but on package 13 of 996 it gets stuck on compiling sys-apps/hal-0.5.7.1-r5 with the following message:

Code: Select all

checking for XML::Parser... configure: error: XML::Parser perl module is required for intltool

!!! Please attach the following file when filing a report to bugs.gentoo.org:
!!! /var/tmp/portage/sys-apps/hal-0.5.7.1-r5/work/hal-0.5.7.1/config.log

!!! ERROR: sys-apps/hal-0.5.7.1-r5 failed.
Call stack:
  ebuild.sh, line 1614:   Called dyn_compile
  ebuild.sh, line 971:   Called qa_call 'src_compile'
  environment, line 3747:   Called src_compile
  hal-0.5.7.1-r5.ebuild, line 151:   Called econf '--with-doc-dir=/usr/share/doc/hal-0.5.7.1-r5' '--with-os-type=gentoo' '--with-pid-file=/var/run/hald.pid' '--with-hwdata=/usr/share/misc' '--enable-hotplug-map' '--disable-verbose-mode' '--disable-pcmcia-support' '--disable-acpi-proc' '--enable-docbook-docs' '--enable-doxygen-docs' '--disable-selinux'
  ebuild.sh, line 577:   Called die

!!! econf failed
!!! If you need support, post the topmost build error, and the call stack if relevant.
!!! A complete build log is located at '/var/tmp/portage/sys-apps/hal-0.5.7.1-r5/temp/build.log'.

cat: /tmp: Is a directory

*** Hit Control-C to exit, or just wait to continue with emerge.

*** Continuing with emerge.
The failed package sys-apps/hal-0.5.7.1-r5 could not be merged and must be successfully installed before continuing.

It tells me I first must build hal before it can continue, but wasn't the whole purpose of the script that it would continue even when some packages fail? Did I do something wrong?

Well it seems it dies with every package that goes wrong. Some package fails, then it says it will continue with the emerge. After that it calculates dependencies again and will try the same package again. This fails again obviously for the same reason as before. Then it will stop for good.

[baldo]

hi,

thx for fixing, but did you upload the changes? i don't find a changed version...

cheers
baldo

[count_zero]

@mrscratch:
The script has a *limited* ability to deal with failed packages--in other words, if a package fails, it will remove it from the list, and try to catch any packages that depend on it. However, if a large number of packages depend on the package that failed (like hal), the script will stop. This is to prevent another package from trying to pull in the failed package, causing an infinite loop of emerging the failed package.

To get past this, you need to fix your specific problem.

Code: Select all

checking for XML::Parser... configure: error: XML::Parser perl module is required for intltool

It looks like you have an XML-Parser problem. Try reinstalling XML-Parser and then emerge hal. Then you should be able to continue with the script.

@baldo:
Sorry about that, I'm currently working a string of nights and haven't been able to finish the release. I should be back on days this weekend, maybe I can do it then.

[12345moon12345]

Hi I'd like to be able to use update-world with some different LDFLAGS for some specific packages.
For instance openoffice fails wilt my standard LDFLAGS="-Wl,-O1 -Wl,--as-needed" (from /etc/make.conf) but succeeds with LDLFAGS=""

Then i found an interesting post ( http://forums.gentoo.org/viewtopic-t-67 ... rt-25.html ):

Mine are currently
Code:
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=both -Wl,-znow"
on several boxes.

I've been using these with the advanced Gentoo install method and overlay by nesl247 (previously know as Evolution Mission). Works great for me, and the the few packages that have problems with --as-needed or -znow can be taken care of by entries in an /etc/portage/bashrc.nesl247 file, as shown below.
---------------------------------------------------------------------------------------------------
# Packages in this array remove --as-needed.
as_needed_packages=(
${as_needed_packages[*]}
media-video/mjpegtools
kde-base/kdemultimedia
kde-base/kdemultimedia-kioslaves
net-mail/courier-imap
media-sound/cdparanoia
mail-client/evolution
media-libs/imlib
)

LDFLAGS="${LDFLAGS:-$( grep ^LDFLAGS /etc/make.conf | sed 's/LDFLAGS="//' | sed 's/"//')}"

for i in ${as_needed_packages[*]}
do
case ${CATEGORY}/${PN} in
${i})
LDFLAGS="$( echo ${LDFLAGS} | sed 's/-Wl,--as-needed//')"
break
;;
esac
done

# Packages in this array remove -znow.
znow_packages=(
${znow_packages[*]}
dev-python/gst-python
x11-base/xorg-server
x11-drivers/ati-drivers
)

for i in ${znow_packages[*]}
do
case ${CATEGORY}/${PN} in
${i})
LDFLAGS="$( echo ${LDFLAGS} | sed 's/-Wl,-znow//')"
break
;;
esac
done

export LDFLAGS=$( echo ${LDFLAGS} )

I'm not a script-expert but it some logic from this could be translated to be of use in the update-script.
Would you be willing to include this feature ( per-package-LDFLAGS ) ?

In theory it would even be possible for update-world to first try the standard LDLAGS for each package and if package fails try again with a simpeler LDFLAGS.... this seems much more complex though. Maybe in some far future version?

keep up the good work, love your script !

[steveL]

For instance openoffice fails wilt my standard LDFLAGS="-Wl,-O1 -Wl,--as-needed" (from /etc/make.conf) but succeeds with LDLFAGS=""

Um, just wanted to ask, when OO.o fails with -as-needed, is that during the emerge itself, or does it just crash afterwards?

BTW the easy way to do this is [topic=499881]outlined here[/topic].

[12345moon12345]

12345moon12345 schreef:
For instance openoffice fails wilt my standard LDFLAGS="-Wl,-O1 -Wl,--as-needed" (from /etc/make.conf) but succeeds with LDLFAGS=""

Um, just wanted to ask, when OO.o fails with -as-needed, is that during the emerge itself, or does it just crash afterwards?

BTW the easy way to do this is outlined here.

during the emerge off-course, otherwise I wouldn't have posted in this thread...

[heilong]

Howdy.

I'd like to note that the elog view support doesn't work if PORT_LOGDIR variable is unset. It's not necessary to have this variable to use elog, the default elog path is /var/log/portage/elog.
I guess this is an update-world bug.
Thanks for this useful script.

--Gene

[haubi]

why not have an ebuild for update-world ?

So one can say:
$ emerge update-world
$ update-world ...

/haubi/

[drjimmy42]

Has anyone gotten the piped output to update-world to work? Ever time I try I get this

Code: Select all

# emerge -puD | update-world 
No arguments supplied.  If you're piping from the emerge command (emerge -p <package> | update-world), this is fine.  Otherwise, cancel and type 'update-world --help' for usage information.
Error: Invalid Command.
Run 'update-world --help' for usage.

I'm pretty sure the problem is that the until line below. I can't figure out what its trying to do with all that but it doesn't seem to be working.

Code: Select all

# piped command MUST include --pretend !!!
if [[ "$arguments" = "" ]]
then echo "No arguments supplied.  If you're piping from the emerge command (emerge -p <package> | update-world), this is fine.  Otherwise, cancel and type 'update-world --help' for usage information."
    until [[ `echo "$piped" | wc -l` -eq 10 ]] && [[ -z `echo "$piped" | grep 'Calculating dependencies'` ]] || [[ -z `echo "${piped:-1}" | tail -n 4` ]]
    do read line
	piped="${piped}
$line"
    done
else :
fi

Any ideas?

[ryker]

why not have an ebuild for update-world ?

So one can say:
$ emerge update-world
$ update-world ...

/haubi/

I don't see the point of an ebuild. I see what you are saying, but you have to remember, update-world is just a simple script. There's not much point in maintaining an ebuild for installing 1 file.