Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
An emerge wrapper for breaking emerges into chunks
View unanswered posts
View posts from last 24 hours

Goto page Previous  1, 2, 3 ... 25, 26, 27, 28, 29, 30  Next  
Reply to topic    Gentoo Forums Forum Index Unsupported Software
View previous topic :: View next topic  
Author Message
hielvc
Advocate
Advocate


Joined: 19 Apr 2002
Posts: 2805
Location: Oceanside, Ca

PostPosted: Wed Feb 14, 2007 5:09 pm    Post subject: Reply with quote

Hi, yeah my cox service was mostly down last week and no Cox wasnt showing any work ordes for my area but my son who works nights keep seeing the Cox trucks, the big ones, that are used when they run new or additional cable. :twisted: But today 2-14-07 Ill be going down until some time this evening probably.

I'm upgrading from a Sempron 2800 754 (32bit) to a Pentium 4 D 805 ( dual core). This would be no bigee but
Im also going to try software raid with 2 80Gig drives which includes the one which has my new pentium system . The 60Gig, in the Sempron, is bacisly full so Ill save my /var/log/emerge.log /var/lib/portage/world /var/db/pkg and my packages from the 80G to a 18G. The other wrinkle is my PWR supply which is only 300W which works fine with one or 2 HD, a dvd and a floppy (for work). I wondering though if it will handel 3 or 4 HD?

super-lupo I didnt install plaudis but read through some of the support thread and emwrap.sh wont currently work with it. It needs a script though if for no other reason than to have short options instead of those dang long ones it seems to use.

EDIT Writting this helped to clear my head and Im off to steal, hum borrow, a dvd-w from my son who borrowed about 60 cdw's from me. Then Ill just use a install cd to boot and rebuild the dually. 8)
_________________
An A-Z Index of the Linux BASH command line
Back to top
View user's profile Send private message
hoyanf
Tux's lil' helper
Tux's lil' helper


Joined: 27 Aug 2005
Posts: 80
Location: Malaysia

PostPosted: Sun Feb 18, 2007 7:57 am    Post subject: Reply with quote

i still cant find the error line :-

./emwrap-4.0.8.sh: line 813: syntax error: unexpected end of file

any help would do...

thanx
_________________
WorkPC -> Xeon x3440 | Gigabyte P55-UD6 | 16GB DDR3 | HDD1 - 600GB | HDD2 - 500 GB | HDD3 - 1TB
HomePC -> Xeon x3320 | Gigabyte GA-EP45-UD3P | 8GB DDR2 | HDD1 - 500GB | HDD2 - 1TB
Back to top
View user's profile Send private message
dol-sen
Developer
Developer


Joined: 30 Jun 2002
Posts: 2805
Location: Richmond, BC, Canada

PostPosted: Sun Feb 18, 2007 4:37 pm    Post subject: Reply with quote

His site is up and running, so just download a copy.
http://68.111.181.40:9002/emwrap.sh
_________________
Brian
Porthole, the Portage GUI frontend irc@freenode: #gentoo-guis, #porthole, Blog
layman, gentoolkit, CoreBuilder, esearch...
Back to top
View user's profile Send private message
cerebus_k
Apprentice
Apprentice


Joined: 20 Jun 2003
Posts: 173
Location: Flower Mound, Texas

PostPosted: Sun Feb 18, 2007 5:02 pm    Post subject: Reply with quote

dol-sen wrote:
His site is up and running, so just download a copy.


Thanks! I hadn't checked lately and didn't notice a version newer than what I've been running.
_________________
Gettin old isn't for wimps
Back to top
View user's profile Send private message
hielvc
Advocate
Advocate


Joined: 19 Apr 2002
Posts: 2805
Location: Oceanside, Ca

PostPosted: Mon Feb 19, 2007 5:10 pm    Post subject: Reply with quote

hoyanf try running the "bash -x emwrap.sh " If the output is to long then "bash -x emwrap.sh >output.lst" and open up "less output.lst"

Ill try to help but my Mother had a massive stroke is unresponcive. I found her yesterday afternoon. Today my brotherand I are going to start to set things in order. The Doctor is giving her at most a month.

Again dol-sen thanks for your help.
_________________
An A-Z Index of the Linux BASH command line
Back to top
View user's profile Send private message
devnull42
n00b
n00b


Joined: 24 Feb 2007
Posts: 14
Location: Italy

PostPosted: Sat Feb 24, 2007 10:52 am    Post subject: Reply with quote

Hey Hiel,

I began writing a gentoo installation guide a few days ago on gentoo-wiki.com, it also uses your emerge wrapper. Just thought you might like to take a look!

Keep up the good work!

http://gentoo-wiki.com/Gentoo_Power_Setup
Back to top
View user's profile Send private message
piavlo
Tux's lil' helper
Tux's lil' helper


Joined: 21 Jun 2005
Posts: 141

PostPosted: Sun Feb 25, 2007 11:45 pm    Post subject: Reply with quote

devnull42 wrote:
Hey Hiel,

I began writing a gentoo installation guide a few days ago on gentoo-wiki.com, it also uses your emerge wrapper. Just thought you might like to take a look!

Keep up the good work!

http://gentoo-wiki.com/Gentoo_Power_Setup

The following should be enough
Code:
emwrap.sh -est
emwrap.sh -esw
You first update the toolchain(twice with the emwrap.sh) then
rebuild the rest of the system with the new toolchain.
Back to top
View user's profile Send private message
devnull42
n00b
n00b


Joined: 24 Feb 2007
Posts: 14
Location: Italy

PostPosted: Tue Feb 27, 2007 6:13 pm    Post subject: Reply with quote

piavlo wrote:

The following should be enough
Code:
emwrap.sh -est
emwrap.sh -esw
You first update the toolchain(twice with the emwrap.sh) then
rebuild the rest of the system with the new toolchain.


Well I don't know, but considering that at the moment of running the script against the given stage3 tarball not only tc-components, but probably also various system packages and, more importantly, libraries are updated, it makes sense to me to do the whole thing to get a clean system, where everything is built against correctly built dependencies.
Back to top
View user's profile Send private message
piavlo
Tux's lil' helper
Tux's lil' helper


Joined: 21 Jun 2005
Posts: 141

PostPosted: Tue Feb 27, 2007 10:02 pm    Post subject: Reply with quote

devnull42 wrote:
piavlo wrote:

The following should be enough
Code:
emwrap.sh -est
emwrap.sh -esw
You first update the toolchain(twice with the emwrap.sh) then
rebuild the rest of the system with the new toolchain.


Well I don't know, but considering that at the moment of running the script against the given stage3 tarball not only tc-components, but probably also various system packages and, more importantly, libraries are updated, it makes sense to me to do the whole thing to get a clean system, where everything is built against correctly built dependencies.


The stage3 is already clean, so you update with emwrap.sh -est all toolchain components in the correct
order twice, then you rebuild the all the system against the new updated and clean toolchain emwrap.sh -esw.
I've used this method to install over 50 different gentoo installation and never had a problem.

Another more paranoid way could be first upgrade all system except toolchain with emwrap.sh -eswuDN, and then as before emwrap.sh -est & emwrap.sh -esw

In your wiki you end up recompiling toolchain 6 times instead of 2(the whole idea behind emwrap is to avoid that).
Also you suggest
    ./emwrap.sh -W (first world build against clean TC system)
    ./emwrap.sh -W (second world build and done)
this does not make sence since portage
already re-emerges the world in the correct order, so therre is no need to do it twice.
This only could make sense if you had pkgA with libA linked against libB from pkgB and libC also from pkgB linked against libA
but in reality such circular dependencies between 2 libraries from 2 different packages never exist. Of course there can be circular dependency between
2 portage pkgs, but is is never real circular dependency in the 2 package libraries.

You can also take a look at https://forums.gentoo.org/viewtopic-p-3548628.html#3548628
Back to top
View user's profile Send private message
devnull42
n00b
n00b


Joined: 24 Feb 2007
Posts: 14
Location: Italy

PostPosted: Tue Feb 27, 2007 11:25 pm    Post subject: Reply with quote

Sounds interesting! I'll give it a read as soon as I find the time to :D

But anyway, what I did was actually just copying hiel's summary of steps for upgrading from page 1 into the wiki.

hielvc wrote:
To tie it all to gather
Code:
gcc-config -l          # make sure of gcc before beginning
emwrap.sh -set or -St
gcc-config -l           #select the new gcc
emwrap.sh -seb or -Sb       # We rebuild the TC and then the rest of the system
emwrap.sh -se  or -S         # doing the 2nd system emerge minus the TC
emwrap.sh -wet or -St        # rebuilds TC against clean system
emwrap.sh -W             # first build of the world files against clean TC system
emwrap.sh -W             # second world rebuild and done



Is this simply out-dated information? Or does it make sense in certain occassions? Thank you for your explanations!
_________________
# whoami
don4lfonso a.k.a. devnull42

~ I'm going to prove the impossible really exists ~
Back to top
View user's profile Send private message
devnull42
n00b
n00b


Joined: 24 Feb 2007
Posts: 14
Location: Italy

PostPosted: Wed Feb 28, 2007 3:19 pm    Post subject: Reply with quote

Furthermore, how would you suggest to fully update a box were, say, new ebuilds are available for tc, system and world? Like this?
Code:
emwrap.sh -est
emwrap.sh -esw

And just considering system+world-tc just the second command? That is, a system -e without the toolchain packages?
Or simply
Code:
emwrap.sh -swuDN

without the empty option?
_________________
# whoami
don4lfonso a.k.a. devnull42

~ I'm going to prove the impossible really exists ~
Back to top
View user's profile Send private message
hielvc
Advocate
Advocate


Joined: 19 Apr 2002
Posts: 2805
Location: Oceanside, Ca

PostPosted: Wed Feb 28, 2007 6:44 pm    Post subject: Reply with quote

Late but heres my 2 cents. The 3 main ideas behind me writing this were to build the TC first, save time and try to build against upto date libaries once. Things have changed, we now have a fine tool called revdep-reuild and 2 excellent guides, Changing the CHOST variable and Gentoo GCC Upgrade Guide.

I still perfer to build any TC update first and there are times when you have to build it first or "emerge system -e" three times, to get a clean TC, so emwrap.sh does it first.

As to rebuilding the system or world twice I have pointed out that I don't. With the TC built first I have never had a problem with building the system except for groff, which always builds once the system is through updating. Its been at least a year and half or two since I did. For the system the libs dependencies arent as deep? complex? multilevel? The most common probablem is where CHOST was changed or the gcc enviroment has probs. These are better taken care, and in some cases the only way to fix, with the above guides and revdep-rebuild. The same goes for the world packages. Revdep-rebuild is usually quickerwith a far smaller list to rebuild.

Another reason why rebuilding twice isnt as important is that portage has improved in calculating DEPENDs and RDEPENDs.

So that said, depending on the chunk size you want to break "emerge world" into.

For --emptytree emerging
Code:
emwrap.sh -seb1   >> build TC once then system or leave off the 1 to build the TC twice
emwrap.sh -W  >> build "emerge world -e" once minus the TC and system packages you just built in above step.
or
emwrap.sh -WX kde mozillia openoffice >> "emerge world -e" minus TC minus system minus kde,mozillia, and openofice


For --update --deep --newuse (newuse optional, if you havent changed your USE flags in make.conf you dont need it)
Code:
emwrap.sh -suDNb or -suDNb1 >> udate TC once or twice then system
emwrap.sh -wuDN  >> builds what remains to be updated


Now you can break the system into a seperate TC chunk and then a system chunk by
Code:
emwrap.sh -set or -set1 or -suDNt or -suDNt1
emwrap.sh -se or -suDN  >> update or build system minus TC


When do you want to use use --emptytree ? After you have changed your CFLAGS and you want them to take effect as quickly as possible. If your starting from a stage3 and again you want your CFLAGS used for every package then --emptytree. Oh if you havent already add EMERGE_DEFAULT_OPTS="--with-bdeps y" to your /etc/make.conf. For more info see this portage-2.1.2-rc1 -uD missing deps, No new feature
_________________
An A-Z Index of the Linux BASH command line
Back to top
View user's profile Send private message
devnull42
n00b
n00b


Joined: 24 Feb 2007
Posts: 14
Location: Italy

PostPosted: Wed Feb 28, 2007 10:35 pm    Post subject: Reply with quote

enlightening :D
_________________
# whoami
don4lfonso a.k.a. devnull42

~ I'm going to prove the impossible really exists ~
Back to top
View user's profile Send private message
Moderato
n00b
n00b


Joined: 02 Jun 2006
Posts: 26
Location: Karlsruhe, Baden-Württemberg, Germany

PostPosted: Fri Apr 13, 2007 11:02 am    Post subject: Reply with quote

hielvc wrote:
To tie it all to gather
Code:
gcc-config -l          # make sure of gcc before beginning
emwrap.sh -set or -St
gcc-config -l           #select the new gcc
emwrap.sh -seb or -Sb       # We rebuild the TC and then the rest of the system
emwrap.sh -se  or -S         # doing the 2nd system emerge minus the TC
emwrap.sh -wet or -St        # rebuilds TC against clean system
emwrap.sh -W             # first build of the world files against clean TC system
emwrap.sh -W             # second world rebuild and done



Well, just one more comment on this (yeah, I'm still updating this way, takes me nearly one week but I feel safe. :))

Anyways, you mention "emwrap.sh -wet or -St". Well I think that's just a typo, so nevermind or correct it, but -St is, as I understand, the same as -set and not -wet.

That's everything, have a nice weekend. :)
Back to top
View user's profile Send private message
hielvc
Advocate
Advocate


Joined: 19 Apr 2002
Posts: 2805
Location: Oceanside, Ca

PostPosted: Sat Apr 14, 2007 5:22 pm    Post subject: Reply with quote

Moderato "-S" is the equivalent to " -se ". Its a hang over from when I first came up with world minus system. In its first form, emwrap.sh-3.0.5, you had to run
Quote:
-d This is a 2 part function. Does system -e build first after emerge system you have
to run emwrap.sh -r to build the world files minus the system files from using
the -d.
-r Resumes building the wrld list, minus the system files.
I knew when I came up with those switch's that they would cause problems and they did within a month. I changed the script and changed the the way the "world - system" function worked so that you could "world - system" without having to do the system first. Since -se has to be run to remove the its files from the world list I left it in. Its actually slower though Since it runs the list generation part of -W, a minute or so.

As to the safe method if its what you feel comfortable with do it. Another way is to make a chroot partition, so you can boot from it, and do a stage3 build, -e or -uDN or using the above listing for the TC and system , using your current /etc/make.conf. Then using your current /var/lib/portage/world, copy it over and do
Code:
emerge $(< world)
This gives you a fresh clean system with a minimum of rebuilding.

Enjoy the weekend
Hiel
_________________
An A-Z Index of the Linux BASH command line
Back to top
View user's profile Send private message
Moderato
n00b
n00b


Joined: 02 Jun 2006
Posts: 26
Location: Karlsruhe, Baden-Württemberg, Germany

PostPosted: Sun Apr 15, 2007 10:08 am    Post subject: Reply with quote

Hi again,

thanks for the explanation. :)

One more thought, though. What does the script when it sees slots? I noticed following: it's just rebuilding the first/earliest version of the ebuild.

I have installed, for example, dev-java/sun-jdk-1.4.2.13-r1, dev-java/sun-jdk-1.5.0.11, dev-java/sun-jdk-1.6.0-r1; BUT only dev-java/sun-jdk-1.4.2.13-r1 is to be rebuild. I really do see a problem here, because rebuilding only the first version is not a good deal since mostly the latest or at least both versions are used.

Anyways, did I do anything wrong? I'm at emwrap.sh -W and that's what the /tmp/emwrap/build file says.

Thanks in advantage. :)
Back to top
View user's profile Send private message
curmudgeon
Veteran
Veteran


Joined: 08 Aug 2003
Posts: 1633

PostPosted: Mon Apr 16, 2007 2:49 pm    Post subject: Reply with quote

I think I found another bug with your script.

When building just the tool chain, it says it will do:
Code:
$ dog /tmp/emwrap/build
sys-kernel/linux-headers-2.6.17-r2
sys-libs/glibc-2.5
sys-devel/gcc-config-1.3.15-r1
sys-devel/binutils-config-1.9-r3
sys-devel/binutils-2.16.1-r3
sys-devel/gcc-4.1.1-r3
sys-libs/glibc-2.5
sys-devel/binutils-2.16.1-r3
sys-devel/gcc-4.1.1-r3


So far, so good. And still no problems after building linux-headers. But after building glibc, the script removes BOTH instances of it in the build file (likewise with binutils). If something stops the process (and this has somehow happened to me several times), then trying to resume will NOT get the second build of glibc or binutils.

Everything gets built fine without any interrupt of the script, but I would expect that I could resume it (and have everything work properly) like I can when rebuilding the system or world packages.
Back to top
View user's profile Send private message
hielvc
Advocate
Advocate


Joined: 19 Apr 2002
Posts: 2805
Location: Oceanside, Ca

PostPosted: Mon Apr 23, 2007 3:47 pm    Post subject: Reply with quote

curmudgeon I just logged in and saw your post. I either didnt get notified or I was over zealous in deleting email notification :?: Ill look at it and get back to you.
_________________
An A-Z Index of the Linux BASH command line
Back to top
View user's profile Send private message
tekknokrat
Apprentice
Apprentice


Joined: 17 Apr 2005
Posts: 278
Location: Magdeburg

PostPosted: Fri May 25, 2007 1:28 pm    Post subject: Reply with quote

i have no patience in reading/searching through the whole thread (perhaps this feature was requested before)
but one feature request from my side.

What I needed in case that the resume list is deleted on restart ( is for me the case because I have /tmp /var/tmp mounted in ramfs ) would be
a switch with that i can say skip packages until number ( e.g. 264 of 279 ) so that it resume at 264, heh?
whole number of packages is gathered via
Code:
emwrap.sh -Wp
(<- e.g.)

I don't know internal structure of the script ( did I already wrote that i am not very patienced? ) but if packages are indexed it would'nt be that problem I think... :roll:
_________________
Optimism is solely an absence of information. / Optimismus ist nur ein Mangel an Information.
(Arthur Schopenhauer)
Back to top
View user's profile Send private message
red-wolf76
l33t
l33t


Joined: 13 Apr 2005
Posts: 714
Location: Rhein-Main Area

PostPosted: Wed May 30, 2007 7:59 am    Post subject: Reply with quote

Ho-hum... I've got the issue that emwrap.sh wants to rebuild the toolchain no matter what, even if it just finished rebuilding it. How's that possible?

Should I post emerge --info and friends?
_________________
0mFg, G3nt00 r0X0r$ T3h B1g!1111 ;)

Use sane CFLAGS! If for no other reason, do it for the lulz!
Back to top
View user's profile Send private message
slycordinator
Advocate
Advocate


Joined: 31 Jan 2004
Posts: 3065
Location: Korea

PostPosted: Wed May 30, 2007 7:10 pm    Post subject: Reply with quote

Well, firstly what parameters/arguments are you passing to it?
Back to top
View user's profile Send private message
red-wolf76
l33t
l33t


Joined: 13 Apr 2005
Posts: 714
Location: Rhein-Main Area

PostPosted: Thu May 31, 2007 6:37 am    Post subject: Reply with quote

You're right. Pure PEBCAK! I was passing -seb to the script, forcing it to always detect a linux-headers update. :oops:
_________________
0mFg, G3nt00 r0X0r$ T3h B1g!1111 ;)

Use sane CFLAGS! If for no other reason, do it for the lulz!
Back to top
View user's profile Send private message
darkphader
Veteran
Veteran


Joined: 09 May 2002
Posts: 1199
Location: Motown

PostPosted: Thu Aug 30, 2007 1:54 pm    Post subject: Reply with quote

emwrap is currently broken - doesn't execute gcc-config properly with gcc-config-1.4.0-r1
Code:
sed: can't read /etc/env.d/gcc/config: No such file or directory
/usr/local/bin/emwrap.sh: line 629: [: : integer expression expected
/usr/local/bin/emwrap.sh: line 631: [: : integer expression expected

BEFORE selecting new GCC:
 [1] NATIVE
 [2] x86_64-pc-linux-gnu-4.2.0 *

**********************************************************************
 I'm going to execute:  # gcc-config x86_64-pc-linux-gnu-
**********************************************************************
 Kill me NOW, or forever hold your peace!
 (sleeping for 15 seconds...)
15 14 13 12 11 10 9 8 7 6 5 4 3 2 1
(continuing...)
 * gcc-config: Could not locate 'x86_64-pc-linux-gnu-' in '/etc/env.d/gcc/' !
ERROR: : gcc-config x86_64-pc-linux-gnu- failed!

Code:
davinci ~ # ls -l /etc/env.d/gcc/
total 16
-rw-r--r-- 1 root root  32 2006-08-03 10:25 config-i386-pc-linux-gnu
-rw-r--r-- 1 root root  32 2007-08-30 02:22 config-i686-pc-linux-gnu
-rw-r--r-- 1 root root 327 2007-07-15 03:53 i686-pc-linux-gnu-4.1.2
-rw-r--r-- 1 root root 235 2007-08-30 02:21 i686-pc-linux-gnu-4.2.0
lrwxrwxrwx 1 root root  23 2007-08-30 02:22 NATIVE -> i686-pc-linux-gnu-4.2.0
Code:
sartre ~ # ls -l /etc/env.d/gcc/
total 8
-rw-r--r-- 1 root root  34 2007-08-30 09:56 config-x86_64-pc-linux-gnu
lrwxrwxrwx 1 root root  25 2007-08-30 09:56 NATIVE -> x86_64-pc-linux-gnu-4.2.0
-rw-r--r-- 1 root root 285 2007-08-30 01:27 x86_64-pc-linux-gnu-4.2.0

The file "/etc/env.d/gcc/config" no longer exists.

Chris
_________________
WYSIWYG - What You See Is What You Grep
Back to top
View user's profile Send private message
tekknokrat
Apprentice
Apprentice


Joined: 17 Apr 2005
Posts: 278
Location: Magdeburg

PostPosted: Fri Aug 31, 2007 2:36 pm    Post subject: Reply with quote

I switched my profile from desktop to hardened and now gcc-4.2 and glibc-2.5 wont emerge.
gcc because it is masked by hardened profile.

so I was trying to emerge my system with the old ones:

gentoo portage # gcc-config --list-profiles

[1] i686-pc-linux-gnu-3.3.6 *

and gcc- sys-libs/glibc-2.3.6-r5.

But glibc doesnt permit downgrading by sanity check.

Quote:

* checking glibc-infopages-2.3.6.tar.bz2 ;-) ... [ ok ]
* Sanity check to keep you from breaking your system:
* Downgrading glibc is not supported and a sure way to destruction

!!! ERROR: sys-libs/glibc-2.3.6-r5 failed.


I thought it was safe to rebuild/downgrade my system with emwrap in the following order

Code:
emwrap -bS
emwrap -W


or could something other mysterious happen with downgrading glibc when i use the order tc,system,world?
_________________
Optimism is solely an absence of information. / Optimismus ist nur ein Mangel an Information.
(Arthur Schopenhauer)
Back to top
View user's profile Send private message
Suicidal
l33t
l33t


Joined: 30 Jul 2003
Posts: 952
Location: /dev/null

PostPosted: Fri Aug 31, 2007 3:32 pm    Post subject: Reply with quote

Talk with the guys in #gentoo-hardened on freenode, from what I remember glibc 2.5 (?r4) should be fine but gcc will definitely have to be downgraded.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Unsupported Software All times are GMT
Goto page Previous  1, 2, 3 ... 25, 26, 27, 28, 29, 30  Next
Page 26 of 30

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum