Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
running multiple emerges concurrently == problem??
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo
View previous topic :: View next topic  
Author Message
ptheborg
n00b
n00b


Joined: 27 Jun 2002
Posts: 67
Location: Rotterdam, The Netherlands

PostPosted: Tue Aug 06, 2002 1:03 pm    Post subject: running multiple emerges concurrently == problem?? Reply with quote

I've searched the man pages for an answer, but couldn't find any.

So my question is:
Is it a problem to run lets say in vc1 an emerge vorbis-tools and in vc2 an emerge apache mod_php mod_ssl??
Of course emerge will merge all the programs, but when both emerge processes are finished at exactly the same time, aren't they both trying to update the same system file or whatever??

I've found myself doing this most of the time when emerging, because after starting an emerge, I think hey, I want that program too....BUT I have not run into trouble YET....
But is there a (little) chance things go wrong???
_________________
Cheers

.NET is like a pet store written with gotos
Back to top
View user's profile Send private message
Naan Yaar
Bodhisattva
Bodhisattva


Joined: 27 Jun 2002
Posts: 1549

PostPosted: Tue Aug 06, 2002 1:18 pm    Post subject: Reply with quote

According to this thread:
https://forums.gentoo.org/viewtopic.php?t=7212
a developer believes that it can cause problems.
Back to top
View user's profile Send private message
ptheborg
n00b
n00b


Joined: 27 Jun 2002
Posts: 67
Location: Rotterdam, The Netherlands

PostPosted: Tue Aug 06, 2002 1:23 pm    Post subject: Reply with quote

hmm, but he's saying that running emerge -f and emerge at the same time could cause problems.....but is this the same as two normal emerges???
_________________
Cheers

.NET is like a pet store written with gotos
Back to top
View user's profile Send private message
Naan Yaar
Bodhisattva
Bodhisattva


Joined: 27 Jun 2002
Posts: 1549

PostPosted: Tue Aug 06, 2002 1:25 pm    Post subject: Reply with quote

emerge -f just fetches the package. This is a subset of fetching and building it, which a plain "emerge" will do.
ptheborg wrote:
hmm, but he's saying that running emerge -f and emerge at the same time could cause problems.....but is this the same as two normal emerges???
Back to top
View user's profile Send private message
ptheborg
n00b
n00b


Joined: 27 Jun 2002
Posts: 67
Location: Rotterdam, The Netherlands

PostPosted: Tue Aug 06, 2002 1:35 pm    Post subject: Reply with quote

so this means running emerge -f and emerge at the same time is something different.
emerge -f fetches the packages but does not compile it, the other emerge process is compiling the packages being fetched by the first process....of course this can lead to troubles....

but emerge 1 and emerge 2, emerge both different packages, this means fetching, compiling and installing.

(oh wait, I see where it can go wrong, if two packages depend on the same package and this package need to be emerge too, both emerge instances will emerge this package?? or am I wrong?)
_________________
Cheers

.NET is like a pet store written with gotos
Back to top
View user's profile Send private message
Naan Yaar
Bodhisattva
Bodhisattva


Joined: 27 Jun 2002
Posts: 1549

PostPosted: Tue Aug 06, 2002 9:58 pm    Post subject: Reply with quote

"emerge -f" is basically one of the beginning steps of an emerge. If this is unsafe, according to the developer, I imagine two parallel emerges would be too. I cannot really see how "emerge -f" can screw up things when done in parallel with an emerge, but I would definitely defer to a developer's knowledge of emerge :).

Anyway, if all you are looking for is compile speed-ups, why don't you set MAKE_OPTS to "-j3" or "-j4", etc., to parallelize make?

ptheborg wrote:
so this means running emerge -f and emerge at the same time is something different.
emerge -f fetches the packages but does not compile it, the other emerge process is compiling the packages being fetched by the first process....of course this can lead to troubles....

but emerge 1 and emerge 2, emerge both different packages, this means fetching, compiling and installing.

(oh wait, I see where it can go wrong, if two packages depend on the same package and this package need to be emerge too, both emerge instances will emerge this package?? or am I wrong?)
Back to top
View user's profile Send private message
ptheborg
n00b
n00b


Joined: 27 Jun 2002
Posts: 67
Location: Rotterdam, The Netherlands

PostPosted: Tue Aug 06, 2002 10:09 pm    Post subject: Reply with quote

OK OK, you've won, I will never run parallel emerges anymore, too dangerous ;)

But of course an emerge -f and an emerge on a different package (than the emerge -f) couldn't go wrong. But if it's about the same packages.....the emerge may be faster than the file download.......
_________________
Cheers

.NET is like a pet store written with gotos
Back to top
View user's profile Send private message
Naan Yaar
Bodhisattva
Bodhisattva


Joined: 27 Jun 2002
Posts: 1549

PostPosted: Tue Aug 06, 2002 10:16 pm    Post subject: Reply with quote

As I said, I really cannot see how a parallel fetch (emerge -f/ebuild fetch) of something unrelated can hurt and the "Tips and Tricks" forum suggests that people have tried it safely... I have a cable connection, so it is not too much of a plus anyway :D

ptheborg wrote:
OK OK, you've won, I will never run parallel emerges anymore, too dangerous ;)

But of course an emerge -f and an emerge on a different package (than the emerge -f) couldn't go wrong. But if it's about the same packages.....the emerge may be faster than the file download.......
Back to top
View user's profile Send private message
rac
Bodhisattva
Bodhisattva


Joined: 30 May 2002
Posts: 6553
Location: Japanifornia

PostPosted: Tue Aug 06, 2002 10:29 pm    Post subject: Reply with quote

It does seem that a lockfile such as the one that Debian's dpkg uses might be prudent to protect against two simultaneous merge stages, if it is indeed such a dangerous activity, although I can't really see it rising to the level of "bug". At least not "urgent enough to file bug".
_________________
For every higher wall, there is a taller ladder
Back to top
View user's profile Send private message
ptheborg
n00b
n00b


Joined: 27 Jun 2002
Posts: 67
Location: Rotterdam, The Netherlands

PostPosted: Tue Aug 06, 2002 10:36 pm    Post subject: Reply with quote

ah......but ehm, I think I'll just stick with running one emerge at the same time.....

Naan Yaar has scared me too much with his reference to that thread with "the developer's" opinion ;)
_________________
Cheers

.NET is like a pet store written with gotos
Back to top
View user's profile Send private message
puddpunk
l33t
l33t


Joined: 20 Jul 2002
Posts: 681
Location: New Zealand

PostPosted: Wed Aug 07, 2002 6:05 am    Post subject: . Reply with quote

i think most of the problem is when the two emerges try do access a cetain file, or write to a certain file, that they will be denied access, or data will be overwritten. You probebly wont end up corrupting...much...but its safer to stack up merges.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum