Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
HOWTO: Creating the latest tarballs.
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Documentation, Tips & Tricks
View previous topic :: View next topic  
Author Message
richard.scott
Veteran
Veteran


Joined: 19 May 2003
Posts: 1497
Location: Oxfordshire, UK

PostPosted: Sat Nov 22, 2008 10:33 pm    Post subject: HOWTO: Creating the latest tarballs. Reply with quote

Hi,

While trying to figure out how hard it could be to write a cron script to create the latest tarballs I came up with this:

Code:
#!/bin/bash

SUBARCH="i686"
REL_TYPE="default"
PROFILE="default/linux/x86/2008.0"
CHOST="i686-pc-linux-gnu"

#
# Download the following to: /var/tmp/catalyst/builds/default/stage3-i686.tar.bz2
#
if [ ! -f /var/tmp/catalyst/builds/default/stage3-${SUBARCH}-latest.tar.bz2 ]; then
  STAGE3="http://gentoo.virginmedia.com/releases/x86/2008.0/stages/stage3-${SUBARCH}-2008.0.tar.bz2"
  mkdir -p /var/tmp/catalyst/builds/default
  axel -a -o /var/tmp/catalyst/builds/default/stage3-${SUBARCH}-latest.tar.bz2 ${STAGE3}
else
  if ls /var/tmp/catalyst/builds/default | grep -q stage3 ; then
    cd /var/tmp/catalyst/builds/default
    STAGE3_DATE="$(ls stage3-*.tar.bz2 | sort -n | tail -n 1 | awk -F "-" '{print $3}' | sed 's/.tar.bz2//')"
  fi
fi

#
# Download the following to:
#
mkdir -p /var/tmp/catalyst/snapshots
rm -f /var/tmp/catalyst/snapshots/portage-latest.tar.bz2
SNAPSHOT="http://gentoo.virginmedia.com/snapshots/portage-latest.tar.bz2"
SNAPSHOT="http://mirror.qubenet.net/mirror/gentoo/snapshots/portage-latest.tar.bz2"
axel -a -o /var/tmp/catalyst/snapshots/portage-latest.tar.bz2 ${SNAPSHOT} || exit 1

#
# Build Stage1 from the available Stage3 file.
#
catalyst -C \
subarch=${SUBARCH} \
target=stage1 \
version_stamp=latest \
rel_type=${REL_TYPE} \
profile=${PROFILE} \
snapshot=latest \
source_subpath=${REL_TYPE}/stage3-${SUBARCH}-latest \
chost=${CHOST} || exit 1

#
# Build a Stage2 from the previous stage1
#
catalyst -C \
subarch=${SUBARCH} \
target=stage2 \
version_stamp=latest \
rel_type=${REL_TYPE} \
profile=${PROFILE} \
snapshot=latest \
source_subpath=${REL_TYPE}/stage1-${SUBARCH}-latest \
chost=${CHOST} || exit 1

#
# Build a Stage3 from the previous stage2
#
catalyst -C \
subarch=${SUBARCH} \
target=stage3 \
version_stamp=latest \
rel_type=${REL_TYPE} \
profile=${PROFILE} \
snapshot=latest \
source_subpath=${REL_TYPE}/stage2-${SUBARCH}-latest || exit 1

#
# Remove the portage snapshot so its not used next time by mistake
#
cd /var/tmp/catalyst
rm -rf kerncache snapshot_cache snapshots

exit 0


Obviously you need to emerge catalyst and for my system I've got dev-util/catalyst-2.0.6.

I'm thinking about extending this script to make a LiveCD as its just an extension of a Stage3 tarball but I've not yet got it working!

Rich
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54097
Location: 56N 3W

PostPosted: Sat Nov 22, 2008 10:52 pm    Post subject: Reply with quote

richard.scott,

You are reinventing the wheel. The gentoo release engineering team already do something like this.

You may want to ask them for their scripts.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
notHerbert
Advocate
Advocate


Joined: 11 Mar 2008
Posts: 2228
Location: 45N 73W

PostPosted: Sat Nov 22, 2008 11:02 pm    Post subject: Reply with quote

You may also be interested in metro and this and this
Back to top
View user's profile Send private message
richard.scott
Veteran
Veteran


Joined: 19 May 2003
Posts: 1497
Location: Oxfordshire, UK

PostPosted: Sat Nov 22, 2008 11:10 pm    Post subject: Reply with quote

NeddySeagoon wrote:
richard.scott,

You are reinventing the wheel. The gentoo release engineering team already do something like this.

You may want to ask them for their scripts.


It's just a nicer wrapper for catalyst so not really reinventing anything!

If The Release Engineering Team really do have scripts that do this then why aren't they using them?
... let me see, when was the last official release? :wink:


Last edited by richard.scott on Sat Nov 22, 2008 11:14 pm; edited 1 time in total
Back to top
View user's profile Send private message
richard.scott
Veteran
Veteran


Joined: 19 May 2003
Posts: 1497
Location: Oxfordshire, UK

PostPosted: Sat Nov 22, 2008 11:13 pm    Post subject: Reply with quote

notHerbert wrote:
You may also be interested in metro and this and this


Thanks I've already seen the Funtoo.org site.

I just can't figure out what the hold up is on the next release of a Gentoo LiveCD and I'm giving the users a choice to create their own and not have to wait for the release engineering team to provide something.

Rich
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54097
Location: 56N 3W

PostPosted: Sun Nov 23, 2008 1:20 pm    Post subject: Reply with quote

richard.scott,

They are. Its not the build that takes the time for an 'official release', its the testing across all arches that will be releasing and the documentation updates.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
richard.scott
Veteran
Veteran


Joined: 19 May 2003
Posts: 1497
Location: Oxfordshire, UK

PostPosted: Sun Nov 23, 2008 2:32 pm    Post subject: Reply with quote

NeddySeagoon wrote:
richard.scott,

They are. Its not the build that takes the time for an 'official release', its the testing across all arches that will be releasing and the documentation updates.


I appreciate that documentation always takes a back seat (it does in my world too) :oops: I guess I don't really understand what testing takes place across arches... Perhaps someone can shed some light on this "testing" process and if there is any way in which we (the community) can help with testing. I'm sure that between us all we have access to every available hardware type going!

Is it just the bootableness (if that's a word) of the ISO images or the stability of the packages involved?
Surely the packages for a LiveCD come from the stable portage tree so by that they should already be stable across all platforms?

The obvious problem area would be the configuration of the LiveCD Kernel so it can support more and more hardware but I guess we could do what other distributions do and include the majority of settings by default. That makese sense to me for an installation CD as IMHO if someone wants a smaller custom kernel then they will have the knowledge and be building that by hand anyway.

Rich.
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54097
Location: 56N 3W

PostPosted: Sun Nov 23, 2008 3:39 pm    Post subject: Reply with quote

richard.scott,

You may want to subscribe to gentoo-releng at lists.gentoo.organd read some of the history on gmane.

Docs can't take a back seat with a Gentoo release. When the *ISOs hit the mirrors, the supporting docs, in several languages have to be there too.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
richard.scott
Veteran
Veteran


Joined: 19 May 2003
Posts: 1497
Location: Oxfordshire, UK

PostPosted: Mon Nov 24, 2008 10:55 am    Post subject: Reply with quote

NeddySeagoon wrote:
richard.scott,

You may want to subscribe to gentoo-releng at lists.gentoo.organd read some of the history on gmane.

Docs can't take a back seat with a Gentoo release. When the *ISOs hit the mirrors, the supporting docs, in several languages have to be there too.


I've had a look at the history of gentoo-releng on gmane and its not really that active:
http://news.gmane.org/gmane.linux.gentoo.releng

The last email was in October 19th

Yes I know that Docs need to be completed before the ISO's launch, but what is the hold up on this?

Has there been _any_ major changes to Gentoo to warrant a re-write of the docs: not to my knowledge?

Are we supporting any new arches than before: not to my knowledge?

Do we already have tools to create the ISO images: yes

Please understand that I'm just trying to figure out what's going on as nothing has been announced since September!

Rich
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54097
Location: 56N 3W

PostPosted: Mon Nov 24, 2008 6:35 pm    Post subject: Reply with quote

richard.scott,

Write to the release engineering email alias. Let me know if you don't get a reply
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Documentation, Tips & Tricks All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum