Gentoo on a Cobalt Qube 3?

Message

prolix · Post by **prolix** » Sat Jan 04, 2003 6:40 pm

This may be an odd idea but personally I think it would be cool, and i'm sure its possible but I wanted some feedback before I go blow up some hardware trying.

I have a Sun Cobalt Qube 3, its mainly a soho server appliance for small networks, it handles all kinds of tasks; email server, web, dhcp, firewall, etc etc. I bought one a while ago off ebay b/c I thought the form factor was interesting and its nothing more than a linux box (running a hacked up version of redhat). I use it as my webserver and mail server and thats about it. It performs great but I'm a figity geek and want to do something new with it.

Here is the hardware config on it:
AMD k6-3 350mhz
196 megs of ram
40 gig drive

Now this is where problems are involved with the qube and other linux distros, it has no monitor, no cdrom, no floppy. You load these via the network. You boot a pc off the cobalt restore cd and hook the qube and pc up via a crossover cable and net-boot the qube and walla, it repartitions and restores.

Thats all fine if you want the cobalt os, but for my use of the qube I don't need all the fancy web gui junk and personally I'd rather just have a nice clean install of Gentoo.

The qube does have a LCD panel on teh back with a keypad which I'm sure I could rig up using lcdproc or something.

The problem is how do I boot this thing. Luckily you can do the entire Gentoo intall via ssh so that clears out a ton of problems associated with no monitor.

I'm thinking I'd need to boot up a pc with the gentoo install cd and then somehow get it configured to let the qube net-boot off that install, and then ssh in and configure the qube. I'm not sure though, not sure if it would work at all.

This has been done before with a redhat install. Here is the link:
http://www.gurulabs.com/rhl-cobalt-howto/index.html

They did it with a RH7.2 install and it seemed to come out fine. They had to go and reflash the Prom on teh machine (it holds the kernel in memory and boots that way.. )

Anyway, I'm sure this would prove to be difficult but I wanted to post this to see if anyone had done any thing similar on other linux appliances or on systems without cdrom/floppies.

lodestone · Post by **lodestone** » Fri Feb 21, 2003 10:12 pm

I am attempting a similar project, but on a cacheraq 4. Haven't had any luck yet, but I will post back if I do.

If anyone has any helpful ideas, I'd love to hear them.

-Lodestone
Matt

prolix · Post by **prolix** » Fri Feb 21, 2003 10:38 pm

Well, my own project is dead b/c I lost interest in the qube and sold it so I could get some better hardware. But, I did have limited success and I got some input from some people at Sun Microsystems about it which was pretty helpful and will apply to the Raq4.

I had 2 drives in my qube, and I was using hte first drive to boot then I was going to load the 2nd drive as the gentoo system. I'd chroot over to it and finish the install there. Then yank drive 1, and make drive 2 the master. this worked, but i had errors. Most were kernel related so overall the project works. Its just a matter of messing with it. There is an experimental 2.4 kernel out for the qube as well, there is info about it in the original link i posted about the RH install.

Here is the info I got from Sun:

Going just a step past what tony mentioned, (and for the more skillful in the ways of the Cobalts I might add.) there is a way to get the qube to "boot" off of other devices. First let me explain the way a qube boots.

There is a "static" kenrel kernel ROM that is called the "First Stage Kernel" This is the kernel that acts almost like BIOS would. It initializes all of the devices and loads a "Second Stage Kernel". The Second Stage loading process is what you would call "booting the machine" A cobalt doesn't act like a normal pc PC the sense that bios finds and loads a boot sector and a boot loader to load an os. That's the main difference. There is a variable set in CMOS called the 'bootdev' This bootdev bootdev the device, minus the leading '/dev/dev, that the First Stage kernel attempts to load the Second Stage Kernel from. By default, for Qube3's Qube3's DO NOT have RAID in them, this variable is set to 'hda1' (Yes it includes a partition number) For RAID'ed RAID'ed the variable is set to md1 md1 md0, I don't recall exactly which. The interesting thing is that you CAN set this variable to a scsi SCSI, IF the first stage kernel is compiled with that SCSI driver built into it. I think symbios symbios cards are built in, but don't quote me on that. I don't have the list of build in drivers.

The Second Stage Kernel is a gzipped vmlinux gzipped. It is NOT a bzImage or bzImage zImage. zImage you want to load a kernel on a cobalt it MUST be built as a vmlinux kernel vmlinux FIRST then gzip -9 gzip -9 used to zip the kernel with the highest compression. This produces a vmlinux.gz vmlinux gz NO BOOT SECTOR OR SETUP HEADERS! It is important that the kernel be built in that manner.

In short, if the First Stage kernel sees the device you are trying to boot from, and your kernel is built right and is in / not /boot it'll work.

Setting this variable is a bit tricky though. AND very UNSUPPORTED. Setting this variable COULD render your machine UNBOOTABLE. EVEN WITH UNBOOTABLE OS RESTORE. And Sun Cobalt Hardware warranty DOES NOT cover RMA'ing the server if RMA'ing do this and render your machine unbootable.

That unbootable said, there are 2 ways to set the variable.

1) through any shell to the machine, you can use the

# cmos -c bootdev <device>

command where <bootdev> is something like hda1 sda1 ... and so on

2) Through a serial console in boot menu mode. (See the knowledge base for instructions on getting into boot menu mode)

Once in boot menu mode, you can follow the help screens and set the bootdev variable there.

All that lovely information bootdev, I know a bit about Gentoo myself. And I an supply SOME information here about loading it on a Cobalt.

1) Gentoo operates off of a 2.4 kernel with devfs (for the Gentoo part). 2.4 kernels will NOT operate on a Qube 3 without taking a big risk and flashing CMOS with a new build. Which, if you mess up a flash, turns your Cobalt into a pretty blue paper weight.

2) A cobalt already boots an os, and the general purpose of the Gentoo Boot Cd. If you OS get a second HD and use that for the Gentoo install, you can do everything necessary HD the chroot steps onward.

3) Since a qube needs no boot chroot if you get that far in the install process, qube don't need to do the boot loader.

4) When you build the kernel for a Gentoo system on a Cobalt, you need to make sure it is built right, see instructions above, and is placed in / not /boot.

That's about all the help I can supply to you for doing this, but I hope it points you in the right direction. The information in this post is not for the faint of heart, and is very very very unsupported. But if you know what you are doing, and could fix a Cobalt if it came to that from a serial console boot menu, then you should be fine.

--

Jason
Sun Microsystems

veri11ion · Post by **veri11ion** » Wed May 14, 2003 5:25 am

I work with Jason actually, he sits behind me.

I think he pretty much covered it though. The ROM on cobalts will only accept a kernel under a certain size. This kind of kills using a 2.4 kernel without mucking around a bit. Flashing the rom corrects that problem.

I haven't been playing with other distros on the little blue boxes as much as Jason has been, but I may be able to field some questions.

--
Timothy Bissell

atopian · Post by **atopian** » Tue May 20, 2003 4:45 pm

The two biggest things to remember when mucking with a x86 cobalt box is setting the root device in the cmos, and building EVERYTHING possible as a module. Everything else is pretty much straightforward.

atopian · Post by **atopian** » Mon May 26, 2003 2:04 pm

Well, after a 3 day weekend's worth of tinkering, I now have a duel proc XTR humming away with gentoo on the bare system.

DISCLAIMER: This is of course completely unsupported and will void any and all warranties you may have with Sun Microsystems or Cobalt Networks. I speak for myself and represent neither Sun Microsystems or Cobalt Networks in this and any other posts relating to this topic.

Doing this could render your cobalt box into a unusable brick, I take no responsibility if this happens, you have been warned.

----

To do this, one needs:

1 Sun Cobalt x86 box (Qube3, XTR, RaQ3/4/550)
1 Serial cable
1 Other linux box with nfs and dhcp server capabilities

The first thing to do is to set up the nfsroot environment to boot the sucker. The easiest way to do this is grab the iso @ ftp://ftp.cobalt.sun.com/pub/iso/259-38 ... 550.iso.gz

Gunzip and mount the iso as a loopback fs. Then grab the nfsroot-x86 directory and copy it to /. Add an entry to /etc/exports for the /nfsroot-x86 like this:

/nfsroot-x86 192.168.1.0/255.255.255.0(rw,no_root_squash)

Change the IP range as needed to suit the network the install will happen on. Once the entry has been made, start or restart nfs.

Next, modify dhcpd.conf and add these lines:

server-name "192.168.1.25";
next-server 192.168.1.25;
option root-path "192.168.1.25:/nfsroot-x86";

Save the changes and either start or restart dhcpd.

Its almost ready! The last thing needed is a few tweaks to the nfsroot image. Go into the /nfsroot-x86 directory, and modify etc/rc.d/rc.sysinit. Before the main_script executes, add a line running 'bash'. Grab the latest x86 generic stage1 tarball and place it in /nfsroot-x86. Also grab the latest cobalt kernel (c
urrently located in rpm form @ ftp://ftp.cobalt.sun.com/pub/products/raq550/RPMS/ ) and place it in /nfsroot-x86.

Now the nfsroot environment is ready. Remember: A ROM OF 2.9.34 OR GREATER IS NEEDED. If the cobalt box is not running 2.9.34, burn the 550 iso obtained earlier, reboot and boot the cd, and do an os restore from cd. The 550 has to have 2.9.34, so the installer will update the rom as part of the install.

Attach the serial cable from port 1 of the cobalt box to a machine. Run a serial console program (i.e. minicom). It should be set to 115200 8N1.

Now boot the cobalt box, and hold down the (S)elect key. After a possibly lengthy harddrive sync, it will prompt you from which device to boot from. Select 'boot from net' and hit (E)nter. The serial console should be showing the bootup sequence, and eventually dropping to bash shell.

The rest of the build is fairly straight forward. There are a few catches. For instance, most new cobalt platforms support software raid (md) and will boot from them by default. Especially if the box has multiple disks (i.e. in an XTR) then a software raid may want to be built. Also instead of emerging a kernel, the cobalt-kernel is needed. It should be located on that rpm downloaded earlier, simply 'rpm2cpio whatever.rpm | cpio -i --make-directories' from the / of the new gentoo system, after a stage3 system has been built/emerged/etc.

After fully emerged and ready, reboot the system but stay at the serial console. When it prompts for it, press space to drop to ROM mode. Go to the boot area, and update the boot_dev and boot_type as needed. then type reboot. It should start up the newly emerged gentoo system!

mroch · Post by **mroch** » Mon Feb 16, 2004 9:51 pm

If you already have a Linux OS installed (you should...) you can follow the Alternative Installation Guide to install inside an existing installation and not need a second linux PC nor have to deal with the whole NFS business.

xlarge · Post by **xlarge** » Fri Mar 19, 2004 7:39 pm

mroch wrote:If you already have a Linux OS installed (you should...) you can follow the Alternative Installation Guide to install inside an existing installation and not need a second linux PC nor have to deal with the whole NFS business.

We still have to fix the prom don't we? to allow bigger kernels and make it look for the kernel in the right place?

I'm running netbsd on my qube2 and i've got a qube3 (the one with raid) waiting to become gentoonized...

mroch · Post by **mroch** » Fri Mar 19, 2004 8:02 pm

xlarge wrote:We still have to fix the prom don't we? to allow bigger kernels and make it look for the kernel in the right place?

Follow these instructions to upgrade the prom and then you should be able to more-or-less follow the Gentoo installation instructions. You may get some errors initially on the first couple of boots (IIRC, something needed to be done to make devfs work right, but it wasn't hard), but the problems are all fixable.

Also, 2.6.0 kernels probably don't work on the Qube 3, so you're better off sticking with the 1.4 stages.

xlarge · Post by **xlarge** » Sat Mar 20, 2004 2:02 pm

okidoki... i'll give it at go, soon enough. (i've already upped the prom.. did that a while ago.. and since i've had problems setting up a bootp... )

dougm · Post by **dougm** » Tue Mar 30, 2004 10:49 am

I've been working out the Gentoo installation and I plan to write a start to finish doc for it once I've completed, that covers everything from creating a remote NFS root system, to booting from LVM. Right now, I'm just trying to get the initrd correct for LVM. I planned my installation so that I would have as little downtime on the qube as possible, so it makes for a pretty fast install (on the system itself. I used an Athlon64 machine to make binary packages nice and fast)

haven · Post by **haven** » Tue Apr 06, 2004 11:26 am

I'm interested in this - I'd be very interested in reading your doc when you have finished it dougm. I have an old qube 3 system who's prom I have updated ready for an upgrade, now it wont boot and I'm not sure where its looking for its kernel so I'm thinking of doing an install via NFS but havent gotten up the nerve to try yet. Its sounding like what you have done is pretty much what I want to do and any pointers would be very welcome.

Dj Lightning · Post by **Dj Lightning** » Wed Apr 07, 2004 5:45 am

Here is a few questions and statements before I attempt te install this weekend on a 3i. If all goes well I will have 2 production 4i's that will be blessed.

you already have a Linux OS installed (you should...) you can follow the Alternative Installation Guide to install inside an existing installation and not need a second linux PC nor have to deal with the whole NFS business.

I dont see why this wouldnt work, but has anyone done it this way?

Now the nfsroot environment is ready. Remember: A ROM OF 2.9.34 OR GREATER IS NEEDED. If the cobalt box is not running 2.9.34, burn the 550 iso obtained earlier, reboot and boot the cd, and do an os restore from cd. The 550 has to have 2.9.34, so the installer will update the rom as part of the install.

Ok, from experience you have a 50/50 chance of making a big paper weight by doing this. Then you must send it to Gerald at Frontstreets to solder in a new ROM.

Any feedback about the Redhat ROM? Thats a new one on me.

Anyways sounds fun and a great way to keep these little boxes going for a few more years.
Now that I think of it I want to install Plesk7 on Gentoo on a Cobalt. Think I shall paint it green and name it Frankenstien. I love this OS

haven · Post by **haven** » Wed Apr 07, 2004 7:45 pm

Quote:
you already have a Linux OS installed (you should...) you can follow the Alternative Installation Guide to install inside an existing installation and not need a second linux PC nor have to deal with the whole NFS business.

I upgraded the prom and checked to see if the version had changed, it hadn't so I figured I needed to reboot for the change to take effect. That was the last time my box booted

I still have options to netboot etc but it doesnt find the kernel by default. Be careful on doing this !

I'm now going to have to resort to an NFS install but am putting it off as I dont exactly understand what is going on with the prom and kernel booting.

Thats where I am up to.

haven · Post by **haven** » Sun Apr 25, 2004 9:14 pm

Hi folks - I have a cobalt qube 3 system, I have cleared a partiition (/home) and extracted the stage 1 files and the portage directory. When I try to chroot I get the following error:

[root /home]# chroot /home
FATAL: kernel too old
[root /home]# uname -r
2.2.16C32_III

Have any of you suffered from this and how have you gotten around it ?
Without chroot I cant install onto an existing system and I dont really want to netboot it if I can help it.

Thanks for any advice.

haven · Post by **haven** » Mon May 03, 2004 11:08 pm

I now have gentoo on my qube with the exception of a working kernel - I've tried the cobalt sources and compilation fails with various module errors missing " characters and other weirdness.

I've tried building from gentoo sources and have also run into problems with LVM errors causing fatal kernel errors on boot.

Before I start posting up reams of information in the hope that someone can help, has anyone got a guide to setting up a kernel for a qube 3 ? or even better has someone got a working kernel or sources that they can make available ?

Any help appreciated please.

Thanks

haven · Post by **haven** » Sat Jul 31, 2004 4:03 pm

Okay thought I better follow this up with some useful info on my experiences.

Unfortunately the weird ass errors I ended up getting with kernel compilation were due to a buggy memory controller - this eventually meant I had to junk the system *sobs*.

Right useful links for what I did:

I followed the red hat guide for tips on flashing the prom:
http://www.gurulabs.com/rhl-cobalt-howto/index.html

I then tried the patch from iceblink:
http://cobalt.iceblink.org/kernel/2.4.25/
as well as the config file provided. This seemed to work fine.

I also tried the debian patch:
http://packages.debian.org/testing/sour ... 2.4-cobalt
Along with the config file from iceblink with similar success.

I also messed around with several redhat kernels which I managed to extract from the rpm files. Unfortunately I had limited success and lots of unexplainable errors when trying to compile these kernels. It may however have been symptomatic of my hardware problems and not the code itself. You may have better success:
*the rpms seem to have been removed from the iceblink site - you may be able to find them on google however*.

Other than the basics the installation went well - I actually installed on a slave machine which happened to also be running a K6 processor and then stuck the hard drive into the Qube. This gave me full control without too much faff whilst installing. I guess you could install on any machine you like - just make sure you setup the make.conf for an AMD k6-II. To save too much hassle I stuck to an ext2 build which worked fine.

If anyone has any questions feel free to ask.

xphyr · Post by **xphyr** » Wed Oct 27, 2004 3:25 am

Hey everyone ... just wanted to put an update out here ... I have a fully running gentoo system on a Raq3 with no issues ... I basically pieced together everything I found here to get a working system. If any one is interested in this just let me know and I will be happy to put some form of documentation together.

ehudokai · Post by **ehudokai** » Fri Dec 17, 2004 1:10 am

xphyr wrote:Hey everyone ... just wanted to put an update out here ... I have a fully running gentoo system on a Raq3 with no issues ... I basically pieced together everything I found here to get a working system. If any one is interested in this just let me know and I will be happy to put some form of documentation together.

Please do, I'm trying to get a RaQ4 installed with Gentoo, but would prefer not to have to boot from network. If you know of a method, please share

EDIT:

resorted to nfs boot method and am currently bootstrapping, everything is working great! figured out how to set up a dhcp server to only respond to the RaQ4.

had a couple issues with the netboot not finding my nfs share, but got those worked out,

it seems almost like the netboot specifically looks for /nfslinux-x86 even if you specify something different in your dhcp.conf so I just simlinked it and exported both.

Hope that helps any other strugglers

forgive my horrible spelling... don't feel like checking it today

Greml1n · Post by **Greml1n** » Wed Dec 22, 2004 11:50 pm

Mind providing a brief how-to for the netboot method you've used ehudokai ?

Just about to try tackle this myself.

ehudokai · Post by **ehudokai** » Thu Dec 23, 2004 1:15 am

Greml1n wrote:Mind providing a brief how-to for the netboot method you've used ehudokai ?

Just about to try tackle this myself.

love to, but first I need to figure out why when I boot the new gentoo system it ends up with this message and a kernel panic:

Code: Select all

sh-2021: reiserfs_read_super: can not find reiserfs on md(9,1)
Kernel panic: VFS: Unable to mount root fs on 09:01

I double checked my /etc/fstab and it says XFS... so is there a reason it's looking for Reiser?

EDIT:

OKEEE DOKEEE note, make sure you have drivers in your kernel for whatever filesystem type you use, especially for the root fs ...

rebuilding kernel now, as long as it works, I will work on writing a howto, going on X-max vacation starting on friday, so I should have more time then.

Greml1n · Post by **Greml1n** » Thu Dec 23, 2004 10:29 pm

Super, thank you

ehudokai · Post by **ehudokai** » Tue Jan 04, 2005 10:59 pm

OK, so this is going to be a very quick guide.

esentially what you do is follow the directions that atopian gave up above and simply add a version of the following to your dhcp.conf

Code: Select all

host cobalt {
  hardware ethernet 00:10:E0:05:1A:97;
  fixed-address x.x.5.21;
  server-name "x.x.5.222";
  next-server x.x.5.222;
  option root-path "x.x.5.222:/opt/nfsroot-x86";
}

this essentially only gives the address to the card with the specified MAC, you may want to double check that your mac is the same as the one I listed, it shouldn't be, I believe the rom menu has a way of giving it to you.
otherwise boot into the RaQ linux OS and do a

Code: Select all

ifconfig -a

After that continue and be sure to include all the drivers you need in your kernel

dumb me

OH I used a kernel and config found at a link on this thread http://forums.gentoo.org/viewtopic.php?t=259059

You do need a patched kernel, so be sure to use one... hope that helps

Greml1n · Post by **Greml1n** » Thu Jan 06, 2005 11:10 am

Thanks for that, I'd actually got the NFS side of things sorted out (though I use a seperate DHCP Server and just set the BTO_IP in the Cobalt RAQ to get it net booting from the right place).

Guess my Gentoo noobness is my main problem at the moment, perhaps I'll tackle it with the kernel you linked to and see how I get on.

What type of stage install did you do, 1,2 or 3?

st0kes · Post by **st0kes** » Fri Dec 09, 2005 11:54 am

Hi all,

Sorry to bring a dead thread back to life, but I have been donated a Qube3 and want to install Gentoo on it, a LOT of Google searching has produced many dead ends and not many results on alternate Qube3 distros, but there is a fair amount of info on getting Gentoo on to a Qube, and this seemed a logical place to start. I've never used Gentoo before but am fairly familiar with Linux and like a challenge! Plus the software on the Qube is a bit old now (2.2 kernel) and I find myself a bit restricted on what I can run on it. Having not used Gentoo before are there any pitfalls I should be aware of?

I have got as far as this in atopian's post:

Its almost ready! The last thing needed is a few tweaks to the nfsroot image. Go into the /nfsroot-x86 directory, and modify etc/rc.d/rc.sysinit. Before the main_script executes, add a line running 'bash'. Grab the latest x86 generic stage1 tarball and place it in /nfsroot-x86. Also grab the latest cobalt kernel (c
urrently located in rpm form @ ftp://ftp.cobalt.sun.com/pub/products/raq550/RPMS/ ) and place it in /nfsroot-x86.

I have found the place in rc.sysinit where main_script is launched. Is he saying I just need a line that says 'bash' above this line?

Also this post is a few years old now .... is today's x86 generic stage1 tarball the same as it was 2 years ago?

I have the DHCP and NFS server ready and my Qube3 PROM is flashed to prepare it for the larger Kernel. If there is anyone subscribed to this thread who could give me any more pointers I would love to hear from you, PM me!

Thanks!

Gentoo on a Cobalt Qube 3?

Gentoo on a Cobalt Qube 3?

Cobalt CacheRaQ 4...

Success!

Docs....

It works

Re: It works

Quick guide w/ DHCP for RaQ only