Got this working on my GTX 470 btw.
If someone wants to know, you need to use the 32bit cuda toolkit, even if you're on amd64, so you get the right lib files for the client. I installed this manually using this script for ubuntu:
wget http://developer.download.nvidia.com/compute/cuda/3_0/toolkit ...