X wont start as user but works as root

[SouthOfHeaven]

I didnt quite know how to formulate this into a search string, but i have installed KDE with xorg and setup drivers and xorg.conf all as i had it previously. If i startx as root it will work fine, but if i create a user and add him to video,audio, mem, kmem, wheel groups and do startx it tells me my secondary video card cannot alocate memory. Any ideas ? I am assuming that as the user X still gets the config from /etc/X11/xorg.conf like it doesn when im root. My main agv video card is a Geforce2 GTS AGP with xdriver called "nv" and the secondary is a Matrox 8mb card with driver "mga", i am really clueless why this wouldnt work.

[vola]

Im not sure, but don't you have to add the user to "users" ?

Regards