[SOLVED] Segmentation fault with vmware-workstation-6.5.3

[funklord]

I have had vmware-workstation-6.5.3.15404 installed and working with vmware-modules-1.0.0.25-r1 for a few months. Yesterday I re-emerged a bunch of stuff trying to fix this bug before giving up and masking the latest version. Now vmware segfaults when I try to run it.

If I run vmware alone this is the output I get:

Code: Select all

$ vmware
Logging to /tmp/vmware-phiggins/setup-3816.log
filename:       /lib/modules/2.6.33-gentoo/misc/vmmon.ko
supported:      external
license:        GPL v2
description:    VMware Virtual Machine Monitor.
author:         VMware, Inc.
depends:        
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4 
filename:       /lib/modules/2.6.33-gentoo/misc/vmnet.ko
supported:      external
license:        GPL v2
description:    VMware Virtual Networking Driver.
author:         VMware, Inc.
depends:        
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4 
filename:       /lib/modules/2.6.33-gentoo/misc/vmblock.ko
supported:      external
version:        1.1.2.0
license:        GPL v2
description:    VMware Blocking File System
author:         VMware, Inc.
srcversion:     9B4563B3C180049AA056D00
depends:        
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4 
parm:           root:The directory the file system redirects to. (charp)
filename:       /lib/modules/2.6.33-gentoo/misc/vmci.ko
supported:      external
supported:      external
license:        GPL v2
description:    VMware Virtual Machine Communication Interface (VMCI).
author:         VMware, Inc.
depends:        
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4 
filename:       /lib/modules/2.6.33-gentoo/misc/vsock.ko
supported:      external
license:        GPL v2
version:        1.0.0.0
description:    VMware Virtual Socket Family
author:         VMware, Inc.
srcversion:     C4EB0AE069279EC545EA18B
depends:        vmci
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4 
filename:       /lib/modules/2.6.33-gentoo/misc/vmmon.ko
supported:      external
license:        GPL v2
description:    VMware Virtual Machine Monitor.
author:         VMware, Inc.
depends:        
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4 
*** glibc detected *** /opt/vmware/workstation/lib/vmware/bin/vmware: malloc(): memory corruption: 0x09d25d60 ***
Aborted

I've had to workaround that for a while by using the VMWARE_USE_SHIPPED_GTK=force trick, and here's the output when I run vmware like that:

Code: Select all

$ VMWARE_USE_SHIPPED_GTK=force vmware
Logging to /tmp/vmware-phiggins/setup-4635.log
/opt/vmware/workstation/bin/vmware: line 31:  4635 Segmentation fault      "$BINDIR"/vmware-modconfig --appname="VMware Workstation" --icon="vmware-workstation"

If I run the command that it reportedly segfaults on, it runs fine:

Code: Select all

$ vmware-modconfig --appname="VMware Workstation" --icon="vmware-workstation"
Logging to /tmp/vmware-phiggins/setup-5280.log
filename:       /lib/modules/2.6.33-gentoo/misc/vmmon.ko
supported:      external
license:        GPL v2
description:    VMware Virtual Machine Monitor.
author:         VMware, Inc.
depends:        
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4 
filename:       /lib/modules/2.6.33-gentoo/misc/vmnet.ko
supported:      external
license:        GPL v2
description:    VMware Virtual Networking Driver.
author:         VMware, Inc.
depends:        
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4 
filename:       /lib/modules/2.6.33-gentoo/misc/vmblock.ko
supported:      external
version:        1.1.2.0
license:        GPL v2
description:    VMware Blocking File System
author:         VMware, Inc.
srcversion:     9B4563B3C180049AA056D00
depends:        
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4 
parm:           root:The directory the file system redirects to. (charp)
filename:       /lib/modules/2.6.33-gentoo/misc/vmci.ko
supported:      external
supported:      external
license:        GPL v2
description:    VMware Virtual Machine Communication Interface (VMCI).
author:         VMware, Inc.
depends:        
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4 
filename:       /lib/modules/2.6.33-gentoo/misc/vsock.ko
supported:      external
license:        GPL v2
version:        1.0.0.0
description:    VMware Virtual Socket Family
author:         VMware, Inc.
srcversion:     C4EB0AE069279EC545EA18B
depends:        vmci
vermagic:       2.6.33-gentoo SMP preempt mod_unload PENTIUM4

I've tried re-emerging system (twice) and googled everything I could think of and haven't made any progress. I tried using the latest vmware-workstation-7 ebuild from the vmware layover and had similar segfaults there.

Here's the ldd output of the vmware binary, with the only things missing being shared libs vmware itself provides:

Code: Select all

$ ldd /opt/vmware/workstation/lib/vmware/bin/vmware
        linux-gate.so.1 =>  (0xffffe000)
        libstdc++.so.6 => /usr/lib/gcc/i686-pc-linux-gnu/4.4.3/libstdc++.so.6 (0xb7775000)
        libXau.so.6 => /usr/lib/libXau.so.6 (0xb7771000)
        libXdmcp.so.6 => /usr/lib/libXdmcp.so.6 (0xb776b000)
        libXcursor.so.1 => /usr/lib/libXcursor.so.1 (0xb7762000)
        libXrandr.so.2 => /usr/lib/libXrandr.so.2 (0xb7759000)
        libXrender.so.1 => /usr/lib/libXrender.so.1 (0xb7750000)
        libpthread.so.0 => /lib/libpthread.so.0 (0xb7736000)
        libX11.so.6 => /usr/lib/libX11.so.6 (0xb7637000)
        libXext.so.6 => /usr/lib/libXext.so.6 (0xb7629000)
        libXi.so.6 => /usr/lib/libXi.so.6 (0xb761c000)
        libXinerama.so.1 => /usr/lib/libXinerama.so.1 (0xb7617000)
        libexpat.so.0 => /usr/lib/libexpat.so.0 (0xb75f8000)
        libfontconfig.so.1 => /usr/lib/libfontconfig.so.1 (0xb75cf000)
        libfreetype.so.6 => /usr/lib/libfreetype.so.6 (0xb755f000)
        libXft.so.2 => /usr/lib/libXft.so.2 (0xb754e000)
        libglib-2.0.so.0 => /usr/lib/libglib-2.0.so.0 (0xb7499000)
        libgmodule-2.0.so.0 => /usr/lib/libgmodule-2.0.so.0 (0xb7495000)
        libgobject-2.0.so.0 => /usr/lib/libgobject-2.0.so.0 (0xb7467000)
        libgthread-2.0.so.0 => /usr/lib/libgthread-2.0.so.0 (0xb7462000)
        libatk-1.0.so.0 => /usr/lib/libatk-1.0.so.0 (0xb744a000)
        libpango-1.0.so.0 => /usr/lib/libpango-1.0.so.0 (0xb740f000)
        libpangoft2-1.0.so.0 => /usr/lib/libpangoft2-1.0.so.0 (0xb73f0000)
        libpangoxft-1.0.so.0 => /usr/lib/libpangoxft-1.0.so.0 (0xb73e8000)
        libpangox-1.0.so.0 => /usr/lib/libpangox-1.0.so.0 (0xb73dd000)
        libgdk-x11-2.0.so.0 => /usr/lib/libgdk-x11-2.0.so.0 (0xb734e000)
        libgdk_pixbuf-2.0.so.0 => /usr/lib/libgdk_pixbuf-2.0.so.0 (0xb7335000)
        libgtk-x11-2.0.so.0 => /usr/lib/libgtk-x11-2.0.so.0 (0xb6fac000)
        libsigc-2.0.so.0 => /usr/lib/libsigc-2.0.so.0 (0xb6fa5000)
        libglibmm-2.4.so.1 => /usr/lib/libglibmm-2.4.so.1 (0xb6f53000)
        libglibmm_generate_extra_defs-2.4.so.1 => /usr/lib/libglibmm_generate_extra_defs-2.4.so.1 (0xb6f4e000)
        libatkmm-1.6.so.1 => /usr/lib/libatkmm-1.6.so.1 (0xb6f0c000)
        libpangomm-1.4.so.1 => /usr/lib/libpangomm-1.4.so.1 (0xb6edf000)
        libgdkmm-2.4.so.1 => /usr/lib/libgdkmm-2.4.so.1 (0xb6e99000)
        libgtkmm-2.4.so.1 => /usr/lib/libgtkmm-2.4.so.1 (0xb6b7a000)
        libart_lgpl_2.so.2 => /usr/lib/libart_lgpl_2.so.2 (0xb6b66000)
        libxml2.so.2 => /usr/lib/libxml2.so.2 (0xb6a77000)
        libglade-2.0.so.0 => /usr/lib/libglade-2.0.so.0 (0xb6a61000)
        libgnomecanvas-2.so.0 => /usr/lib/libgnomecanvas-2.so.0 (0xb6a38000)
        libgnomecanvasmm-2.6.so.1 => /usr/lib/libgnomecanvasmm-2.6.so.1 (0xb69f8000)
        librsvg-2.so.2 => /usr/lib/librsvg-2.so.2 (0xb69cd000)
        libview.so.2 => /usr/lib/libview.so.2 (0xb6985000)
        libsexymm.so.2 => /usr/lib/libsexymm.so.2 (0xb696d000)
        libsexy.so.2 => /usr/lib/libsexy.so.2 (0xb695d000)
        libz.so.1 => /lib/libz.so.1 (0xb694b000)
        libpangocairo-1.0.so.0 => /usr/lib/libpangocairo-1.0.so.0 (0xb6940000)
        libcairo.so.2 => /usr/lib/libcairo.so.2 (0xb68dd000)
        libcairomm-1.0.so.1 => /usr/lib/libcairomm-1.0.so.1 (0xb68bb000)
        libXfixes.so.3 => /usr/lib/libXfixes.so.3 (0xb68b5000)
        libpng12.so.0 => /usr/lib/libpng12.so.0 (0xb6895000)
        libvmwarebase.so.0 => not found
        libvmwareui.so.0 => not found
        libgvmomi.so.0 => not found
        libgcc_s.so.1 => /usr/lib/gcc/i686-pc-linux-gnu/4.4.3/libgcc_s.so.1 (0xb6879000)
        libc.so.6 => /lib/libc.so.6 (0xb670d000)
        /lib/ld-linux.so.2 (0xb787c000)
        libm.so.6 => /lib/libm.so.6 (0xb66e6000)
        libxcb.so.1 => /usr/lib/libxcb.so.1 (0xb66cd000)
        libdl.so.2 => /lib/libdl.so.2 (0xb66c9000)
        librt.so.1 => /lib/librt.so.1 (0xb66bf000)
        libXcomposite.so.1 => /usr/lib/libXcomposite.so.1 (0xb66bb000)
        libXdamage.so.1 => /usr/lib/libXdamage.so.1 (0xb66b7000)
        libpixman-1.so.0 => /usr/lib/libpixman-1.so.0 (0xb666a000)
        libdirectfb-1.4.so.0 => /usr/lib/libdirectfb-1.4.so.0 (0xb65f6000)
        libfusion-1.4.so.0 => /usr/lib/libfusion-1.4.so.0 (0xb65ec000)
        libdirect-1.4.so.0 => /usr/lib/libdirect-1.4.so.0 (0xb65d9000)
        libglitz-glx.so.1 => /usr/lib/libglitz-glx.so.1 (0xb65d3000)
        libglitz.so.1 => /usr/lib/libglitz.so.1 (0xb65b2000)
        libGL.so.1 => //usr/lib/opengl/xorg-x11/lib/libGL.so.1 (0xb6559000)
        libgio-2.0.so.0 => /usr/lib/libgio-2.0.so.0 (0xb64e0000)
        libresolv.so.2 => /lib/libresolv.so.2 (0xb64c8000)
        libgiomm-2.4.so.1 => /usr/lib/libgiomm-2.4.so.1 (0xb6458000)
        libgailutil.so.18 => /usr/lib/libgailutil.so.18 (0xb644e000)
        libgsf-1.so.114 => /usr/lib/libgsf-1.so.114 (0xb641e000)
        libbz2.so.1 => /lib/libbz2.so.1 (0xb6411000)
        libcroco-0.6.so.3 => /usr/lib/libcroco-0.6.so.3 (0xb63e2000)
        libxcb-render-util.so.0 => /usr/lib/libxcb-render-util.so.0 (0xb63de000)
        libxcb-render.so.0 => /usr/lib/libxcb-render.so.0 (0xb63d5000)
        libXxf86vm.so.1 => /usr/lib/libXxf86vm.so.1 (0xb63cf000)
        libX11-xcb.so.1 => /usr/lib/libX11-xcb.so.1 (0xb63cb000)
        libxcb-glx.so.0 => /usr/lib/libxcb-glx.so.0 (0xb63b9000)
        libdrm.so.2 => /usr/lib/libdrm.so.2 (0xb63af000)

Here's my emerge --info:

Code: Select all

$ emerge --info
Portage 2.1.8.3 (default/linux/x86/10.0, gcc-4.4.3, glibc-2.11-r1, 2.6.33-gentoo i686)
=================================================================
System uname: Linux-2.6.33-gentoo-i686-Intel-R-_Pentium-R-_4_CPU_3.40GHz-with-gentoo-2.0.1
Timestamp of tree: Tue, 23 Mar 2010 16:00:01 +0000
ccache version 2.4 [enabled]
app-shells/bash:     4.1_p2-r1
dev-java/java-config: 2.1.10
dev-lang/python:     2.6.5, 3.1.2
dev-util/ccache:     2.4-r8
dev-util/cmake:      2.8.1
sys-apps/baselayout: 2.0.1
sys-apps/openrc:     0.6.1
sys-apps/sandbox:    2.2
sys-devel/autoconf:  2.13, 2.65
sys-devel/automake:  1.10.3, 1.11.1
sys-devel/binutils:  2.20.1
sys-devel/gcc:       4.4.3
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.6b
virtual/os-headers:  2.6.33
ACCEPT_KEYWORDS="x86 ~x86"
ACCEPT_LICENSE="*"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=native -Os -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/X11/xkb /usr/share/config"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-march=native -Os -pipe -fomit-frame-pointer"
DISTDIR="/usr/portage/distfiles"
FEATURES="assume-digests ccache distlocks fixpackages news parallel-fetch protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_US.UTF-8"
LDFLAGS="-Wl,-O1"
LINGUAS="en en_US"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/var/lib/layman/sunrise /var/lib/layman/ruby /var/lib/layman/vmware"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="3dnow X a52 aac acl acpi aim alsa amr amrnb amrwb apache2 apm aspell bash-completion berkdb branding bzip2 cairo cdaudio cdio cdparanoia cdr cjk cleartype cli corefonts cracklib crypt cups curl curlwrappers custom-cflags custom-optimization cxx dbus dell directfb divx djvu dri dts dvd dvdr dvdread encode fbcon ffmpeg fftw firefox flac fontconfig fortran ftp fuse gdbm gif gimp git glitz gnutls gpm gstreamer gtk hal iconv id3tag imap ipod javascript jpeg kde kdehiddenvisibility kipi lame mad matroska mmap mmx modules mp2 mp3 mp4 mpeg mplayer mtp mudflap musicbrainz mysql mysqli ncurses network nls nptl nptlonly nsplugin ntfs offensive ogg openal opengl openmp oss pam pch pcre pdf perl phonon pic plasma png pppd python qt3support qt4 quicktime readline realmedia reflection reiserfs rss rtc ruby samba sasl sdl session spell spl sqlite sqlite3 sse sse2 ssl subversion svg sysfs syslog tcpd theora threads thumbnail tidy tls truetype type1 unicode usb vim-syntax vorbis webkit win32codecs wmp x264 x86 xcomposite xine xml xorg xscreensaver xulrunner xvid xvmc zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1 emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en en_US" RUBY_TARGETS="ruby18 jruby" USERLAND="GNU" VIDEO_CARDS="nv fbdev vesa vga" 
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, LC_ALL, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

Can anybody suggest something else to try?

EDIT:

I forgot to add, when I run vmware with VMWARE_USE_SHIPPED_GTK=force, this gets printed in /var/log/messages:

Code: Select all

Mar 23 12:14:55 gravytrain kernel: vmware-modconfi[11151]: segfault at 1c4f ip b674c78d sp bfaee8f0 error 4 in libc-2.11.so[b66d0000+164000]

[sigkate]

I had the exact same problem. Using strace -f, I determined it segfaulted when reading /opt/vmware/workstation/lib/vmware/modules/modules.xml. I removed that file, then it segfaulted reading /etc/xml/catalog. I replaced /opt/vmware/workstation/lib/vmware/lib/libxml2.so.2/libxml2.so.2 with my system libxml2.so.2.7.7, and vmware runs.

HTH,

--Kate

[funklord]

I had the exact same problem. Using strace -f, I determined it segfaulted when reading /opt/vmware/workstation/lib/vmware/modules/modules.xml. I removed that file, then it segfaulted reading /etc/xml/catalog. I replaced /opt/vmware/workstation/lib/vmware/lib/libxml2.so.2/libxml2.so.2 with my system libxml2.so.2.7.7, and vmware runs.

HTH,

--Kate

I moved vmware's libxml2.so file to /tmp and now vmware starts up. I'll mark this post solved, but it's unfortunate that we have to use this workaround.

Thanks for your help and the quick response Kate!

[smalldog]

I have same problem. Your proposed solution could not solve the segfault. Current I am downloading vmware-workstation 7 and hope it can solve such problem.

/usr/share/themes/Clearlooks/gtk-2.0/gtkrc:74: error: unexpected identifier `colorize_scrollbar', expected character `}'
/opt/vmware/player/bin/vmplayer: line 31: 6872 Segmentation fault "$BINDIR"/vmware-modconfig --appname="VMware Player" --icon="vmware-player"

[funklord]

Current I am downloading vmware-workstation 7 and hope it can solve such problem.

Upgrading to 7.x didn't fix the issue for me, but it could have been a separate problem. Can you post the output of ldd and strace -f of the vmware executable?

You might also try making your own post to see if you get more viewers.

[holycow]

I had the exact same problem. Using strace -f, I determined it segfaulted when reading /opt/vmware/workstation/lib/vmware/modules/modules.xml. I removed that file, then it segfaulted reading /etc/xml/catalog. I replaced /opt/vmware/workstation/lib/vmware/lib/libxml2.so.2/libxml2.so.2 with my system libxml2.so.2.7.7, and vmware runs.

Sweet! Thanks for the tip. I got vmware running after doing the libxml2 replacement. I didn't have to remove the modules.xml file, either. So, it must've been an issue with the recent libxml2-2.7.7 upgrade that caused the problem.

On a side note. I'm getting a bit fed up with vmware's fragility, and vmware tech support's lack of response for these types of issues. It seems I run into more issues with vmware after most upgrades, than with any other package. I really should check out the other available emulation offerings.