I was able to avoid the segfault on both by reducing the parallel jobs from 16(12) to 8(6). I suspect the massive parallelism is causing certain ebuilds to become unstable. That seems likely as well. I'm not sure why, but some ebuilds won't build in parallel at all.
Parallel build issues rarely ...