If you don't mind downgrading to the stable version of app-text/poppler, which is the version that libreoffice-bin links to, and assuming you run on the ~amd64 arch, you could modify your /etc/portage/package.keywords file:
echo app-text/poppler -~amd64 >> /etc/portage/package.keywords
This will ...