No, this is not a bug.
The issue is that cairo can be used as a library for a server. There is no need to build X on a server if you do not use it. When building cairo on a workstation, you should be building cairo with the X useflag. Additionally, you would want support for pdfs, pngs, and svgs on ...