Log Message:
spdlog: Reduce size of hammer to bring in external fmtlib.

Some dependent packages link fine without fmtlib (eg. libixion)
and fmtlib ending up in their libtool file is causing problems
of its own.

This way only packages that are including those relevant fmtlib
symbols need to be explicitly linked against fmtlib.