Most importantly, the ABI versioning issue which was discussed already in several posts above. That one can potentially break the build.
That could be solved by making sure that the version of the dependency which is used at build-time is exactly the same as the one which is used at run-time.