It looks like a PEP related to this topic has recently been revived. The discussion thread is here: PEP 467: Minor API improvements for binary sequences
It looks like if implemented, it would add getbyte and iterbytes methods that directly address the pain points from the OP (plus some other helpful byte/bytearray methods).