We are fortunate in SE Michigan because about 20 years ago the ZIP codes were redone in some counties and aligned with our city/township (MCDs here) geography. That makes the boundaries consistent. However, it's certainly true that often it's unclear where a zip code boundary actually is. But...Census can define them through the reported zip codes of addresses on the MAF, so that should generally lead to consistency even when they're hard to map.
In general, addressing throughout the nation has improved greatly in the past 25-30 years because of the 911 systems' requirements. That's why rural areas got addresses instead of rural route/box numbers. The ambulance has to be able to find the house!