If the limit is lawfully in place, adequately signed and you were driving in excess of the limit, no, you cannot avoid points. The foregoing are all points you may wish to investigate. As you say, Google Maps leading you astray is no defence (see ‘adequately signed’).