Frankly if you want to fight this one, you'll have to take them to the Traffic Penalty Tribunal with the full PCN penalty in play. I agree it seems very unfair, and you might get a sympathetic adjudicator who could rule you were "in traffic", but it's a long shot.