If you'd stopped on the double-yellow lines before or after the bus stop, you would have had the board/alight passengers exemption, but there are no exemptions at all for restricted bus stops, apart from a medical emergency preventing you from driving on, or the car going bang.