We Asians ,especially Chinese,Japanese or Koreans ,normally do not want to create any form of trouble in public places. We can take plenty of racial slurs and abuses. But if it comes to physical confrontation, I am pretty sure the White bigot would lose out. We are actually a very tolerant people. But well, when you are not White and traveling in a White country, you have to suffer some indignities and swallow your pride.No point retaliating to such White racial bigots - they are found everywhere.They are not confined to Sydney alone. You see them in America, in Europe and in UK as well.
So live and let live in peace. Do not let such low down people spoil your day or even spoil your stay ....Cheer Up!!!