The best solution is to give errant parents a final warning. Your kid will be expelled from that kindergarten if you are still late from picking up your kid after repeated warnings.
Fine for what? So stupid. These parents will have a tougher time by going to a further kindergarten or realised that no kindergarten want to do their business.