Because they lack the discipline of the PAP. PAP also has its own internal squabbles, but they learn to show a united front to the public and present themselves a disciplined party.
The other parties are just a ragtag bunch. They are always jumping from party to party, always squabbling and backstabbing each other. They are also carving up Singapore as though they own it.