It is not illegal. It can lead to you losing your Singapore citizenship but you won't be sent to jail or fined.
did your grandparents give up their PRC citizenship explicitly while retaining their singapore citizenship?
mine didnt and they dont have ICA knocking on their doors to demand that they choose sides.