If you are using RS-232 for your communications, it could be fatal to the PLC and the HMI since RS-232 is a ground referenced signal.
In this case, the panel will try to derive it's ground from the PLC through the communications wire. If the panel ground reference is not close to the PLC ground reference, it can and will cause the com ports to die from too much impedence.
Panel manufacturers put ground points on the HMI's because they are needed to make sure that communications lines are balanced and so that any noise has a dissipation path.