The neutral and ground are tied to the same point in the distribution box. In your house, this would be the main breaker box.
A load on the neutral raises the line a couple of volts above ground. This is normal. It's caused by the resistance of the line, and the load on it. 5 volts might be a bit high, but not alarming. If the wiring isn't warm, then it's probably just a long run to the distribution point. If you need to lower it, run more neutrals, or increase the wire gauge.
The difference between ground and neutral is that ground never has a load. That way, it's always a true zero reference.
If you suspect a fault, there may be a corroded connection somewhere. Make measurements of neutral/ground voltage along several points tracing back to the box. The voltage will be lower the closer you get to the box. A big jump indicates a problem.