Sounds like it's time to dig out the scope.
Does this happen when just a certain device is powered down? Or any of them?
Do you lose the terminating resistor when this happens? (which would be crazy, but I have to ask).
Does the powered down device pull the data lines down? Physically disconnecting the powered down device might get things going again in this case.
Or does your polling program get hung up trying to communicate with the offline device?
As an alternative to the scope, connect a PC up to your Modbus network with a USB to RS485 converter and listen in on what is going on. You can also issue commands from your PC that would mimic what the Master should be doing.