Welcome to the Forum !
That's unusual; you certainly should be able to upload and download over the same direct network connection.
Is the *.PVA file you are trying to download the exact same as the one you uploaded, or did you make modifications in PanelBuilder32 ? Are you certain the Terminal Model and Firmware are set to match the actual terminal ?
Do you get an error message, and if so, what does it say ?