On a PC, a USB port freeze due to EMI comming from the peripheral. Also when the 5V is short by the peripheral.
If you are lucky, a simple application restart will restart the USB port. Less lucky, you should disconnect-reconnect the cable on this port. And unlucky, you should restart your PC.
I would check how the USB port 5V is used on your board. And the filtering of power supplies, and all signal comming from the eyternal world.