Assuming you followed the steps here:
http://www.symantec.com/docs/TECH203497
...it should narrow it down.
Also, the firewall either block traffic or it doesn't. It won't be intermittent.
Have you tredi just removing the firewall component completely and letting it run like that for a day or two to see if the problem continues? Perhaps another component is causing this. I believe TV uses 443 and by default that shouldn't be blocked.