u/softwaremaniac

Unable to pinpoint the cause of continuous packet loss with streaming services
▲ 3 r/Cisco

Unable to pinpoint the cause of continuous packet loss with streaming services

Hi!

DIA circuit 2/2 gbps, super stable except for IPTV. I have been able to capture intermittent packet loss (easily reproducible on wireshark), the actual drops become visible only in extreme cases (green artifacts, buffering, black screens). Different sources tested.

I'm monitoring everything locally with Grafana, no drops on the path, Cisco is clean, no dropped or paused frames.

Local paths appear clean on the monitoring, cables checked, SFPs checked. The rest of the network works flawlessly even at the time of the drops.

The drops happen even when an app is used, no STB, nothing like that. However, the worst part is, some services work well, while others drop almost instantly on this very network.

Working - Netflix, Youtube, Pickbox Amazon...
Not working - 3 separate provider streaming services with live TV channels. Some unicast, others multicast, tested, all exhibit packet loss.

Nat translations look ok, only a few thousand at the time of issues

C8300, 17.12.2, issue has persisted across multiple FW versions. QoS in place to prioritize IPTV traffic coming from the STB/PC IP did not help. WAN side shaping did not help.
IPTV does not require separate VLANs, plug and play or log in if app.

Prior to this, ISR4331 was in place, no issues could be observed. The only other addition was the 504, which has proven too slow CPU wise, therefore 804 has been put into place. Now CPU usage is normal and no CPU spikes can be observed.

Topology as an overview.

504 and 518 are now 804 and 812, 312 fully decommissioned.

This has persisted for years at this point and everybody is clueless.

Any assistance is very much appreciated.

https://preview.redd.it/v2ru1x8xyixg1.jpg?width=1441&format=pjpg&auto=webp&s=0d48d8e56abb650388c7c111a96421039c8c9fa1

https://preview.redd.it/bgq9dxstzixg1.png?width=1813&format=png&auto=webp&s=df0692471fd14beba9cccdb1def87579efe9c788

reddit.com
u/softwaremaniac — 18 hours ago