Real-time elephant flow monitoring in AI / ML fabrics
The diagram shows a Probability Density Function (PDF) of the time taken to fill a default 1,400 byte sFlow datagram for a 400G switch port, randomly sampling 1-in-100,000 packets, handling a line...
View ArticleTesting DDoS mitigation software
The recently released open source sflowgen tool is a synthetic sFlow generator intended for testing, demonstrations, dashboards, and attack-detection validation. This article uses sflowgen to test the...
View ArticleFixing Ghost Drops: How eBPF Rescued IPv6 Telemetry
A customer complains that they aren't getting IPFIX flow data from a router. Use socat to check that IPFIX is being received (IANA assigned port for IPFIX is 4739):socat -b 0 -dd -u UDP6-RECV:4739 -...
View ArticleFour public live production flow analytics dashboards
The following publicly accessible dashboards show live data from operational networks, including: an AI/ML RoCEv2 fabric, a world-wide Kubernetes cluster, and an Internet Exchange Provider (IXP). Click...
View ArticleSONiC developments for visibility into AI/ML networks in 2026
SONiC sFlow High Level Design (HLD) v1.4 was recently published. This is the latest in a series of revisions bringing support for sFlow extensions that enhance network visibility for AI / ML traffic...
View ArticleMonitoring RoCEv2 with sFlow
The talk Seeing Through the RDMA Fog: Monitoring RoCEv2 with sFlow at the recent North American Network Operator's Group (NANOG) conference describes how leveraging industry standard sFlow telemetry...
View ArticleReal-time visualization of AI / ML traffic matrix
Heatmap is available on GitHub. The application provides a real-time traffic matrix visualization of end-to-end traffic flowing across an Ethernet fabric. Each axis represents an ordered list of...
View ArticleExporting events to Loki
Grafana Loki is an open source log aggregation system inspired by Prometheus. While it is possible to use Loki with Grafana Alloy, a simpler approach is to send logs directly using the Loki HTTP API....
View ArticleSC25: SDSC Expanse cluster live AI/ML metrics
The SDSC Expanse cluster live AI/ML metrics dashboard is a joint InMon / San Diego Supercomputer Center (SDSC) demonstration at The International Conference for High Performance Computing, Networking,...
View ArticleUltra Ethernet Transport
The Ultra Ethernet Consortium has a mission to Deliver an Ethernet based open, interoperable, high performance, full-communications stack architecture to meet the growing network demands of AI &...
View ArticleVector Packet Processor (VPP) dropped packet notifications
Vector Packet Processor (VPP) release 25.10 extends the sFlow implementation to include support for dropped packet notifications, providing detailed, low overhead, visibility into traffic flowing...
View ArticleAI / ML network performance metrics at scale
The charts above show information from a GPU cluster running an AI / ML training workload. The 244 nodes in the cluster are connected by 100G links to a single large switch. Industry standard sFlow...
View ArticlePacket trimming
The latest version of the AI Metrics dashboard uses industry standard sFlow telemetry from network switches to monitor the number of trimmed packets to use as a congestion metric.Ultra Ethernet...
View ArticleLinux packet sampling using eBPF
Linux 6.11+ kernels provide TCX attachment points for eBPF programs to efficiently examine packets as they ingress and egress the host. The latest version of the open source Host sFlow agent includes...
View ArticleTracing network packets with eBPF and pwru
pwru (packet, where are you?) is an open source tool from Cilium that used eBPF instrumentation in recent Linux kernels to trace network packets through the kernel. In this article we will use...
View ArticleAI Metrics with InfluxDB Cloud
The InfluxDB AI Metrics dashboard shown above tracks performance metrics for AI/ML RoCEv2 network traffic, for example, large scale CUDA compute tasks using NVIDIA Collective Communication Library...
View ArticleAI network performance monitoring using containerlab
AI Metrics is available on GitHub. The application provides performance metrics for AI/ML RoCEv2 network traffic, for example, large scale CUDA compute tasks using NVIDIA Collective Communication...
View ArticleAI Metrics with Grafana Cloud
The Grafana AI Metrics dashboard shown above tracks performance metrics for AI/ML RoCEv2 network traffic, for example, large scale CUDA compute tasks using NVIDIA Collective Communication Library...
View ArticleMulti-vendor support for dropped packet notifications
The sFlow Dropped Packet Notification Structures extension was published in October 2020. Extending sFlow to provide visibility into dropped packets offers significant benefits for network...
View ArticleAI Metrics with Prometheus and Grafana
The Grafana AI Metrics dashboard shown above tracks performance metrics for AI/ML RoCEv2 network traffic, for example, large scale CUDA compute tasks using NVIDIA Collective Communication Library...
View Article