9/28 spike capture

This commit is contained in:
hz
2026-09-28 21:51:42 -05:00
parent 48500792ce
commit 0654c03e89
1049 changed files with 187402 additions and 328 deletions
-1
View File
@@ -1,5 +1,4 @@
__pycache__/
logs/
reports/
# Local, account-specific reporting and email preparation scripts.
+73 -57
View File
@@ -1,6 +1,24 @@
# Network spike monitor
Windows 7 SP1 or newer, Python 3.8 or newer (use Python 3.8 on Windows 7). No packages or administrator rights required to run the monitor.
# Network spike monitor
Linux (including Linux Mint 22.3/Ubuntu 24.04) or Windows 7 SP1 or newer, with Python 3.8 or newer (use Python 3.8 on Windows 7). No Python packages required. Running the monitor does not require administrator rights.
### Linux Mint / Ubuntu setup
Install the system commands once:
```bash
sudo apt install python3 iputils-ping traceroute
```
Start monitoring from the repository directory:
```bash
python3 network_monitor.py
```
Linux uses `ping` and unprivileged UDP `traceroute`, with reverse DNS enabled. Windows uses `ping.exe` and `tracert.exe` (ICMP); different probe protocols can receive different responses from firewalls and routers. Linux command output is forced to the C locale for consistent parsing. Missing commands produce an installation hint at startup.
For the examples below, use `python3` instead of `python` on Linux. `Start Monitor.cmd` is the Windows launcher.
### Windows 7 setup
@@ -9,57 +27,55 @@ Install [Python 3.8.10](https://www.python.org/downloads/release/python-3810/) u
Check `python --version` reports Python 3.8.x on Windows 7. On newer Windows, a newer supported Python release is fine. The monitor's ping and tracert options, trace cancellation, and logging use Python 3.8-compatible APIs. Python 3.8 is no longer maintained. Compatibility tests run on Python 3.8 on a newer Windows system; a physical Windows 7 installation has not been tested.
### Start monitoring
Double-click **Start Monitor.cmd**, or run:
```powershell
python network_monitor.py
```
Pings `1.1.1.1` once per second. A spike is a reply of at least 100 ms, or (after 10 healthy samples) at least 3 times the healthy median AND 40 ms above it. Missing replies also count. Windows `tracert` runs after **at least three bad probes in each of two consecutive one-minute periods**. Periods are non-overlapping and start when monitoring starts; the rule is evaluated at the first probe after each period ends. For example, three spikes in minute one and three in minute two trigger a trace at about two minutes. Six spikes in one minute followed by a quiet minute do not trigger it. A period with fewer than three bad probes resets the streak; gaps from computer sleep also break it. Monitoring continues while tracing runs. An incident runs tracert repeatedly, one at a time, with a 2-second pause between attempts (`--trace-retry`). It continues even if pings recover, until a trace captures a spike or you stop the monitor. There is no attempt limit. After capture, ping monitoring continues; another qualifying period can start a new incident after the 120-second cooldown (`--cooldown`). Ctrl+C stops monitoring and cancels an active trace.
Customize the target and sensitivity:
```powershell
python network_monitor.py --target 8.8.8.8 --threshold 80 --required 3 --period 60 --consecutive 2 --cooldown 60
```
Run one diagnostic immediately, then monitor normally (automatic incidents still repeat until capture):
```powershell
python network_monitor.py --trace-now
```
Use `python network_monitor.py --help` for all options. Hostnames resolve to a single IPv4 address at startup so ping and tracert use the same destination. This measures the path to the selected target; it does not measure every Internet service. Run separate instances with separate `--log-dir` directories to compare destinations.
## Preserved evidence
Reverse DNS is enabled: raw logs show hop hostnames alongside their IP addresses when available, for example `hop1.subsystem2.spectrum.com [192.0.2.1]`. JSON hop records include both `hostname` and `ip`. Routers without reverse DNS show only an IP; routers that do not reply may show only stars. DNS lookup can make each trace take longer.
All logs go to `logs` beside the program by default, or the directory supplied with `--log-dir`:
- Only traces that capture a spike are retained. Each has a timestamped `trace_YYYYMMDD_HHMMSS_microseconds.txt` containing the **entire, unmodified stdout and stderr**, plus a matching `.json` with hop timings, command, incident ID, attempt number, and assessment.
- While a trace runs, output streams to `.pending.txt`. If it captures a spike, this file becomes the saved `.txt`; otherwise it is deleted, including on normal cancellation without measured spikes. A forced process kill or power failure may leave a temporary `.pending.txt`.
- `events.jsonl` appends individual spikes/lost replies, period summaries, and brief incident/attempt results between runs. Healthy pings appear only in the console and are not written to disk. Discarded attempts do not retain their full output or hop arrays here.
- Existing logs from earlier versions are left in place. Raw output uses the Windows command's native encoding.
No logs are automatically deleted or rotated. A long-running session can grow large; archive logs after stopping the monitor. Probe intervals are best effort; timeouts may make a cycle longer than the requested interval. Values below 1 ms are represented as 0.5 ms for calculations. Parsing requires the Windows ping reply's `TTL` field and `ms` timings; unrecognized successful replies produce an explicit error.
## Interpreting reports
A trace is retained when **any individual timed probe at any hop** meets the spike threshold: 100 ms by default, or the relative ping threshold based on the healthy baseline frozen when the incident starts. A single slow probe counts even if the other two replies are fast, downstream hops recover, or the destination never replies. Partial/cancelled traces are also retained if they contain measured slow replies; timeouts alone do not qualify. This captures evidence without claiming the responding router is faulty.
Saved JSON includes the individual `spike_probes` with hop, hostname, IP, and RTT. Compact event summaries include `peak_probe_ms`, `spike_limit_ms`, and `spike_probe_count` so you can see why an attempt was kept or discarded. Hop medians and `--hop-jump` are used only for the separate tentative segment assessment, not to decide whether to save a trace.
The report looks for an RTT jump that remains elevated through subsequent responding hops, including the destination. It identifies a possible segment, not a proven faulty router. These are round-trip measurements taken at different times, not per-link transit times. Return paths and ICMP prioritization can differ. A spike can end while tracert is still running. Missing hops are not evidence of packet loss in forwarded traffic.
Microsoft documents that some routers do not answer traceroute probes: [TRACERT troubleshooting](https://learn.microsoft.com/en-us/troubleshoot/windows-server/networking/trace-route-troubleshoot-tcp-ip-problems).
## Verification
```powershell
python -m unittest -v
python network_monitor.py --target 127.0.0.1 --count 3 --trace-now
```
`--count` ends monitoring after the requested probe count and cancels an active incident capture. A healthy loopback diagnostic should leave no saved trace files.
Double-click **Start Monitor.cmd**, or run:
```powershell
python network_monitor.py
```
Continuously runs route traces to `1.1.1.1` from startup, one at a time, with a 2-second pause between traces (`--trace-retry`). Tracing continues after capturing a spike and does not wait for ping spikes, qualifying periods, or a cooldown. Windows uses `tracert`; Linux uses `traceroute`. Ctrl+C stops monitoring and cancels the active trace.
Pings also run once per second to maintain a healthy latency baseline. A spike is a reply of at least 100 ms, or (after 10 healthy samples) at least 3 times the healthy median AND 40 ms above it. Missing ping replies are logged as loss. Each trace uses the baseline available when it starts; until 10 healthy ping samples exist, traces use only the absolute threshold. Only traces containing measured slow replies are saved.
Customize the target, sensitivity, and pause between traces:
```powershell
python network_monitor.py --target 8.8.8.8 --threshold 80 --trace-retry 1
```
`--trace-now` and `--cooldown` remain accepted for compatibility but have no effect. `--required`, `--period`, and `--consecutive` affect ping period summaries only; they do not control tracing.
Use `python network_monitor.py --help` for all options. Hostnames resolve to a single IPv4 address at startup so ping and route tracing use the same destination. This measures the path to the selected target; it does not measure every Internet service. Run separate instances with separate `--log-dir` directories to compare destinations.
## Preserved evidence
Reverse DNS is enabled: raw logs show hop hostnames alongside their IP addresses when available, for example `hop1.subsystem2.spectrum.com [192.0.2.1]`. JSON hop records include both `hostname` and `ip`. Routers without reverse DNS show only an IP; routers that do not reply may show only stars. DNS lookup can make each trace take longer.
All logs go to `logs` beside the program by default, or the directory supplied with `--log-dir`:
- Only traces that capture a spike are retained. Each has a timestamped `trace_YYYYMMDD_HHMMSS_microseconds.txt` containing the **entire, unmodified stdout and stderr**, plus a matching `.json` with hop timings, command, attempt number, and assessment.
- While a trace runs, output streams to `.pending.txt`. If it captures a spike, this file becomes the saved `.txt`; otherwise it is deleted, including on normal cancellation without measured spikes. A forced process kill or power failure may leave a temporary `.pending.txt`.
- `events.jsonl` appends individual spikes/lost replies, period summaries, and brief trace results between runs. Healthy pings appear only in the console and are not written to disk. Discarded attempts do not retain their full output or hop arrays here.
- Existing logs from earlier versions are left in place. Raw output preserves the command's original bytes.
No logs are automatically deleted or rotated. A long-running session can grow large; archive logs after stopping the monitor. Probe intervals are best effort; timeouts may make a cycle longer than the requested interval. Values below 1 ms are represented as 0.5 ms for calculations. Parsing requires the ping reply's `TTL`/`ttl` field and `ms` timings; unrecognized successful replies produce an explicit error.
## Interpreting reports
A trace is retained when **any individual timed probe at any hop** meets the spike threshold: 100 ms by default, or the relative ping threshold based on the healthy baseline frozen when each trace starts. A single slow probe counts even if the other two replies are fast, downstream hops recover, or the destination never replies. Partial/cancelled traces are also retained if they contain measured slow replies; timeouts alone do not qualify. This captures evidence without claiming the responding router is faulty.
Saved JSON includes the individual `spike_probes` with hop, hostname, IP, and RTT. Compact event summaries include `peak_probe_ms`, `spike_limit_ms`, and `spike_probe_count` so you can see why an attempt was kept or discarded. Hop medians and `--hop-jump` are used only for the separate tentative segment assessment, not to decide whether to save a trace.
The report looks for an RTT jump that remains elevated through subsequent responding hops, including the destination. It identifies a possible segment, not a proven faulty router. These are round-trip measurements taken at different times, not per-link transit times. Return paths and ICMP prioritization can differ. A spike can end while tracert is still running. Missing hops are not evidence of packet loss in forwarded traffic.
Microsoft documents that some routers do not answer traceroute probes: [TRACERT troubleshooting](https://learn.microsoft.com/en-us/troubleshoot/windows-server/networking/trace-route-troubleshoot-tcp-ip-problems).
## Verification
```powershell
python -m unittest -v
python network_monitor.py --target 127.0.0.1 --count 3 --trace-now
```
`--count` ends monitoring after the requested probe count and cancels an active trace. A healthy loopback diagnostic should leave no saved trace files. On Linux, run these commands with `python3`; the integration test runs when both `ping` and `traceroute` are installed.
+3007
View File
File diff suppressed because it is too large Load Diff
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:18:23.606-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
13.282,
12.138,
11.827
],
"median_ms": 12.138,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 13.282
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.138
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.827
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
71.872,
32.549,
11.087
],
"median_ms": 32.549,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 71.872
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 32.549
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 11.087
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
23.093,
10.964,
13.797
],
"median_ms": 13.797,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 23.093
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 10.964
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.797
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
13.693,
13.877,
25.915
],
"median_ms": 13.877,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.693
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.877
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 25.915
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
17.476,
38.853,
15.05
],
"median_ms": 17.476,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.476
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 38.853
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 15.05
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
17.646,
16.826,
25.62
],
"median_ms": 17.646,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.646
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.826
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 25.62
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
23.771,
26.828,
17.568
],
"median_ms": 23.771,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 23.771
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 26.828
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 17.568
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
16.353,
26.614,
15.768
],
"median_ms": 16.353,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 16.353
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 26.614
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.768
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
18.58,
17.064,
21.588
],
"median_ms": 18.58,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 18.58
},
{
"ip": "141.101.73.159",
"hostname": null,
"rtt_ms": 17.064
},
{
"ip": "141.101.73.125",
"hostname": null,
"rtt_ms": 21.588
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
17.684,
18.514,
32.694
],
"median_ms": 18.514,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.157",
"hostname": null,
"rtt_ms": 17.684
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 18.514
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 32.694
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_201822_597829.txt",
"spike_captured": true,
"spike_limit_ms": 57.6,
"spike_probes": [
{
"hop": 2,
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 71.872
}
],
"spike_probe_count": 1,
"peak_probe_ms": 71.872,
"sustained_jump_found": false,
"incident_id": "incident_20260928_201818_387619",
"attempt": 2
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 13.282 ms 12.138 ms 11.827 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 71.872 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 32.549 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 11.087 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 23.093 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 10.964 ms 13.797 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 13.693 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.877 ms 25.915 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 17.476 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 38.853 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 15.050 ms
6 lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 17.646 ms 16.826 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 25.620 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 23.771 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 26.828 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 17.568 ms
8 141.101.73.110 (141.101.73.110) 16.353 ms 141.101.73.111 (141.101.73.111) 26.614 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.768 ms
9 141.101.73.195 (141.101.73.195) 18.580 ms 141.101.73.159 (141.101.73.159) 17.064 ms 141.101.73.125 (141.101.73.125) 21.588 ms
10 141.101.73.157 (141.101.73.157) 17.684 ms one.one.one.one (1.1.1.1) 18.514 ms 32.694 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:26:22.440-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
12.624,
11.771,
12.801
],
"median_ms": 12.624,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.624
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.771
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.801
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
11.916,
13.724,
10.855
],
"median_ms": 11.916,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 11.916
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 13.724
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 10.855
}
]
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": [
14.083,
16.651,
12.602
],
"median_ms": 14.083,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 14.083
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 16.651
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 12.602
}
]
},
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": [
12.582,
11.662,
12.739
],
"median_ms": 12.582,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.582
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 11.662
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.739
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
17.727,
17.944,
15.615
],
"median_ms": 17.727,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.727
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.944
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 15.615
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
16.155,
18.621,
15.103
],
"median_ms": 16.155,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 16.155
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 18.621
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 15.103
}
]
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
23.633,
14.67,
15.728
],
"median_ms": 15.728,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 23.633
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 14.67
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.728
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
14.764,
15.716,
93.58
],
"median_ms": 15.716,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 14.764
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.716
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 93.58
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
14.768,
16.835,
15.685
],
"median_ms": 15.685,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 14.768
},
{
"ip": "141.101.73.177",
"hostname": null,
"rtt_ms": 16.835
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.685
}
]
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
23.634,
14.795,
15.683
],
"median_ms": 15.683,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 23.634
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 14.795
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.683
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202621_633856.txt",
"spike_captured": true,
"spike_limit_ms": 57.05,
"spike_probes": [
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 93.58
}
],
"spike_probe_count": 1,
"peak_probe_ms": 93.58,
"sustained_jump_found": false,
"incident_id": "incident_20260928_202618_625014",
"attempt": 2
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 12.624 ms 11.771 ms 12.801 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 11.916 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 13.724 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 10.855 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 14.083 ms 16.651 ms 12.602 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 12.582 ms 11.662 ms 12.739 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 17.727 ms 17.944 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 15.615 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 16.155 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 18.621 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 15.103 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 23.633 ms 14.670 ms 15.728 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 14.764 ms 141.101.73.110 (141.101.73.110) 15.716 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 93.580 ms
9 141.101.73.111 (141.101.73.111) 14.768 ms 141.101.73.177 (141.101.73.177) 16.835 ms 141.101.73.111 (141.101.73.111) 15.685 ms
10 one.one.one.one (1.1.1.1) 23.634 ms 14.795 ms 15.683 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:29:06.241-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
11.418,
10.916,
18.892
],
"median_ms": 11.418,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.418
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 10.916
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 18.892
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
20.784,
4.783,
13.387
],
"median_ms": 13.387,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 20.784
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 4.783
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 13.387
}
]
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": [
16.087,
14.657,
14.756
],
"median_ms": 14.756,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 16.087
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.657
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.756
}
]
},
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": [
13.603,
12.74,
23.558
],
"median_ms": 13.603,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.603
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.74
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 23.558
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
16.734,
16.649,
22.009
],
"median_ms": 16.734,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.734
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.649
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 22.009
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
16.557,
18.732,
16.653
],
"median_ms": 16.653,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 16.557
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 18.732
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.653
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
34.748,
48.801,
134.849
],
"median_ms": 48.801,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 34.748
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 48.801
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 134.849
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
24.822,
16.656,
16.596
],
"median_ms": 16.656,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 24.822
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.656
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.596
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
24.725,
25.864,
23.545
],
"median_ms": 24.725,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 24.725
},
{
"ip": "141.101.73.127",
"hostname": null,
"rtt_ms": 25.864
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 23.545
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
32.703,
16.675,
16.817
],
"median_ms": 16.817,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.179",
"hostname": null,
"rtt_ms": 32.703
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.675
},
{
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 16.817
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202904_832610.txt",
"spike_captured": true,
"spike_limit_ms": 57.2,
"spike_probes": [
{
"hop": 7,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 134.849
}
],
"spike_probe_count": 1,
"peak_probe_ms": 134.849,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 4
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 11.418 ms 10.916 ms 18.892 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 20.784 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 4.783 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 13.387 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 16.087 ms 14.657 ms 14.756 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 13.603 ms 12.740 ms 23.558 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 16.734 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 16.649 ms 22.009 ms
6 lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 16.557 ms 18.732 ms lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 16.653 ms
7 lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 34.748 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 48.801 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 134.849 ms
8 141.101.73.110 (141.101.73.110) 24.822 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.656 ms 16.596 ms
9 141.101.73.195 (141.101.73.195) 24.725 ms 141.101.73.127 (141.101.73.127) 25.864 ms 141.101.73.110 (141.101.73.110) 23.545 ms
10 141.101.73.179 (141.101.73.179) 32.703 ms one.one.one.one (1.1.1.1) 16.675 ms 141.101.73.117 (141.101.73.117) 16.817 ms
+357
View File
@@ -0,0 +1,357 @@
{
"time": "2026-09-28T20:29:10.442-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
68.207,
30.279,
16.68
],
"median_ms": 30.279,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 68.207
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 30.279
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 16.68
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
133.789,
14.497,
67.823
],
"median_ms": 67.823,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 133.789
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 14.497
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 67.823
}
]
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": [
27.603,
12.699,
66.685
],
"median_ms": 27.603,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 27.603
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 12.699
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 66.685
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
115.596,
46.812,
83.848
],
"median_ms": 83.848,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 115.596
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 46.812
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 83.848
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
17.741,
32.777,
15.677
],
"median_ms": 17.741,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.741
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 32.777
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 15.677
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
23.734,
14.677,
29.818
],
"median_ms": 23.734,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 23.734
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 14.677
},
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 29.818
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
24.594,
12.879,
34.976
],
"median_ms": 24.594,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 24.594
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 12.879
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 34.976
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
16.7,
15.605,
16.556
],
"median_ms": 16.556,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.7
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.605
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.556
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
15.748,
36.274,
34.642
],
"median_ms": 34.642,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.748
},
{
"ip": "141.101.73.179",
"hostname": null,
"rtt_ms": 36.274
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 34.642
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
26.605,
56.88,
17.619
],
"median_ms": 26.605,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.177",
"hostname": null,
"rtt_ms": 26.605
},
{
"ip": "141.101.73.167",
"hostname": null,
"rtt_ms": 56.88
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 17.619
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202908_833609.txt",
"spike_captured": true,
"spike_limit_ms": 57.0,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 68.207
},
{
"hop": 2,
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 133.789
},
{
"hop": 2,
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 67.823
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 66.685
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 115.596
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 83.848
}
],
"spike_probe_count": 6,
"peak_probe_ms": 133.789,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 5
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 68.207 ms 30.279 ms 16.680 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 133.789 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 14.497 ms 67.823 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 27.603 ms 12.699 ms 66.685 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 115.596 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 46.812 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 83.848 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 17.741 ms 32.777 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 15.677 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 23.734 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 14.677 ms lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 29.818 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 24.594 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 12.879 ms 34.976 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.700 ms 141.101.73.111 (141.101.73.111) 15.605 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.556 ms
9 141.101.73.110 (141.101.73.110) 15.748 ms 141.101.73.179 (141.101.73.179) 36.274 ms 141.101.73.110 (141.101.73.110) 34.642 ms
10 141.101.73.177 (141.101.73.177) 26.605 ms 141.101.73.167 (141.101.73.167) 56.880 ms one.one.one.one (1.1.1.1) 17.619 ms
+356
View File
@@ -0,0 +1,356 @@
{
"time": "2026-09-28T20:29:18.445-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
12.089,
12.706,
12.803
],
"median_ms": 12.706,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.089
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.706
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.803
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
19.892,
34.727,
10.949
],
"median_ms": 19.892,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 19.892
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 34.727
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 10.949
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
14.049,
14.744,
20.781
],
"median_ms": 14.744,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.049
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 14.744
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 20.781
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
12.748,
12.477,
15.861
],
"median_ms": 12.748,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.748
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.477
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 15.861
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
14.767,
48.76,
28.798
],
"median_ms": 28.798,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 14.767
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 48.76
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 28.798
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
29.792,
15.801,
82.747
],
"median_ms": 29.792,
"timeouts": 0,
"probes": [
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 29.792
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 15.801
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 82.747
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
65.813,
42.788,
15.785
],
"median_ms": 42.788,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 65.813
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 42.788
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 15.785
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
32.797,
40.609,
24.621
],
"median_ms": 32.797,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 32.797
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 40.609
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 24.621
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
42.985,
18.721,
14.63
],
"median_ms": 18.721,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 42.985
},
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 18.721
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 14.63
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
17.71,
17.748
],
"median_ms": 17.729,
"timeouts": 1,
"probes": [
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 17.71
},
{
"ip": "141.101.73.125",
"hostname": null,
"rtt_ms": 17.748
}
]
},
{
"hop": 11,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
15.846,
16.934,
16.525
],
"median_ms": 16.525,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.846
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.934
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.525
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202916_835701.txt",
"spike_captured": true,
"spike_limit_ms": 57.0,
"spike_probes": [
{
"hop": 6,
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 82.747
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 65.813
}
],
"spike_probe_count": 2,
"peak_probe_ms": 82.747,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 7
}
+12
View File
@@ -0,0 +1,12 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 12.089 ms 12.706 ms 12.803 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 19.892 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 34.727 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 10.949 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 14.049 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 14.744 ms 20.781 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 12.748 ms 12.477 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 15.861 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 14.767 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 48.760 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 28.798 ms
6 lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 29.792 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 15.801 ms lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 82.747 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 65.813 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 42.788 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 15.785 ms
8 141.101.73.111 (141.101.73.111) 32.797 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 40.609 ms 24.621 ms
9 141.101.73.161 (141.101.73.161) 42.985 ms 141.101.73.165 (141.101.73.165) 18.721 ms 141.101.73.111 (141.101.73.111) 14.630 ms
10 141.101.73.161 (141.101.73.161) 17.710 ms 141.101.73.125 (141.101.73.125) 17.748 ms *
11 one.one.one.one (1.1.1.1) 15.846 ms 16.934 ms 16.525 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:29:21.842-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
13.768,
20.08,
32.803
],
"median_ms": 20.08,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 13.768
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 20.08
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 32.803
}
]
},
{
"hop": 2,
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": [
11.768,
23.746,
13.851
],
"median_ms": 13.851,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 11.768
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 23.746
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 13.851
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
16.99,
60.434,
17.849
],
"median_ms": 17.849,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 16.99
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 60.434
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 17.849
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
13.837,
15.779,
12.684
],
"median_ms": 13.837,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.837
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 15.779
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.684
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
16.628,
13.706,
37.777
],
"median_ms": 16.628,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.628
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 13.706
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 37.777
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
14.665,
17.774,
26.657
],
"median_ms": 17.774,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 14.665
},
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.774
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 26.657
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
16.693,
31.732,
40.68
],
"median_ms": 31.732,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 16.693
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 31.732
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 40.68
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
32.578,
17.625,
15.731
],
"median_ms": 17.625,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 32.578
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 17.625
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.731
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
15.692,
16.685,
27.723
],
"median_ms": 16.685,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.692
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 16.685
},
{
"ip": "141.101.73.175",
"hostname": null,
"rtt_ms": 27.723
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
20.581,
15.715,
24.695
],
"median_ms": 20.581,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 20.581
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.715
},
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 24.695
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202920_836621.txt",
"spike_captured": true,
"spike_limit_ms": 57.0,
"spike_probes": [
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 60.434
}
],
"spike_probe_count": 1,
"peak_probe_ms": 60.434,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 8
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 13.768 ms 20.080 ms 32.803 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 11.768 ms 23.746 ms 13.851 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 16.990 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 60.434 ms 17.849 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.837 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 15.779 ms 12.684 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 16.628 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 13.706 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 37.777 ms
6 lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 14.665 ms lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 17.774 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 26.657 ms
7 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 16.693 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 31.732 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 40.680 ms
8 141.101.73.110 (141.101.73.110) 32.578 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 17.625 ms 15.731 ms
9 141.101.73.110 (141.101.73.110) 15.692 ms 16.685 ms 141.101.73.175 (141.101.73.175) 27.723 ms
10 one.one.one.one (1.1.1.1) 20.581 ms 15.715 ms 141.101.73.173 (141.101.73.173) 24.695 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:29:29.845-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
11.501,
11.054,
11.598
],
"median_ms": 11.501,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.501
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.054
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.598
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
21.995,
11.454,
12.243
],
"median_ms": 12.243,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 21.995
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 11.454
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 12.243
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
14.808,
13.724,
13.694
],
"median_ms": 13.724,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.808
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 13.724
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.694
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
12.841,
21.593,
13.652
],
"median_ms": 13.652,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 12.841
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 21.593
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.652
}
]
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": [
25.817,
16.682,
24.792
],
"median_ms": 24.792,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 25.817
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.682
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 24.792
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
16.902,
24.561,
24.783
],
"median_ms": 24.561,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 16.902
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 24.561
},
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 24.783
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
31.145,
13.391,
60.786
],
"median_ms": 31.145,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 31.145
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 13.391
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 60.786
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
24.955,
16.58,
15.504
],
"median_ms": 16.58,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 24.955
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 16.58
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.504
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
14.664,
14.546,
31.752
],
"median_ms": 14.664,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.664
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.546
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 31.752
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
32.601,
17.576,
14.612
],
"median_ms": 17.576,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.125",
"hostname": null,
"rtt_ms": 32.601
},
{
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 17.576
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 14.612
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202928_838679.txt",
"spike_captured": true,
"spike_limit_ms": 57.1,
"spike_probes": [
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 60.786
}
],
"spike_probe_count": 1,
"peak_probe_ms": 60.786,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 10
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 11.501 ms 11.054 ms 11.598 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 21.995 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 11.454 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 12.243 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 14.808 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 13.724 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 13.694 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 12.841 ms 21.593 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 13.652 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 25.817 ms 16.682 ms 24.792 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 16.902 ms lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 24.561 ms lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 24.783 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 31.145 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 13.391 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 60.786 ms
8 141.101.73.111 (141.101.73.111) 24.955 ms 141.101.73.110 (141.101.73.110) 16.580 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.504 ms
9 141.101.73.110 (141.101.73.110) 14.664 ms 14.546 ms 141.101.73.111 (141.101.73.111) 31.752 ms
10 141.101.73.125 (141.101.73.125) 32.601 ms 141.101.73.117 (141.101.73.117) 17.576 ms one.one.one.one (1.1.1.1) 14.612 ms
+345
View File
@@ -0,0 +1,345 @@
{
"time": "2026-09-28T20:29:34.048-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
39.689,
22.378,
20.855
],
"median_ms": 22.378,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 39.689
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 22.378
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 20.855
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
11.746,
13.389,
11.135
],
"median_ms": 11.746,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 11.746
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 13.389
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 11.135
}
]
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": [
15.187,
20.814,
13.664
],
"median_ms": 15.187,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 15.187
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 20.814
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.664
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
13.688,
24.772,
13.911
],
"median_ms": 13.911,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.688
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 24.772
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.911
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
63.145,
38.85,
30.615
],
"median_ms": 38.85,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 63.145
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 38.85
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 30.615
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
15.632,
17.743,
26.775
],
"median_ms": 17.743,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 15.632
},
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.743
},
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 26.775
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
16.742,
62.903,
21.668
],
"median_ms": 21.668,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.742
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 62.903
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 21.668
}
]
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
62.645,
81.934,
33.542
],
"median_ms": 62.645,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 62.645
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 81.934
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 33.542
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
17.708,
15.547,
25.467
],
"median_ms": 17.708,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.171",
"hostname": null,
"rtt_ms": 17.708
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.547
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 25.467
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
17.794,
20.597,
20.596
],
"median_ms": 20.596,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.159",
"hostname": null,
"rtt_ms": 17.794
},
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 20.597
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 20.596
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202932_839632.txt",
"spike_captured": true,
"spike_limit_ms": 57.15,
"spike_probes": [
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 63.145
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 62.903
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 62.645
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 81.934
}
],
"spike_probe_count": 4,
"peak_probe_ms": 81.934,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 11
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 39.689 ms 22.378 ms 20.855 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 11.746 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 13.389 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 11.135 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 15.187 ms 20.814 ms 13.664 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.688 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 24.772 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.911 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 63.145 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 38.850 ms 30.615 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 15.632 ms lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 17.743 ms lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 26.775 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.742 ms 62.903 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 21.668 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 62.645 ms 81.934 ms 33.542 ms
9 141.101.73.171 (141.101.73.171) 17.708 ms 141.101.73.111 (141.101.73.111) 15.547 ms 25.467 ms
10 141.101.73.159 (141.101.73.159) 17.794 ms 141.101.73.195 (141.101.73.195) 20.597 ms one.one.one.one (1.1.1.1) 20.596 ms
+351
View File
@@ -0,0 +1,351 @@
{
"time": "2026-09-28T20:29:38.250-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
12.629,
48.238,
21.741
],
"median_ms": 21.741,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.629
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 48.238
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 21.741
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
96.772,
58.312,
12.706
],
"median_ms": 58.312,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 96.772
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 58.312
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 12.706
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
13.794,
177.922,
77.865
],
"median_ms": 77.865,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 13.794
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 177.922
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 77.865
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
15.624,
26.827,
33.603
],
"median_ms": 26.827,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 15.624
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 26.827
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 33.603
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
42.748,
14.761,
16.61
],
"median_ms": 16.61,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 42.748
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 14.761
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.61
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
16.843,
33.819,
30.766
],
"median_ms": 30.766,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.843
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 33.819
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 30.766
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
49.717,
16.787,
13.557
],
"median_ms": 16.787,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 49.717
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.787
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 13.557
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
15.727,
15.946,
24.537
],
"median_ms": 15.946,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.727
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.946
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 24.537
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
31.566,
16.344,
87.595
],
"median_ms": 31.566,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 31.566
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 16.344
},
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 87.595
}
]
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
16.713,
16.992,
16.749
],
"median_ms": 16.749,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.713
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.992
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.749
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202936_840654.txt",
"spike_captured": true,
"spike_limit_ms": 57.3,
"spike_probes": [
{
"hop": 2,
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 96.772
},
{
"hop": 2,
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 58.312
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 177.922
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 77.865
},
{
"hop": 9,
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 87.595
}
],
"spike_probe_count": 5,
"peak_probe_ms": 177.922,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 12
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 12.629 ms 48.238 ms 21.741 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 96.772 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 58.312 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 12.706 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 13.794 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 177.922 ms 77.865 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 15.624 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 26.827 ms 33.603 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 42.748 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 14.761 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 16.610 ms
6 lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 16.843 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 33.819 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 30.766 ms
7 lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 49.717 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.787 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 13.557 ms
8 141.101.73.111 (141.101.73.111) 15.727 ms 15.946 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 24.537 ms
9 141.101.73.110 (141.101.73.110) 31.566 ms 141.101.73.111 (141.101.73.111) 16.344 ms 141.101.73.165 (141.101.73.165) 87.595 ms
10 one.one.one.one (1.1.1.1) 16.713 ms 16.992 ms 16.749 ms
+362
View File
@@ -0,0 +1,362 @@
{
"time": "2026-09-28T20:29:51.051-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
11.881,
11.027,
10.829
],
"median_ms": 11.027,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.881
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.027
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 10.829
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
11.977,
13.166,
11.482
],
"median_ms": 11.977,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 11.977
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 13.166
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 11.482
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
15.066,
28.773,
28.706
],
"median_ms": 28.706,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 15.066
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 28.773
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 28.706
}
]
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": [
13.609,
12.709,
12.678
],
"median_ms": 12.709,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.609
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 12.709
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 12.678
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
65.693,
15.663,
16.631
],
"median_ms": 16.631,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 65.693
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 15.663
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.631
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
16.779,
18.712,
19.632
],
"median_ms": 18.712,
"timeouts": 0,
"probes": [
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.779
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 18.712
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 19.632
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
31.746,
22.684,
18.604
],
"median_ms": 22.684,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 31.746
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 22.684
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 18.604
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
20.963,
33.536,
22.571
],
"median_ms": 22.571,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 20.963
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 33.536
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 22.571
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
26.708,
25.622,
24.678
],
"median_ms": 25.622,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 26.708
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 25.622
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 24.678
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
39.678,
16.581,
15.663
],
"median_ms": 16.581,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.157",
"hostname": null,
"rtt_ms": 39.678
},
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 16.581
},
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 15.663
}
]
},
{
"hop": 11,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
16.836,
121.805,
16.747
],
"median_ms": 16.836,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.836
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 121.805
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.747
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202949_844423.txt",
"spike_captured": true,
"spike_limit_ms": 57.2,
"spike_probes": [
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 65.693
},
{
"hop": 11,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 121.805
}
],
"spike_probe_count": 2,
"peak_probe_ms": 121.805,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 16
}
+12
View File
@@ -0,0 +1,12 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 11.881 ms 11.027 ms 10.829 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 11.977 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 13.166 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 11.482 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 15.066 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 28.773 ms 28.706 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.609 ms 12.709 ms 12.678 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 65.693 ms 15.663 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 16.631 ms
6 lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 16.779 ms 18.712 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 19.632 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 31.746 ms 22.684 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 18.604 ms
8 141.101.73.110 (141.101.73.110) 20.963 ms 141.101.73.111 (141.101.73.111) 33.536 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 22.571 ms
9 141.101.73.110 (141.101.73.110) 26.708 ms 25.622 ms 141.101.73.111 (141.101.73.111) 24.678 ms
10 141.101.73.157 (141.101.73.157) 39.678 ms 141.101.73.165 (141.101.73.165) 16.581 ms 15.663 ms
11 one.one.one.one (1.1.1.1) 16.836 ms 121.805 ms 16.747 ms
+368
View File
@@ -0,0 +1,368 @@
{
"time": "2026-09-28T20:29:55.653-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
12.404,
11.62,
11.089
],
"median_ms": 11.62,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.404
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.62
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.089
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
11.645,
11.652,
26.356
],
"median_ms": 11.652,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 11.645
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 11.652
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 26.356
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
12.94,
13.829,
13.576
],
"median_ms": 13.576,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 12.94
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.829
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 13.576
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
20.891,
13.66,
13.908
],
"median_ms": 13.908,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 20.891
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.66
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.908
}
]
},
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": [
15.777,
16.958,
18.814
],
"median_ms": 16.958,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 15.777
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.958
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 18.814
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
18.704,
19.617,
41.708
],
"median_ms": 19.617,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 18.704
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 19.617
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 41.708
}
]
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
50.621,
32.674,
47.663
],
"median_ms": 47.663,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 50.621
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 32.674
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 47.663
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
40.665,
44.696,
16.608
],
"median_ms": 40.665,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 40.665
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 44.696
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 16.608
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
51.615,
19.768,
80.616
],
"median_ms": 51.615,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.159",
"hostname": null,
"rtt_ms": 51.615
},
{
"ip": "141.101.73.147",
"hostname": null,
"rtt_ms": 19.768
},
{
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 80.616
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
278.328,
41.527,
80.708
],
"median_ms": 80.708,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 278.328
},
{
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 41.527
},
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 80.708
}
]
},
{
"hop": 11,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
48.679,
30.784,
18.654
],
"median_ms": 30.784,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 48.679
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 30.784
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 18.654
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202953_844924.txt",
"spike_captured": true,
"spike_limit_ms": 57.2,
"spike_probes": [
{
"hop": 9,
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 80.616
},
{
"hop": 10,
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 278.328
},
{
"hop": 10,
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 80.708
}
],
"spike_probe_count": 3,
"peak_probe_ms": 278.328,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 17
}
+12
View File
@@ -0,0 +1,12 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 12.404 ms 11.620 ms 11.089 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 11.645 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 11.652 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 26.356 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 12.940 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 13.829 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 13.576 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 20.891 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.660 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 13.908 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 15.777 ms 16.958 ms 18.814 ms
6 lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 18.704 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 19.617 ms 41.708 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 50.621 ms 32.674 ms 47.663 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 40.665 ms 44.696 ms 141.101.73.111 (141.101.73.111) 16.608 ms
9 141.101.73.159 (141.101.73.159) 51.615 ms 141.101.73.147 (141.101.73.147) 19.768 ms 141.101.73.169 (141.101.73.169) 80.616 ms
10 141.101.73.165 (141.101.73.165) 278.328 ms 141.101.73.169 (141.101.73.169) 41.527 ms 141.101.73.165 (141.101.73.165) 80.708 ms
11 one.one.one.one (1.1.1.1) 48.679 ms 30.784 ms 18.654 ms
+393
View File
@@ -0,0 +1,393 @@
{
"time": "2026-09-28T20:30:00.456-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
24.138,
16.469,
169.839
],
"median_ms": 24.138,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 24.138
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 16.469
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 169.839
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
26.806,
25.115,
15.938
],
"median_ms": 25.115,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 26.806
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 25.115
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 15.938
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
430.866,
63.825,
63.605
],
"median_ms": 63.825,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 430.866
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 63.825
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 63.605
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
14.588,
102.676,
9.497
],
"median_ms": 14.588,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 14.588
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 102.676
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 9.497
}
]
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": [
42.948,
38.77,
92.606
],
"median_ms": 42.948,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 42.948
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 38.77
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 92.606
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
150.697,
217.735,
68.657
],
"median_ms": 150.697,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 150.697
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 217.735
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 68.657
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
16.802,
17.785,
21.496
],
"median_ms": 17.785,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 16.802
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 17.785
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 21.496
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
162.783,
19.849,
16.575
],
"median_ms": 19.849,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 162.783
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 19.849
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.575
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
43.745,
40.46,
177.716
],
"median_ms": 43.745,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 43.745
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 40.46
},
{
"ip": "141.101.73.147",
"hostname": null,
"rtt_ms": 177.716
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
20.598,
38.712,
57.747
],
"median_ms": 38.712,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 20.598
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 38.712
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 57.747
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_202957_845832.txt",
"spike_captured": true,
"spike_limit_ms": 57.2,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 169.839
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 430.866
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 63.825
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 63.605
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 102.676
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 92.606
},
{
"hop": 6,
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 150.697
},
{
"hop": 6,
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 217.735
},
{
"hop": 6,
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 68.657
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 162.783
},
{
"hop": 9,
"ip": "141.101.73.147",
"hostname": null,
"rtt_ms": 177.716
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 57.747
}
],
"spike_probe_count": 12,
"peak_probe_ms": 430.866,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 18
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 24.138 ms 16.469 ms 169.839 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 26.806 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 25.115 ms 15.938 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 430.866 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 63.825 ms 63.605 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 14.588 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 102.676 ms 9.497 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 42.948 ms 38.770 ms 92.606 ms
6 lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 150.697 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 217.735 ms lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 68.657 ms
7 lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 16.802 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 17.785 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 21.496 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 162.783 ms 141.101.73.111 (141.101.73.111) 19.849 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.575 ms
9 141.101.73.110 (141.101.73.110) 43.745 ms 141.101.73.111 (141.101.73.111) 40.460 ms 141.101.73.147 (141.101.73.147) 177.716 ms
10 141.101.73.173 (141.101.73.173) 20.598 ms one.one.one.one (1.1.1.1) 38.712 ms 57.747 ms
+339
View File
@@ -0,0 +1,339 @@
{
"time": "2026-09-28T20:30:04.055-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
9.097,
12.906,
12.826
],
"median_ms": 12.826,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 9.097
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.906
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.826
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
11.715,
12.939,
30.42
],
"median_ms": 12.939,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 11.715
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 12.939
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 30.42
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
38.949,
15.6,
14.717
],
"median_ms": 15.6,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 38.949
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 15.6
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.717
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
26.488,
39.015,
42.711
],
"median_ms": 39.015,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 26.488
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 39.015
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 42.711
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
17.714,
16.641,
21.662
],
"median_ms": 17.714,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.714
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.641
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 21.662
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
77.611,
46.661,
28.832
],
"median_ms": 46.661,
"timeouts": 0,
"probes": [
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 77.611
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 46.661
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 28.832
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
58.575,
27.689,
18.787
],
"median_ms": 27.689,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 58.575
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 27.689
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 18.787
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
85.794,
14.572,
17.577
],
"median_ms": 17.577,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 85.794
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.572
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 17.577
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
19.584,
16.354,
17.432
],
"median_ms": 17.432,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.167",
"hostname": null,
"rtt_ms": 19.584
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 16.354
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 17.432
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
16.412,
24.77,
27.732
],
"median_ms": 24.77,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.159",
"hostname": null,
"rtt_ms": 16.412
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 24.77
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 27.732
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203002_847161.txt",
"spike_captured": true,
"spike_limit_ms": 57.2,
"spike_probes": [
{
"hop": 6,
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 77.611
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 58.575
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 85.794
}
],
"spike_probe_count": 3,
"peak_probe_ms": 85.794,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 19
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 9.097 ms 12.906 ms 12.826 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 11.715 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 12.939 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 30.420 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 38.949 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 15.600 ms 14.717 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 26.488 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 39.015 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 42.711 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 17.714 ms 16.641 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 21.662 ms
6 lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 77.611 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 46.661 ms lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 28.832 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 58.575 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 27.689 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 18.787 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 85.794 ms 141.101.73.110 (141.101.73.110) 14.572 ms 141.101.73.111 (141.101.73.111) 17.577 ms
9 141.101.73.167 (141.101.73.167) 19.584 ms 141.101.73.111 (141.101.73.111) 16.354 ms 141.101.73.110 (141.101.73.110) 17.432 ms
10 141.101.73.159 (141.101.73.159) 16.412 ms one.one.one.one (1.1.1.1) 24.770 ms 27.732 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:30:12.458-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
31.985,
31.026,
11.737
],
"median_ms": 31.026,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 31.985
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 31.026
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.737
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
11.843,
14.001,
11.515
],
"median_ms": 11.843,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 11.843
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 14.001
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 11.515
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
13.577,
11.681,
15.878
],
"median_ms": 13.577,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 13.577
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 11.681
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 15.878
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
12.773,
46.591,
12.692
],
"median_ms": 12.773,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.773
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 46.591
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.692
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
16.667,
15.672,
17.779
],
"median_ms": 16.667,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.667
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 15.672
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.779
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
15.708,
16.775,
18.876
],
"median_ms": 16.775,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 15.708
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 16.775
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 18.876
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
40.785,
33.826,
68.809
],
"median_ms": 40.785,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 40.785
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 33.826
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 68.809
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
43.784,
33.941
],
"median_ms": 38.8625,
"timeouts": 1,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 43.784
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 33.941
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
99.58,
36.647,
23.546
],
"median_ms": 36.647,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 99.58
},
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 36.647
},
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 23.546
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
19.821,
16.82,
25.689
],
"median_ms": 19.821,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 19.821
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.82
},
{
"ip": "141.101.73.175",
"hostname": null,
"rtt_ms": 25.689
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203010_849173.txt",
"spike_captured": true,
"spike_limit_ms": 57.2,
"spike_probes": [
{
"hop": 7,
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 68.809
},
{
"hop": 9,
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 99.58
}
],
"spike_probe_count": 2,
"peak_probe_ms": 99.58,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 21
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 31.985 ms 31.026 ms 11.737 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 11.843 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 14.001 ms 11.515 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 13.577 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 11.681 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 15.878 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 12.773 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 46.591 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 12.692 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 16.667 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 15.672 ms 17.779 ms
6 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 15.708 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 16.775 ms lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 18.876 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 40.785 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 33.826 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 68.809 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 43.784 ms * 141.101.73.111 (141.101.73.111) 33.941 ms
9 141.101.73.111 (141.101.73.111) 99.580 ms 141.101.73.173 (141.101.73.173) 36.647 ms 23.546 ms
10 one.one.one.one (1.1.1.1) 19.821 ms 16.820 ms 141.101.73.175 (141.101.73.175) 25.689 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:30:15.657-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
10.849,
12.979,
10.948
],
"median_ms": 10.948,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 10.849
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.979
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 10.948
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
11.765,
12.026,
23.431
],
"median_ms": 12.026,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 11.765
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 12.026
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 23.431
}
]
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": [
12.937,
10.877,
13.775
],
"median_ms": 12.937,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 12.937
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 10.877
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 13.775
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
12.64,
11.777,
14.902
],
"median_ms": 12.64,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.64
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 11.777
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 14.902
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
16.636,
17.699,
15.807
],
"median_ms": 16.636,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.636
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.699
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 15.807
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
34.966,
20.813,
62.835
],
"median_ms": 34.966,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 34.966
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 20.813
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 62.835
}
]
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
14.702,
14.848,
15.547
],
"median_ms": 14.848,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 14.702
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 14.848
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.547
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
15.679,
14.677,
14.603
],
"median_ms": 14.677,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.679
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.677
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.603
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
14.672,
16.583,
15.588
],
"median_ms": 15.588,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.672
},
{
"ip": "141.101.73.157",
"hostname": null,
"rtt_ms": 16.583
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.588
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
22.601,
15.679,
16.685
],
"median_ms": 16.685,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 22.601
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.679
},
{
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 16.685
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203014_850176.txt",
"spike_captured": true,
"spike_limit_ms": 57.35,
"spike_probes": [
{
"hop": 6,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 62.835
}
],
"spike_probe_count": 1,
"peak_probe_ms": 62.835,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 22
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 10.849 ms 12.979 ms 10.948 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 11.765 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 12.026 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 23.431 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 12.937 ms 10.877 ms 13.775 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 12.640 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 11.777 ms 14.902 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 16.636 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 17.699 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 15.807 ms
6 lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 34.966 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 20.813 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 62.835 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 14.702 ms 14.848 ms 15.547 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.679 ms 141.101.73.110 (141.101.73.110) 14.677 ms 14.603 ms
9 141.101.73.110 (141.101.73.110) 14.672 ms 141.101.73.157 (141.101.73.157) 16.583 ms 141.101.73.110 (141.101.73.110) 15.588 ms
10 one.one.one.one (1.1.1.1) 22.601 ms 15.679 ms 141.101.73.117 (141.101.73.117) 16.685 ms
+351
View File
@@ -0,0 +1,351 @@
{
"time": "2026-09-28T20:30:19.459-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
19.787,
21.825,
51.87
],
"median_ms": 21.825,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 19.787
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 21.825
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 51.87
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
45.75,
82.407,
13.849
],
"median_ms": 45.75,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 45.75
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 82.407
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 13.849
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
17.758,
25.933,
13.686
],
"median_ms": 17.758,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 17.758
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 25.933
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.686
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
70.829,
34.775,
51.713
],
"median_ms": 51.713,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 70.829
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 34.775
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 51.713
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
28.759,
163.831,
26.694
],
"median_ms": 28.759,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 28.759
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 163.831
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 26.694
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
63.771,
19.856,
43.794
],
"median_ms": 43.794,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 63.771
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 19.856
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 43.794
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
60.798,
40.81,
18.791
],
"median_ms": 40.81,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 60.798
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 40.81
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 18.791
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
29.904,
26.582,
15.812
],
"median_ms": 26.582,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 29.904
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 26.582
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.812
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
24.712,
23.586,
16.633
],
"median_ms": 23.586,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.149",
"hostname": null,
"rtt_ms": 24.712
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 23.586
},
{
"ip": "141.101.73.175",
"hostname": null,
"rtt_ms": 16.633
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
20.909,
15.557,
16.895
],
"median_ms": 16.895,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.163",
"hostname": null,
"rtt_ms": 20.909
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.557
},
{
"ip": "141.101.73.127",
"hostname": null,
"rtt_ms": 16.895
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203017_850858.txt",
"spike_captured": true,
"spike_limit_ms": 57.35,
"spike_probes": [
{
"hop": 2,
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 82.407
},
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 70.829
},
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 163.831
},
{
"hop": 6,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 63.771
},
{
"hop": 7,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 60.798
}
],
"spike_probe_count": 5,
"peak_probe_ms": 163.831,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 23
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 19.787 ms 21.825 ms 51.870 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 45.750 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 82.407 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 13.849 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 17.758 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 25.933 ms 13.686 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 70.829 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 34.775 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 51.713 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 28.759 ms 163.831 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 26.694 ms
6 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 63.771 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 19.856 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 43.794 ms
7 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 60.798 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 40.810 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 18.791 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 29.904 ms 141.101.73.110 (141.101.73.110) 26.582 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.812 ms
9 141.101.73.149 (141.101.73.149) 24.712 ms 141.101.73.110 (141.101.73.110) 23.586 ms 141.101.73.175 (141.101.73.175) 16.633 ms
10 141.101.73.163 (141.101.73.163) 20.909 ms one.one.one.one (1.1.1.1) 15.557 ms 141.101.73.127 (141.101.73.127) 16.895 ms
+362
View File
@@ -0,0 +1,362 @@
{
"time": "2026-09-28T20:30:23.261-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
14.273,
21.992,
29.693
],
"median_ms": 21.992,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 14.273
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 21.992
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 29.693
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
39.917,
58.389,
9.749
],
"median_ms": 39.917,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 39.917
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 58.389
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 9.749
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
24.084,
43.889,
40.761
],
"median_ms": 40.761,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 24.084
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 43.889
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 40.761
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
40.768,
24.702,
12.575
],
"median_ms": 24.702,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 40.768
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 24.702
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.575
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
25.781,
16.845,
14.732
],
"median_ms": 16.845,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 25.781
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.845
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 14.732
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
43.774,
15.712,
48.779
],
"median_ms": 43.774,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 43.774
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 15.712
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 48.779
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
77.763,
24.845,
15.688
],
"median_ms": 24.845,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 77.763
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 24.845
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 15.688
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
16.615,
17.685,
26.789
],
"median_ms": 17.685,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 16.615
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 17.685
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 26.789
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
15.584,
17.621,
15.533
],
"median_ms": 15.584,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.584
},
{
"ip": "141.101.73.125",
"hostname": null,
"rtt_ms": 17.621
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.533
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
17.688,
23.542,
20.648
],
"median_ms": 20.648,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.127",
"hostname": null,
"rtt_ms": 17.688
},
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 23.542
},
{
"ip": "141.101.73.171",
"hostname": null,
"rtt_ms": 20.648
}
]
},
{
"hop": 11,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
56.584,
37.852,
18.574
],
"median_ms": 37.852,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 56.584
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 37.852
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 18.574
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203021_851704.txt",
"spike_captured": true,
"spike_limit_ms": 58.05,
"spike_probes": [
{
"hop": 2,
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 58.389
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 77.763
}
],
"spike_probe_count": 2,
"peak_probe_ms": 77.763,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 24
}
+12
View File
@@ -0,0 +1,12 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 14.273 ms 21.992 ms 29.693 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 39.917 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 58.389 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 9.749 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 24.084 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 43.889 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 40.761 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 40.768 ms 24.702 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 12.575 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 25.781 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 16.845 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 14.732 ms
6 lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 43.774 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 15.712 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 48.779 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 77.763 ms 24.845 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 15.688 ms
8 141.101.73.111 (141.101.73.111) 16.615 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 17.685 ms 26.789 ms
9 141.101.73.110 (141.101.73.110) 15.584 ms 141.101.73.125 (141.101.73.125) 17.621 ms 141.101.73.111 (141.101.73.111) 15.533 ms
10 141.101.73.127 (141.101.73.127) 17.688 ms 141.101.73.161 (141.101.73.161) 23.542 ms 141.101.73.171 (141.101.73.171) 20.648 ms
11 one.one.one.one (1.1.1.1) 56.584 ms 37.852 ms 18.574 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:30:26.858-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
21.349,
13.522,
9.716
],
"median_ms": 13.522,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 21.349
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 13.522
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 9.716
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
13.708,
46.539,
9.909
],
"median_ms": 13.708,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 13.708
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 46.539
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 9.909
}
]
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": [
14.869,
12.941,
14.686
],
"median_ms": 14.686,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.869
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 12.941
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.686
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
12.619,
13.801,
14.909
],
"median_ms": 13.801,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 12.619
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.801
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 14.909
}
]
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": [
16.677,
16.899,
16.725
],
"median_ms": 16.725,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.677
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.899
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.725
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
27.671,
143.714,
21.72
],
"median_ms": 27.671,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 27.671
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 143.714
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 21.72
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
16.686,
15.759,
16.6
],
"median_ms": 16.6,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.686
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.759
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 16.6
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
15.7,
14.742,
31.58
],
"median_ms": 15.7,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.7
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.742
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 31.58
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
32.814,
15.56,
15.572
],
"median_ms": 15.572,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.171",
"hostname": null,
"rtt_ms": 32.814
},
{
"ip": "141.101.73.159",
"hostname": null,
"rtt_ms": 15.56
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.572
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
16.675,
14.614,
18.831
],
"median_ms": 16.675,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.157",
"hostname": null,
"rtt_ms": 16.675
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 14.614
},
{
"ip": "141.101.73.163",
"hostname": null,
"rtt_ms": 18.831
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203025_853363.txt",
"spike_captured": true,
"spike_limit_ms": 58.05,
"spike_probes": [
{
"hop": 6,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 143.714
}
],
"spike_probe_count": 1,
"peak_probe_ms": 143.714,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 25
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 21.349 ms 13.522 ms 9.716 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 13.708 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 46.539 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 9.909 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 14.869 ms 12.941 ms 14.686 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 12.619 ms 13.801 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 14.909 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 16.677 ms 16.899 ms 16.725 ms
6 lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 27.671 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 143.714 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 21.720 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.686 ms 15.759 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 16.600 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.700 ms 141.101.73.110 (141.101.73.110) 14.742 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 31.580 ms
9 141.101.73.171 (141.101.73.171) 32.814 ms 141.101.73.159 (141.101.73.159) 15.560 ms 141.101.73.110 (141.101.73.110) 15.572 ms
10 141.101.73.157 (141.101.73.157) 16.675 ms one.one.one.one (1.1.1.1) 14.614 ms 141.101.73.163 (141.101.73.163) 18.831 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:30:34.663-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
11.502,
12.919,
28.85
],
"median_ms": 12.919,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.502
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.919
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 28.85
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
32.937,
13.502,
11.978
],
"median_ms": 13.502,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 32.937
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 13.502
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 11.978
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
15.023,
13.085,
14.694
],
"median_ms": 14.694,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 15.023
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.085
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.694
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
13.659,
13.59,
24.777
],
"median_ms": 13.659,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.659
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.59
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 24.777
}
]
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": [
34.078,
78.527,
16.697
],
"median_ms": 34.078,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 34.078
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 78.527
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.697
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
14.708,
15.649,
16.725
],
"median_ms": 15.649,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 14.708
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 15.649
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.725
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
16.649,
16.889,
16.031
],
"median_ms": 16.649,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 16.649
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 16.889
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.031
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
15.595,
44.683,
14.737
],
"median_ms": 15.595,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.595
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 44.683
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 14.737
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
14.594,
20.609,
16.838
],
"median_ms": 16.838,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.594
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 20.609
},
{
"ip": "141.101.73.119",
"hostname": null,
"rtt_ms": 16.838
}
]
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
13.575,
15.884,
12.666
],
"median_ms": 13.575,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 13.575
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.884
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 12.666
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203033_854831.txt",
"spike_captured": true,
"spike_limit_ms": 57.5,
"spike_probes": [
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 78.527
}
],
"spike_probe_count": 1,
"peak_probe_ms": 78.527,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 27
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 11.502 ms 12.919 ms 28.850 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 32.937 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 13.502 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 11.978 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 15.023 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 13.085 ms 14.694 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.659 ms 13.590 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 24.777 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 34.078 ms 78.527 ms 16.697 ms
6 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 14.708 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 15.649 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 16.725 ms
7 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 16.649 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 16.889 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.031 ms
8 141.101.73.111 (141.101.73.111) 15.595 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 44.683 ms 141.101.73.111 (141.101.73.111) 14.737 ms
9 141.101.73.110 (141.101.73.110) 14.594 ms 20.609 ms 141.101.73.119 (141.101.73.119) 16.838 ms
10 one.one.one.one (1.1.1.1) 13.575 ms 15.884 ms 12.666 ms
+333
View File
@@ -0,0 +1,333 @@
{
"time": "2026-09-28T20:30:50.864-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
11.75,
12.49,
11.767
],
"median_ms": 11.767,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.75
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.49
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.767
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
36.975,
23.615,
13.836
],
"median_ms": 23.615,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 36.975
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 23.615
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 13.836
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
13.944,
14.469,
14.756
],
"median_ms": 14.469,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 13.944
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.469
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.756
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
62.672,
13.676,
22.708
],
"median_ms": 22.708,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 62.672
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.676
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 22.708
}
]
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": [
51.703,
16.733,
28.595
],
"median_ms": 28.595,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 51.703
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.733
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 28.595
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
21.651,
27.873,
24.588
],
"median_ms": 24.588,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 21.651
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 27.873
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 24.588
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
15.68,
16.67,
22.673
],
"median_ms": 16.67,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.68
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.67
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 22.673
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
14.713,
32.717,
14.617
],
"median_ms": 14.713,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.713
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 32.717
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 14.617
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
32.632,
15.631,
15.575
],
"median_ms": 15.631,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.179",
"hostname": null,
"rtt_ms": 32.632
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.631
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.575
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
38.696,
112.611,
26.668
],
"median_ms": 38.696,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 38.696
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 112.611
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 26.668
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203049_858827.txt",
"spike_captured": true,
"spike_limit_ms": 57.3,
"spike_probes": [
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 62.672
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 112.611
}
],
"spike_probe_count": 2,
"peak_probe_ms": 112.611,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 32
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 11.750 ms 12.490 ms 11.767 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 36.975 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 23.615 ms 13.836 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 13.944 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 14.469 ms 14.756 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 62.672 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.676 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 22.708 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 51.703 ms 16.733 ms 28.595 ms
6 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 21.651 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 27.873 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 24.588 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.680 ms 16.670 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 22.673 ms
8 141.101.73.110 (141.101.73.110) 14.713 ms 141.101.73.111 (141.101.73.111) 32.717 ms 14.617 ms
9 141.101.73.179 (141.101.73.179) 32.632 ms 141.101.73.110 (141.101.73.110) 15.631 ms 15.575 ms
10 141.101.73.169 (141.101.73.169) 38.696 ms one.one.one.one (1.1.1.1) 112.611 ms 26.668 ms
+368
View File
@@ -0,0 +1,368 @@
{
"time": "2026-09-28T20:30:55.268-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
11.562,
10.72,
13.83
],
"median_ms": 11.562,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.562
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 10.72
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 13.83
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
19.868,
11.594,
12.101
],
"median_ms": 12.101,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 19.868
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 11.594
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 12.101
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
15.683,
15.838,
13.923
],
"median_ms": 15.683,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 15.683
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 15.838
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.923
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
13.608,
9.768,
30.734
],
"median_ms": 13.608,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.608
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 9.768
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 30.734
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
14.772,
36.006,
34.804
],
"median_ms": 34.804,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 14.772
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 36.006
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 34.804
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
14.987,
37.694,
16.624
],
"median_ms": 16.624,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 14.987
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 37.694
},
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.624
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
15.62,
20.753,
112.974
],
"median_ms": 20.753,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.62
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 20.753
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 112.974
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
17.701,
19.61,
14.611
],
"median_ms": 17.701,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 17.701
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 19.61
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 14.611
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
22.755,
16.489,
59.773
],
"median_ms": 22.755,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 22.755
},
{
"ip": "141.101.73.159",
"hostname": null,
"rtt_ms": 16.489
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 59.773
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
190.624,
39.593,
15.498
],
"median_ms": 39.593,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 190.624
},
{
"ip": "141.101.73.171",
"hostname": null,
"rtt_ms": 39.593
},
{
"ip": "141.101.73.179",
"hostname": null,
"rtt_ms": 15.498
}
]
},
{
"hop": 11,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
24.692,
15.635,
25.674
],
"median_ms": 24.692,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 24.692
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.635
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 25.674
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203053_859651.txt",
"spike_captured": true,
"spike_limit_ms": 57.15,
"spike_probes": [
{
"hop": 7,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 112.974
},
{
"hop": 9,
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 59.773
},
{
"hop": 10,
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 190.624
}
],
"spike_probe_count": 3,
"peak_probe_ms": 190.624,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 33
}
+12
View File
@@ -0,0 +1,12 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 11.562 ms 10.720 ms 13.830 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 19.868 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 11.594 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 12.101 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 15.683 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 15.838 ms 13.923 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 13.608 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 9.768 ms 30.734 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 14.772 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 36.006 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 34.804 ms
6 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 14.987 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 37.694 ms lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 16.624 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.620 ms 20.753 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 112.974 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 17.701 ms 141.101.73.110 (141.101.73.110) 19.610 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 14.611 ms
9 141.101.73.110 (141.101.73.110) 22.755 ms 141.101.73.159 (141.101.73.159) 16.489 ms 141.101.73.111 (141.101.73.111) 59.773 ms
10 141.101.73.173 (141.101.73.173) 190.624 ms 141.101.73.171 (141.101.73.171) 39.593 ms 141.101.73.179 (141.101.73.179) 15.498 ms
11 one.one.one.one (1.1.1.1) 24.692 ms 15.635 ms 25.674 ms
+345
View File
@@ -0,0 +1,345 @@
{
"time": "2026-09-28T20:30:59.267-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
15.944,
35.861,
14.793
],
"median_ms": 15.944,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 15.944
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 35.861
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 14.793
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
32.858,
6.478,
13.143
],
"median_ms": 13.143,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 32.858
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 6.478
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 13.143
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
13.845,
15.708,
14.726
],
"median_ms": 14.726,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 13.845
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 15.708
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.726
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
23.574,
13.728,
39.962
],
"median_ms": 23.574,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 23.574
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.728
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 39.962
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
68.681,
18.644,
17.743
],
"median_ms": 18.644,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 68.681
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 18.644
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.743
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
18.642,
22.754,
100.731
],
"median_ms": 22.754,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 18.642
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 22.754
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 100.731
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
32.644,
65.693,
49.747
],
"median_ms": 49.747,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 32.644
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 65.693
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 49.747
}
]
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
46.668,
43.724,
47.667
],
"median_ms": 46.668,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 46.668
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 43.724
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 47.667
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
27.7,
164.008,
17.634
],
"median_ms": 27.7,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.179",
"hostname": null,
"rtt_ms": 27.7
},
{
"ip": "141.101.73.147",
"hostname": null,
"rtt_ms": 164.008
},
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 17.634
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
15.709,
13.544,
22.883
],
"median_ms": 15.709,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.167",
"hostname": null,
"rtt_ms": 15.709
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 13.544
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 22.883
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203057_860657.txt",
"spike_captured": true,
"spike_limit_ms": 57.25,
"spike_probes": [
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 68.681
},
{
"hop": 6,
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 100.731
},
{
"hop": 7,
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 65.693
},
{
"hop": 9,
"ip": "141.101.73.147",
"hostname": null,
"rtt_ms": 164.008
}
],
"spike_probe_count": 4,
"peak_probe_ms": 164.008,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 34
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 15.944 ms 35.861 ms 14.793 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 32.858 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 6.478 ms 13.143 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 13.845 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 15.708 ms 14.726 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 23.574 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 13.728 ms 39.962 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 68.681 ms 18.644 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 17.743 ms
6 lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 18.642 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 22.754 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 100.731 ms
7 lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 32.644 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 65.693 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 49.747 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 46.668 ms 43.724 ms 47.667 ms
9 141.101.73.179 (141.101.73.179) 27.700 ms 141.101.73.147 (141.101.73.147) 164.008 ms 141.101.73.195 (141.101.73.195) 17.634 ms
10 141.101.73.167 (141.101.73.167) 15.709 ms one.one.one.one (1.1.1.1) 13.544 ms 22.883 ms
+386
View File
@@ -0,0 +1,386 @@
{
"time": "2026-09-28T20:31:03.271-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
59.664,
15.605,
14.796
],
"median_ms": 15.605,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 59.664
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 15.605
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 14.796
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
24.877,
17.364,
20.712
],
"median_ms": 20.712,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 24.877
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 17.364
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 20.712
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
17.685,
17.683,
60.693
],
"median_ms": 17.685,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 17.685
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 17.683
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 60.693
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
13.703,
98.781,
37.651
],
"median_ms": 37.651,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.703
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 98.781
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 37.651
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
88.689,
17.543,
21.718
],
"median_ms": 21.718,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 88.689
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.543
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 21.718
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
59.788,
30.692,
16.637
],
"median_ms": 30.692,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 59.788
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 30.692
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 16.637
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
61.781,
14.653,
17.715
],
"median_ms": 17.715,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 61.781
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 14.653
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 17.715
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
17.722,
44.649,
34.724
],
"median_ms": 34.724,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 17.722
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 44.649
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 34.724
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
18.651,
38.304,
23.641
],
"median_ms": 23.641,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.175",
"hostname": null,
"rtt_ms": 18.651
},
{
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 38.304
},
{
"ip": "141.101.73.179",
"hostname": null,
"rtt_ms": 23.641
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
16.623,
19.674,
33.244
],
"median_ms": 19.674,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 16.623
},
{
"ip": "141.101.73.157",
"hostname": null,
"rtt_ms": 19.674
},
{
"ip": "141.101.73.177",
"hostname": null,
"rtt_ms": 33.244
}
]
},
{
"hop": 11,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
16.627,
15.793,
17.695
],
"median_ms": 16.627,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.627
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.793
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 17.695
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203101_861621.txt",
"spike_captured": true,
"spike_limit_ms": 57.5,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 59.664
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 60.693
},
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 98.781
},
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 88.689
},
{
"hop": 6,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 59.788
},
{
"hop": 7,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 61.781
}
],
"spike_probe_count": 6,
"peak_probe_ms": 98.781,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 35
}
+12
View File
@@ -0,0 +1,12 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 59.664 ms 15.605 ms 14.796 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 24.877 ms 17.364 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 20.712 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 17.685 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 17.683 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 60.693 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.703 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 98.781 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 37.651 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 88.689 ms 17.543 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 21.718 ms
6 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 59.788 ms 30.692 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 16.637 ms
7 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 61.781 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 14.653 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 17.715 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 17.722 ms 141.101.73.110 (141.101.73.110) 44.649 ms 34.724 ms
9 141.101.73.175 (141.101.73.175) 18.651 ms 141.101.73.117 (141.101.73.117) 38.304 ms 141.101.73.179 (141.101.73.179) 23.641 ms
10 141.101.73.169 (141.101.73.169) 16.623 ms 141.101.73.157 (141.101.73.157) 19.674 ms 141.101.73.177 (141.101.73.177) 33.244 ms
11 one.one.one.one (1.1.1.1) 16.627 ms 15.793 ms 17.695 ms
+351
View File
@@ -0,0 +1,351 @@
{
"time": "2026-09-28T20:31:07.268-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
11.954,
10.737,
45.783
],
"median_ms": 11.954,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.954
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 10.737
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 45.783
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
11.882,
22.352,
21.192
],
"median_ms": 21.192,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 11.882
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 22.352
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 21.192
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
13.718,
13.594,
24.671
],
"median_ms": 13.718,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 13.718
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.594
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 24.671
}
]
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": [
14.764,
25.135,
16.513
],
"median_ms": 16.513,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 14.764
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 25.135
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 16.513
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
17.733,
15.738,
41.72
],
"median_ms": 17.733,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.733
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 15.738
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 41.72
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
91.848,
61.705,
26.9
],
"median_ms": 61.705,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 91.848
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 61.705
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 26.9
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
17.633,
100.891,
19.667
],
"median_ms": 19.667,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 17.633
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 100.891
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 19.667
}
]
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
16.583,
16.639,
45.666
],
"median_ms": 16.639,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.583
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.639
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 45.666
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
16.631,
152.597,
124.061
],
"median_ms": 124.061,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 16.631
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 152.597
},
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 124.061
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
14.986,
41.645,
18.527
],
"median_ms": 18.527,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 14.986
},
{
"ip": "141.101.73.179",
"hostname": null,
"rtt_ms": 41.645
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 18.527
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203105_862694.txt",
"spike_captured": true,
"spike_limit_ms": 57.9,
"spike_probes": [
{
"hop": 6,
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 91.848
},
{
"hop": 6,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 61.705
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 100.891
},
{
"hop": 9,
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 152.597
},
{
"hop": 9,
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 124.061
}
],
"spike_probe_count": 5,
"peak_probe_ms": 152.597,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 36
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 11.954 ms 10.737 ms 45.783 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 11.882 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 22.352 ms 21.192 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 13.718 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 13.594 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 24.671 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 14.764 ms 25.135 ms 16.513 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 17.733 ms 15.738 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 41.720 ms
6 lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 91.848 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 61.705 ms 26.900 ms
7 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 17.633 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 100.891 ms 19.667 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.583 ms 16.639 ms 45.666 ms
9 141.101.73.111 (141.101.73.111) 16.631 ms 152.597 ms 141.101.73.173 (141.101.73.173) 124.061 ms
10 one.one.one.one (1.1.1.1) 14.986 ms 141.101.73.179 (141.101.73.179) 41.645 ms one.one.one.one (1.1.1.1) 18.527 ms
+357
View File
@@ -0,0 +1,357 @@
{
"time": "2026-09-28T20:31:11.869-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
27.211,
20.007,
55.766
],
"median_ms": 27.211,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 27.211
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 20.007
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 55.766
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
43.04,
122.183,
112.752
],
"median_ms": 112.752,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 43.04
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 122.183
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 112.752
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
18.719,
41.726,
26.665
],
"median_ms": 26.665,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 18.719
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 41.726
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 26.665
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
26.686,
40.765,
33.843
],
"median_ms": 33.843,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 26.686
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 40.765
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 33.843
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
19.687,
26.785,
18.632
],
"median_ms": 19.687,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 19.687
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 26.785
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 18.632
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
389.841,
62.478,
20.394
],
"median_ms": 62.478,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 389.841
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 62.478
},
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 20.394
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
17.145,
20.679,
31.715
],
"median_ms": 20.679,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 17.145
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 20.679
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 31.715
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
19.652,
35.729,
37.664
],
"median_ms": 35.729,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 19.652
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 35.729
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 37.664
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
15.6,
63.582,
25.606
],
"median_ms": 25.606,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 15.6
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 63.582
},
{
"ip": "141.101.73.179",
"hostname": null,
"rtt_ms": 25.606
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
58.427,
17.651,
18.511
],
"median_ms": 18.511,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 58.427
},
{
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 17.651
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 18.511
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203109_864266.txt",
"spike_captured": true,
"spike_limit_ms": 58.1,
"spike_probes": [
{
"hop": 2,
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 122.183
},
{
"hop": 2,
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 112.752
},
{
"hop": 6,
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 389.841
},
{
"hop": 6,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 62.478
},
{
"hop": 9,
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 63.582
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 58.427
}
],
"spike_probe_count": 6,
"peak_probe_ms": 389.841,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 37
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 27.211 ms 20.007 ms 55.766 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 43.040 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 122.183 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 112.752 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 18.719 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 41.726 ms 26.665 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 26.686 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 40.765 ms 33.843 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 19.687 ms 26.785 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 18.632 ms
6 lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 389.841 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 62.478 ms lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 20.394 ms
7 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 17.145 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 20.679 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 31.715 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 19.652 ms 35.729 ms 141.101.73.110 (141.101.73.110) 37.664 ms
9 141.101.73.161 (141.101.73.161) 15.600 ms 141.101.73.111 (141.101.73.111) 63.582 ms 141.101.73.179 (141.101.73.179) 25.606 ms
10 one.one.one.one (1.1.1.1) 58.427 ms 141.101.73.117 (141.101.73.117) 17.651 ms one.one.one.one (1.1.1.1) 18.511 ms
+339
View File
@@ -0,0 +1,339 @@
{
"time": "2026-09-28T20:31:17.074-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
292.387,
101.774,
38.711
],
"median_ms": 101.774,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 292.387
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 101.774
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 38.711
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
38.562,
26.893,
23.757
],
"median_ms": 26.893,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 38.562
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 26.893
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 23.757
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
14.753,
55.78,
15.831
],
"median_ms": 15.831,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 14.753
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 55.78
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 15.831
}
]
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": [
52.707,
11.875,
14.647
],
"median_ms": 14.647,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 52.707
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 11.875
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 14.647
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
35.707,
27.799,
15.771
],
"median_ms": 27.799,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 35.707
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 27.799
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 15.771
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
17.711,
28.835,
25.771
],
"median_ms": 25.771,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.711
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 28.835
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 25.771
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
33.791,
28.764,
13.703
],
"median_ms": 28.764,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 33.791
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 28.764
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 13.703
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
16.649,
211.562
],
"median_ms": 114.1055,
"timeouts": 1,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 16.649
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 211.562
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
27.745,
15.374,
100.957
],
"median_ms": 27.745,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 27.745
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.374
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 100.957
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
33.406,
30.854,
40.632
],
"median_ms": 33.406,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 33.406
},
{
"ip": "141.101.73.127",
"hostname": null,
"rtt_ms": 30.854
},
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 40.632
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203114_864843.txt",
"spike_captured": true,
"spike_limit_ms": 58.15,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 292.387
},
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 101.774
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 211.562
},
{
"hop": 9,
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 100.957
}
],
"spike_probe_count": 4,
"peak_probe_ms": 292.387,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 38
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 292.387 ms 101.774 ms 38.711 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 38.562 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 26.893 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 23.757 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 14.753 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 55.780 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 15.831 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 52.707 ms 11.875 ms 14.647 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 35.707 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 27.799 ms 15.771 ms
6 lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 17.711 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 28.835 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 25.771 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 33.791 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 28.764 ms 13.703 ms
8 141.101.73.110 (141.101.73.110) 16.649 ms * 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 211.562 ms
9 141.101.73.110 (141.101.73.110) 27.745 ms 141.101.73.111 (141.101.73.111) 15.374 ms 141.101.73.110 (141.101.73.110) 100.957 ms
10 one.one.one.one (1.1.1.1) 33.406 ms 141.101.73.127 (141.101.73.127) 30.854 ms 141.101.73.195 (141.101.73.195) 40.632 ms
+369
View File
@@ -0,0 +1,369 @@
{
"time": "2026-09-28T20:31:21.872-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
24.678,
75.963,
43.67
],
"median_ms": 43.67,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 24.678
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 75.963
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 43.67
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
25.705,
100.384,
30.779
],
"median_ms": 30.779,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 25.705
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 100.384
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 30.779
}
]
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": [
99.718,
24.795,
14.573
],
"median_ms": 24.795,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 99.718
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 24.795
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 14.573
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
121.768,
70.822,
64.789
],
"median_ms": 70.822,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 121.768
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 70.822
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 64.789
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
65.677,
43.756,
46.736
],
"median_ms": 46.736,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 65.677
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 43.756
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 46.736
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
52.805,
20.743,
39.833
],
"median_ms": 39.833,
"timeouts": 0,
"probes": [
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 52.805
},
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 20.743
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 39.833
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
225.593,
47.626,
49.782
],
"median_ms": 49.782,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 225.593
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 47.626
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 49.782
}
]
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
24.657,
53.675,
18.77
],
"median_ms": 24.657,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 24.657
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 53.675
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 18.77
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
37.699,
16.589,
22.535
],
"median_ms": 22.535,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 37.699
},
{
"ip": "141.101.73.175",
"hostname": null,
"rtt_ms": 16.589
},
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 22.535
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
30.692,
31.34,
17.703
],
"median_ms": 30.692,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.171",
"hostname": null,
"rtt_ms": 30.692
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 31.34
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 17.703
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203119_866189.txt",
"spike_captured": true,
"spike_limit_ms": 58.25,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 75.963
},
{
"hop": 2,
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 100.384
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 99.718
},
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 121.768
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 70.822
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 64.789
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 65.677
},
{
"hop": 7,
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 225.593
}
],
"spike_probe_count": 8,
"peak_probe_ms": 225.593,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 39
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 24.678 ms 75.963 ms 43.670 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 25.705 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 100.384 ms 30.779 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 99.718 ms 24.795 ms 14.573 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 121.768 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 70.822 ms 64.789 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 65.677 ms 43.756 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 46.736 ms
6 lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 52.805 ms lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 20.743 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 39.833 ms
7 lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 225.593 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 47.626 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 49.782 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 24.657 ms 53.675 ms 18.770 ms
9 141.101.73.169 (141.101.73.169) 37.699 ms 141.101.73.175 (141.101.73.175) 16.589 ms 141.101.73.161 (141.101.73.161) 22.535 ms
10 141.101.73.171 (141.101.73.171) 30.692 ms one.one.one.one (1.1.1.1) 31.340 ms 17.703 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:31:26.275-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
32.437,
14.481,
11.91
],
"median_ms": 14.481,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 32.437
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 14.481
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.91
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
49.695,
50.233,
21.718
],
"median_ms": 49.695,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 49.695
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 50.233
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 21.718
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
17.685,
12.761,
38.666
],
"median_ms": 17.685,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 17.685
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 12.761
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 38.666
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
10.665,
29.729,
33.803
],
"median_ms": 29.729,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 10.665
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 29.729
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 33.803
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
16.629,
135.762,
15.784
],
"median_ms": 16.629,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.629
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 135.762
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 15.784
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
33.609,
38.921,
22.692
],
"median_ms": 33.609,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 33.609
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 38.921
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 22.692
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
16.685,
24.677,
27.906
],
"median_ms": 24.677,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.685
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 24.677
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 27.906
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
48.452,
24.661,
14.748
],
"median_ms": 24.661,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 48.452
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 24.661
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 14.748
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
35.617,
20.179,
40.629
],
"median_ms": 35.617,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 35.617
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 20.179
},
{
"ip": "141.101.73.179",
"hostname": null,
"rtt_ms": 40.629
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
18.557,
20.49,
42.368
],
"median_ms": 20.49,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.127",
"hostname": null,
"rtt_ms": 18.557
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 20.49
},
{
"ip": "141.101.73.149",
"hostname": null,
"rtt_ms": 42.368
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203124_867324.txt",
"spike_captured": true,
"spike_limit_ms": 58.7,
"spike_probes": [
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 135.762
}
],
"spike_probe_count": 1,
"peak_probe_ms": 135.762,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 40
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 32.437 ms 14.481 ms 11.910 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 49.695 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 50.233 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 21.718 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 17.685 ms 12.761 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 38.666 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 10.665 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 29.729 ms 33.803 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 16.629 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 135.762 ms 15.784 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 33.609 ms lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 38.921 ms 22.692 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.685 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 24.677 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 27.906 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 48.452 ms 24.661 ms 141.101.73.111 (141.101.73.111) 14.748 ms
9 141.101.73.111 (141.101.73.111) 35.617 ms 141.101.73.110 (141.101.73.110) 20.179 ms 141.101.73.179 (141.101.73.179) 40.629 ms
10 141.101.73.127 (141.101.73.127) 18.557 ms one.one.one.one (1.1.1.1) 20.490 ms 141.101.73.149 (141.101.73.149) 42.368 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:31:33.076-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
10.682,
111.778,
52.783
],
"median_ms": 52.783,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 10.682
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 111.778
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 52.783
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
45.843,
16.209,
20.166
],
"median_ms": 20.166,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 45.843
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 16.209
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 20.166
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
14.744,
12.664,
15.705
],
"median_ms": 14.744,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 14.744
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 12.664
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 15.705
}
]
},
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": [
15.728,
12.637,
15.755
],
"median_ms": 15.728,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 15.728
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.637
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 15.755
}
]
},
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": [
14.651,
17.7,
18.782
],
"median_ms": 17.7,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 14.651
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.7
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 18.782
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
38.679,
42.767,
27.806
],
"median_ms": 38.679,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 38.679
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 42.767
},
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 27.806
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
27.68,
34.639,
16.699
],
"median_ms": 27.68,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 27.68
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 34.639
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.699
}
]
},
{
"hop": 8,
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": [
16.696,
17.579,
15.788
],
"median_ms": 16.696,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 16.696
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 17.579
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.788
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
24.7,
20.529,
15.736
],
"median_ms": 20.529,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 24.7
},
{
"ip": "141.101.73.127",
"hostname": null,
"rtt_ms": 20.529
},
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 15.736
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
17.493,
17.76,
17.483
],
"median_ms": 17.493,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 17.493
},
{
"ip": "141.101.73.125",
"hostname": null,
"rtt_ms": 17.76
},
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 17.483
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203131_869508.txt",
"spike_captured": true,
"spike_limit_ms": 58.35,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 111.778
}
],
"spike_probe_count": 1,
"peak_probe_ms": 111.778,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 42
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 10.682 ms 111.778 ms 52.783 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 45.843 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 16.209 ms 20.166 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 14.744 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 12.664 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 15.705 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 15.728 ms 12.637 ms 15.755 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 14.651 ms 17.700 ms 18.782 ms
6 lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 38.679 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 42.767 ms lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 27.806 ms
7 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 27.680 ms 34.639 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.699 ms
8 141.101.73.110 (141.101.73.110) 16.696 ms 17.579 ms 15.788 ms
9 141.101.73.110 (141.101.73.110) 24.700 ms 141.101.73.127 (141.101.73.127) 20.529 ms 141.101.73.165 (141.101.73.165) 15.736 ms
10 one.one.one.one (1.1.1.1) 17.493 ms 141.101.73.125 (141.101.73.125) 17.760 ms 141.101.73.173 (141.101.73.173) 17.483 ms
+321
View File
@@ -0,0 +1,321 @@
{
"time": "2026-09-28T20:31:37.479-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
13.419,
65.511,
16.744
],
"median_ms": 16.744,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 13.419
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 65.511
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 16.744
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
19.754,
12.433,
14.024
],
"median_ms": 14.024,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 19.754
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 12.433
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 14.024
}
]
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": [
22.598,
24.865,
29.655
],
"median_ms": 24.865,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 22.598
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 24.865
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 29.655
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
23.574,
12.689,
12.722
],
"median_ms": 12.722,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 23.574
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 12.689
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.722
}
]
},
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": [
17.779,
14.72,
14.764
],
"median_ms": 14.764,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.779
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 14.72
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 14.764
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
18.686,
15.626,
25.82
],
"median_ms": 18.686,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 18.686
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 15.626
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 25.82
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
49.733,
25.648,
14.651
],
"median_ms": 25.648,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 49.733
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 25.648
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 14.651
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
14.713,
15.556,
14.79
],
"median_ms": 14.79,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.713
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.556
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 14.79
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
19.618,
15.699
],
"median_ms": 17.6585,
"timeouts": 1,
"probes": [
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 19.618
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.699
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
20.002,
27.919,
37.537
],
"median_ms": 27.919,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 20.002
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 27.919
},
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 37.537
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203135_870042.txt",
"spike_captured": true,
"spike_limit_ms": 58.65,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 65.511
}
],
"spike_probe_count": 1,
"peak_probe_ms": 65.511,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 43
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 13.419 ms 65.511 ms 16.744 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 19.754 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 12.433 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 14.024 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 22.598 ms 24.865 ms 29.655 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 23.574 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 12.689 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 12.722 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 17.779 ms 14.720 ms 14.764 ms
6 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 18.686 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 15.626 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 25.820 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 49.733 ms 25.648 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 14.651 ms
8 141.101.73.110 (141.101.73.110) 14.713 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.556 ms 141.101.73.111 (141.101.73.111) 14.790 ms
9 141.101.73.165 (141.101.73.165) 19.618 ms 141.101.73.110 (141.101.73.110) 15.699 ms *
10 one.one.one.one (1.1.1.1) 20.002 ms 27.919 ms 141.101.73.161 (141.101.73.161) 37.537 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:31:40.876-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
15.227,
10.866,
10.74
],
"median_ms": 10.866,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 15.227
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 10.866
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 10.74
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
12.68,
10.743,
9.798
],
"median_ms": 10.743,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 12.68
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 10.743
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 9.798
}
]
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": [
13.04,
12.898,
12.644
],
"median_ms": 12.898,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 13.04
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 12.898
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 12.644
}
]
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": [
13.557,
13.076,
13.45
],
"median_ms": 13.45,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.557
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.076
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.45
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
16.769,
16.633,
17.481
],
"median_ms": 16.769,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.769
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.633
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.481
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
26.948,
14.821,
24.731
],
"median_ms": 24.731,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 26.948
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 14.821
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 24.731
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
15.864,
18.705,
14.727
],
"median_ms": 15.864,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 15.864
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 18.705
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 14.727
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
23.896,
56.572,
14.688
],
"median_ms": 23.896,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 23.896
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 56.572
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.688
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
64.597,
18.543,
15.631
],
"median_ms": 18.543,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 64.597
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 18.543
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.631
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
43.639,
17.61,
17.758
],
"median_ms": 17.758,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.177",
"hostname": null,
"rtt_ms": 43.639
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 17.61
},
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 17.758
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203139_871486.txt",
"spike_captured": true,
"spike_limit_ms": 58.95,
"spike_probes": [
{
"hop": 9,
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 64.597
}
],
"spike_probe_count": 1,
"peak_probe_ms": 64.597,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 44
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 15.227 ms 10.866 ms 10.740 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 12.680 ms 10.743 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 9.798 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 13.040 ms 12.898 ms 12.644 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.557 ms 13.076 ms 13.450 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 16.769 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 16.633 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 17.481 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 26.948 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 14.821 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 24.731 ms
7 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 15.864 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 18.705 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 14.727 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 23.896 ms 56.572 ms 141.101.73.110 (141.101.73.110) 14.688 ms
9 141.101.73.111 (141.101.73.111) 64.597 ms 141.101.73.110 (141.101.73.110) 18.543 ms 141.101.73.111 (141.101.73.111) 15.631 ms
10 141.101.73.177 (141.101.73.177) 43.639 ms one.one.one.one (1.1.1.1) 17.610 ms 141.101.73.195 (141.101.73.195) 17.758 ms
+363
View File
@@ -0,0 +1,363 @@
{
"time": "2026-09-28T20:31:50.282-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
25.26,
22.708,
146.867
],
"median_ms": 25.26,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 25.26
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 22.708
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 146.867
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
16.768,
289.054,
314.749
],
"median_ms": 289.054,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 16.768
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 289.054
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 314.749
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
31.897,
16.671,
26.65
],
"median_ms": 26.65,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 31.897
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 16.671
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 26.65
}
]
},
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": [
50.664,
27.691,
8.989
],
"median_ms": 27.691,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 50.664
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 27.691
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 8.989
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
377.86,
217.707,
16.658
],
"median_ms": 217.707,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 377.86
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 217.707
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.658
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
66.757,
17.737,
16.759
],
"median_ms": 17.737,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 66.757
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 17.737
},
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.759
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
34.792,
86.729,
24.675
],
"median_ms": 34.792,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 34.792
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 86.729
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 24.675
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
17.731,
47.616,
36.578
],
"median_ms": 36.578,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 17.731
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 47.616
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 36.578
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
18.378,
46.638,
14.522
],
"median_ms": 18.378,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.175",
"hostname": null,
"rtt_ms": 18.378
},
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 46.638
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.522
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
14.896,
15.806,
14.653
],
"median_ms": 14.896,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.149",
"hostname": null,
"rtt_ms": 14.896
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.806
},
{
"ip": "141.101.73.147",
"hostname": null,
"rtt_ms": 14.653
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203147_872876.txt",
"spike_captured": true,
"spike_limit_ms": 59.1,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 146.867
},
{
"hop": 2,
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 289.054
},
{
"hop": 2,
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 314.749
},
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 377.86
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 217.707
},
{
"hop": 6,
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 66.757
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 86.729
}
],
"spike_probe_count": 7,
"peak_probe_ms": 377.86,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 46
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 25.260 ms 22.708 ms 146.867 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 16.768 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 289.054 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 314.749 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 31.897 ms 16.671 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 26.650 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 50.664 ms 27.691 ms 8.989 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 377.860 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 217.707 ms 16.658 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 66.757 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 17.737 ms lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 16.759 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 34.792 ms 86.729 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 24.675 ms
8 141.101.73.111 (141.101.73.111) 17.731 ms 47.616 ms 141.101.73.110 (141.101.73.110) 36.578 ms
9 141.101.73.175 (141.101.73.175) 18.378 ms 141.101.73.165 (141.101.73.165) 46.638 ms 141.101.73.110 (141.101.73.110) 14.522 ms
10 141.101.73.149 (141.101.73.149) 14.896 ms one.one.one.one (1.1.1.1) 15.806 ms 141.101.73.147 (141.101.73.147) 14.653 ms
+363
View File
@@ -0,0 +1,363 @@
{
"time": "2026-09-28T20:31:54.880-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
32.375,
15.29,
64.731
],
"median_ms": 32.375,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 32.375
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 15.29
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 64.731
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
19.812,
13.997,
12.152
],
"median_ms": 13.997,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 19.812
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 13.997
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 12.152
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
22.886,
16.49,
13.805
],
"median_ms": 16.49,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 22.886
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 16.49
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.805
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
25.665,
14.717,
14.661
],
"median_ms": 14.717,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 25.665
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 14.717
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 14.661
}
]
},
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": [
16.799,
16.737,
15.634
],
"median_ms": 16.737,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.799
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.737
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 15.634
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
14.565,
15.591,
14.942
],
"median_ms": 14.942,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 14.565
},
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 15.591
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 14.942
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
21.949,
18.774,
30.758
],
"median_ms": 21.949,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 21.949
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 18.774
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 30.758
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
47.781,
118.806,
255.919
],
"median_ms": 118.806,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 47.781
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 118.806
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 255.919
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
163.139,
280.769,
77.529
],
"median_ms": 163.139,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 163.139
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 280.769
},
{
"ip": "141.101.73.125",
"hostname": null,
"rtt_ms": 77.529
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
26.606,
43.696,
84.741
],
"median_ms": 43.696,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 26.606
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 43.696
},
{
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 84.741
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203152_874626.txt",
"spike_captured": true,
"spike_limit_ms": 59.1,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 64.731
},
{
"hop": 8,
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 118.806
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 255.919
},
{
"hop": 9,
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 163.139
},
{
"hop": 9,
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 280.769
},
{
"hop": 9,
"ip": "141.101.73.125",
"hostname": null,
"rtt_ms": 77.529
},
{
"hop": 10,
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 84.741
}
],
"spike_probe_count": 7,
"peak_probe_ms": 280.769,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 47
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 32.375 ms 15.290 ms 64.731 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 19.812 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 13.997 ms 12.152 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 22.886 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 16.490 ms 13.805 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 25.665 ms 14.717 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 14.661 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 16.799 ms 16.737 ms 15.634 ms
6 lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 14.565 ms lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 15.591 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 14.942 ms
7 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 21.949 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 18.774 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 30.758 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 47.781 ms 141.101.73.110 (141.101.73.110) 118.806 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 255.919 ms
9 141.101.73.161 (141.101.73.161) 163.139 ms 141.101.73.110 (141.101.73.110) 280.769 ms 141.101.73.125 (141.101.73.125) 77.529 ms
10 one.one.one.one (1.1.1.1) 26.606 ms 43.696 ms 141.101.73.117 (141.101.73.117) 84.741 ms
+387
View File
@@ -0,0 +1,387 @@
{
"time": "2026-09-28T20:32:01.686-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
26.213,
14.514,
21.843
],
"median_ms": 21.843,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 26.213
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 14.514
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 21.843
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
7.738,
35.125,
15.785
],
"median_ms": 15.785,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 7.738
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 35.125
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 15.785
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
18.865,
122.13
],
"median_ms": 70.4975,
"timeouts": 1,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 18.865
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 122.13
}
]
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": [
21.846,
24.956,
27.514
],
"median_ms": 24.956,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 21.846
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 24.956
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 27.514
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
20.731,
27.552,
58.845
],
"median_ms": 27.552,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 20.731
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 27.552
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 58.845
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
420.029,
363.766,
184.757
],
"median_ms": 363.766,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 420.029
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 363.766
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 184.757
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
66.383,
18.688,
63.675
],
"median_ms": 63.675,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 66.383
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 18.688
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 63.675
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
244.757,
158.691,
178.627
],
"median_ms": 178.627,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 244.757
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 158.691
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 178.627
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
37.999,
29.76,
113.611
],
"median_ms": 37.999,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.175",
"hostname": null,
"rtt_ms": 37.999
},
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 29.76
},
{
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 113.611
}
]
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
51.554,
73.878,
184.442
],
"median_ms": 73.878,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 51.554
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 73.878
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 184.442
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203157_875238.txt",
"spike_captured": true,
"spike_limit_ms": 59.75,
"spike_probes": [
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 122.13
},
{
"hop": 6,
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 420.029
},
{
"hop": 6,
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 363.766
},
{
"hop": 6,
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 184.757
},
{
"hop": 7,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 66.383
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 63.675
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 244.757
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 158.691
},
{
"hop": 8,
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 178.627
},
{
"hop": 9,
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 113.611
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 73.878
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 184.442
}
],
"spike_probe_count": 12,
"peak_probe_ms": 420.029,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 48
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 26.213 ms 14.514 ms 21.843 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 7.738 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 35.125 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 15.785 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 18.865 ms * lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 122.130 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 21.846 ms 24.956 ms 27.514 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 20.731 ms 27.552 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 58.845 ms
6 lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 420.029 ms lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 363.766 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 184.757 ms
7 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 66.383 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 18.688 ms 63.675 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 244.757 ms 158.691 ms 141.101.73.110 (141.101.73.110) 178.627 ms
9 141.101.73.175 (141.101.73.175) 37.999 ms 141.101.73.173 (141.101.73.173) 29.760 ms 141.101.73.169 (141.101.73.169) 113.611 ms
10 one.one.one.one (1.1.1.1) 51.554 ms 73.878 ms 184.442 ms
+363
View File
@@ -0,0 +1,363 @@
{
"time": "2026-09-28T20:32:06.287-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
13.745,
15.707,
55.985
],
"median_ms": 15.707,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 13.745
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 15.707
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 55.985
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
37.713,
319.511,
127.73
],
"median_ms": 127.73,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 37.713
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 319.511
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 127.73
}
]
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": [
18.791,
19.01,
15.562
],
"median_ms": 18.791,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 18.791
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 19.01
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 15.562
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
43.702,
16.855,
38.622
],
"median_ms": 38.622,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 43.702
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 16.855
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 38.622
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
19.005,
19.816,
24.647
],
"median_ms": 19.816,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 19.005
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 19.816
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 24.647
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
27.78,
93.838,
28.754
],
"median_ms": 28.754,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 27.78
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 93.838
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 28.754
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
51.053,
62.37,
19.634
],
"median_ms": 51.053,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 51.053
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 62.37
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 19.634
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
91.806,
113.707,
35.628
],
"median_ms": 91.806,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 91.806
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 113.707
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 35.628
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
15.728,
37.778,
17.583
],
"median_ms": 17.583,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.159",
"hostname": null,
"rtt_ms": 15.728
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 37.778
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 17.583
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
156.363,
19.273,
44.563
],
"median_ms": 44.563,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 156.363
},
{
"ip": "141.101.73.163",
"hostname": null,
"rtt_ms": 19.273
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 44.563
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203203_876772.txt",
"spike_captured": true,
"spike_limit_ms": 60.300000000000004,
"spike_probes": [
{
"hop": 2,
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 319.511
},
{
"hop": 2,
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 127.73
},
{
"hop": 6,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 93.838
},
{
"hop": 7,
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 62.37
},
{
"hop": 8,
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 91.806
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 113.707
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 156.363
}
],
"spike_probe_count": 7,
"peak_probe_ms": 319.511,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 49
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 13.745 ms 15.707 ms 55.985 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 37.713 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 319.511 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 127.730 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 18.791 ms 19.010 ms 15.562 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 43.702 ms 16.855 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 38.622 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 19.005 ms 19.816 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 24.647 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 27.780 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 93.838 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 28.754 ms
7 lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 51.053 ms 62.370 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 19.634 ms
8 141.101.73.110 (141.101.73.110) 91.806 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 113.707 ms 35.628 ms
9 141.101.73.159 (141.101.73.159) 15.728 ms 141.101.73.111 (141.101.73.111) 37.778 ms 141.101.73.110 (141.101.73.110) 17.583 ms
10 one.one.one.one (1.1.1.1) 156.363 ms 141.101.73.163 (141.101.73.163) 19.273 ms one.one.one.one (1.1.1.1) 44.563 ms
+345
View File
@@ -0,0 +1,345 @@
{
"time": "2026-09-28T20:32:20.089-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
34.604,
54.059,
12.719
],
"median_ms": 34.604,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 34.604
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 54.059
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.719
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
151.953,
36.523,
34.759
],
"median_ms": 36.523,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 151.953
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 36.523
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 34.759
}
]
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": [
18.729,
49.903,
15.559
],
"median_ms": 18.729,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 18.729
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 49.903
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 15.559
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
42.712,
34.763,
49.664
],
"median_ms": 42.712,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 42.712
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 34.763
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 49.664
}
]
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": [
489.837,
42.485,
58.649
],
"median_ms": 58.649,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 489.837
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 42.485
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 58.649
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
63.621,
46.816,
24.638
],
"median_ms": 46.816,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 63.621
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 46.816
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 24.638
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
32.825,
215.789,
54.684
],
"median_ms": 54.684,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 32.825
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 215.789
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 54.684
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
19.846,
23.656,
25.697
],
"median_ms": 23.656,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 19.846
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 23.656
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 25.697
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
32.628,
36.581,
15.617
],
"median_ms": 32.628,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.163",
"hostname": null,
"rtt_ms": 32.628
},
{
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 36.581
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.617
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
33.553,
24.367,
18.603
],
"median_ms": 24.367,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.175",
"hostname": null,
"rtt_ms": 33.553
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 24.367
},
{
"ip": "141.101.73.157",
"hostname": null,
"rtt_ms": 18.603
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203217_880219.txt",
"spike_captured": true,
"spike_limit_ms": 59.45,
"spike_probes": [
{
"hop": 2,
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 151.953
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 489.837
},
{
"hop": 6,
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 63.621
},
{
"hop": 7,
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 215.789
}
],
"spike_probe_count": 4,
"peak_probe_ms": 489.837,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 53
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 34.604 ms 54.059 ms 12.719 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 151.953 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 36.523 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 34.759 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 18.729 ms 49.903 ms 15.559 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 42.712 ms 34.763 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 49.664 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 489.837 ms 42.485 ms 58.649 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 63.621 ms 46.816 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 24.638 ms
7 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 32.825 ms 215.789 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 54.684 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 19.846 ms 23.656 ms 141.101.73.111 (141.101.73.111) 25.697 ms
9 141.101.73.163 (141.101.73.163) 32.628 ms 141.101.73.117 (141.101.73.117) 36.581 ms 141.101.73.110 (141.101.73.110) 15.617 ms
10 141.101.73.175 (141.101.73.175) 33.553 ms one.one.one.one (1.1.1.1) 24.367 ms 141.101.73.157 (141.101.73.157) 18.603 ms
+393
View File
@@ -0,0 +1,393 @@
{
"time": "2026-09-28T20:32:30.494-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
27.601,
42.138,
46.83
],
"median_ms": 42.138,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 27.601
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 42.138
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 46.83
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
19.877,
145.381,
14.717
],
"median_ms": 19.877,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 19.877
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 145.381
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 14.717
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
22.76,
156.8,
219.665
],
"median_ms": 156.8,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 22.76
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 156.8
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 219.665
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
129.825,
31.775,
67.834
],
"median_ms": 67.834,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 129.825
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 31.775
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 67.834
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
26.754,
29.764,
383.531
],
"median_ms": 29.764,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 26.754
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 29.764
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 383.531
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
34.582,
15.737,
26.746
],
"median_ms": 26.746,
"timeouts": 0,
"probes": [
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 34.582
},
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 15.737
},
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 26.746
}
]
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
235.682,
240.666,
89.081
],
"median_ms": 235.682,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 235.682
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 240.666
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 89.081
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
28.324,
31.617,
102.747
],
"median_ms": 31.617,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 28.324
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 31.617
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 102.747
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
57.586,
24.667,
29.553
],
"median_ms": 29.553,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 57.586
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 24.667
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 29.553
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
20.634,
68.127,
152.57
],
"median_ms": 68.127,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 20.634
},
{
"ip": "141.101.73.147",
"hostname": null,
"rtt_ms": 68.127
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 152.57
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203226_882335.txt",
"spike_captured": true,
"spike_limit_ms": 59.0,
"spike_probes": [
{
"hop": 2,
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 145.381
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 156.8
},
{
"hop": 3,
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 219.665
},
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 129.825
},
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 67.834
},
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 383.531
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 235.682
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 240.666
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 89.081
},
{
"hop": 8,
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 102.747
},
{
"hop": 10,
"ip": "141.101.73.147",
"hostname": null,
"rtt_ms": 68.127
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 152.57
}
],
"spike_probe_count": 12,
"peak_probe_ms": 383.531,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 55
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 27.601 ms 42.138 ms 46.830 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 19.877 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 145.381 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 14.717 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 22.760 ms 156.800 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 219.665 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 129.825 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 31.775 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 67.834 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 26.754 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 29.764 ms 383.531 ms
6 lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 34.582 ms lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 15.737 ms lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 26.746 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 235.682 ms 240.666 ms 89.081 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 28.324 ms 31.617 ms 141.101.73.110 (141.101.73.110) 102.747 ms
9 141.101.73.161 (141.101.73.161) 57.586 ms 141.101.73.110 (141.101.73.110) 24.667 ms 141.101.73.111 (141.101.73.111) 29.553 ms
10 141.101.73.173 (141.101.73.173) 20.634 ms 141.101.73.147 (141.101.73.147) 68.127 ms one.one.one.one (1.1.1.1) 152.570 ms
+381
View File
@@ -0,0 +1,381 @@
{
"time": "2026-09-28T20:32:35.094-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
65.288,
23.372,
14.855
],
"median_ms": 23.372,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 65.288
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 23.372
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 14.855
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
35.83,
11.998,
16.814
],
"median_ms": 16.814,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 35.83
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 11.998
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 16.814
}
]
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": [
24.622,
16.724,
22.858
],
"median_ms": 22.858,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 24.622
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 16.724
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 22.858
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
105.598,
167.877,
129.712
],
"median_ms": 129.712,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 105.598
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 167.877
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 129.712
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
29.794,
370.797,
63.465
],
"median_ms": 63.465,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 29.794
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 370.797
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 63.465
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
75.822,
20.688,
18.776
],
"median_ms": 20.688,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 75.822
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 20.688
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 18.776
}
]
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
260.06,
18.502,
24.888
],
"median_ms": 24.888,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 260.06
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 18.502
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 24.888
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
138.538,
61.869,
19.606
],
"median_ms": 61.869,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 138.538
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 61.869
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 19.606
}
]
},
{
"hop": 9,
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": [
15.787,
17.77,
53.593
],
"median_ms": 17.77,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.787
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 17.77
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 53.593
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
35.709,
28.688,
53.626
],
"median_ms": 35.709,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 35.709
},
{
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 28.688
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 53.626
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203232_883843.txt",
"spike_captured": true,
"spike_limit_ms": 59.1,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 65.288
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 105.598
},
{
"hop": 4,
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 167.877
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 129.712
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 370.797
},
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 63.465
},
{
"hop": 6,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 75.822
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 260.06
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 138.538
},
{
"hop": 8,
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 61.869
}
],
"spike_probe_count": 10,
"peak_probe_ms": 370.797,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 56
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 65.288 ms 23.372 ms 14.855 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 35.830 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 11.998 ms 16.814 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 24.622 ms 16.724 ms 22.858 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 105.598 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 167.877 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 129.712 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 29.794 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 370.797 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 63.465 ms
6 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 75.822 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 20.688 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 18.776 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 260.060 ms 18.502 ms 24.888 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 138.538 ms 141.101.73.110 (141.101.73.110) 61.869 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 19.606 ms
9 141.101.73.111 (141.101.73.111) 15.787 ms 17.770 ms 53.593 ms
10 one.one.one.one (1.1.1.1) 35.709 ms 141.101.73.169 (141.101.73.169) 28.688 ms one.one.one.one (1.1.1.1) 53.626 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:32:45.892-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
11.671,
33.155,
20.894
],
"median_ms": 20.894,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.671
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 33.155
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 20.894
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
13.675,
11.59,
11.804
],
"median_ms": 11.804,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 13.675
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 11.59
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 11.804
}
]
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": [
13.194,
15.279,
20.712
],
"median_ms": 15.279,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 13.194
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 15.279
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 20.712
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
14.721,
15.823,
13.865
],
"median_ms": 14.721,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 14.721
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 15.823
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.865
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
30.858,
17.05,
17.771
],
"median_ms": 17.771,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 30.858
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.05
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 17.771
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
12.829,
18.675,
16.731
],
"median_ms": 16.731,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 12.829
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 18.675
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 16.731
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
16.705,
15.827,
16.785
],
"median_ms": 16.705,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 16.705
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.827
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.785
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
14.695,
73.63,
29.715
],
"median_ms": 29.715,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.695
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 73.63
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 29.715
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
14.682,
14.669,
15.682
],
"median_ms": 14.682,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 14.682
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 14.669
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.682
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
19.642,
15.51,
17.801
],
"median_ms": 17.801,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 19.642
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.51
},
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 17.801
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203244_886967.txt",
"spike_captured": true,
"spike_limit_ms": 58.4,
"spike_probes": [
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 73.63
}
],
"spike_probe_count": 1,
"peak_probe_ms": 73.63,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 59
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 11.671 ms 33.155 ms 20.894 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 13.675 ms 11.590 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 11.804 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 13.194 ms 15.279 ms 20.712 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 14.721 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 15.823 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 13.865 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 30.858 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 17.050 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 17.771 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 12.829 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 18.675 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 16.731 ms
7 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 16.705 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.827 ms 16.785 ms
8 141.101.73.110 (141.101.73.110) 14.695 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 73.630 ms 29.715 ms
9 141.101.73.111 (141.101.73.111) 14.682 ms 14.669 ms 141.101.73.110 (141.101.73.110) 15.682 ms
10 141.101.73.165 (141.101.73.165) 19.642 ms one.one.one.one (1.1.1.1) 15.510 ms 141.101.73.195 (141.101.73.195) 17.801 ms
+333
View File
@@ -0,0 +1,333 @@
{
"time": "2026-09-28T20:33:07.101-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
13.904,
9.95,
11.863
],
"median_ms": 11.863,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 13.904
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 9.95
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.863
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
29.876,
11.642,
13.267
],
"median_ms": 13.267,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 29.876
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 11.642
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 13.267
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
22.762,
12.665,
14.785
],
"median_ms": 14.785,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 22.762
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 12.665
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 14.785
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
12.808,
13.784,
23.001
],
"median_ms": 13.784,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.808
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.784
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 23.001
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
16.604,
16.28,
19.5
],
"median_ms": 16.604,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.604
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.28
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 19.5
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
40.712,
101.749,
19.78
],
"median_ms": 40.712,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 40.712
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 101.749
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 19.78
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
52.801,
167.769,
46.687
],
"median_ms": 52.801,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 52.801
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 167.769
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 46.687
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
17.758,
27.749,
24.672
],
"median_ms": 24.672,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 17.758
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 27.749
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 24.672
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
14.618,
15.592,
28.354
],
"median_ms": 15.592,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 14.618
},
{
"ip": "141.101.73.127",
"hostname": null,
"rtt_ms": 15.592
},
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 28.354
}
]
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
33.62,
15.734,
15.682
],
"median_ms": 15.734,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 33.62
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.734
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.682
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203305_892619.txt",
"spike_captured": true,
"spike_limit_ms": 57.35,
"spike_probes": [
{
"hop": 6,
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 101.749
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 167.769
}
],
"spike_probe_count": 2,
"peak_probe_ms": 167.769,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 65
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 13.904 ms 9.950 ms 11.863 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 29.876 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 11.642 ms 13.267 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 22.762 ms 12.665 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 14.785 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 12.808 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.784 ms 23.001 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 16.604 ms 16.280 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 19.500 ms
6 lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 40.712 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 101.749 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 19.780 ms
7 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 52.801 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 167.769 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 46.687 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 17.758 ms 141.101.73.111 (141.101.73.111) 27.749 ms 141.101.73.110 (141.101.73.110) 24.672 ms
9 141.101.73.161 (141.101.73.161) 14.618 ms 141.101.73.127 (141.101.73.127) 15.592 ms 141.101.73.173 (141.101.73.173) 28.354 ms
10 one.one.one.one (1.1.1.1) 33.620 ms 15.734 ms 15.682 ms
+333
View File
@@ -0,0 +1,333 @@
{
"time": "2026-09-28T20:33:10.898-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
78.884,
11.973,
13.85
],
"median_ms": 13.85,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 78.884
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.973
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 13.85
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
11.971,
8.727,
15.246
],
"median_ms": 11.971,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 11.971
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 8.727
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 15.246
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
32.724,
27.397,
24.821
],
"median_ms": 27.397,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 32.724
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 27.397
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 24.821
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
30.692,
14.833,
22.656
],
"median_ms": 22.656,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 30.692
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 14.833
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 22.656
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
17.834,
51.861,
36.783
],
"median_ms": 36.783,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.834
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 51.861
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 36.783
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
17.657,
24.8,
14.801
],
"median_ms": 17.657,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 17.657
},
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 24.8
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 14.801
}
]
},
{
"hop": 7,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": [
31.048,
71.585,
16.837
],
"median_ms": 31.048,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 31.048
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 71.585
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 16.837
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
17.498,
16.726,
14.746
],
"median_ms": 16.726,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 17.498
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.726
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.746
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
26.663,
14.615,
17.666
],
"median_ms": 17.666,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.179",
"hostname": null,
"rtt_ms": 26.663
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.615
},
{
"ip": "141.101.73.177",
"hostname": null,
"rtt_ms": 17.666
}
]
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
15.536,
17.754,
18.822
],
"median_ms": 17.754,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.536
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 17.754
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 18.822
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203309_893076.txt",
"spike_captured": true,
"spike_limit_ms": 57.2,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 78.884
},
{
"hop": 7,
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 71.585
}
],
"spike_probe_count": 2,
"peak_probe_ms": 78.884,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 66
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 78.884 ms 11.973 ms 13.850 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 11.971 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 8.727 ms 15.246 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 32.724 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 27.397 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 24.821 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 30.692 ms 14.833 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 22.656 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 17.834 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 51.861 ms 36.783 ms
6 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 17.657 ms lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 24.800 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 14.801 ms
7 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 31.048 ms 71.585 ms 16.837 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 17.498 ms 16.726 ms 141.101.73.110 (141.101.73.110) 14.746 ms
9 141.101.73.179 (141.101.73.179) 26.663 ms 141.101.73.110 (141.101.73.110) 14.615 ms 141.101.73.177 (141.101.73.177) 17.666 ms
10 one.one.one.one (1.1.1.1) 15.536 ms 17.754 ms 18.822 ms
+333
View File
@@ -0,0 +1,333 @@
{
"time": "2026-09-28T20:33:17.901-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
12.763,
11.69,
11.932
],
"median_ms": 11.932,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.763
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.69
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.932
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
10.79,
10.525,
18.505
],
"median_ms": 10.79,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 10.79
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 10.525
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 18.505
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
12.881,
11.9,
12.884
],
"median_ms": 12.881,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 12.881
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 11.9
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 12.884
}
]
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": [
12.967,
21.875,
13.65
],
"median_ms": 13.65,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 12.967
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 21.875
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.65
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
16.879,
16.557,
14.798
],
"median_ms": 16.557,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.879
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.557
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 14.798
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
17.793,
14.663,
24.414
],
"median_ms": 17.793,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.793
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 14.663
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 24.414
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
113.05,
46.685,
15.652
],
"median_ms": 46.685,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 113.05
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 46.685
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 15.652
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
13.716,
15.633,
15.708
],
"median_ms": 15.633,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 13.716
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.633
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.708
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
16.77,
15.615,
84.621
],
"median_ms": 16.77,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.173",
"hostname": null,
"rtt_ms": 16.77
},
{
"ip": "141.101.73.171",
"hostname": null,
"rtt_ms": 15.615
},
{
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 84.621
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
14.613,
16.861,
15.575
],
"median_ms": 15.575,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 14.613
},
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 16.861
},
{
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 15.575
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203316_894675.txt",
"spike_captured": true,
"spike_limit_ms": 57.1,
"spike_probes": [
{
"hop": 7,
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 113.05
},
{
"hop": 9,
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 84.621
}
],
"spike_probe_count": 2,
"peak_probe_ms": 113.05,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 68
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 12.763 ms 11.690 ms 11.932 ms
2 syn-076-057-161-112.res.spectrum.com (76.57.161.112) 10.790 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 10.525 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 18.505 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 12.881 ms 11.900 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 12.884 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 12.967 ms 21.875 ms 13.650 ms
5 lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 16.879 ms lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 16.557 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 14.798 ms
6 lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 17.793 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 14.663 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 24.414 ms
7 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 113.050 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 46.685 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 15.652 ms
8 141.101.73.110 (141.101.73.110) 13.716 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.633 ms 141.101.73.111 (141.101.73.111) 15.708 ms
9 141.101.73.173 (141.101.73.173) 16.770 ms 141.101.73.171 (141.101.73.171) 15.615 ms 141.101.73.117 (141.101.73.117) 84.621 ms
10 one.one.one.one (1.1.1.1) 14.613 ms 141.101.73.195 (141.101.73.195) 16.861 ms 141.101.73.169 (141.101.73.169) 15.575 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:33:21.901-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
19.271,
9.73,
10.859
],
"median_ms": 10.859,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 19.271
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 9.73
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 10.859
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
13.919,
10.848,
13.431
],
"median_ms": 13.431,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 13.919
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 10.848
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 13.431
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
15.516,
12.176,
15.774
],
"median_ms": 15.516,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 15.516
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 12.176
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 15.774
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
12.699,
11.784,
22.912
],
"median_ms": 12.699,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.699
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 11.784
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 22.912
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
23.775,
17.936,
31.721
],
"median_ms": 23.775,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 23.775
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.936
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 31.721
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
74.797,
15.805,
26.936
],
"median_ms": 26.936,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 74.797
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 15.805
},
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 26.936
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
16.644,
42.816,
17.644
],
"median_ms": 17.644,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.644
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 42.816
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 17.644
}
]
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
16.761,
15.831,
16.748
],
"median_ms": 16.748,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.761
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.831
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.748
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
15.725,
16.605,
15.537
],
"median_ms": 15.725,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.725
},
{
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 16.605
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.537
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
16.62,
32.638,
15.741
],
"median_ms": 16.62,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.167",
"hostname": null,
"rtt_ms": 16.62
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 32.638
},
{
"ip": "141.101.73.125",
"hostname": null,
"rtt_ms": 15.741
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203320_895607.txt",
"spike_captured": true,
"spike_limit_ms": 57.1,
"spike_probes": [
{
"hop": 6,
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 74.797
}
],
"spike_probe_count": 1,
"peak_probe_ms": 74.797,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 69
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 19.271 ms 9.730 ms 10.859 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 13.919 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 10.848 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 13.431 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 15.516 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 12.176 ms 15.774 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 12.699 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 11.784 ms 22.912 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 23.775 ms 17.936 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 31.721 ms
6 lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 74.797 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 15.805 ms lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 26.936 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.644 ms 42.816 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 17.644 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.761 ms 15.831 ms 16.748 ms
9 141.101.73.111 (141.101.73.111) 15.725 ms 141.101.73.169 (141.101.73.169) 16.605 ms 141.101.73.111 (141.101.73.111) 15.537 ms
10 141.101.73.167 (141.101.73.167) 16.620 ms one.one.one.one (1.1.1.1) 32.638 ms 141.101.73.125 (141.101.73.125) 15.741 ms
+333
View File
@@ -0,0 +1,333 @@
{
"time": "2026-09-28T20:33:33.107-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
12.679,
11.641,
11.977
],
"median_ms": 11.977,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.679
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.641
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.977
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
12.781,
11.848,
23.003
],
"median_ms": 12.781,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 12.781
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 11.848
},
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 23.003
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
13.016,
24.666,
15.688
],
"median_ms": 15.688,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.016
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 24.666
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 15.688
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
34.65,
12.931,
13.836
],
"median_ms": 13.836,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 34.65
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 12.931
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.836
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
17.612,
36.901,
16.705
],
"median_ms": 17.612,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.612
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 36.901
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.705
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
18.699,
14.836,
58.731
],
"median_ms": 18.699,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 18.699
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 14.836
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 58.731
}
]
},
{
"hop": 7,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": [
14.694,
27.818,
16.674
],
"median_ms": 16.674,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 14.694
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 27.818
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.674
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
41.706,
30.745,
44.673
],
"median_ms": 41.706,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 41.706
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 30.745
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 44.673
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
16.639,
23.582,
54.892
],
"median_ms": 23.582,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.157",
"hostname": null,
"rtt_ms": 16.639
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 23.582
},
{
"ip": "141.101.73.167",
"hostname": null,
"rtt_ms": 54.892
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
16.59,
66.467,
37.515
],
"median_ms": 37.515,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.165",
"hostname": null,
"rtt_ms": 16.59
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 66.467
},
{
"ip": "141.101.73.127",
"hostname": null,
"rtt_ms": 37.515
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203331_898300.txt",
"spike_captured": true,
"spike_limit_ms": 56.8,
"spike_probes": [
{
"hop": 6,
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 58.731
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 66.467
}
],
"spike_probe_count": 2,
"peak_probe_ms": 66.467,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 72
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 12.679 ms 11.641 ms 11.977 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 12.781 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 11.848 ms syn-076-057-161-108.res.spectrum.com (76.57.161.108) 23.003 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 13.016 ms 24.666 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 15.688 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 34.650 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 12.931 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.836 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 17.612 ms 36.901 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 16.705 ms
6 lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 18.699 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 14.836 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 58.731 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 14.694 ms 27.818 ms 16.674 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 41.706 ms 30.745 ms 141.101.73.110 (141.101.73.110) 44.673 ms
9 141.101.73.157 (141.101.73.157) 16.639 ms 141.101.73.110 (141.101.73.110) 23.582 ms 141.101.73.167 (141.101.73.167) 54.892 ms
10 141.101.73.165 (141.101.73.165) 16.590 ms one.one.one.one (1.1.1.1) 66.467 ms 141.101.73.127 (141.101.73.127) 37.515 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:33:36.904-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
14.302,
18.026,
9.958
],
"median_ms": 14.302,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 14.302
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 18.026
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 9.958
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
11.686,
11.992,
13.318
],
"median_ms": 11.992,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 11.686
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 11.992
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 13.318
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
23.777,
14.721,
13.925
],
"median_ms": 14.721,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 23.777
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 14.721
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 13.925
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
13.426,
26.661,
13.755
],
"median_ms": 13.755,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.426
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 26.661
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.755
}
]
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": [
27.994,
17.792,
17.749
],
"median_ms": 17.792,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 27.994
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.792
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.749
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
12.805,
17.735,
34.997
],
"median_ms": 17.735,
"timeouts": 0,
"probes": [
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 12.805
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 17.735
},
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 34.997
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
40.675,
40.732,
15.735
],
"median_ms": 40.675,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 40.675
},
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 40.732
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.735
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
60.783,
18.612,
54.857
],
"median_ms": 54.857,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 60.783
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 18.612
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 54.857
}
]
},
{
"hop": 9,
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": [
14.668,
15.608,
24.731
],
"median_ms": 15.608,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 14.668
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.608
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 24.731
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
18.863,
16.597,
24.851
],
"median_ms": 18.863,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 18.863
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.597
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 24.851
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203335_899285.txt",
"spike_captured": true,
"spike_limit_ms": 56.8,
"spike_probes": [
{
"hop": 8,
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 60.783
}
],
"spike_probe_count": 1,
"peak_probe_ms": 60.783,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 73
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 14.302 ms 18.026 ms 9.958 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 11.686 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 11.992 ms 13.318 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 23.777 ms 14.721 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 13.925 ms
4 lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 13.426 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 26.661 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 13.755 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 27.994 ms 17.792 ms 17.749 ms
6 lag-31.chcgildt87w-bcr00.netops.charter.com (66.109.10.82) 12.805 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 17.735 ms lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 34.997 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 40.675 ms lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 40.732 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 15.735 ms
8 141.101.73.110 (141.101.73.110) 60.783 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 18.612 ms 141.101.73.111 (141.101.73.111) 54.857 ms
9 141.101.73.110 (141.101.73.110) 14.668 ms 15.608 ms 24.731 ms
10 141.101.73.195 (141.101.73.195) 18.863 ms one.one.one.one (1.1.1.1) 16.597 ms 24.851 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:33:44.906-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
61.198,
12.924,
13.68
],
"median_ms": 13.68,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 61.198
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.924
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 13.68
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
27.996,
25.101,
29.638
],
"median_ms": 27.996,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 27.996
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 25.101
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 29.638
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
24.832,
22.891,
14.85
],
"median_ms": 22.891,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 24.832
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 22.891
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 14.85
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
13.787,
12.792,
13.618
],
"median_ms": 13.618,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.787
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 12.792
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.618
}
]
},
{
"hop": 5,
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": [
17.737,
16.791,
25.662
],
"median_ms": 17.737,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.737
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.791
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 25.662
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
18.579,
24.768,
16.958
],
"median_ms": 18.579,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 18.579
},
{
"ip": "66.109.5.136",
"hostname": "lag-21.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 24.768
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 16.958
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
18.842,
45.894,
37.396
],
"median_ms": 37.396,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 18.842
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 45.894
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 37.396
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
26.835,
15.69,
15.646
],
"median_ms": 15.69,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 26.835
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 15.69
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.646
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
22.573,
16.679,
14.486
],
"median_ms": 16.679,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.163",
"hostname": null,
"rtt_ms": 22.573
},
{
"ip": "141.101.73.171",
"hostname": null,
"rtt_ms": 16.679
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 14.486
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
16.64,
14.637,
46.787
],
"median_ms": 16.64,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.167",
"hostname": null,
"rtt_ms": 16.64
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 14.637
},
{
"ip": "141.101.73.127",
"hostname": null,
"rtt_ms": 46.787
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203343_901920.txt",
"spike_captured": true,
"spike_limit_ms": 56.8,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 61.198
}
],
"spike_probe_count": 1,
"peak_probe_ms": 61.198,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 75
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 61.198 ms 12.924 ms 13.680 ms
2 syn-076-057-161-110.res.spectrum.com (76.57.161.110) 27.996 ms syn-076-057-161-114.res.spectrum.com (76.57.161.114) 25.101 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 29.638 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 24.832 ms lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 22.891 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 14.850 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.787 ms 12.792 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 13.618 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 17.737 ms 16.791 ms 25.662 ms
6 lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 18.579 ms lag-21.chcgildt87w-bcr00.netops.charter.com (66.109.5.136) 24.768 ms lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 16.958 ms
7 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 18.842 ms 45.894 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 37.396 ms
8 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 26.835 ms 15.690 ms 141.101.73.110 (141.101.73.110) 15.646 ms
9 141.101.73.163 (141.101.73.163) 22.573 ms 141.101.73.171 (141.101.73.171) 16.679 ms 141.101.73.111 (141.101.73.111) 14.486 ms
10 141.101.73.167 (141.101.73.167) 16.640 ms one.one.one.one (1.1.1.1) 14.637 ms 141.101.73.127 (141.101.73.127) 46.787 ms
+327
View File
@@ -0,0 +1,327 @@
{
"time": "2026-09-28T20:33:48.907-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: a hop has replies from multiple routers; cannot assign its combined timings to one router.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
136.957,
12.825,
21.708
],
"median_ms": 21.708,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 136.957
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.825
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 21.708
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
12.798,
30.795,
14.742
],
"median_ms": 14.742,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 12.798
},
{
"ip": "76.57.161.114",
"hostname": "syn-076-057-161-114.res.spectrum.com",
"rtt_ms": 30.795
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 14.742
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
40.737,
39.715,
12.7
],
"median_ms": 39.715,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 40.737
},
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 39.715
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 12.7
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
13.934,
29.68,
13.709
],
"median_ms": 13.934,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 13.934
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 29.68
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 13.709
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
16.763,
15.708,
16.747
],
"median_ms": 16.747,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 16.763
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 15.708
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 16.747
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
15.732,
17.711,
32.977
],
"median_ms": 17.711,
"timeouts": 0,
"probes": [
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 15.732
},
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.711
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 32.977
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
15.579,
16.791,
16.696
],
"median_ms": 16.696,
"timeouts": 0,
"probes": [
{
"ip": "66.109.5.225",
"hostname": "lag-0.pr2.chi10.netops.charter.com",
"rtt_ms": 15.579
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.791
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.696
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
15.708,
16.665,
35.897
],
"median_ms": 16.665,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 15.708
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 16.665
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 35.897
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
15.515,
16.667,
15.593
],
"median_ms": 15.593,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 15.515
},
{
"ip": "141.101.73.177",
"hostname": null,
"rtt_ms": 16.667
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.593
}
]
},
{
"hop": 10,
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": [
15.594,
16.847,
42.664
],
"median_ms": 16.847,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 15.594
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.847
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 42.664
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203347_902390.txt",
"spike_captured": true,
"spike_limit_ms": 56.7,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 136.957
}
],
"spike_probe_count": 1,
"peak_probe_ms": 136.957,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 76
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 136.957 ms 12.825 ms 21.708 ms
2 syn-076-057-161-114.res.spectrum.com (76.57.161.114) 12.798 ms 30.795 ms syn-076-057-161-110.res.spectrum.com (76.57.161.110) 14.742 ms
3 lag-63.hcr01wksawi13.netops.charter.com (76.57.161.116) 40.737 ms 39.715 ms lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 12.700 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 13.934 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 29.680 ms 13.709 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 16.763 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 15.708 ms 16.747 ms
6 lag-301.pr2.chi10.netops.charter.com (209.18.43.61) 15.732 ms lag-11.chcgildt87w-bcr00.netops.charter.com (66.109.6.20) 17.711 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 32.977 ms
7 lag-0.pr2.chi10.netops.charter.com (66.109.5.225) 15.579 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 16.791 ms 16.696 ms
8 141.101.73.110 (141.101.73.110) 15.708 ms 16.665 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 35.897 ms
9 141.101.73.161 (141.101.73.161) 15.515 ms 141.101.73.177 (141.101.73.177) 16.667 ms 141.101.73.111 (141.101.73.111) 15.593 ms
10 one.one.one.one (1.1.1.1) 15.594 ms 16.847 ms 42.664 ms
+333
View File
@@ -0,0 +1,333 @@
{
"time": "2026-09-28T20:33:52.908-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
12.829,
11.678,
12.814
],
"median_ms": 12.814,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.829
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 11.678
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 12.814
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
26.92,
11.685,
13.241
],
"median_ms": 13.241,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 26.92
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 11.685
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 13.241
}
]
},
{
"hop": 3,
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": [
12.756,
16.056,
15.679
],
"median_ms": 15.679,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 12.756
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 16.056
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 15.679
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
40.637,
15.801,
21.957
],
"median_ms": 21.957,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 40.637
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 15.801
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 21.957
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
17.549,
15.764,
13.665
],
"median_ms": 15.764,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.549
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 15.764
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 13.665
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
14.927,
24.845,
15.71
],
"median_ms": 15.71,
"timeouts": 0,
"probes": [
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 14.927
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 24.845
},
{
"ip": "66.109.0.228",
"hostname": "lag-41.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 15.71
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
21.703,
16.71,
14.874
],
"median_ms": 16.71,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 21.703
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 16.71
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 14.874
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
25.827,
85.72,
68.725
],
"median_ms": 68.725,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 25.827
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 85.72
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 68.725
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
17.673,
16.656,
15.823
],
"median_ms": 16.656,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 17.673
},
{
"ip": "141.101.73.117",
"hostname": null,
"rtt_ms": 16.656
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 15.823
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
17.624,
16.653,
22.091
],
"median_ms": 17.624,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 17.624
},
{
"ip": "141.101.73.169",
"hostname": null,
"rtt_ms": 16.653
},
{
"ip": "141.101.73.161",
"hostname": null,
"rtt_ms": 22.091
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203351_903345.txt",
"spike_captured": true,
"spike_limit_ms": 56.5,
"spike_probes": [
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 85.72
},
{
"hop": 8,
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 68.725
}
],
"spike_probe_count": 2,
"peak_probe_ms": 85.72,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 77
}
+11
View File
@@ -0,0 +1,11 @@
traceroute to 1.1.1.1 (1.1.1.1), 30 hops max, 60 byte packets
1 172.29.152.65 (172.29.152.65) 12.829 ms 11.678 ms 12.814 ms
2 syn-076-057-161-108.res.spectrum.com (76.57.161.108) 26.920 ms syn-076-057-161-112.res.spectrum.com (76.57.161.112) 11.685 ms 13.241 ms
3 lag-63.hcr02wksawi13.netops.charter.com (76.57.161.120) 12.756 ms 16.056 ms 15.679 ms
4 lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 40.637 ms lag-61.rcr11gnfdwibb.netops.charter.com (24.160.225.34) 15.801 ms lag-61.rcr11milzwift.netops.charter.com (24.160.225.30) 21.957 ms
5 lag-16-10.chcgildt87w-bcr00.netops.charter.com (66.109.6.204) 17.549 ms 15.764 ms lag-18-10.chctilwc00w-bcr00.netops.charter.com (66.109.6.206) 13.665 ms
6 lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 14.927 ms 24.845 ms lag-41.chcgildt87w-bcr00.netops.charter.com (66.109.0.228) 15.710 ms
7 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 21.703 ms lag-401.pr2.chi10.netops.charter.com (66.109.0.109) 16.710 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 14.874 ms
8 141.101.73.111 (141.101.73.111) 25.827 ms 0.ae4.pr1.dca10.tbone.rr.com (66.109.1.113) 85.720 ms 68.725 ms
9 141.101.73.195 (141.101.73.195) 17.673 ms 141.101.73.117 (141.101.73.117) 16.656 ms 141.101.73.111 (141.101.73.111) 15.823 ms
10 one.one.one.one (1.1.1.1) 17.624 ms 141.101.73.169 (141.101.73.169) 16.653 ms 141.101.73.161 (141.101.73.161) 22.091 ms
+351
View File
@@ -0,0 +1,351 @@
{
"time": "2026-09-28T20:34:04.114-05:00",
"target": "1.1.1.1",
"returncode": 0,
"command": [
"traceroute",
"-4",
"-N",
"1",
"-q",
"3",
"-m",
"30",
"-w",
"0.5",
"1.1.1.1"
],
"assessment": "Individual slow trace probe captured; this alone does not locate a faulty hop. Inconclusive: destination did not return timed replies; cannot locate the end-to-end delay.",
"hops": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": [
34.744,
31.421,
68.745
],
"median_ms": 34.744,
"timeouts": 0,
"probes": [
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 34.744
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 31.421
},
{
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 68.745
}
]
},
{
"hop": 2,
"ip": null,
"hostname": null,
"rtt_ms": [
15.764,
12.628,
74.319
],
"median_ms": 15.764,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.108",
"hostname": "syn-076-057-161-108.res.spectrum.com",
"rtt_ms": 15.764
},
{
"ip": "76.57.161.112",
"hostname": "syn-076-057-161-112.res.spectrum.com",
"rtt_ms": 12.628
},
{
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 74.319
}
]
},
{
"hop": 3,
"ip": null,
"hostname": null,
"rtt_ms": [
24.798,
12.843,
25.522
],
"median_ms": 24.798,
"timeouts": 0,
"probes": [
{
"ip": "76.57.161.116",
"hostname": "lag-63.hcr01wksawi13.netops.charter.com",
"rtt_ms": 24.798
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 12.843
},
{
"ip": "76.57.161.120",
"hostname": "lag-63.hcr02wksawi13.netops.charter.com",
"rtt_ms": 25.522
}
]
},
{
"hop": 4,
"ip": null,
"hostname": null,
"rtt_ms": [
60.685,
60.688,
24.594
],
"median_ms": 60.685,
"timeouts": 0,
"probes": [
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 60.685
},
{
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 60.688
},
{
"ip": "24.160.225.34",
"hostname": "lag-61.rcr11gnfdwibb.netops.charter.com",
"rtt_ms": 24.594
}
]
},
{
"hop": 5,
"ip": null,
"hostname": null,
"rtt_ms": [
112.787,
29.66,
18.728
],
"median_ms": 29.66,
"timeouts": 0,
"probes": [
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 112.787
},
{
"ip": "66.109.6.204",
"hostname": "lag-16-10.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 29.66
},
{
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 18.728
}
]
},
{
"hop": 6,
"ip": null,
"hostname": null,
"rtt_ms": [
25.698,
17.696,
15.798
],
"median_ms": 17.696,
"timeouts": 0,
"probes": [
{
"ip": "66.109.10.82",
"hostname": "lag-31.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 25.698
},
{
"ip": "66.109.6.20",
"hostname": "lag-11.chcgildt87w-bcr00.netops.charter.com",
"rtt_ms": 17.696
},
{
"ip": "66.109.0.109",
"hostname": "lag-401.pr2.chi10.netops.charter.com",
"rtt_ms": 15.798
}
]
},
{
"hop": 7,
"ip": null,
"hostname": null,
"rtt_ms": [
26.638,
16.691,
16.687
],
"median_ms": 16.691,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 26.638
},
{
"ip": "209.18.43.61",
"hostname": "lag-301.pr2.chi10.netops.charter.com",
"rtt_ms": 16.691
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.687
}
]
},
{
"hop": 8,
"ip": null,
"hostname": null,
"rtt_ms": [
17.747,
11.677,
16.666
],
"median_ms": 16.666,
"timeouts": 0,
"probes": [
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 17.747
},
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 11.677
},
{
"ip": "66.109.1.113",
"hostname": "0.ae4.pr1.dca10.tbone.rr.com",
"rtt_ms": 16.666
}
]
},
{
"hop": 9,
"ip": null,
"hostname": null,
"rtt_ms": [
17.646,
16.638,
23.652
],
"median_ms": 17.646,
"timeouts": 0,
"probes": [
{
"ip": "141.101.73.110",
"hostname": null,
"rtt_ms": 17.646
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 16.638
},
{
"ip": "141.101.73.111",
"hostname": null,
"rtt_ms": 23.652
}
]
},
{
"hop": 10,
"ip": null,
"hostname": null,
"rtt_ms": [
16.777,
19.449,
22.54
],
"median_ms": 19.449,
"timeouts": 0,
"probes": [
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 16.777
},
{
"ip": "141.101.73.195",
"hostname": null,
"rtt_ms": 19.449
},
{
"ip": "1.1.1.1",
"hostname": "one.one.one.one",
"rtt_ms": 22.54
}
]
}
],
"raw_file": "/home/hz/dev/spectrum/logs/trace_20260928_203402_906113.txt",
"spike_captured": true,
"spike_limit_ms": 56.85,
"spike_probes": [
{
"hop": 1,
"ip": "172.29.152.65",
"hostname": null,
"rtt_ms": 68.745
},
{
"hop": 2,
"ip": "76.57.161.110",
"hostname": "syn-076-057-161-110.res.spectrum.com",
"rtt_ms": 74.319
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 60.685
},
{
"hop": 4,
"ip": "24.160.225.30",
"hostname": "lag-61.rcr11milzwift.netops.charter.com",
"rtt_ms": 60.688
},
{
"hop": 5,
"ip": "66.109.6.206",
"hostname": "lag-18-10.chctilwc00w-bcr00.netops.charter.com",
"rtt_ms": 112.787
}
],
"spike_probe_count": 5,
"peak_probe_ms": 112.787,
"sustained_jump_found": false,
"incident_id": null,
"attempt": 80
}

Some files were not shown because too many files have changed in this diff Show More