feat(analytics): split kci-dev, scripts, and bots from dashboard traffic by alanpeixinho · Pull Request #2154 · kernelci/dashboard

alanpeixinho · 2026-10-01T19:26:25Z

What it is

Classify User-Agents into client dashboard, kci-dev, script, or bot
Record kci-dev/<version> as the browser, and Linux, macOS, or Windows from (OS) in the User-Agent
Add a client label to request counts and daily unique visitors
Add a Client control on the Grafana API dashboard and filter the analytics panels with it
New client series start at deploy. Older samples without that label stay in Prometheus until they age out of the selected range.
Closes Count kci-dev as its own analytics client #2144

How to test

From backend/:

poetry run pytest -m unit kernelCI_app/tests/unitTests/middleware/backendRequestMetricsMiddleware_test.py -q

docker compose -f docker-compose.monitoring.yml up -d
Start the backend with PROMETHEUS_METRICS_ENABLED=true and metrics on port 8001. runserver needs --noreload.
Send a few /api/ requests:

curl -H 'User-Agent: kci-dev/0.1.11 (Linux)' http://localhost:8000/api/schema/
curl -H 'User-Agent: curl/8.5.0' http://localhost:8000/api/schema/
curl -H 'User-Agent: Mozilla/5.0 (compatible; Googlebot/2.1)' http://localhost:8000/api/schema/
curl -A 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 Chrome/131.0.0.0 Safari/537.36' http://localhost:8000/api/schema/

On http://localhost:8001/metrics/ confirm client="kci-dev", client="script", client="bot", and client="dashboard". The kci-dev request series should show browser="kci-dev/0.1.11", os="Linux",
device="cli".
In Grafana at http://localhost:3000, import monitoring/dashboard.json. Set the range to the last 15 minutes.
Client: All clients shows one unique-visitor total and one slice per client on Requests by Client. Client: kci-dev limits the analytics panels to that client. Response time and total calls
stay unchanged, because those series have no client label.

* Classify kci-dev, curl/wget/python-requests, and crawlers as their own client * Keep the kci-dev version on the browser label and read OS from the User-Agent * Add a client label to request and unique-visitor counters * Filter the Grafana analytics panels with a Client dropdown Part of kernelci#2144 Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi>

felipebergamin · 2026-10-02T17:55:26Z

+            browser=UNKNOWN,
+            os=UNKNOWN,
+            device=UNKNOWN,
+            client=Client.DASHBOARD,


Empty User-Agent is counted as dashboard. Those requests are not from the web app, so they inflate the dashboard visitors.

Empty User-Agent is now client=unknown, along with any User-Agent that is not a recognized browser, kci-dev, curl, wget, python-requests, or a bot.

* Time /api/ requests on dashboard_backend_request_latency_seconds by endpoint and client * Keep /admin/ and /health/ on the Django view-latency histogram * Point total calls, average, p50, and p95 at those client series Built on kernelci#2154. Closes kernelci#2149 Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi>

Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi>

alanpeixinho · 2026-10-05T19:31:02Z

dashboard example

kcidev example

all clients example

felipebergamin · 2026-10-05T21:14:05Z

+        if os_family:
+            os = KCI_DEV_OS.get(os_family.strip().casefold(), UNKNOWN)
+        return ClientInfo(
+            browser=f"kci-dev/{version}" if version else "kci-dev",


I made a comment for this in another PR in the stack (#2156)

this would create a series for every release of kci-dev

Changed to use a separate counter for browser, and the kci-dev version.

Awesome to see kci-dev versions!

* Keep the browser label at kci-dev * Count releases on dashboard_kci_dev_requests_by_version_total * Treat a missing or non-release token as unknown * Show versions on a donut filtered by the Client dropdown Part of kernelci#2144 Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi>

felipebergamin · 2026-10-06T19:35:20Z

+    r"^kci-dev(?:/([^\s/()]+))?(?:\s+\(([^)]+)\))?\s*$",
+    re.IGNORECASE,
+)
+KCI_DEV_VERSION = re.compile(r"^\d+\.\d+\.\d+(?:[a-z0-9.]{0,16})?$", re.IGNORECASE)


just a note: I see this matches all the kci-dev versions on https://pypi.org/project/kci-dev/#history

but it is easy to have problems with any rc or non stable versions. eg. 0.1.3.dev1 matches with the regex. But 0.1.3.dev-1 does not. Depends on how the kci-dev decides its version labels

kci-dev sends the PEP 440 version from Poetry. 0.1.3.dev1 already matches. 0.1.3.dev-1 is not valid PEP 440, so it stays unknown.

* Time /api/ requests on dashboard_backend_request_latency_seconds by endpoint and client * Keep /admin/ and /health/ on the Django view-latency histogram * Point total calls, average, p50, and p95 at those client series Built on kernelci#2154. Closes kernelci#2149 Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi>

…2156) * feat(analytics): record API latency by endpoint and client * Time /api/ requests on dashboard_backend_request_latency_seconds by endpoint and client * Keep /admin/ and /health/ on the Django view-latency histogram * Point total calls, average, p50, and p95 at those client series Built on kernelci#2154. Closes kernelci#2149 Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi> * feat(analytics): show 4xx and 5xx by endpoint * Add a panel summed by endpoint and status_class, limited to 4xx and 5xx Part of kernelci#2150 Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi> * test(analytics): stop latency tests clobbering the Django histogram The latency tests replaced the process-wide Prometheus histogram and left it replaced, so the health-skip test saw no /api/ observation once both suites shared a worker. Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi> * fix(analytics): sort request metrics middleware imports Ruff I001 failed pre-commit because prometheus_client sat after the first-party import. Assisted-by: Cursor Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi> * fix(analytics): split API latency by HTTP method GET and POST to the same endpoint were recorded as one series. Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi> * fix(analytics): keep latency on the response and split methods Stop the histogram sample when the response returns, and group the dashboard sums by method so GET and POST stay apart. Assisted-by: Cursor Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi> --------- Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi>

alanpeixinho mentioned this pull request Oct 1, 2026

feat(analytics): publish visitors by request-count band #2155

Merged

4 tasks

felipebergamin reviewed Oct 2, 2026

View reviewed changes

alanpeixinho mentioned this pull request Oct 2, 2026

feat(analytics): record API latency by endpoint and client #2156

Merged

fix(analytics): stop counting unrecognized clients as dashboard

e535fb7

Signed-off-by: Alan Peixinho <alan.peixinho@profusion.mobi>

felipebergamin reviewed Oct 5, 2026

View reviewed changes

felipebergamin approved these changes Oct 6, 2026

View reviewed changes

alanpeixinho added this pull request to the merge queue Oct 7, 2026

Merged via the queue into kernelci:main with commit a68436c Oct 7, 2026
7 checks passed

Navigation Menu

Repository navigation

feat(analytics): split kci-dev, scripts, and bots from dashboard traffic - #2154

feat(analytics): split kci-dev, scripts, and bots from dashboard traffic#2154
alanpeixinho merged 3 commits into
kernelci:mainfrom
profusion:feat/analytics-client-label

alanpeixinho commented Oct 1, 2026

Uh oh!

felipebergamin Oct 2, 2026

Uh oh!

alanpeixinho Oct 5, 2026

Uh oh!

alanpeixinho commented Oct 5, 2026

Uh oh!

felipebergamin Oct 5, 2026

Uh oh!

alanpeixinho Oct 6, 2026

Uh oh!

bhcopeland Oct 6, 2026

Uh oh!

felipebergamin Oct 6, 2026

Uh oh!

alanpeixinho Oct 6, 2026

Uh oh!

alanpeixinho Oct 7, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

alanpeixinho commented Oct 1, 2026

What it is

How to test

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

alanpeixinho commented Oct 5, 2026

dashboard example

kcidev example

all clients example

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants