Observability

A table testing whether AI can rebuild a thousand-odd apps, with the verdict published. in AI · Models & Assistants →

Hardware compatibility checker that calculates which open-weight LLMs and quantization levels your local machine can… in AI · Models & Assistants →

Hugging Face benchmark board comparing open-weight language models across standardized evaluations (MMLU-Pro, GPQA… in AI · Models & Assistants →

An LLM tracing and evaluation tool that runs inside a notebook and renders traces locally. in AI · Agents & Infrastructure →

An LLM observability tool: change the base URL and requests are logged as they pass through. in AI · Agents & Infrastructure →

Framework-agnostic LLM tracing and evaluation, OpenTelemetry-compatible. in AI · Agents & Infrastructure →

Shows input, output, latency and token count for every chain step separately. in AI · Agents & Infrastructure →

Runs prompts and models side by side against a test set declared in YAML. in AI · Agents & Infrastructure →

A platform for versioning, logging and evaluating LLM prompts, so you can trace which prompt produced which output. in AI · Agents & Infrastructure →

The LLM side of Weights & Biases. Rather than setting up a separate tracing tool, if you already track training in W&B… in AI · Agents & Infrastructure →

A metrics library for RAG pipelines, including metrics that work without reference answers. in AI · RAG, Embeddings & Vectors →

Measures the RAG triad — context relevance, groundedness, answer relevance. in AI · RAG, Embeddings & Vectors →

A free, local tool that tracks token usage and cost across dozens of AI coding tools — Claude Code, Cursor, Codex… in AI · Applied Tools →

A list of exporters and resources for Prometheus, the open-source monitoring system. in DevOps & Infrastructure →

A resource list for Splunk, the log-search and monitoring platform. in DevOps & Infrastructure →

Brendan Gregg's page on the flame graph visualisation: how to read one, the CPU/memory/off-CPU variants, generation tools and talks. in DevOps & Infrastructure →

Unifies Prometheus, Loki, PostgreSQL and dozens of sources on one dashboard. in DevOps & Infrastructure →

An open-source monitoring system for metrics collection and alerting, with a time-series database. in DevOps & Infrastructure →

Collects errors with stack traces, source maps and user context, grouping duplicates. in DevOps & Infrastructure →

The blog and tools of a widely cited expert on Linux performance and observability. in Networking & Sysadmin →

An explorer visualising Bitcoin’s pending transaction pool and the chain, runnable against your own node. in Networking & Sysadmin →

A family of tools for real-time network traffic monitoring, showing which device moves how much over which protocol. in Networking & Sysadmin →

A tool that monitors and reports plays and users on your Plex server. in Self-Hosting & Personal Cloud →

Measures how long you spend in which project and language through an editor plugin. in Editors, IDEs & Terminals →