UnderstandYour Telemetry Quality
Move beyond guesswork. OllyGarden Insights processes your OTLP data to produce a definitive Instrumentation Score, providing a clear, data-driven path to optimize your OpenTelemetry implementation.
Grounded in emerging community best practices we're helping to define.
Why Is Judging Telemetry Quality So Hard?
Without a standard measure, assessing and improving telemetry quality is difficult, inconsistent, and often neglected until problems become critical.
Subjective Assessment
How do you really know if your OpenTelemetry instrumentation is effective? Different teams, different opinions, no common benchmark.
Hidden Issues
Missing critical attributes, inefficient signal use, or incomplete traces often go unnoticed until it's too late, leading to higher costs and slower incident response.
No Standard Measure
The OpenTelemetry ecosystem has lacked a standardized way to objectively measure instrumentation quality. This makes true improvement and benchmarking a guessing game.
The result? Teams struggle with "good enough" instrumentation that costs more, reveals less, and makes troubleshooting harder than it should be.
Quantify Your Quality:
The Instrumentation Score
OllyGarden Insights leverages the Instrumentation Score specification—an open, rule-based system designed to objectively assess your OpenTelemetry data (OTLP). We provide a numerical score from 0 (Poor) to 100 (Excellent), giving you an unprecedented understanding of your telemetry's effectiveness.
The Future of Telemetry Assessment
OllyGarden created the Instrumentation Score as an open-source effort. By using our Insights service, you're an early adopter of this next-generation approach to telemetry quality. Our service analyzes your data, calculates your score based on rules derived from OTel Semantic Conventions and best practices, and provides detailed reports on why you received that score and how to improve it.
Excellent
90-100
Best-in-class instrumentation with comprehensive coverage and optimal practices.
Good
75-89
Solid foundation with good practices, some areas for optimization.
Needs Improvement
50-74
Significant gaps in coverage or practices that need addressing.
Poor
0-49
Critical issues requiring immediate attention and major improvements.
Secure & Focused Analysis
Our service securely streams and analyzes your OpenTelemetry data (OTLP). Your data is processed, scored, and then discarded—we never store your telemetry long-term.
From Score to Action: Detailed Insights
Your Instrumentation Score is a composite reflection of adherence to best practices, revealing specific areas for targeted improvement.
Instrumentation Quality Breakdown
See exactly which rules impacted your score – positive or negative. Understand missing attributes, semantic convention adherence, and trace completeness.
Efficiency & Optimization Opportunities
Identify score-impacting inefficiencies that also drive up costs. Detect overly verbose traces and high-cardinality metrics.
Service & Pipeline Benchmarking
Compare Instrumentation Scores across your services to prioritize efforts. Focus improvements where they'll have the biggest impact.
Actionable Recommendations
Get clear, prioritized guidance to improve your score and overall telemetry health with specific implementation steps.
Sample Insights details
The OllyGarden Insights & Scoring Process
Secure data ingestion leads to automated score calculation and insightful reporting. See how we transform your raw telemetry into actionable intelligence.
Secure Data Ingestion
Securely stream a sample of your OpenTelemetry data (OTLP) to OllyGarden. No agent installation required—simply point your existing telemetry pipeline to our analysis endpoint.
Rule-Based Analysis & Score Calculation
Our platform ingests your OTLP data and applies the Instrumentation Score ruleset. Each rule contributes to the overall score based on its severity and findings.
Detailed Report & Scorecard
Receive a comprehensive report with your service's Instrumentation Score, a breakdown of contributing factors, identified issues, and actionable recommendations for improvement.
Track Your Progress
Implement changes based on our recommendations and resubmit data to see your Instrumentation Score improve over time. Cultivate a culture of telemetry excellence.
A Clearer View for Everyone: The Value of Scoring
The Instrumentation Score provides a common language and clear metrics for everyone involved in observability, from engineers to executives. It's time to get on the same page.
For Observability Engineers and SREs
Objectively demonstrate the quality of your instrumentation. Use your score to advocate for improvements, track progress, and reduce the noise that leads to alert fatigue.
Key Benefits:
- Quantify instrumentation quality with hard numbers
- Identify specific technical debt in your telemetry
- Justify time spent on observability improvements
- Reduce false positives and alert noise
For Software Development Teams
Get clear, quantifiable feedback on your service's instrumentation health. Understand how to improve your score and contribute to a more efficient and robust system.
Key Benefits:
- Service-specific instrumentation scorecards
- Clear action items for developers
- Track improvements over time
For CTOs and Engineering Managers
Gain a standardized metric to benchmark observability maturity across teams. Tie instrumentation quality directly to efficiency gains and reduced operational risk.
Key Benefits:
- Executive dashboards with organization-wide scores
- Team performance benchmarking
- Risk assessment and mitigation planning
For the open source community
By adopting OllyGarden Insights, you support the development and refinement of a much-needed open standard for instrumentation quality. Help us cultivate a better future for observability.
Key Benefits:
- Contribute to open source scoring standards
- Help establish community best practices
- Advance the state of observability tooling
- Participate in the future of telemetry quality
One Score, Universal Understanding
Whether you're debugging a production issue, planning infrastructure costs, or reporting to stakeholders, the Instrumentation Score provides a common reference point that everyone can understand and act upon.
Pioneering an Open Standard for Telemetry Quality
We're not just building a product; we're fostering a movement towards better, more standardized instrumentation. The Instrumentation Score is designed to be an open, community-driven standard that benefits the entire observability ecosystem.
Open Source Framework
The Instrumentation Score is developed as an open-source initiative. Its core analysis rules and scoring methodology are freely available, encouraging the community to use, contribute to, and improve it.
Community-Driven Standard
We actively collaborate with observability experts, OpenTelemetry maintainers, and end-users to refine the scoring criteria and guidelines. Your feedback and adoption are crucial in shaping this emerging standard.
For the Community
The Instrumentation Score aims to strengthen the entire observability ecosystem by providing standardized metrics and best practices, applicable across various tools and platforms.
Ready to Know Your Score?
Join the early access program and be among the first to receive your Instrumentation Score. Transform guesswork into measurable improvements.
