Orcapod Consulting Services→
Telemetry Data Engineer at Orcapod… · Hybrid -…
ExperiencedHybridHybrid - Bengaluru
Skills
Open TelemetryData EngineeringTelemetryMachine LearningPythonArtificial IntelligenceAdvanced AnalyticsKafka
Job Description
Telemetry Data Engineer
Job Summary
We are looking for a Telemetry Data Engineer with strong hands-on experience in OpenTelemetry (OTel) and data engineering. The role will focus on building, managing, and optimizing telemetry pipelines that collect, process, transform, and distribute logs, metrics, and traces across large-scale distributed systems.
The ideal candidate should have practical experience with OpenTelemetry Collector, telemetry pipelines, distributed tracing, data ingestion, streaming technologies, and cloud environments.
Key Responsibilities
- Design, build, and maintain scalable telemetry and observability data pipelines.
- Implement and configure OpenTelemetry (OTel) for collecting logs, metrics, and distributed traces.
- Work hands-on with OpenTelemetry Collector, including receivers, processors, exporters, and pipeline configurations.
- Develop telemetry ingestion, transformation, enrichment, filtering, and routing pipelines.
- Integrate OpenTelemetry with applications, microservices, Kubernetes, and cloud platforms.
- Build and maintain real-time data pipelines using technologies such as Kafka or similar streaming platforms.
- Work with observability platforms such as Prometheus, Grafana, Jaeger, Tempo, ELK/OpenSearch, or equivalent tools.
- Troubleshoot telemetry collection, pipeline failures, data quality, latency, and observability issues.
- Collaborate with application, platform, DevOps, SRE, and engineering teams to improve system observability.
- Optimize telemetry pipelines for performance, scalability, reliability, and cost.
- Develop automation/scripts using Python, Java, or Go where required.
- Support production environments and participate in troubleshooting and root-cause analysis.
Required Skills
- Strong experience in Data Engineering / Data Pipelines / Observability Engineering.
- Hands-on OpenTelemetry experience is mandatory.
- Strong hands-on experience with OpenTelemetry Collector.
- Good understanding of logs, metrics, traces, and distributed tracing.
- Experience configuring OTel receivers, processors, exporters, and pipelines.
- Strong experience with Kafka or other streaming technologies.
- Programming/scripting experience in Python, Java, or Go.
- Experience working with Kubernetes and microservices.
- Experience with at least one cloud platform AWS, Azure, or GCP.
- Strong understanding of APIs, data ingestion, transformation, and processing.
- Good knowledge of SQL and data engineering concepts.
- Strong troubleshooting and production support skills.
Good to Have
- Experience with Prometheus, Grafana, Jaeger, Tempo, ELK, OpenSearch or similar observability platforms.
- Experience with cloud-native observability.
- Knowledge of OTLP (OpenTelemetry Protocol).
- Experience with Kubernetes observability and service instrumentation.
- Experience with CI/CD and Infrastructure as Code.
- Experience working with high-volume telemetry data.