Lead DevOps / Observability Engineer (#5720)

We are looking for a Lead DevOps / Observability Engineer to lead the migration of the client's observability stack from New Relic and Datadog to Grafana, using technologies such as Prometheus, Loki, and Tempo.

This is a hands-on role combining:
- DevOps & platform engineering - deploying and configuring the new observability stack using AWS, Kubernetes, and Terraform.
- Application instrumentation - modifying application code to add or adapt metrics, logs, and traces.
- Migration & collaboration - rebuilding existing dashboards and alerts in Grafana and working with multiple engineering teams to ensure full monitoring coverage.

We are looking for someone who is comfortable working across both infrastructure and application code and can independently drive a cross-team observability migration.

Responsibilities:

• Lead the migration of monitoring, alerting, and dashboards from New Relic and Datadog to Grafana.
• Design and implement the target observability architecture (metrics, logs, traces) and the infrastructure-as-code (Terraform) needed to support it.
• Audit existing New Relic and Datadog dashboards, alerts, and integrations to build a complete migration inventory and ensure feature/coverage parity in Grafana.
• Make application-level code changes across services to add, adjust, or replace instrumentation (metrics exporters, logging, tracing libraries) as needed for the new stack.
• Work with AWS infrastructure, including EKS, Kubernetes, and Docker, to deploy and operate the new observability tooling.
• Configure AWS networking and access as needed to support the observability platform (VPCs, security groups, IAM).
• Contribute to CI/CD pipelines and deployment automation using GitHub Actions to support the rollout.
• Collaborate with development, platform, and infrastructure teams to coordinate the cutover from New Relic/Datadog to Grafana with minimal disruption.
• Identify and remediate any security issues (secrets, keys, dependencies) encountered in the course of this work.
• Document the new observability architecture, migration procedures, and dashboard/alert mappings.
• Use AI-assisted development tools, including Codex, to improve engineering productivity and delivery speed.

Requirements: 

• Strong hands-on experience with Grafana, including dashboard design, alerting, and data source configuration (e.g. Prometheus, Loki, Tempo, or similar).
• Practical experience migrating away from commercial observability platforms such as New Relic and/or Datadog.
• Full-stack development experience — comfortable reading, modifying, and instrumenting application code across front-end and back-end services, not just infrastructure.
• Solid experience with AWS in production environments, including EKS and Kubernetes.
• Practical experience with Docker and containerized workloads.
• Strong Terraform and infrastructure-as-code skills.
• Experience with GitHub Actions or comparable CI/CD tools.
• Ability to work across multiple teams, services, and codebases to coordinate a cross-cutting migration.
• Fluency with Codex or comparable AI-assisted coding tools.

Nica to have:

• Prior experience running a similar New Relic/Datadog-to-Grafana (or equivalent) observability migration end to end.
• Grafana-specific certifications or demonstrated community contributions (plugins, dashboards, etc.).
• Experience with the broader Prometheus/Loki/Tempo (LGTM) ecosystem.
• AWS certification, such as AWS Solutions Architect Associate/Professional.
• Experience with RDS and other AWS data services.
• Prior contract or consulting experience with clearly defined deliverables.
• At least an Upper-Intermediate level of English