Principal Observability Engineer

Job description

Job Overview: We have an outstanding role that will collaborate with application, infrastructure, cloud, networking, platform engineering, and operations teams to improve service visibility, reliability, and operational excellence. We support teams in deciding what should be monitored, how service health should be evaluated, and how telemetry can be applied to deliver actionable operational insights. This role is not centered on Dynatrace platform administration. Instead, it emphasizes setting observability standards, collaborating with engineering teams, crafting monitoring strategies, and supporting the efficient use of Dynatrace, OpenTelemetry, and current observability methods across Engineering IT. Responsibilities: • Partner with Engineering IT service owners and engineering teams to assess observability maturity and identify monitoring gaps. • Understand application, infrastructure, cloud, networking, and platform architectures to establish suitable observability approaches. • Conduct workshops and technical discussions to understand business and operational requirements. • Recommend monitoring, telemetry, alerting, and dashboard solutions that improve service reliability and operational visibility. • Define and maintain Engineering IT observability standards and guidelines. • Develop standard dashboard templates for common service types. • Define meaningful Service Level Indicators and support teams in establishing appropriate Service Level Objectives. • Standardize service health perspectives, alerting methods, tagging approaches, and telemetry standards. • Encourage uniformity in monitoring and observability throughout Engineering IT. • Guide engineering teams in implementing observability using Dynatrace and OpenTelemetry or equivalent experience. • Build meaningful dashboards, service health views, and operational reporting. • Use Dynatrace Query Language (DQL) to examine telemetry and generate operational insights. • Collaborate with teams on telemetry build, instrumentation, and observability guidelines. • Assess observability requirements across cloud, infrastructure, networking, storage, and CI/CD platforms. • Establish monitoring strategies for enterprise technologies such as VMware, NetApp Storage, Jenkins, Terraform, and hybrid cloud environments. • Provide mentorship on monitoring cloud-native and hybrid workloads using services such as AWS CloudWatch and Azure Monitor. • Evaluate observability requirements for enterprise networking, including SD-WAN and network performance monitoring. • Support observability build for batch processing and scheduled workloads. • Independently coordinate and lead technical discussions, workshops, and review sessions. Required Skills and Experience: • Strong experience in observability, monitoring, Site Reliability Engineering (SRE), platform engineering, or a related field. • Experience defining monitoring strategies and observability solutions for enterprise environments. • Strong hands-on experience using Dynatrace as an enterprise observability platform. • Experience working with Dynatrace Grail and querying telemetry through Dynatrace Query Language (DQL). • Experience developing dashboards, service health views, alerts, and operational reporting. • Good understanding of OpenTelemetry concepts, including instrumentation, collectors and telemetry pipelines. • Experience in monitoring and observability involving multiple of the following technologies: AWS CloudWatch, Azure Monitor, VMware, NetApp Storage, Jenkins,Terraform, Kubernetes, Linux, Enterprise networking "Nice to Have" Skills and Experience: • OpenStack monitoring experience! In Return: This role provides the opportunity to build the future of observability within Engineering IT. We influence engineering practices across a broad technology landscape, establish enterprise-wide standards, and help build a modern observability capability that supports reliable, resilient, and data-driven operations. Join us and be part of an ambitious team dedicated to achieving flawless operational excellence! In Return: 10x Mindset at Arm At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Read more about how we bring the 10x mindset to life on the Arm blog. Didn't find what you were looking for? Join our talent community. Click here to get started. Accommodations at Arm At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email accommodations@arm.com. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process. Equal Opportunities at Arm Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. Hybrid Working at Arm Arm’s hybrid approach to working is centred around fle