Senior Consultant – AI Observability

Posted 1hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Dynatrace consultant helping Arctiq deliver AI observability for enterprise customers. Instrumenting LLM workloads, monitoring reliability and cost, and implementing cloud telemetry solutions.

Responsibilities:

  • Deliver Dynatrace implementations for SaaS environments, emphasizing AI and LLM-based applications
  • Instrument AI applications, agents, and LLM pipelines using OpenTelemetry and Dynatrace AI observability capabilities
  • Monitor latency, token usage, cost, errors, and model and prompt behavior
  • Implement Arize alongside Dynatrace for model evaluation, drift, and quality monitoring
  • Monitor AI infrastructure and services, including GPU and compute workloads, vector databases, AWS Bedrock, and Azure OpenAI
  • Build dashboards, alerts, and Workflows to surface AI cost and reliability issues and trigger remediation
  • Implement OpenTelemetry collector pipelines, including Bindplane, routing AI-related telemetry to Dynatrace
  • Implement Dynatrace configuration as code using Terraform, Configuration APIs, and tooling
  • Configure tagging, synthetics, RUM, logging, and dashboards
  • Support Gen2 to Gen3 migration workstreams involving AI workloads
  • Document solutions and conduct knowledge-transfer sessions
  • Keep delivery work on scope, schedule, and budget; flag risks to the Delivery Architect and engagement lead
  • Travel up to 25% for project kick-offs, workshops, and close-outs
  • Pursue continued education through training and industry certifications

Requirements:

  • 5+ years of experience in software, platform, data, or ML engineering
  • 2+ years delivering on the Dynatrace platform or a comparable observability tool
  • Understanding of AI observability, including monitoring of AI and LLM-based workloads
  • Hands-on experience with OpenTelemetry instrumentation and collectors
  • Working knowledge of Dynatrace SaaS deployments
  • Familiarity with tagging, synthetics, RUM, logging, and dashboards
  • Active Dynatrace Associate certification, or willingness to obtain it within the first 90 days
  • Clear written and verbal communication, with the ability to explain AI observability to practitioners and business stakeholders
  • Ability to travel up to 25%
  • Proficiency in Python
  • Familiarity with common LLM frameworks and SDKs, such as OpenAI, LangChain, and LlamaIndex
  • Experience with AWS or Azure, including managed AI services
  • Hands-on experience with Terraform and Git-based workflows
  • Experience with Kubernetes
  • Hands-on experience with Arize or similar AI observability and evaluation platforms
  • Experience with Bindplane or other observability pipeline tools
  • Experience building or deploying RAG pipelines, agents, or other LLM applications
  • Active higher-level Dynatrace certification, such as Dynatrace Implementation or Dynatrace Professional
  • Exposure to Gen2 to Gen3 Dynatrace migration
  • Prior consulting or professional services experience

Benefits:

  • Continued education through training and industry certifications
  • Equal opportunity and inclusive work environment
  • Interview accommodations or adjustments available
  • Remote work arrangement
  • Travel opportunities for project kick-offs, workshops, and close-outs