AI Platform Architect
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Platform Engineer building secure, scalable Claude and RAG platforms for NewRocket, an AI-first ServiceNow partner. Enabling governed enterprise integrations, LLMOps, and production AI delivery.
Responsibilities:
- Design, build, deploy, and maintain scalable platform capabilities supporting enterprise AI, machine learning, LLM, RAG, and agentic AI applications
- Create reusable reference architectures, infrastructure patterns, deployment templates, integration components, and engineering standards
- Build secure integrations with enterprise data, APIs, workflow systems, authorized tools, Anthropic API, and Claude models
- Enable standardized authentication, model access, prompt and context management, structured outputs, tool use, logging, error handling, and rate-limit management
- Support Claude-based document analysis, knowledge assistance, workflow automation, agentic task execution, summarization, classification, and decision support
- Establish and operate CI/CD pipelines, LLMOps and MLOps capabilities, evaluation pipelines, deployment automation, monitoring, and lifecycle management
- Support production AI services through incident response, troubleshooting, root-cause analysis, capacity planning, and service-level monitoring
- Define and monitor availability, latency, throughput, token consumption, model cost, tool-call success rates, task-completion rates, and error rates
- Design and manage cloud infrastructure across AWS, Microsoft Azure, Google Cloud Platform, or client-approved environments
- Implement infrastructure as code, containerized deployments, identity and access controls, security, privacy, auditing, vulnerability management, disaster recovery, and business continuity
- Build secure data-ingestion, transformation, indexing, retrieval, RAG, embeddings, vector-store, hybrid-search, and source-attribution pipelines
- Integrate AI applications with databases, data warehouses, document repositories, knowledge bases, ServiceNow, and third-party SaaS platforms
- Implement responsible-AI safeguards, observability, tracing, output validation, approval gates, fallback behavior, and human-in-the-loop workflows
- Build integrations between AI platforms, ServiceNow, enterprise APIs, identity providers, workflow tools, collaboration platforms, and line-of-business systems
- Provide technical guidance and collaborate with AI, data, product, ServiceNow, consulting, and client technology teams
- Contribute to playbooks, runbooks, reference architectures, technical documentation, reusable modules, knowledge-sharing sessions, architecture reviews, demos, implementation planning, and customer workshops
- Productionize AI solutions and contribute reusable components to NewRocket’s Intelligence Platform, Data Intelligence Platform, and Agent Pack ecosystem
Requirements:
- 5+ years of experience in platform engineering, cloud engineering, DevOps, software engineering, data engineering, systems integration, or related technical roles
- Hands-on experience designing and deploying cloud-native applications and services on AWS, Microsoft Azure, and/or Google Cloud Platform
- Strong experience with CI/CD, Git-based workflows, automated testing, infrastructure as code, and production release processes
- Experience with Docker, Kubernetes, serverless services, or comparable cloud-native platforms
- Proficiency in Python, JavaScript/TypeScript, Java, Go, Bash, or similar programming and scripting languages
- Experience designing and consuming REST APIs, integrating enterprise applications, and implementing authentication and authorization patterns
- Hands-on experience with LLM-powered applications, generative AI services, AI/ML platforms, RAG systems, AI workflow automation, or related technologies
- Familiarity with prompt and context engineering, token management, embeddings, vector search, RAG, structured outputs, tool use/function calling, evaluations, and model monitoring
- Experience with logging, metrics, tracing, alerting, and incident management
- Strong knowledge of cloud security, identity and access management, secrets management, network security, and secure software-development practices
- Experience with relational databases, NoSQL databases, data warehouses, object storage, search platforms, or vector databases
- Strong problem-solving, troubleshooting, communication, and documentation skills
- Ability to work effectively in a fast-paced, collaborative, customer-oriented environment
- Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical discipline; equivalent relevant professional experience will be considered
- Preferred: hands-on Claude, Anthropic API, Anthropic Console, Claude Code, or Anthropic technical guidance experience
- Preferred: Anthropic Academy learning, partner enablement, technical training, or equivalent Claude implementation experience
- Preferred: Model Context Protocol, LLM frameworks, evaluation, guardrails, observability, MLOps, data engineering, vector databases, Terraform, Kubernetes operations, ServiceNow, consulting, professional services, enterprise architecture, or client-facing technical delivery experience
- Relevant certifications are a plus
Benefits:
- Diverse and inclusive workplace
- Equal opportunity workplace and affirmative action employer
- Reasonable accommodation available for individuals with disabilities
Similar Jobs
AI Platform Architect
AI Platform Engineer building secure, scalable Claude and RAG platforms. Enabling governed AI integrations across NewRocket’s ServiceNow enterprise ecosystem.
Senior Java Developer
Senior Java Developer building Java/Spring Boot microservices on AWS for an airline-aviation partner. Working remotely from India with IST hours and occasional CST overlap.
Senior Python Engineer
Senior Python Engineer building scalable Python and Django backend services for Nile Bits’ business-focused digital solutions. Optimizing distributed systems, APIs, and production reliability.
Senior Software Engineer, Go
Senior Go engineer building cross-platform endpoint agents and cloud microservices. Protecting Blackpoint Cyber customers through scalable cybersecurity software.
Oracle Technical Architect
Oracle Technical Architect shaping Oracle 19c integration architecture for Intelance, an enterprise architecture, AI transformation, and cybersecurity consultancy. Reviewing resilience, dependencies, and platform requirements.
Senior Java Engineer – Python, Technical Leadership
Senior Java Engineer building Java and Python cloud-native microservices for Salve.Inno Consulting. Providing technical leadership across AWS, Kubernetes, Docker, and AI-powered systems.
Senior Java Engineer – Python, Technical Leadership
Senior Java Engineer designing Java and Python microservices for cloud-native AI systems. Providing technical leadership across AWS, Kubernetes, Docker, and distributed backend services.
Senior Java Engineer – Python, Technical Leadership
Senior Java Engineer building Java/Python cloud-native microservices for Salve.Inno Consulting’s international AI systems. Shaping architecture, AWS infrastructure, and technical standards across distributed services.
Senior Java Engineer – Python, Technical Leadership
Senior Java Engineer designing Java and Python cloud-native microservices for internationally used AI-powered systems. Providing technical leadership across AWS, Kubernetes, Docker, and distributed backend services.
Senior Java Engineer, Python – Technical Leadership
Senior Java Engineer building Java and Python cloud-native microservices for Salve.Inno Consulting’s international AI-powered systems. Providing technical leadership across AWS, Kubernetes, Docker, and distributed backend services.
Senior Java Backend Engineer – Spring Boot, Microservices
Senior Java backend engineer building scalable Spring Boot microservices and REST APIs. Producing rigorous backend software for next-generation AI training and evaluation systems.
Network Infrastructure Chief Architect
Network infrastructure chief architect leading complex pursuits for MGT, a provider of technology and advisory solutions to government agencies. Defining networking offerings, architectures, pricing, and delivery standards.
Principal Backend Engineer – Music Discovery Platform
Principal Backend Engineer building HARMAN’s APIs and backend systems for music metadata, search, and recommendations. Remote role focused on scalable, high-performance data services.
Senior Java Engineer
Senior Java Engineer developing secure, scalable back-end eCustoms applications for EU institutions and government administrations. Leading APIs, integrations, cloud development, and software projects as a long-term contractor.
Back-End Developer – Junior/Mid-Level
Desenvolvedor Back End construindo, mantendo e evoluindo serviços e aplicações de software. Investigando bugs, implementando melhorias e colaborando na evolução técnica dos produtos.
Backend Engineer
Backend Engineer building Mem0’s AI-agent memory platform with Python, REST APIs, databases, and AWS. Operating reliable production services for enterprise customers and open-source developers.
Senior Backend Developer, NodeJS
Senior Backend Node.js desarrollando aplicaciones y APIs escalables para empresas globales en Coderio. Trabajando con Node.js, bases de datos, microservicios y equipos ágiles.
Senior Backend Engineer, Data
Senior Backend & Data Engineer building Python services and Databricks pipelines for Publicis Groupe’s unified marketing intelligence platform. Powering analytics, automation, and agentic workflows across marketing channels.
Senior Backend Engineer
Senior Backend Engineer building secure, scalable AI microservices and APIs. Supporting banking and insurance clients with fraud prevention, AML, KYC, and automation solutions.
Drupal Developer
Drupal Developer building and maintaining Drupal CMS web applications for GDIT’s government healthcare mission. Developing PHP integrations, modules, themes, and responsive front-end solutions.