Staff Software Engineer – AI Platform
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Staff Software Engineer building Aledade’s shared AI infrastructure for secure foundation-model access. Developing scalable model gateways, cloud integrations, observability, and self-service platform capabilities.
Responsibilities:
- Build and operate shared infrastructure enabling Aledade applications and AI agents to securely and reliably access foundation models
- Develop platform capabilities including model gateways, cloud AI services, provider integrations, routing and fallback, usage controls, observability, reliability, and model governance
- Consider the full lifecycle of production platform systems, including architecture, scalability, failure modes, security, operational readiness, cost, and developer experience
- Evolve the platform as AI adoption grows, building reusable and self-service capabilities rather than one-off solutions
- Identify and develop scalable and performant solutions
- Work across disciplines to shape product strategy and execution
- Develop foundations of code architecture and quality
- Mentor and coach engineers
- Set and uphold engineering process standards supporting high-quality engineering
- Collaborate with engineers, product partners, security, infrastructure teams, and AI application and agent teams
Requirements:
- BS/BTech (or higher) in Computer Science, Engineering or a related field required
- 8+ years of production-level experience as an engineer building highly scalable systems
- 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value
- 4+ years of experience working with SQL or other database querying languages on large multi-table data sets
- Experience architecting, developing, and deploying large-scale distributed systems at scale
- Experience with cloud technologies, e.g., AWS, Azure, GCP
- Experience building continuous integration and continuous development (CI/CD) pipelines
- Strong familiarity with server-side web technologies such as Java, Python, Scala, C#, C++, or Go
- Experience building or operating production platform infrastructure, distributed systems, developer platforms, or other high-availability shared services
- Experience with LLM infrastructure, model gateways, foundation model APIs, or managed AI platforms such as AWS Bedrock, Azure OpenAI, Google Vertex AI, or similar technologies
- Strong experience with cloud infrastructure, preferably AWS, and technologies such as Kubernetes, containers, and infrastructure as code
- Experience designing observability and operational practices for production systems, including metrics, distributed tracing, logging, alerting, SLOs, dashboards, and failure handling
- Experience designing APIs and self-service platform capabilities used by other engineering teams
- Experience with identity, access control, secrets management, security, and governance for shared infrastructure
- Experience with cost management, usage attribution, quotas, budgets, or capacity management for shared platforms
- Experience operating systems that handle sensitive or regulated data
- Ability to evaluate architectural tradeoffs across reliability, performance, security, cost, scalability, and developer experience
- Sitting for prolonged periods of time
- Extensive use of computers and keyboard
- Occasional walking and lifting may be required
Similar Jobs
Working Student – AI Engineering
Working Student building Python AI applications, RAG workflows, and agent systems at Hamburg-based data and AI engineering company AgentixLake. Supporting evaluation, testing, deployment, and monitoring.
Staff Applied AI Engineer
Staff Applied AI Engineer owning AI portfolios and shipping agentic applications. Modernizing collectibles authentication, grading, vaulting, and trading through applied AI.
Divisional Artificial Intelligence Engineer III
AI platform engineer leading architecture, reliability, and adoption for shared LLM infrastructure. Building reusable orchestration, observability, and production services across products.
Forward Deployed AI Engineer
Forward Deployed AI Engineer deploying production AI solutions for Keyrus, an enterprise intelligence consultancy. Integrating APIs, cloud platforms, enterprise systems, and client workflows.
Staff Applied AI Engineer
Staff Applied AI Engineer owning business-domain AI portfolios at Collectors, a collectibles authentication, grading, and trading technology company. Building production agents and reusable application patterns.
AI Architect, Software Architect
Arquitecto de IA Generativa y software para knowmad mood, compañía de transformación digital. Diseñando arquitecturas, soluciones empresariales y servicios de IA para clientes.
Java Software Architect, AI
Arquitecto Java y especialista en IA Generativa para knowmad mood, compañía de transformación digital. Diseñando arquitecturas, modernizando aplicaciones y asesorando a clientes en soluciones de IA.
Senior Libraries Engineer – AI, HPC
Senior Libraries Engineer developing GPU- and CPU-accelerated libraries for AI, image processing, and scientific computing at NVIDIA. Optimizing algorithms and leading library engineering projects.
AI Engineer, Forward Deployed
AI Engineer building production Claude agents, RAG pipelines, and MCP integrations for Collectiv’s enterprise analytics and AI consulting clients. Consulting directly with stakeholders from a fully remote U.S.-based role.
AI Engineer, Forward Deployed – Copilot, Azure AI Foundry
AI Engineer building production Microsoft Copilot and Azure AI Foundry solutions for Collectiv’s enterprise consulting clients. Developing RAG pipelines, agents, integrations, evaluations, and production-ready governance.
Engineer, Software Architect, AI Practitioner
Software-Architekt entwickelt moderne TypeScript-Enterprise-Anwendungen für DAI Software. Verantwortlich für Architektur, Entwicklung, Testing und Deployment KI-gestützter Lösungen.
AI Engineer, Analyst III
Pessoa AI Engineer no Grupo Boticário, líder brasileiro de beleza, desenvolvendo integrações com LLMs para o OMS. Automatizando fluxos, reduzindo trabalho manual e melhorando a experiência do usuário.
AI Engineer – New College Graduate
New graduate AI engineers building Bitdeer’s full-stack AI cloud infrastructure. Developing cloud, Kubernetes, model-serving, and AI Agent platforms for globally distributed workloads.
Junior AI Engineer
Engenheiro de IA júnior desenvolvendo chatbots, copilots e agentes autônomos baseados em LLMs. Integrando APIs, pipelines RAG e sistemas de observabilidade em produção.
AI Architect
AI Architect designing secure, scalable AI and ML solutions for a federal healthcare modernization program. Leading enterprise architecture, cloud integration, MLOps, and responsible AI practices.
Principal AI Engineer
Principal AI Engineer building Natera’s Vector Store GenAI Platform for clinical document intelligence. Setting retrieval architecture and shipping production AI systems for oncology and healthcare workflows.
AI Architect I
Agentic AI Architect designing scalable, reusable architectures for RealPage’s production AI agents. Translating workflows into reliable orchestration, integration, evaluation, and observability patterns.
AI Developer IV
Senior Agentic AI Platform Engineer building reusable orchestration, runtime, and reliability infrastructure. Enabling RealPage product teams to develop, release, evaluate, and operate production AI agents.
Legal & Compliance Lead – AI
Kovo's first legal and compliance hire building AI-enabled financial products for underserved consumers. Owning regulatory strategy, product launches, automation, and partner relationships.
Senior AI Developer, Technology Engineer
Senior AI Developer Technology Engineer accelerating generative AI training and inference on NVIDIA platforms. Optimizing algorithms, architectures, frameworks, and low-level software with developers and researchers.