AI Architect
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Architect scaling AI pipeline infrastructure for The Information, a technology and business journalism publisher. Designing reliable LLM workflows, observability, and high-fan-out platform capabilities.
Responsibilities:
- Maintain and operate all existing AI pipelines on the platform
- Migrate remaining workflows from the legacy orchestration framework to the primary platform
- Own on-call response for AI pipeline failures, including failed-job triage and retries
- Manage LLM provider relationships, API key rotation, cost tracking, and model upgrades
- Design and implement new high-fan-out AI pipelines for future horizontal workflows
- Establish conventions for onboarding new pipelines, including registry entries, job subclassing, batch fan-out, and automated reporting
- Drive architectural decisions around data storage, queue partitioning, concurrency throttling, and cost controls
- Evaluate and integrate new LLM providers and embedding models while maintaining backward compatibility with existing vector data
- Build observability and operational tooling, including custom reporting, cost tracking, and alerting
- Partner with product, editorial/content, and growth teams to translate requirements into pipeline designs
- Integrate AI pipelines with the broader technical stack
- Mentor engineers on AI pipeline patterns, prompt engineering, and platform architecture
- Own the technical proposal process for new pipelines and major infrastructure changes
Requirements:
- 5+ years building production applications in a modern web framework such as Rails, Django, or similar
- Strong experience with ORM usage, API-only application design, and background job processing
- Proven experience designing idempotent, retryable, fan-out job pipelines, including batching, concurrency controls, dead-letter handling, and queue partitioning
- Hands-on experience with multiple LLM providers, structured output, embeddings, prompt engineering, and cost tracking
- Experience with a vector database for similarity matching at scale, including batched queries, namespace management, and embedding model migration
- Experience running internal services on a cloud PaaS or equivalent, with relational databases, caching/queueing infrastructure, and observability tooling
- Track record of authoring technical design documents, making build-vs-buy decisions, and designing extensible platforms
- Must be eligible to live and work in the United States
- Preferred: 5+ years of Ruby/Ruby on Rails experience
- Preferred: Experience migrating workflows from a Python-based orchestration framework to a Ruby-based framework
- Preferred: Familiarity with agent orchestration and LLM tracing/observability ecosystems
- Preferred: Experience with AI alerting or notification systems
- Preferred: Background in media/publishing AI applications
- Preferred: Experience with state machine libraries for managing job lifecycles
- Preferred: Experience building retrieval-augmented generation (RAG) pipelines
Benefits:
- Company-paid medical, dental, and vision coverage for employees and their dependents
- Medical coverage that includes fertility care and $0 copays for in-office mental health visits with in-network providers
- Paid parental leave
- Generous paid time off (PTO) that increases with tenure
- 401(k) plan with employer matching contributions
- Flexible Spending Accounts (FSAs) for healthcare and dependent care expenses
- Fitness and wellness stipend
- Monthly cell phone reimbursement
- Company-sponsored lunches in the office every Monday
- Commuter benefits
- Supportive, inclusive, and diverse work environment with a zero-tolerance policy for harassment
- Bonus
Similar Jobs
AI/Enterprise Architect Engineer, AI Specialist – Content Developer
AI systems engineering content developer creating production-grade educational materials for Jala University. Applying AI architecture, migration, documentation, and compliance expertise to practical industry-focused education.
AI Engineer – RAG and Agents, Content Developer
AI content developer creating RAG and agent curriculum for Jala University's Master in AI Systems Engineering. Developing practical, industry-aligned education for underserved regions.
Senior AI Engineer, Agents
Senior AI Engineer advancing clinical AI agents for a Latin American healthtech company. Designing ontologies, fine-tuning models, and building evaluations for production healthcare workflows.
Senior AI Engineer, Location AI
Senior AI Engineer building LLM-backed evaluation systems, agent tooling, and data pipelines. Improving Mapbox's real-time location platform across Search, Places, Navigation, and developer tools.
Senior AI Engineer – Location AI
Senior AI Engineer building evaluation-driven LLM systems, data pipelines, and agent tooling for Mapbox's real-time location platform. Owning production AI quality, latency, and reliability across teams.
Senior AI Architect
Senior AI Architect designing production-ready AI architectures for Genesys Cloud customer-experience orchestration. Leading presales discovery, prototypes, integrations, and executive technical engagements.
Senior Software Engineer – AI, Search
Senior Software Engineer building Ford’s Java cloud-native eCommerce microservices platform. Designing scalable, fault-tolerant services and search capabilities for future mobility.
Director, AI Engineering
Director leading Capital One’s AI infrastructure and optimization systems. Building responsible, scalable AI capabilities that transform customer and associate banking experiences.
Senior/Lead Forward Deployed AI Engineer
Senior AI engineer deploying Claude-powered enterprise workflows and integrations for NewRocket’s ServiceNow customers. Building secure, evaluated, reusable AI solutions across enterprise environments.
Forward Deployed AI Engineer
Forward Deployed AI Engineer delivering Claude-powered AI workflows, integrations, and automations for NewRocket enterprise clients. Building secure, scalable solutions across ServiceNow and broader business ecosystems.
AI Engineer – Campus Hire
Early-career AI Engineer building Claude-powered, agentic AI and RAG solutions for NewRocket, an AI-first ServiceNow partner. Supporting enterprise automation, evaluation, and deployment.
AI Engineer
AI Engineer building Cognigy conversational AI, LLM, and API integrations. Supporting Acliviti’s enterprise customer-experience and technical-transformation consulting clients.
Senior Software Engineer – AI
Senior AI Engineer building production AI features for Usersnap’s SaaS feedback platform. Owning fullstack architecture, LLM integrations, evaluation, and reliable launches.
Staff Software Engineer, AI/ML Infrastructure
Staff Software Engineer building AI/ML and evaluation infrastructure for Thumbtack's home-services marketplace. Designing scalable GenAI platforms, model systems, and developer tooling.
Staff Software Engineer, AI/ML Infrastructure
Staff Software Engineer building scalable AI/ML platforms and evaluation systems. Enabling Thumbtack’s home-services marketplace and GenAI-powered customer experiences.
Software, AI Architect
Software & AI Architect building Brightfin’s AI-native platform for IT financial management, technology expense management, and FinOps. Owning architecture, AI capabilities, infrastructure, and governance.
Staff AI Engineer
Staff AI Engineer building retrieval, inference, and agentic systems for Acquia’s Drupal-based digital experience platform. Shipping shared AI capabilities that turn enterprise data signals into customer workflows.
Lead AI Engineer
Lead AI Engineer modernizing InsCipher’s insurance compliance platform with production GenAI and agentic systems. Defining AI architecture, LLMOps standards, and enterprise engineering practices.
Technical Lead, AI and Automation
Líder técnico de IA e automação conduzindo arquitetura, governança e inovação. Impulsionando a transformação digital da Solo Network Brasil com times e embaixadores.
Software Engineer, AI, IT, Data Evaluator
AI evaluator reviewing software, IT, and data artifacts for accuracy and quality. Providing structured feedback to help Mercor and leading AI labs train frontier models.