Senior Software Engineer Lead
Posted 2hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Leading design and implementation of Akamai's globally distributed AI inference platform. Optimizing containerized workloads, inference frameworks, and OpenAI-compatible endpoints.
Responsibilities:
- Lead the design and implementation of critical platform components for Akamai Inference Cloud
- Drive technical decisions for AI inference workloads, including selecting tools, frameworks, and approaches
- Mentor and guide engineers through code reviews, design discussions, and technical problem-solving
- Implement and optimize containerized AI workloads with hardware-specific optimizations
- Integrate inference frameworks at scale
- Collaborate across teams to define technical requirements and contribute to platform standards
- Ensure operational excellence and delivery of high-quality, scalable solutions
- Build and optimize globally distributed systems delivering OpenAI-compatible endpoints and orchestrating inference workloads across regions
Requirements:
- 8 years of relevant experience
- Bachelor's degree or its equivalent
- Proficiency in distributed systems, cloud services, and platform engineering
- Hands-on experience with AI inference, model serving, or LLM deployment
- Working knowledge of TensorRT, vLLM, TorchServe, and Triton
- Experience with Kubernetes, Docker, and cloud-native architectures
- Experience building scalable, high-performance systems
- Experience with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code
- Technical leadership through mentoring, code quality advocacy, and driving technical solutions for complex problems
- Familiarity with REST/gRPC API design and development
- Knowledge of GPU infrastructure and hardware acceleration
- Knowledge of observability, monitoring, and debugging distributed systems
Benefits:
- Annual bonus or incentives
- Equity awards
- Employee Stock Purchase Plan (ESPP)
- Healthcare
- 401K savings plan
- Company holidays
- Vacation (in the form of PTO)
- Sick time
- Parental leave
- Employee assistance program
- Mental and financial wellness support
- Flexible work arrangements: at home, in an office, or a combination of both
















