Senior Machine Learning Software Engineer
Posted 9hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Machine Learning Senior Software Engineer building model validation, optimization, and safety systems for Akamai’s distributed cloud platform. Developing secure inference pipelines, guardrails, and model evaluation frameworks.
Responsibilities:
- Develop and maintain model validation and security scanning pipelines assessing models for quality, correctness, and vulnerabilities before deployment
- Implement quantization, pruning, and other optimization techniques to reduce model footprint and improve inference latency across diverse hardware configurations
- Build guardrail and content safety systems enforcing compliance policies and mitigating jailbreaking and prompt injection risks
- Design model routing and prompt management infrastructure for intelligent request handling across model variants
- Contribute to model evaluation frameworks measuring accuracy, performance, and safety metrics across the model lifecycle
- Build and operate systems responsible for model validation, quantization, and safety across the Akamai Inference Cloud
Requirements:
- 5 years of relevant experience
- Bachelor's or Master's degree in Computer Science, Machine Learning, or a related field
- Hands-on experience with PyTorch, TensorFlow, or JAX, including model training, fine-tuning, and inference optimization
- Proficiency in GPTQ, AWQ, and GGUF model quantization techniques
- Understanding of how model compression impacts accuracy and latency
- Experience with large language models, transformer architectures, and multi-modal AI systems
- Familiarity with model safety and responsible AI practices, including content filtering, red-teaming, or adversarial robustness evaluation
- Proficiency in Python and experience building production data or ML pipelines
- Experience with containerized deployments, CI/CD practices, and cloud infrastructure is suggested but not required
Benefits:
- Flexible work from home, office, or both
- Healthcare
- 401K savings plan
- Company holidays
- Vacation in the form of PTO
- Sick time
- Parental leave
- Employee assistance program
- Mental wellness support
- Financial wellness support
- Annual bonus or incentives
- Equity awards
- Employee Stock Purchase Plan (ESPP)
- Opportunities to grow, flourish, and achieve great things














