Software Engineer – API Gateway
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Software Engineer supporting API gateway development for Featherless.ai, enhancing AI inference cloud infrastructure. Collaborating on feature development, reliability improvements, and managing infrastructure.
Responsibilities:
- support and evolve the API gateway to our inference cloud, which is responsible for
- authentication and inference to all models
- subscription management and subscription entitlement (e.g. context-length, concurrency limits)
- providing the necessary API surface for applications and builders
- undertake feature development and bug fixes to keep up with clients, resolve user issues, and onboard new models
- improve the reliability of the existing API (increasing instrumentation and monitoring, right-sizing infrastructure)
- respond to availability incidents
- triage and resolve issues of inference quality and reliability
- manage the infrastructure on which our gateway runs
Requirements:
- first-hand experience of the user’s we’re building for (familiarity with popular open LLMs, common clients, and experience building with LLM)
- experience with the technologies and paradigms of the web (REST, websockets, DNS, networking, opentelemetry)
- experience with significant components of our stack (k8s, node, mikro-orm, fastify, redis, mongodb, python, elastic cloud, cloudflare, sentry, otel)
- ability to debug complex issues across a wide stack and build instrumentation as necessary
- desire to work collaboratively as part of a skilled team
- Alignment with team and company values, including
- bias to action
- responsiveness to users (bug-fixes over features)
- instinct to iterate
- subscribing to that done means proven by usage data
Benefits:
- This team operates on Eastern Time
- Remote preference to hire in Toronto, Canada
Similar Jobs
Senior Software Engineer
Software Engineer for the WEX Benefits Technology team, focusing on customer challenges and software solutions. Building high-quality software using modern technologies and testing practices.
Product Engineer
Product Engineer at Scrunch building and shipping product end-to-end across frontend and backend technologies. Contributing to product decisions and leveraging modern AI tools for efficiency.
Product Engineer
Product Engineer at Scrunch focusing on building and shipping product features for AI marketing solutions. Work across frontend and backend to develop high-quality user experiences.
Software Engineer, New Grad
Software Engineer New Grad position at Dunder Mifflin. Join the team to contribute to software engineering initiatives.
Principal Software Engineer
Principal Software Engineer responsible for building scalable software applications at Highmark Health. Collaborating across teams to drive technical execution of multi-channel solutions.
Principal Engineer, Public Cloud – R&D Core
Principal Engineer driving the design and architecture of large-scale cloud services for data management at Cloudera. Collaborating with cross-functional teams to ensure technical excellence and scalability.
Senior Manager – Full Stack Engineering
Senior Manager leading Full Stack Engineering to deliver high-quality applications at CCC Intelligent Solutions. Providing technical leadership and managing a team of full stack engineers in scalable web solutions.
Lead Engineer, Software
Lead Software Engineer providing technology strategy and mentoring for Ensemble’s software delivery teams. Focused on design, development, and collaboration to meet client needs.
Senior Engineer – Supersonic
Senior Engineer for AI-driven development at Fingermark, supporting customer solutions in QSR sector. Focused on modern software development and technical leadership within the Supersonic team.
Senior Engineer – Supersonic
Senior Engineer developing AI-driven solutions for Fingermark's ecommerce platforms. Leading agentic coding workflows and building resilient architectures in GCP.
Full Stack Engineer, AI Systems
Backend Engineer for AI systems by building reliable and fast backend systems. Focused on creating APIs and optimizing production environments for AI features.
Software Engineer – HealthTech
Software Engineer developing HealthTech solutions focusing on full-stack development in agile teams at PLANFOX. Collaborating on robust software architectures for the healthcare sector.
Senior Software Engineer – m/f/d
Senior Software Engineer focusing on backend development for Credibur, a fintech startup automating debt management. Improving core systems while maintaining performance, correctness, and reliability.
Software Developer
Software Developer designing and building scalable applications on Intelex's next‑generation platform. Collaborating with teams to deliver high‑quality solutions in an Agile environment.
Full-Stack Web Developer – m/w/d
Full-Stack Web Developer developing software cellms® with a focus on programming and design. Collaborating in an agile team through all phases from planning to deployment in Germany.
Fullstack Developer
Fullstack Developer responsible for creating intuitive user interfaces for web applications. Collaborating on projects with modern frontend technologies like React, Angular, or Vue.js.
Senior Software Engineer, Windows Desktop App
Senior Software Engineer developing secure, privacy-focused Windows applications for DuckDuckGo. Collaborating with teams to define roadmaps and deliver key features.
Engineering Team Leader, Elements Team
Engineering Team Leader at Fundraise Up, leading a distributed team of Fullstack developers. Driving the development of embedded donation widgets for non-profits.
Engineering Team Leader, Elements Team
Engineering Team Lead leading a remote team to build embedded donation technologies for nonprofits. Overseeing development processes and mentoring engineers while collaborating across global teams.
Engineering Team Leader
Team Lead developing embedded widgets for a global fundraising platform. Leading a remote team of Fullstack developers with a focus on impactful technology.