Senior Backend Software Engineer, Data/ETL
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Backend Software Engineer building and scaling data ingestion pipelines and architecture for AI-driven product suite. Collaborate with teams to optimize data workflows in a fully remote role.
Responsibilities:
- Design and build data ingestion pipelines integrating with dozens of external sources (social platforms, third-party APIs, web scrapers)
- Architect ETL workflows using Airflow and Kafka to process high-volume data streams (millions of records daily)
- Collaborate with AI/ML engineers to ensure data quality and availability for Agentic RAG pipelines
- Build and optimize multi-store data architecture: vector databases (Pinecone), relational databases (Postgres), and search engines (OpenSearch)
- Develop and maintain integrations with social media platforms (Meta, LinkedIn, TikTok, X/Twitter) handling webhook ingestion and API polling
- Optimize data freshness, throughput, and reliability across distributed systems
- Participate in code reviews and contribute to backend services (FastAPI/Python, occasional Ruby on Rails)
Requirements:
- Bachelor's degree in Computer Science or related degree; or equivalent work experience
- Minimum 5 years of professional software engineering experience
- Minimum 4 years proven experience building data pipelines and ETL workflows in Python
- Minimum 3 years experience with workflow orchestration tools (Airflow, Dagster, Prefect, or similar)
- Minimum 3 years working with multiple data storage technologies (relational, vector, search engines)
- Experience with message queues and event streaming (Kafka, RabbitMQ, SQS/SNS)
- Proven experience building high-throughput, fault-tolerant systems (we process 100s of millions of comments per year)
- Strong understanding of API design, rate limiting, and webhook handling
- Experience with data quality monitoring and observability
- Demonstrated ability to take ownership of projects, prioritize tasks, and deliver high-quality results independently
Benefits:
- Flex PTO plan
- Generous holidays and off-week between Christmas and New Years
- Multiple healthcare options, including plans with FSA and HSA
- Matching traditional and Roth 401k—immediately vested
- Family and paternity leave
- Life Insurance
Similar Jobs
Full Stack Developer, Python
Full Stack Python Developer focused on developing dynamic web applications and APIs. Work with modern technologies in a flexible environment, contributing to impactful projects.
Java Developer – Mid/Senior, Python
Java Developer responsible for backend architecture and microservices at Salve.Inno Consulting. Engaging in product decisions and collaborating with multiple engineering teams.
Senior Backend Developer, PHP
Senior Backend Developer contributing to backend solutions that support language access services. Focused on PHP, Symfony, and REST APIs within a multicultural global team.
Junior Backend Developer, Python
Junior Backend Developer working with Python in an automated content production environment at uNaice GmbH. Involves API development and data processing for e-commerce and publishing sectors.
Senior Developer, C#, .NET, SQL
Senior Developer at Fresche Solutions focusing on backend solutions with C# and SQL for data applications. Collaborating with clients and optimizing database performance in a flexible remote environment.
Senior Developer – C#, .NET, SQL
Senior Developer at Fresche Solutions specializing in C#, .NET, and SQL. Designing, building, and optimizing data-driven application solutions with complex queries and backend systems.
Senior Backend Java – Event-Driven Architecture
Senior Backend Java position focusing on event-driven architecture for FlyingHub, a drone management platform. Responsible for building robust backend systems and ensuring modular design.
Senior Java Developer
Senior Java Developer focusing on back-end software development for Miquido's projects. Join remote team in Poland to contribute to innovative software solutions.
Desarrollador Backend
Seeking a Backend Developer with solid .NET experience in a tech transformation company focused on local and international needs. Join a supportive and professional work environment emphasizing work-life balance.
Lead PHP/React Developer
Lead Developer responsible for managing PHP and React applications for process automation at a small team in Hamburg remote. Overseeing software architecture, team leadership, and quality assurance.
Senior Backend Engineer
Senior Backend Engineer developing a cross-platform presentation tool for a new company from the makers of Wunderlist. Seeking a product-oriented backend developer skilled in Go, Clojure, or Node.js.
Mid-level Java Software Engineer
Software Engineer developing Java applications in the Squad Alavancas Lojas at Grupo Casas Bahia. Focusing on creating tools for credit and insurance services for sales support.
.NET & Python Developer (AWS) – Mid/Senior
Senior developer at GFT working with .NET, Python, and AWS technologies. Focus on microservices, cloud development, and CI/CD implementations.
Senior .NET Developer, Python, AWS
Senior professional required for .NET and Python development in AWS at GFT. Engaging in team collaboration and cloud application management.
Java Developer
Java Developer creating innovative software solutions for educational institutions. Collaborating closely with users and team using modern technologies and responsive applications.
Engineer III – Backend
Software Engineer building systems for Falcon security operations at CrowdStrike. Collaborate with research and development teams to enhance cybersecurity solutions with scalable cloud technology.
Cloud Software Architect – Node.js, React.js
Cloud Software Architect designing and building modern cloud solutions for mission-critical government projects. Collaborating with Agile teams to architect, deploy, and sustain a multi-tenant cloud platform.
Software Engineer, Backend
Senior Software Engineer contributing to AI platform for healthcare documentation. Building robust user-facing features and scaling platform for clinician efficiency.
Associate Technical Architect – Databricks
Associate Technical Architect developing solutions for data migration and processing at Quantiphi, an AI-first digital engineering company.
Senior Backend Engineer, Solana
Senior Backend Engineer designing and maintaining scalable API services for Blockworks. Leading backend development in a fast-paced startup environment with a focus on quality and performance.