Senior Data Engineer – Equity
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer enhancing backend systems and optimizing recommendation algorithms for a social media app. Contributing to the architecture and performance of the recommendation infrastructure.
Responsibilities:
- Design, optimize, and maintain tables and data structures to support recommendation and trending content data.
- Work with structured data storage solutions, including PostgreSQL and JSONB, to manage recommendation and interaction data.
- Implement and refine recommendation algorithms (e.g., collaborative filtering, content-based, and hybrid approaches) to enhance relevancy.
- Use similarity search libraries like Annoy or Faiss to optimize recommendation speed and accuracy.
- Continuously evaluate recommendation logic to better serve user preferences, ensuring real-time delivery.
- Aggregate, analyze, and process user interaction data to support recommendations and trending content.
- Design efficient queries and implement aggregation methods to capture relevant data and insights for recommendations.
- Identify, troubleshoot, and resolve data handling issues to ensure accurate recommendation delivery.
- Optimize queries, processing workflows, and containerised services for high performance and scalability within AWS ECS.
Requirements:
- Proven experience as a Data Engineer or Backend Engineer, with a focus on recommendation systems.
- Proficient in SQL and database management, especially with PostgreSQL and JSONB for structured data handling.
- Solid understanding of recommendation algorithms (collaborative filtering, content-based, hybrid approaches).
- Experience with similarity search libraries such as Annoy or Faiss.
- Strong programming skills in Python, with experience in building backend logic for data-intensive applications in a containerised environment.
- Familiarity with AWS ECS for container management, including task scheduling and scaling.
- Experience using AWS EventBridge to trigger workflows or automate tasks in response to application events.
- Analytical skills for data aggregation, querying, and insights generation.
- Strong debugging and optimisation skills for handling large-scale data processing in cloud-based environments.
Benefits:
- This is an equity-only position, offering a unique opportunity to gain a stake in a rapidly growing company and contribute directly to its success.
Similar Jobs
Senior Data Engineer
Senior Data Engineer responsible for developing data pipelines and collaborating on metrics at Mytra. Take ownership of data infrastructure and work with cross-functional teams.
Data Engineering – Tech Lead / Manager
Leading the Data Engineering team for DIGITIZEI INFORMATICA LTDA, focusing on technical guidance and individual growth. Overseeing analytics projects with significant impact on business decisions and product development.
Senior Data Engineer – Engenheiro de Dados Sênior
Senior Data Engineer at Dadosfera leading data-focused projects for startups and corporations. Involves building data pipelines, cloud solutions, and quality assurance in data management.
Senior Product Manager, Data Platform
Senior Product Manager responsible for adopting AI in healthcare data solutions. Collaborating across teams to enhance product development and drive measurable impact.
Data Engineer
Data Engineer building and managing scalable data infrastructure at Alpha Lion. Transforming fragmented data into reliable and analytics-ready datasets for decision-making.
Senior Software Developer, Data Platform
Senior Software Developer modernizing Data Transfer Platform for Intrahealth, a healthcare EMR provider. Focusing on scalable and configurable backend systems in a complex environment.
Data Architect
Data Architect evaluating and evolving data architecture for partners at EVT. Focus on ingestion, processing, and structuring of data with a collaborative team environment.
Data Engineer
Data Engineer responsible for designing, building, and maintaining data pipelines at Loopback Health. Collaborating with cross-functional teams to drive system and process improvements.
Data Engineer
Data Engineer optimizing and maintaining data pipelines in Blackline Safety's IoT-enabled safety ecosystem. Collaborating with product, engineering, and analytics teams on impactful data-driven initiatives.
Senior Ingeniero de Datos
Senior Data Engineer developing data solutions for transforming lives at Sofka. Collaborating in a close-knit team focused on continuous improvement and technical excellence.
Senior Data Engineer
Senior Data Engineer at Arsipa developing scalable data platforms and ETL/ELT pipelines. Collaboration with teams to ensure data quality, performance, and innovation in data architecture.
Data Engineer
Data Engineer shaping cloud-based data solutions for top U.S. companies. Engage with diverse projects remotely from Latin America.
Senior Data Engineer
Senior Technical Consultant delivering end-to-end data solutions and managing client relationships. Collaborating with technical team to drive project success with Microsoft technologies.
Senior Data Engineer – Data for Products
Lead the design and implementation of scalable batch and streaming data pipelines on Azure. Collaborate with product teams to ensure data quality, performance, and governance across the data lifecycle.
Data Engineer
Data Engineer maintaining scalable data pipelines for an international company in Hamburg. Requires experience with Snowflake, ETL processes and Azure Data Factory.
IS Data Warehouse Architect – III
Data Warehouse Architect designing and developing data models and ETL specifications. Collaborating on data architecture and vendor relations for a nonprofit health care organization.
Senior Director – Data Platform, Analytics
Leading the development of an integrated data platform at Harbor Compliance. Unifying fragmented data and establishing governance to empower decision-making.
Senior Data Engineer
Senior Data Engineer at D.A. Davidson optimizing data integrations and migrating legacy structures. Involves cloud architecture and coordination with product teams.
Data Architect
Professional Services Delivery Architect at Ciena guiding global delivery teams and ensuring high-quality outcomes for customer engagements. Leading complex transformations and influencing solution strategy.
Distinguished Architect, Data Platform
Distinguished Architect leading the design of a next-generation data platform at CloudZero. Driving technical decisions and architectural innovations for scalable cloud cost management solutions.