Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer responsible for building enterprise-grade data pipelines for a global client. Join a premier AI services provider to drive innovation with data science and technology.
Responsibilities:
- Design and build production-grade data pipelines in Databricks using Spark/PySpark and SQL.
- Develop and maintain an Analytics ID stitching pipeline using deterministic and probabilistic matching techniques across multiple customer data sources.
- Build and manage modular data marts (Identity, Behavior, Demographics) with independent refresh cadences.
- Implement and maintain a scalable feature store supporting downstream analytics and data science use cases.
- Own the end-to-end data lifecycle: ingestion, transformation, validation, deployment, monitoring, and optimization.
- Develop data quality frameworks including schema drift detection, anomaly monitoring, match-rate validation, and automated deduplication audits.
- Implement CI/CD processes for multi-environment promotion (dev/staging/prod) in Databricks environments.
- Coordinate orchestration workflows and manage dependencies using Databricks Workflows or similar tools.
- Collaborate closely with Data Architects and Client stakeholders to translate business rules into scalable technical solutions.
- Produce comprehensive technical documentation including data contracts, lineage maps, architecture diagrams, and operational runbooks.
Requirements:
- 4+ years of experience in Data Engineering building production-grade data pipelines at scale.
- Strong hands-on experience with Databricks and Apache Spark (PySpark preferred).
- Advanced SQL skills (complex joins, CTEs, window functions, performance tuning).
- Experience developing identity resolution or entity matching pipelines (deterministic and/or probabilistic).
- Experience designing and implementing data marts or dimensional models (Kimball or similar).
- Familiarity with data quality frameworks (schema drift detection, validation, anomaly monitoring).
- Experience implementing CI/CD for data pipelines and managing multi-environment deployments.
- Strong communication skills and ability to present technical concepts to non-technical stakeholders.
- Experience using Jira for ticket tracking and Confluence for documentation.
- Nice to Have: Experience with third-party data providers (Epsilon, LiveRamp, Neustar).
- Experience with feature stores (Databricks Feature Store, Feast, or similar).
- Knowledge of Databricks Unity Catalog.
- Experience managing large-scale customer data (transactions, loyalty, retail/QSR data).
- Experience with Delta Lake / Lakehouse architecture.
- Familiarity with orchestration tools such as Airflow.
- Experience working in consulting or embedded enterprise client environments.
- Advanced English level (written and spoken) required for client-facing collaboration and technical presentations.
Benefits:
- 📚Learning Opportunities: Certifications in AWS (we are AWS Partners), Databricks, and Snowflake.
- Access to AI learning paths to stay up to date with the latest technologies.
- Study plans, courses, and additional certifications tailored to your role.
- Access to Udemy Business, offering thousands of courses to boost your technical and soft skills.
- English lessons to support your professional communication.
- 👨🏽💻Travel opportunities to attend industry conferences and meet clients.
- 👩🏫 Mentoring and Development: Career development plans and mentorship programs to help shape your path.
- 🎁 Celebrations & Support: Special day rewards to celebrate birthdays, work anniversaries, and other personal milestones.
- Company-provided equipment.
- ⚖️ Flexible working options to help you strike the right balance.
- Other benefits may vary according to your location in LATAM.
Similar Jobs
Data Architect
Data Architect evaluating and evolving data architecture for partners at EVT. Focus on ingestion, processing, and structuring of data with a collaborative team environment.
Data Engineer
Data Engineer responsible for designing, building, and maintaining data pipelines at Loopback Health. Collaborating with cross-functional teams to drive system and process improvements.
Data Engineer
Data Engineer optimizing and maintaining data pipelines in Blackline Safety's IoT-enabled safety ecosystem. Collaborating with product, engineering, and analytics teams on impactful data-driven initiatives.
Senior Ingeniero de Datos
Senior Data Engineer developing data solutions for transforming lives at Sofka. Collaborating in a close-knit team focused on continuous improvement and technical excellence.
Senior Data Engineer
Senior Data Engineer at Arsipa developing scalable data platforms and ETL/ELT pipelines. Collaboration with teams to ensure data quality, performance, and innovation in data architecture.
Data Engineer
Data Engineer shaping cloud-based data solutions for top U.S. companies. Engage with diverse projects remotely from Latin America.
Senior Data Engineer
Senior Technical Consultant delivering end-to-end data solutions and managing client relationships. Collaborating with technical team to drive project success with Microsoft technologies.
Senior Data Engineer – Data for Products
Lead the design and implementation of scalable batch and streaming data pipelines on Azure. Collaborate with product teams to ensure data quality, performance, and governance across the data lifecycle.
Data Engineer
Data Engineer maintaining scalable data pipelines for an international company in Hamburg. Requires experience with Snowflake, ETL processes and Azure Data Factory.
IS Data Warehouse Architect – III
Data Warehouse Architect designing and developing data models and ETL specifications. Collaborating on data architecture and vendor relations for a nonprofit health care organization.
Senior Director – Data Platform, Analytics
Leading the development of an integrated data platform at Harbor Compliance. Unifying fragmented data and establishing governance to empower decision-making.
Senior Data Engineer
Senior Data Engineer at D.A. Davidson optimizing data integrations and migrating legacy structures. Involves cloud architecture and coordination with product teams.
Data Architect
Professional Services Delivery Architect at Ciena guiding global delivery teams and ensuring high-quality outcomes for customer engagements. Leading complex transformations and influencing solution strategy.
Distinguished Architect, Data Platform
Distinguished Architect leading the design of a next-generation data platform at CloudZero. Driving technical decisions and architectural innovations for scalable cloud cost management solutions.
Senior Data Engineer
Data Engineer designing and maintaining data pipelines for Arrow Electronics. Collaborating with teams in engineering and architecture discussions across global projects.
Data Engineer – AI, Spark, Databricks, Healthcare
Data Engineer managing advanced Spark scripts for data validation and integration at Cotiviti. Collaborating with engineering teams to ensure data integrity and compliance in healthcare data processes.
Senior Software Engineer, Data Platform Team
Senior Software Engineer designing and developing features for data platforms at Sysdig. Leading technical strategy and mentoring teams in cloud security innovations.
Data Engineering Architect – Manager
Data Engineering Architect managing scalable AWS Data Lakehouse architectures at Naveera Technology. Overseeing data engineering projects with a focus on analytics and reporting solutions.
AI Data Engineer
AI Data Engineer bridging data warehousing and AI-driven analytics capabilities. Collaborating on automated solutions and operational workflows in eCommerce with global brands.
AI Data Engineer
AI Data Engineer at Netwrix designing and building enterprise-grade data and AI platforms. Focused on stability and repeatability while adhering to security and governance standards.