Principal Data Engineer, Architect – Data Platform Assessment
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Principal Data Engineer at DaCodes evaluating data platforms for large-scale loyalty programs. Drive assessments and provide actionable insights across diverse projects and industries.
Responsibilities:
- Independently, thoroughly, and objectively assess a data platform that supports a large-scale loyalty program, identifying technical, operational, and business risks.
- Evaluate the end-to-end architecture of the data platform in cloud environments.
- Analyze batch and/or streaming data pipelines (ingestion, transformation, and consumption).
- Review practices related to:
- data quality
- transactional reconciliation
- handling of late events, duplicates, and reprocessing.
- Identify technical debt, single points of failure, and scalability risks.
- Evaluate how data supports critical loyalty program processes.
- Identify financial risks derived from data errors.
- Assess team maturity and dependencies on key individuals.
- Evaluate the handling of personal data (PII) and financial and transactional data.
- Review practices related to access control, auditing and traceability, and data lineage.
- Identify relevant compliance gaps.
- Deliver a structured diagnostic including critical risks (high impact), medium risks, and existing good practices.
- Provide prioritized recommendations and a 30 / 60 / 90-day roadmap.
Requirements:
- 8–12+ years of experience in data engineering and/or data architecture.
- Proven experience assessing existing platforms (assessment, audit, or recovery scenarios).
- Background in at least one of the following domains:
- loyalty programs
- fintech / payments
- high-volume e-commerce
- telecommunications
- Strong experience in cloud-native environments.
- Experience working with or evaluating platforms that include technologies such as:
- Cloud (AWS, Google Cloud, or Azure (or equivalent))
- Data Lakes (e.g., S3, GCS, ADLS)
- Data Warehouses (e.g., BigQuery, Snowflake, Redshift, Synapse)
- Advanced SQL
- Batch processing (e.g., Spark, Databricks, or similar)
- Event platforms such as Kafka, Kinesis, Pub/Sub
- Orchestration tools such as Airflow, Dagster, Prefect (or equivalent)
- SQL (mandatory)
- Python and/or Scala / Java
- Data quality validations
- PII handling
- Data auditing and traceability.
- Understanding of how loyalty programs operate.
- Familiarity with concepts such as:
- breakage
- points liability
- financial impact of data errors.
- Ability to assess risks from both technical and business perspectives.
- Strong critical thinking and sound technical judgment.
- Ability to read and evaluate code without needing to rewrite it.
- Clear communication with both technical and executive stakeholders.
- Ability to prioritize realistic and actionable recommendations.
- Expected Seniority: Principal / Staff Data Engineer, Senior Data Architect, Senior Technical Consultant with proven assessment experience
Benefits:
- 🚀 Integration with global brands and disruptive startups.
- 🏡 Remote work / Home office.
- ⏳ Schedule aligned with the assigned work cell/project.
- 📅 Monday to Friday work schedule.
- 🎉 Day off on your birthday.
- 🏥 Major medical expenses insurance (applies to Mexico).
- 🛡️ Life insurance (applies to Mexico).
- 🌎 Multicultural work teams.
- 🎓 Access to courses and certifications.
- 📢 Meetups with special guests from the IT field.
- 📡 Virtual integration events and interest groups.
- 📢 English classes.
- 🏆 Opportunities within our different business lines.
- 🏅 Proudly certified as a Great Place to Work.
Similar Jobs
Data Architect
Data Architect evaluating and evolving data architecture for partners at EVT. Focus on ingestion, processing, and structuring of data with a collaborative team environment.
Data Engineer
Data Engineer responsible for designing, building, and maintaining data pipelines at Loopback Health. Collaborating with cross-functional teams to drive system and process improvements.
Data Engineer
Data Engineer optimizing and maintaining data pipelines in Blackline Safety's IoT-enabled safety ecosystem. Collaborating with product, engineering, and analytics teams on impactful data-driven initiatives.
Senior Ingeniero de Datos
Senior Data Engineer developing data solutions for transforming lives at Sofka. Collaborating in a close-knit team focused on continuous improvement and technical excellence.
Senior Data Engineer
Senior Data Engineer at Arsipa developing scalable data platforms and ETL/ELT pipelines. Collaboration with teams to ensure data quality, performance, and innovation in data architecture.
Data Engineer
Data Engineer shaping cloud-based data solutions for top U.S. companies. Engage with diverse projects remotely from Latin America.
Senior Data Engineer
Senior Technical Consultant delivering end-to-end data solutions and managing client relationships. Collaborating with technical team to drive project success with Microsoft technologies.
Senior Data Engineer – Data for Products
Lead the design and implementation of scalable batch and streaming data pipelines on Azure. Collaborate with product teams to ensure data quality, performance, and governance across the data lifecycle.
Data Engineer
Data Engineer maintaining scalable data pipelines for an international company in Hamburg. Requires experience with Snowflake, ETL processes and Azure Data Factory.
IS Data Warehouse Architect – III
Data Warehouse Architect designing and developing data models and ETL specifications. Collaborating on data architecture and vendor relations for a nonprofit health care organization.
Senior Director – Data Platform, Analytics
Leading the development of an integrated data platform at Harbor Compliance. Unifying fragmented data and establishing governance to empower decision-making.
Senior Data Engineer
Senior Data Engineer at D.A. Davidson optimizing data integrations and migrating legacy structures. Involves cloud architecture and coordination with product teams.
Data Architect
Professional Services Delivery Architect at Ciena guiding global delivery teams and ensuring high-quality outcomes for customer engagements. Leading complex transformations and influencing solution strategy.
Distinguished Architect, Data Platform
Distinguished Architect leading the design of a next-generation data platform at CloudZero. Driving technical decisions and architectural innovations for scalable cloud cost management solutions.
Senior Data Engineer
Data Engineer designing and maintaining data pipelines for Arrow Electronics. Collaborating with teams in engineering and architecture discussions across global projects.
Data Engineer – AI, Spark, Databricks, Healthcare
Data Engineer managing advanced Spark scripts for data validation and integration at Cotiviti. Collaborating with engineering teams to ensure data integrity and compliance in healthcare data processes.
Senior Software Engineer, Data Platform Team
Senior Software Engineer designing and developing features for data platforms at Sysdig. Leading technical strategy and mentoring teams in cloud security innovations.
Data Engineering Architect – Manager
Data Engineering Architect managing scalable AWS Data Lakehouse architectures at Naveera Technology. Overseeing data engineering projects with a focus on analytics and reporting solutions.
AI Data Engineer
AI Data Engineer bridging data warehousing and AI-driven analytics capabilities. Collaborating on automated solutions and operational workflows in eCommerce with global brands.
AI Data Engineer
AI Data Engineer at Netwrix designing and building enterprise-grade data and AI platforms. Focused on stability and repeatability while adhering to security and governance standards.