Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer responsible for designing and building data infrastructure in iGaming and Fintech. Collaborate with cross-functional teams to ensure reliable data processing and analysis.
Responsibilities:
- Design and implement robust, scalable data architecture to support the collection, storage, and processing of large volumes of igaming and customer data
- Build and maintain efficient ETL and ELT processes to ensure seamless data ingestion from multiple sources into our data lake, DWH, and final consumers
- Create and maintain well-structured data models that ensure accuracy, integrity, and optimal performance for analytical use cases following Kimball best practices
- Collaborate with cross-functional teams to integrate data across systems, with several types of integration as API, Kafka, DB extractions, Webscrapping, Email, etc.
- Develop and manage real-time data pipelines using streaming technologies (e.g., Kafka) to support time-sensitive use cases
- Enforce data governance policies and best practices, ensuring high standards for data quality, security, and regulatory compliance
- Continuously monitor, troubleshoot, and optimize data pipelines, queries, and infrastructure for speed, efficiency, and reliability
- Support and expand production-grade orchestration workflows using Apache Airflow
- Set up and maintain monitoring, alerting, and observability for data pipelines and systems using tools like Elementary, Datadog, Prometheus, or Grafana
- Develop and maintain CI/CD pipelines for data projects using Bitbucket Pipelines or GitHub Actions, ensuring streamlined deployment and testing processes
- Follow best practices in Git-based version control and work collaboratively in a modern DevOps environment.
Requirements:
- 5+ years of experience with Python, preferably including 2+ years working with Airflow
- 5+ years of experience with SQL in big data environments, preferably including 2+ years with dbt
- 4+ years in cloud environments, preferably with 2+ years each in Snowflake and AWS
- 2+ years of experience with data streaming platforms, preferably on Kafka
- 2+ years of hands-on experience with containerization (Docker, Kubernetes)
- 3+ years managing CI/CD pipelines, ideally using Bitbucket Pipelines or GitHub Actions
- Deep understanding of data governance, data quality, and data lineage principles
- Proficient in using monitoring and alerting tools such as Datadog, Prometheus, or Grafana
- Solid experience with version control tools (Git) and IaaS (e.g., Terraform)
- Strong communication and problem-solving skills, with a proactive and self-driven attitude.
Benefits:
- Competitive salary synonymous with skills and experience
- Performance and bonus structure dependent on achievement of set targets and personal performance
- The opportunity to making a real impact at a time of rapid growth
- Consultancy B2B contract on a full time basis with 25 days PTO
Similar Jobs
Data Engineer III
Data Engineer III designing and building complex data pipelines for AI/ML capabilities in the leading firm Robert Half. Collaborating with cross-functional teams to optimize data infrastructure and ensure data quality.
Data Engineer
Data Engineer responsible for designing and maintaining data architecture and infrastructure. Developing, testing, and deploying data solutions to meet organizational needs.
Data Engineer, L2
Data Engineer responsible for designing, building, and maintaining data architecture and infrastructure. Develop and deploy data solutions meeting organizational needs.
Lead Data Engineer
Lead Data Engineer building and scaling modern data platforms that power analytics and AI/ML initiatives at Evnek Technologies. Collaborate and mentor while ensuring reliable data infrastructure.
Senior GCP Data Engineer
Senior Consultant in GCP Data Engineering, designing and implementing scalable data solutions at EY. Collaborating with stakeholders and optimizing data pipelines within an agile consulting framework.
Product Owner – Data Platform
Product Owner at Localiza&Co focusing on the evolution of data platforms aligned with company strategies. Collaborating across engineering, data, and business teams.
Senior Data Engineer – PowerBI, Databricks
Senior Data Engineer focusing on Power BI and Azure Databricks for a global reinsurance client. Building centralized reporting platform and contributing to claims data transformation.
Lead Data Engineer, Multiple Positions Available
Lead Data Engineer responsible for designing and implementing data movement solutions for Provident Bank. Collaborating with teams to ensure data warehouse efficiency and quality.
Software Engineer, Data Platform
Software Engineer needed to enhance image capture and analysis platform for recycling tech startup. Create software to sort recyclables and improve sustainability efforts.
Senior Data Engineer
Senior Data Engineer at ZigZag developing data platforms and enabling analytics. Focus on Snowflake architecture and collaboration with multiple teams.
Senior Cloud Data Architect
Data Architect at Vertical Relevance shaping customer cloud journeys with AWS solutions. Designing and implementing data solutions, ensuring customer success through strong technical guidance.
Azure API, Data Engineer
Azure API & Data Engineer part of a strategic LATAM integration project. Focused on Cloud Integration, APIs, and Data Engineering with Azure and AWS.
Manager, Data Engineering
Manager, Data Engineering at Skillable responsible for building data pipelines and managing a team. Leading the engineering practices in a fully remote environment.
Data Engineer
Data Engineer developing data solutions for climate and energy at Carrier Global Corporation. Building and maintaining data pipelines and models to enable analytics and reporting.
Data Engineer
Data Engineer responsible for building infrastructure at Lifebit. Bridging biological science and software engineering to power scientific discoveries while ensuring compliance.
Senior Data Engineer – Microsoft Fabric
Senior Microsoft Data Engineer designing and delivering data solutions for LATAM company. Leading technical implementations and enabling data teams with high-quality data in a remote environment.
Data Engineer
Data Engineer at IRIUM working on banking projects and developing Databricks solutions in fully remote mode. Looking for someone with extensive data engineering experience and Python skills.
Principal Data Architect
Principal Data Architect at HostPapa focusing on shaping data architecture and insights for CloudBlue’s platform. Collaborating across teams to build AI-driven solutions in a cloud-native environment.
Service Manager – DataOps MDG
Service Manager overseeing IT operational services and ensuring service performance at Tec2Cloud. Leading process design and automation initiatives aligning with IT governance in a collaborative setting.
Junior Data Engineer
Jr. Data Engineer at Cutsforth LLC shaping the future of data use in power generation industry through operational data insights. Join our innovative team to design scalable data pipelines.