Big Data Engineer
Employment Information
Job Description
Data Engineer focusing on large-scale data systems operations and real-time data pipelines at Inetum. Collaborating with engineers and product managers to build robust technical solutions.
Responsibilities:
- Responsible for design, development and operations of large-scale data systems operating at petabytes scale.
- Focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure.
- Interact with engineers, product managers, BI developers and architects to provide scalable robust technical solutions.
- Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low-latency, and fault-tolerance.
- Experience with Java, Python to write data pipelines and data processing layers.
- Experience in Airflow & Github.
- Experience in writing map-reduce jobs.
- Proven expertise with Big Data Technologies Hadoop, Hive, Kafka, Presto, Spark, HBase.
- Highly Proficient in SQL.
- Experience with Cloud Technologies (GCP, Azure).
- Experience with relational model, memory data stores desirable (Oracle, Cassandra, Druid).
Requirements:
- Bachelor's degree or engineering degree in one of the following areas: Computer Systems, Computer Science, Information Technology, Software Engineering, Applied Mathematics, Statistics or related field.
- At least 4 years of verifiable experience in roles related to Data engineering, Big Data development experience, Large-scale data processing, Data pipeline development.
- Use of technologies such as Hadoop, Spark, Kafka, Hive, etc.
- English language at conversational level.
Benefits:
- Benefits above and beyond the legal requirements.
- Work flexibility (hybrid/remote).
- Access to cutting-edge tools and technologies.
- Opportunity for professional growth in high-impact projects.
Related Jobs
Distinguished Data Engineer
Capital One
Distinguished Data Engineer at Capital One driving the adoption of modern data technologies. Collaborating on engineering issues and promoting a culture of excellence in cloud-based solutions.
Senior Lead Data Engineer
Capital One
Lead Data Engineer developing innovative cloud-based solutions for Capital One. Collaborating with Agile teams to deliver robust data tools and support digital product managers.
Senior Data Engineer
Delivery Hero
Senior Data Engineer designing, building, and maintaining data architecture for efood. Collaborating with Product and Engineering teams to empower data-driven decision making.
Data Engineer
QAD
Data Engineer serving as backbone for advanced AI/ML initiatives at QAD. Ensuring reliable and scalable data for model development and production tasks while collaborating with cross-functional teams.
Senior Data Engineer – Snowflake
Data Ideology, LLC
Sr. Snowflake Data Engineer responsible for designing, implementing, and optimizing Snowflake data solutions. Engaging with clients to understand requirements and leading high-quality data platform deliveries.
Senior Data Engineer, Graph Analytics
TRM Labs
Senior Data Engineer building scalable systems to analyze cryptocurrency transactions at TRM Labs. Collaborating with engineers and data scientists to develop critical algorithms for blockchain analysis.
DBA, Enterprise Data Engineer
Authentic8
DBA & Enterprise Data Engineer leading database operations and data pipeline management at Authentic8. Ensuring data integrity, performance, and accessibility for business decisions.
Senior Manager, Data Engineering
CrowdStrike
Senior Manager, Data Engineering at CrowdStrike leading global team of data engineers. Focused on optimizing data ingestion and processing pipelines in a fast-paced SaaS environment.
Senior Data Engineer – Sensor Foundation
CrowdStrike
Sr. Data Engineer developing reliable data pipelines for product metrics at CrowdStrike. Collaborating across teams to deliver insights and optimize data solutions.
Senior Manager – Data Architecture & Engineering
3Cloud
Senior Manager managing Azure Data Architecture & Engineering at 3Cloud. Leading a team in delivering client engagements and fostering strong team commitment.
Director, Data Architecture – Engineering
3Cloud
Director of Data Architecture & Engineering at 3Cloud managing teams in Azure practice. Overseeing delivery leadership, team performance, and driving company culture.
Data Engineer II
Nielsen
Design and automate essential data pipelines ensuring seamless integration for Nielsen's analytics. Collaborate with teams and uphold data integrity throughout its lifecycle.
Senior Data Engineering Consultant
Telefónica Tech
Senior AI / Data Engineering Consultant at Telefónica Tech leading projects in AI, Data Science and Data Engineering, focusing on Microsoft Azure solutions. Client-facing role requiring innovative thinking and mentoring.
Senior Data Engineer
Jusbrasil
Data Engineer at Jusbrasil responsible for building data ingestion pipelines and collaborating with various teams. Utilizing advanced data architecture and engineering practices to transform raw data into valuable insights.
Senior Data Architect
Concentrix
Senior Data Architect designing high-performance data architectures for Concentrix. Collaborating with teams to ensure enterprise-grade solutions in various domains.
Data Engineer
Contruent
Data Engineer optimizing SQL environments and managing data pipelines for analytics-driven organization. Collaborating with Data Science team to enhance reporting capabilities and AI applications.
Data Migration Consultant
Unison
Data Migration Consultant designing and developing solutions using Talend Data Services platform for federal clients. Requires strong SQL skills and experience in software integration principles.
AI/ML Data Engineer
General Dynamics Information Technology
Senior AI Data Engineer leveraging Databricks and Generative AI for innovative data solutions at GDIT. Collaborating with data scientists and architects to enhance data quality and efficiency.
Senior Data Engineer, Data and Intelligence Product
AcuityMD
Senior Data Engineer at AcuityMD developing healthcare data and intelligence products. Collaborating with cross-functional teams to enhance and deliver high quality data-driven solutions.
Data Engineer
SailPoint
Senior Data Engineer at SailPoint designing ELT processes and maintaining scalable data pipelines. Building robust data ingestion systems leveraging cloud technologies for enterprise identity security.