Senior Big Data Architect
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Big Data Architect designing Cloudera, Kafka, and AWS data platforms for banking clients. Leading enterprise-scale streaming, integration, governance, and architecture standards.
Responsibilities:
- Own the end-to-end solution architecture for large-scale distributed data, streaming, and data integration solutions
- Act as the lead architect for Data Solutions distributed data, integration and platforms
- Provide architectural direction, governance, design assurance and technical leadership across initiatives
- Shape the evolution of target architecture and ensure alignment with enterprise technology strategy, engineering standards and long-term platform objectives
- Lead solution architecture across the Enterprise Data Lake, Operational Datastore and associated data platform services within the Cloudera CDP environment on AWS
- Design and document scalable distributed data and streaming solutions across Cloudera, Kafka, API, and cloud platforms
- Define ingestion, processing, storage, and consumption patterns
- Provide architectural oversight across solution delivery
- Work with engineering teams to ensure solutions are deliverable, scalable, secure, supportable, and aligned to enterprise architecture principles
- Review technical designs produced by engineering teams
- Identify technical risks, dependencies, assumptions, non-functional requirements, and design trade-offs
- Support delivery planning by breaking solutions into iterative delivery increments and sprint-level outcomes
- Represent solution designs at architecture review boards and governance forums
- Engage with business stakeholders, delivery teams, and enterprise architects
- Develop and promote architectural patterns, engineering standards and best practices across the data platform ecosystem
Requirements:
- 10+ years’ overall IT experience, with significant experience in data platform, integration, or distributed systems delivery
- Proven experience architecting streaming or real-time data applications using Kafka or equivalent event-streaming technologies
- Experience with Kafka consumer architecture, including consumer groups, offsets, retries, dead-letter handling, ordering, partitioning, and scalability
- Proven experience designing solutions on Cloudera CDH/CDP, or substantial experience with equivalent enterprise-scale distributed data platforms
- Experience designing and delivering large-scale data ingestion, transformation, storage, and consumption patterns
- Strong understanding of batch and real-time data processing architectures
- Experience working in complex enterprise environments with multiple systems, vendors, platforms, and governance processes
- Strong understanding of non-functional requirements including performance, scalability, resilience, security, observability, and operational support
- Experience providing architectural leadership across multiple workstreams, programs, or delivery teams
- Experience mentoring architects, senior engineers or technical leads and influencing technical decision-making
- Distributed data platforms and data lake architecture on Cloudera CDH/CDP or equivalent platforms
- Event streaming and real-time integration technologies, including Kafka and related messaging patterns
- Large-scale data processing and transformation frameworks such as Spark, Flink, Hive, Impala or equivalent technologies
- Java, Spring Boot, and REST services
- NoSQL and distributed data storage technologies including HBase, Cassandra, or equivalent platforms
- Cloud services, preferably AWS
- DevOps, CI/CD, observability, resilience
Benefits:
- Long-term remote-first contract position
- Remote in EU
- Contract through December 2026, with extension to 2027
Similar Jobs
Data Engineer – Mid-Level
Mid-level Data Engineer building AI/ML data systems for Ignite Digital’s national security and Navy IT clients. Designing pipelines, models, dashboards, and integrations using Python, SQL, and QLIK Advana.
Senior Data Platform Engineer
Senior Data Platform Engineer building DEFCON AI’s durable, explainable data platform for resilient optimization. Preserving provenance, uncertainty, source disagreements, and point-in-time entity histories.
Senior Data Engineer
Senior Data Engineer designing banking data pipelines across AWS, Oracle, Airflow, dbt, and SAP. Modernizing legacy systems through Data Mesh and Medallion architectures.
Senior Data Engineer
Senior Data Engineer building BigQuery and Dataform pipelines for Avenga, an AI-focused international engineering firm. Migrating ETL workflows and modernizing analytics across cloud and on-premises systems.
Senior Data Engineer – Clinical Platforms, Databricks
Senior Data Engineer building Databricks-based clinical trial platforms at Muttdata. Designing compliant lakehouse pipelines and integrations for regulated clinical data.
Senior EDW Data Architect
Senior EDW Data Architect designing Teradata enterprise data warehouses for regulated banking clients. Leading governance, data modelling, SQL validation, and delivery support in a remote EU contract.
Data Architect – Microsoft Fabric
Microsoft Fabric Data Architect designing secure enterprise data platforms for Argano, a digital consultancy. Leading Fabric landing zones, analytics, governance, and generative AI architecture.
Senior Data Platform Engineer, Enterprise Merchant Integrations
Senior Data Platform Engineer building reliable AWS merchant integrations for Extend’s AI-driven post-purchase retail platform. Developing event-driven data systems, onboarding tooling, and error reporting.
Senior Data Engineer
Senior Data Engineer building ingestion, data quality, and graph infrastructure for Inflect’s digital infrastructure marketplace. Scaling InfraSpec and RouteFinder platforms across global teams.
Data Engineer – Reporting & Analytics
Data Engineer modernizing enterprise reporting and analytics for a global technology team. Building Tableau solutions, SQL datasets, pipelines, and cloud data platforms.
Software Engineer – Research Data Platform
Software Engineer building scalable data systems and APIs for Bioptimus’s universal biology AI foundation model. Optimizing storage, databases, and infrastructure for research and product teams.
Data Engineer, Snowflake
Senior Backend/Data Engineer building scalable Python, Django, and Snowflake data platforms. Supporting Addepto’s AI consulting and data engineering solutions for global enterprises and startups.
Master’s Scholarship Fellow, Data Engineering
Bolsista de mestrado pesquisando timelines inteligentes, eventos temporais e engenharia de dados para o Itaú. Desenvolvendo arquiteturas e protótipos de contexto para oportunidades baseadas em eventos.
Master’s Scholarship Researcher – Customer Timeline, Temporal Events, Data Engineering
Master’s researcher developing temporal data and event-driven architectures for Itaú’s intelligent customer timeline. Supporting prototypes for event-based opportunities and customer journeys.
Senior AI/Data Engineer, Data Platforms, Machine Learning, Applied AI
Senior AI/Data Engineer leading Azure data platforms, machine learning, and LLM applications. Delivering secure, governed solutions for federal agencies and other clients.
AI/Data Engineer, Mid-Level – Python, Azure Data, ML Pipelines
AI/Data Engineer building Python ETL workflows, Azure data services, and ML-ready infrastructure. Supporting federal and regulated clients with scalable, governed data platforms.
Software Developer, Data Engineer
Software Developer & Data Engineer building WISEcode’s food intelligence lakehouse. Designing ingestion, entity resolution, and data pipelines powering food decisions.
Data Engineer, AI & Analytics
Data Engineer building unified, AI-ready marketing data foundations for Power Digital, an AI-native growth firm. Owning ingestion, dbt modeling, semantic layers, and production pipelines.
Lead Data Engineer
Lead Data Engineer directing Microsoft Fabric, Python, and PySpark data engagements for CreateFuture, an AI-native consulting partner. Leading teams, architecture, pipelines, and client delivery.
Senior Data Operations Engineer
Senior Data Operations Engineer managing Snowflake health, performance, and costs for Anvilogic’s AI cybersecurity platform. Onboarding customers and supporting Snowflake and Databricks production environments.