Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer building batch and streaming infrastructure for DKSR’s CIVORA urban data hub. Supporting cities, regions, and mission-critical data use cases.
Responsibilities:
- Build and operate the data infrastructure powering CIVORA, DKSR’s urban data hub for cities and regions
- Contribute to platform components and internal tooling
- Collaborate with product and project delivery teams to shape reusable, scalable, and well-documented data infrastructure
- Design and maintain batch and streaming data pipelines serving multiple cities and use cases
- Support complex and mission-critical use cases and establish best practices and design patterns
- Write clean, maintainable, testable software
- Propose and prototype new approaches and challenge existing patterns
- Understand business problems, refine requirements, design systems, and deliver solutions end-to-end
- Work closely with the Data Architect and product development team
Requirements:
- 1–3 years of relevant experience in data engineering and software development
- B.Sc. in Computer Science, Data Science, Data Engineering, or a related field; equivalent professional experience is also welcome
- Python for data processing with pandas, NumPy, and scikit-learn, along with structured software development practices
- SQL and an understanding of relational database design
- Hands-on experience with Apache Airflow or a similar pipeline orchestration tool
- Familiarity with the Kafka protocol or similar streaming systems
- Experience with Docker containerization
- Working knowledge of cloud concepts and infrastructure-as-code principles, including Helm and Terraform
- Comfortable communicating in spoken and written English
- Proactive team player and direct communicator
- Experience with agentic development using GitHub, Copilot, or Claude
- Kubernetes experience is preferred
- Hands-on experience with AWS, Azure, or GCP is preferred
- Ability to read and work with Java, JavaScript, Rust, or Go is an advantage
- Willingness to learn and operate technologies including Helm, OpenTofu/Terraform, MinIO/SeaweedFS, Apache Superset, Apache Iceberg, Lakekeeper, Redpanda, Kafka Connect, Trino, and MLflow
- German is not required, but is highly valuable
- Must already reside in Germany and be legally authorized to work in Germany
- Visa sponsorship and relocation support are not provided
Benefits:
- Job Ticket or Job Bike – for a sustainable commute
- Professional development budget
- 30 days of vacation, plus time off on December 24 and December 31
- Corporate Benefits
- Subsidy for Urban Sports Club
- Open feedback culture
- Support when you need it – and space when you want it
Similar Jobs
Senior AI/ML/Data Engineer
Senior AI/ML/Data Engineer building ML, NLP, LLM, and RAG solutions for QAVION’s consulting and technology boutique. Developing semantic search, GenAI services, and scalable data pipelines.
Senior ETL Testing, Data Engineer
Senior ETL/Data Engineer building and testing scalable GCP data pipelines. Developing cloud data warehouses, automation, and CI/CD integrations for an IT services organization.
Assistant Vice President – Technology, Information Management, Data Warehouse
Data Solution Architect leading Mashreq Global Services' Information Management–Data Warehouse department. Designing Databricks Lakehouse solutions, enterprise data models, streaming systems, and governance frameworks.
Assistant Vice President – Technology, Information Management, Data Warehouse
Assistant Vice President leading Mashreq Global Services' enterprise data warehouse architecture, operations, and strategy. Guiding specialists, securing platforms, and driving data modernization.
Senior Software Engineer, Data Platform
Senior Software Engineer solving distributed-systems challenges in Apache Pinot for StarTree’s real-time analytics cloud. Improving performance, reliability, concurrency, and data infrastructure at massive scale.
Data Engineer
Data Engineer building Python and Azure data pipelines, integrations, and APIs. Delivering scalable ETL/ELT and real-time data solutions for enterprise consulting clients.
Data Engineer II – Library Systems
Data Engineer II building ETL pipelines, metadata systems, and AI-ready data platforms for Johns Hopkins Libraries. Supporting research, analytics, data quality, and library operations.
Data Engineer
Data Engineer building scalable Azure and Snowflake data platforms for Datavail’s data management and cloud services. Developing pipelines, warehouses, lakes, and analytics solutions.
Senior Data Engineer
Senior Data Engineer building clinical data pipelines and cloud applications for Providence’s healthcare system. Supporting data-driven operations with modern engineering, analytics, and AI technologies.
Data Engineering Analyst
Data Engineering Analyst optimizing Servus Credit Union’s data warehouse, pipelines, integrations, and analytics infrastructure. Supporting data-driven financial services for Alberta members.
Senior Cloud Data Engineer
Senior Cloud Data Engineer building secure cloud data systems for BMC. Designing pipelines, data warehouses, ETL processes, and cloud-based data solutions.
Senior Backend Engineer - Data Platform
Backend Developer building TypeScript and Node.js data services for NaNLABS’ insurance wildfire-risk platform. Designing integrations, ingestion pipelines, and reliable PostgreSQL systems.
Data Engineering Intern
Data Engineering Intern building scalable ELT pipelines and data models at Super.com, a consumer fintech platform. Ensuring data quality, governance, and operational reliability for high-volume datasets.
Data Warehouse, Analytics Architect
Data warehouse architect designing scalable lakehouse and analytics infrastructure for Virtru’s secure data-sharing platform. Leading SRE, technical architecture, and engineering mentorship.
Presales Data Architect, Modern Data Stack, AI
Presales Data Architect diseñando arquitecturas Modern Data Stack y AI para Reclut, marketplace de reclutamiento con IA. Liderando preventa, PoCs y conexión entre clientes y equipos de delivery.
Senior Data Engineer – MS Fabric
Senior Data Engineer building Azure data platforms and ETL pipelines for Keyrus, a global data, digital, and AI consulting company. Supporting enterprise analytics, reporting, and master data management.
Data Architect
Data Architect designing Lakeside's enterprise data architecture for BI, analytics, and AI. Leading Snowflake, data modeling, governance, and resilient integration solutions.
Software Engineer – Agentic Data Pipelines
Software engineer building agentic LLM systems for biomedical data acquisition, curation, and quality control. Supporting Iambic Therapeutics’ AI-driven drug discovery platform and Enchant model training.
Engineer III – Platform Data Engineer
Platform Data Engineer building and operating CrowdStrike's cybersecurity analytics infrastructure. Managing Airflow, Terraform, CI/CD, cloud platforms, and data security at scale.
Lead Forward Deployed Engineer – Data Science, Integration
Forward Deployed Engineer at Salesforce, the AI CRM company, building ML, API integrations, and workflows for defense and intelligence customers. Leading secure, customer-site mission delivery.