Software Engineer, Data
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Python Software Engineer focused on building scalable data ingestion systems for fintech company. Collaborating across teams to improve data transformation and reporting processes.
Responsibilities:
- Design and build Python-based software frameworks for data ingestion, transformation, and reporting, following solid software engineering principles.
- Develop reusable, maintainable, and well-tested core libraries and services that standardize how data is injected, processed, and exposed.
- Implement scalable data processing systems using Python and PySpark, focusing on performance, reliability, and extensibility.
- Collaborate in the creation of data transformation layers that feed analytical reports and dashboards, ensuring consistency and correctness of outputs.
- Write comprehensive automated tests using Pytest, covering: Core framework logic, Data transformations, Data quality validations, and Generated reports and dashboards.
- Implement automated data quality checks and validation processes to ensure data integrity at scale.
- Build and maintain SQL scripts and database integrations to support data workflows.
- Use Infrastructure as Code (Terraform) to provision and manage cloud resources.
- Monitor system health, troubleshoot production issues, and continuously improve performance and stability.
- Create and maintain design documents, runbooks, and technical documentation for data systems.
- Participate in design reviews and code reviews, promoting best practices in software engineering and testing.
- Collaborate with product managers, analysts, and stakeholders to define requirements and deliverable timelines.
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience as a Software Engineer, with a strong focus on backend or platform development.
- Strong software engineering background, including system design, clean architecture, and maintainable codebases.
- Proficiency in Python, including building frameworks and shared libraries.
- Hands-on experience with Terraform or similar Infrastructure as Code tools.
- Strong experience with PySpark for large-scale data processing.
- Strong experience with Pytest and automated testing strategies for complex systems.
- Solid SQL knowledge and experience working with relational databases.
- Deep understanding of ETL concepts and data extraction, transformation, and loading processes.
- Fintech experience is a must-have, including familiarity with banking concepts such as: Credit products, Financial transactions, Regulatory requirements, Data accuracy and reconciliation.
- Experience working in Linux/Unix environments and shell scripting.
- Strong analytical, problem-solving, and communication skills.
- Ability to work collaboratively across engineering, data, and business teams.
Similar Jobs
Senior Software Engineer
Software Engineer for the WEX Benefits Technology team, focusing on customer challenges and software solutions. Building high-quality software using modern technologies and testing practices.
Product Engineer
Product Engineer at Scrunch building and shipping product end-to-end across frontend and backend technologies. Contributing to product decisions and leveraging modern AI tools for efficiency.
Product Engineer
Product Engineer at Scrunch focusing on building and shipping product features for AI marketing solutions. Work across frontend and backend to develop high-quality user experiences.
Software Engineer, New Grad
Software Engineer New Grad position at Dunder Mifflin. Join the team to contribute to software engineering initiatives.
Principal Software Engineer
Principal Software Engineer responsible for building scalable software applications at Highmark Health. Collaborating across teams to drive technical execution of multi-channel solutions.
Principal Engineer, Public Cloud – R&D Core
Principal Engineer driving the design and architecture of large-scale cloud services for data management at Cloudera. Collaborating with cross-functional teams to ensure technical excellence and scalability.
Senior Manager – Full Stack Engineering
Senior Manager leading Full Stack Engineering to deliver high-quality applications at CCC Intelligent Solutions. Providing technical leadership and managing a team of full stack engineers in scalable web solutions.
Lead Engineer, Software
Lead Software Engineer providing technology strategy and mentoring for Ensemble’s software delivery teams. Focused on design, development, and collaboration to meet client needs.
Senior Engineer – Supersonic
Senior Engineer for AI-driven development at Fingermark, supporting customer solutions in QSR sector. Focused on modern software development and technical leadership within the Supersonic team.
Senior Engineer – Supersonic
Senior Engineer developing AI-driven solutions for Fingermark's ecommerce platforms. Leading agentic coding workflows and building resilient architectures in GCP.
Full Stack Engineer, AI Systems
Backend Engineer for AI systems by building reliable and fast backend systems. Focused on creating APIs and optimizing production environments for AI features.
Software Engineer – HealthTech
Software Engineer developing HealthTech solutions focusing on full-stack development in agile teams at PLANFOX. Collaborating on robust software architectures for the healthcare sector.
Senior Software Engineer – m/f/d
Senior Software Engineer focusing on backend development for Credibur, a fintech startup automating debt management. Improving core systems while maintaining performance, correctness, and reliability.
Software Developer
Software Developer designing and building scalable applications on Intelex's next‑generation platform. Collaborating with teams to deliver high‑quality solutions in an Agile environment.
Full-Stack Web Developer – m/w/d
Full-Stack Web Developer developing software cellms® with a focus on programming and design. Collaborating in an agile team through all phases from planning to deployment in Germany.
Fullstack Developer
Fullstack Developer responsible for creating intuitive user interfaces for web applications. Collaborating on projects with modern frontend technologies like React, Angular, or Vue.js.
Senior Software Engineer, Windows Desktop App
Senior Software Engineer developing secure, privacy-focused Windows applications for DuckDuckGo. Collaborating with teams to define roadmaps and deliver key features.
Engineering Team Leader, Elements Team
Engineering Team Leader at Fundraise Up, leading a distributed team of Fullstack developers. Driving the development of embedded donation widgets for non-profits.
Engineering Team Leader, Elements Team
Engineering Team Lead leading a remote team to build embedded donation technologies for nonprofits. Overseeing development processes and mentoring engineers while collaborating across global teams.
Engineering Team Leader
Team Lead developing embedded widgets for a global fundraising platform. Leading a remote team of Fullstack developers with a focus on impactful technology.