Senior Database Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Sr. Database Engineer at MarketOnce designing and optimizing large-scale data solutions for immersive digital experiences. Collaborating with teams on advanced analytics and AI-driven capabilities.
Responsibilities:
- Analyze and optimize production data solutions to identify and resolve issues related to performance, locking, and scalability
- Write and optimize complex SQL across the full stack — Spark SQL for distributed transformations, PostgreSQL for transactional and analytical workloads, and Delta Lake for versioned, ACID-compliant table management
- Design and build large-scale Spark and Azure Data Factory pipelines for batch and streaming ingestion, transformation, and feature engineering — leveraging both PySpark and Spark SQL for distributed processing at large scale
- Design and develop data lake architectures including Medallion Architecture to support advanced analytics and large-scale data ingestion
- Build and maintain production-grade data pipelines for efficient data movement and transformation across systems. Managing Delta table lifecycles, schema evolution, Z-ordering, time travel, and Change Data Feed to support reliable, performant analytics and OLTP and ML workloads
- Design and operate hybrid storage patterns combining PostgreSQL for transactional workloads — with optimized schemas, indexes, CTEs, window functions, and partitioning — alongside Delta Lake Lakehouse layers for analytical and ML workloads
- Design and implement reporting solutions that deliver actionable insights to business stakeholders
- Communicate database and data architecture designs to business and technical audiences, including business users, program sponsors, database administrators, ETL and BI developers
- Evaluate potential technology/tool solutions that meet business needs and facilitate internal and external discussions towards desirable outcomes
- Collaborate with solution architects and project resources on systems integration and compatibility, while acting as a leader in coaching, training, and providing guidance
- Create functional and technical documentation related to data architecture and business intelligence solutions
- Provide technical consulting to application development teams during application design and development for highly complex or critical projects
- Design data governance procedures to ensure compliance with internal and external regulations
Requirements:
- 7+ years in data engineering, big data platforms, or a related discipline with hands-on production experience at scale
- Located in Eastern or Central time zone; you will work extensively with a team member in the UK
- Proven experience analyzing and tuning production database systems for performance and reliability
- Expert-level SQL skills — complex joins, CTEs, window functions, query plan analysis, and optimization across both OLTP (PostgreSQL) and distributed engines (Spark SQL, Databricks SQL, Delta Lake)
- Hands-on experience with data lake technologies and data pipeline frameworks (e.g., Azure Data Lake, Azure Data Factory, Databricks)
- Deep expertise in Apache Spark — DataFrames, Spark SQL, UDFs, partitioning, broadcast strategies, and hands-on performance tuning experience
- Data warehouse and visualization experience, including demonstrated strong Logical, Physical, and Dimensional Modeling skills
- Solid command of Delta Lake internals — transaction log, schema enforcement, schema evolution, time travel, CDF, Z-ordering, liquid clustering, and OPTIMIZE/VACUUM operations
- Strong PostgreSQL experience — schema design, indexing strategies, partitioning, EXPLAIN/ANALYZE tuning, and extensions including pgvector for similarity search
- Strong Python skills — PySpark, pandas, async programming, building production data utilities
- Strong understanding of reporting and BI solution design, including Power BI or similar tools
- Experience in design of technology roadmaps and the transition from the current architectural framework to target architecture of the future
- Excellent verbal and written communication skills to document and present data models, strategies, standards, and concepts to both business and IT audiences
- Experience with the following tech & tools: SQL Engines: Azure SQL Server, Spark, Cosmos DB, PostgreSQL, Elastic Azure Technologies: Cosmos DB, SQL Database, Analytics, Azure Databricks, Data Factory, Fabric, Power BI, Azure Data Lake ETL Tools: Azure Data Factory, Azure Databricks, Azure Stream Analytics Lakehouse: Delta Lake, Delta Live Tables
Benefits:
- Competitive base salary: $150,000-$180,000/year
- Flexible vacation policy – take the time you need to recharge
- Comprehensive health, vision & dental insurance
- 401k with company contribution
- Opportunity for career progression with plenty of room for personal growth
Similar Jobs
Senior Backend Software Engineer, BI Automation
Senior Software Engineer managing backend application development and automation for Keeper Security. Building scalable solutions for Business Intelligence and operational workflows.
Backend Engineer
Backend Engineer responsible for server-side components in AI-powered resource management tools at Air Apps. Collaborating with cross-functional teams to build robust and scalable backend services.
Backend Engineer
Backend Software Engineer designing and maintaining server-side components for Air Apps' applications. Collaborating with teams to deliver scalable backend services for rapid growth.
Specialist, Backend Developer
Backend Developer role at a fintech in Brazil revolutionizing credit solutions. Seeking expertise in Java, data manipulation, and AWS for an innovative team.
Senior Back-End Developer – C# / .NET 8 / Azure Functions / APIM / SQL
Senior Back-End Developer designing, building, and supporting backend services for healthcare portal hosted on Microsoft Azure. Utilizing C#, .NET 8, and Azure Functions to ensure data security and functionality.
Software Engineer, Python
Senior Software Engineer at Rasa driving product development for AI agents. Collaborating across teams to lead architecture decisions and mentor engineers.
Senior Full Stack Engineer, C++, React
Senior Full Stack Engineer developing features for an AI Podcasting platform. Focused on enhancing user experience through innovative technology in C++ and React.
Senior Software Engineer, Java
Senior Software Engineer working remotely to develop Java solutions for Tixr's ticketing platform. Collaborating with cross-functional teams on complex projects.
Senior Full Stack Developer – PHP, Angular
Full Stack Senior Developer in a SaaS company enhancing business performance with AI-driven solutions. Collaborate on backend and frontend enhancements for the Checklist Fácil product.
Principal Java Engineer
Principal Java Engineer at Sparq leading teams in developing scalable web applications and mentoring developers. If driven by AI innovation and collaboration, you'll thrive in our modern work environment.
Principal Python Engineer
Senior Python Engineer designing and maintaining backend services for cargo industry. Collaborating with a small, senior team in a high-ownership, startup-like environment.
Arquiteto(a) de Software – Node.js, Platform & Frameworks
Node.js Software Architect developing and maintaining projects at Grupo SysMap. Focusing on innovative solutions in tech across various industries for over 25 years.
Intermediate Java Developer
Intermediate Java Developer enhancing customer and associate experiences by developing innovative applications. Working remotely first and collaborating with teams in Vancouver, BC.
Backend Engineer, Go
Software Engineer in Go with Pyyne focusing on backend services for a large dating platform. Collaborating with teams to deliver scalable solutions and maintain high-performance systems.
Technical Architect – Marketing Cloud Intelligence, Personalization
Technical Architect designing and implementing marketing solutions for Offprem Technology customers. Focusing on Marketing Cloud Intelligence and Personalization, overseeing build quality and leading technical discussions.
Pessoa Desenvolvedora Sênior – PHP, Python
Senior PHP and Python Developer at a leading fintech, focusing on payment solutions and innovative products. Involvement in Scrum ceremonies and collaboration on product development.
Application Backend Engineer – Client Data
Remote Backend Engineer at Yelp building features on a Service Oriented Architecture. Collaborating with teams and mentoring engineers in a dynamic global environment.
Backend Engineer, Node.js, AWS
Role focused on modifying production systems and collaborating closely with engineers. Engaging in code analysis, incremental solutions, and ensuring quality testing.
Senior FullStack Developer, Python, Node, React
Senior FullStack Developer for Extractta, focusing on building scalable solutions with Node.js, Python, Angular, and React. Emphasizes teamwork and product evolution in a dynamic environment.
Intermediate Backend Developer
Intermediate Backend Developer working with engineering teams to maintain components of the Smile Digital Health platform. Responsible for full development lifecycle and technical expertise preparation.