Technical Lead, Spark, Java
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Technical Lead for Spark at Cloudera working on distributed systems and leading features from design to production. Collaborating with teams across the US and Hungary on large-scale data engineering projects.
Responsibilities:
- Design new features for Cloudera’s data engineering experience
- Take features from prototypes to leading a team to deliver in production at scale
- Contribute to Apache Spark, Livy
- Develop new features in Scala/Java/Python on modern platforms
- Gain expertise in distributed data processing and components of Cloudera Data Engineering Experience stack
- Work on large-scale distributed systems in production clusters
- Debug system-level deployment issues and resolve failures
- Work on improving internal infrastructure
- Collaborate with other team members and stakeholders
Requirements:
- 8-10+ years of professional software development
- Experience leading and delivering complex product enhancements
- Strong understanding of at least one of the following languages: Java, Scala, Python
- Experience with systems design and development
- Passionate about programming, clean coding habits, attention to detail, and focus on quality
- Strong ability to research and solve problems independently
- Open-minded, desire to learn new things and build great products.
- Experience with distributed systems
- Experience with SQL planners
- Experience with using/developing Apache Spark, Livy or other related technologies
- Experience with large-scale, distributed systems design and development with an understanding of scaling, performance, and scheduling
- Solid experience with at least one cloud
- Contributors to open-source projects.
Benefits:
- Generous PTO Policy
- Support work life balance with Unplugged Days
- Flexible WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement program
- Access to Continued Career Development
- Comprehensive Benefits and Competitive Packages
- Paid Volunteer Time
- Employee Resource Groups
Similar Jobs
Senior Software Engineer, Ruby on Rails
Senior Software Engineer developing Ruby on Rails applications for CentralReach. Focused on building scalable features and mentoring team members in technology solutions.
Backend Developer, C#/C++
Backend developer working on software solutions for Opus::L at Dedalus. Focus on modernizing architecture and integrating new backend technologies for better healthcare solutions.
Senior Fullstack Engineer – Angular, Java, Go, .NET
Fullstack Engineer developing critical backoffice applications for financial solutions. Seeking senior professionals with expertise in Angular and robust backend systems in a remote setting.
Software Engineer – Full Stack, Java
Software Engineer developing innovative applications for back-end processing and user experiences. Working with Java, Spring, Angular, and cloud-native solutions for Alight's comprehensive benefits platform.
Java Backend Developer – Specialist
Technical Lead leading Java microservices development for fintech solutions. Ensuring team delivery and collaboration with cross-functional teams to enhance performance.
Senior Mobile Engineer – React Native, JavaScript, TypeScript
Senior Mobile Engineer developing high-quality mobile applications using React Native with Expo for Forwood. Leading the mobile stack and driving app releases end-to-end in a remote work environment.
Mid-Level Software Engineer, Java, Python
Software Engineer at CESAR developing backend solutions with Java and Python, collaborating with teams to improve processes. Minimum 4 years of backend development experience required.
Senior Software Engineer, Elixir
Senior Software Engineer at Sona building next-gen AI-native workforce solutions, directly interacting with users and owning features end-to-end.
Backend Software Engineer – Data & Platform
Backend Software Engineer designing systems for the data platform at KinaTrax. Focused on backend architecture and distributed systems for athlete performance data collection.
Database Engineer
Database Engineer leading and scaling database infrastructure for Limble's maintenance operations platform. Collaborating with cross-functional teams to optimize system performance and support growth.
Senior UI Developer, .NET C#/AWS/SQL
Sr. UI Developer at Gainwell developing healthcare administration products using ASP.NET and SQL. An opportunity to grow in a company valuing work flexibility, learning, and career development.
Cloud Integration Developer, Python
Integration Developer developing Python scripts on AWS for a Proof of Concept at GDIT. Supporting the Centers for Medicare and Medicaid Services with near real-time integration capabilities.
JavaScript Developer
JavaScript Developer supporting modernization and sustainment of NASA applications. Collaborating in Agile development environments to deliver robust software solutions.
Senior Data Platform Engineer, Python, AWS, MDM – Finance
Senior Data Platform Engineer designing data pipeline infrastructure with a focus on Python and AWS services for a leading financial services company. Collaborating on scalable and reliable data solutions.
Senior Data Platform Engineer – Python, AWS, MDM
Senior Data Platform Engineer managing Python-based solutions and AWS cloud services for a financial services company. Leading data engineering to support pricing analytics and trading systems.
Senior Data Platform Engineer – Python, AWS, MDM
Senior Data Platform Engineer leading design and management of Python/AWS data pipelines for financial services company. Collaborating on enterprise scale data solutions with sophisticated engineering.
Senior Data Platform Engineer – Python, AWS, MDM
Data Platform Engineer specializing in Python and AWS, working on enterprise data pipelines for a financial services platform.
Senior Data Platform Engineer – Python, AWS, MDM
Senior Data Platform Engineer focusing on designing and managing data pipelines with Python and AWS solutions. Join a financial services leader transforming the U.S. mortgage market.
Full Stack Software Developer – Backend-focused
Full Stack Software Developer with backend focus at HSI, building scalable software solutions and mentoring junior developers. Working remotely to enhance workplace safety through innovative technology.
Software Engineer, Java, Spring Boot
Software Engineer developing secure and reliable services for open source projects at the Eclipse Foundation. Collaborating with global teams on APIs, platforms, and community services.