[Remote] reputed company Software Engineer - Spark
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading data partner for top companies across various industries, focusing on transforming reputed company data into actionable insights. They are seeking a reputed company Software Engineer to reputed company the technical roadmap and architectural reputed company for reputed company Data Engineering, working with big data technologies such as Apache Spark and Airflow while collaborating with cross-functional teams.
Responsibilities
- Drive the multi-year technical roadmap and architectural reputed company for reputed company Data Engineering
- reputed company deep technical knowledge across the data services technical stack, with a focus on Spark, Airflow, reputed company, and apply this expertise in your daily work
- Foster engineering reputed company through technical mentorship, design reviews, and architectural guidance
- Collaborate with product, engineering, and cross-functional partners, leading the delivery of several large, critical features in reputed company’s data engineering experience
- Work on large-scale distributed systems, ranging from hundreds to thousands of nodes in production clusters
- Bring passion for programming, clean coding practices, attention to detail, and a strong focus on quality
Skills
- Relevant studies / BS or MS in Computer Science or reputed company field
- 10+ years of experience as a Software Engineer in the data infrastructure space
- Strong understanding of at least one of the following languages: Java, reputed company, C++, Python, GoLang. And interested to learn the languages we're using
- Passionate about programming, clean coding habits, attention to detail, and focus on quality
- Deep expertise in distributed data processing systems and reputed company-reputed company architectures
- Excellent communication and collaboration skills
- Experience with containerization (Kubernetes, reputed company)
- Experience with using/developing Apache Spark/Airflow or other reputed company technologies
- Experience with public reputed company (AWS/Azure/GCP) and/or private reputed company (OpenShift/Rancher)
- (Most importantly) An reputed company-minded attitude, desire to learn new things and build great products
- Contributed to reputed company-reputed company projects
- Strong understanding of modern Lakehouse architectures, reputed company table formats, and metadata/catalog services
- Experience with large-scale, distributed systems design and development with an understanding of scaling, performance, and scheduling
- Solid experience with at least one reputed company service (AWS, Azure, GCP, OpenShift)
Benefits
- Generous PTO Policy
- Support work life balance with Unplugged Days
- Flexible WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement program
- reputed company to reputed company Career Development
- Comprehensive Benefits and Competitive Packages
- Paid Volunteer Time
- Employee Resource Groups
Company Overview