Job Summary:
At Disney Streaming, data is a key strategic priority. The Data, Algorithms, Tech, Analytics (D.A.T.A.) organization within Disney Streaming builds trusted datasets, algorithms and actionable insights to empower Disney to delight our customers.
The Compute and Orchestration team within the D.A.T.A. organization is looking for a Lead Software Engineer to help design and execute the future evolution of our data platform. You'll be tasked with raising the bar by innovating and adopting new patterns and technologies to keep our team on the bleeding edge of development. You'll get to understand the challenges of efficiently scaling a data platform for hundreds of engineers and analysts, all while using the latest technologies available from AWS and beyond.
At Disney Streaming we feel strongly that teams should own their own processes, decide their own technologies, and design solutions for the long term. If you're interested in working in a highly collaborative team environment like this, please get in touch - we'd love to hear from you!
Responsibilities:
Work within a cross-functional team of engineers to build software for a large-scale data processing ecosystem supporting real-time and batch data that underpins all analytic and operational data flows
Design and build robust solutions to support data discovery, lineage, governance, and privacy compliance across the data platform
Continuously improve our CICD components, and help bring process improvements to our engineering and analytical customers
Influence and drive software engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation
Work with other teams: evangelize the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption
Basic Qualifications:
+ 8+ years of relevant professional experience
+ Proficient with Python or Scala (preferably both!)
+ Proven track record with Spark and related platform tooling (Databricks/EMR)
+ Experience building data platform tools for large, diverse groups of users
Preferred Qualifications:
+ Fluent understanding of how to deploy and run cloud-based data solutions (AWS, GCP, Azure)
+ Ability to dive deep into any technical component as well as understand and drive the overall systems architecture
+ You care deeply about craftsmanship in your software, and can work backwards from the customer experience
+ Experience building data pipelines using tools such as Kinesis, Kafka, or Flink
+ Familiarity with workflow scheduler tools such as Airflow
+ Familiarity with metadata management, data lineage, and principles of data governance
+ You have excellent written and verbal communication skills
Required Education:
+ Bachelors degree in Computer Science or related field or equivalent work
**Job ID:** 7092497020220515
**Location:** Santa Monica,California
**Job Posting Company:**
The Walt Disney Company and its Affiliated Companies are Equal Employment Opportunity employers and welcome all job seekers including individuals with disabilities and veterans with disabilities. If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or apply for a position, email Candidate.Accommodations@Disney.com with your request. This email address is not for general employment inquiries or correspondence. We will only respond to those requests that are related to the accessibility of the online application system due to a disability.