Lead Data Engineer, India – ed&a Icc
Country :
India
Region : Karnataka
Town : Bengaluru
Category : Production - Quality
Contract type : Permanent
Availability : Full time
Job description
Nike has embraced big data technologies to enable data-driven decisions. We are looking a Lead Data Engineer to keep pace. As Lead Data Engineer, you will work with a variety of talented Nike teammates and be a driving force for building first-class solutions for Enterprise Data and Analytics. The ideal candidate will have programming experience, big data skills, comfortable with ambiguity and will enjoy working in a fast-paced dynamic environment.
WHAT WILL YOU WORK ON
* Design and build reusable components, frameworks and libraries at scale to support analytics data products
* Design and implement product features in collaboration with business and Technology stakeholders
* Anticipate, identify and solve issues concerning data management to improve data quality
* Clean, prepare and optimize data at scale for ingestion and consumption
* Drive the implementation of new data management projects and re-structure of the current data architecture
* Implement complex automated workflows and routines using workflow scheduling tools
* Build continuous integration, test-driven development and production deployment frameworks
* Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards
* Analyze and profile data for the purpose of designing scalable solutions
* Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues
* Mentor and develop other data engineers in adopting best practices
WHO WILL YOU WORK WITH
* Work with product management to understand business requirements
* Work with Engineering leadership and architecture teams to align on design, architecture and enterprise strategy
Profile
* 8+ Years experience of building big data solutions
* Advanced experience building cloud scalable, real time and high-performance data lake solutions leveraging AWS, EMR, S3, Hive & Spark
* Experience working in an agile and iterative landscape
* Experience with relational SQL
* Experience with scripting languages such as Shell, Python
* Experience with source control tools such as GitHub and related dev process
* Experience with workflow scheduling tools like Airflow
* In-depth understanding of micro service architecture
* Strong understanding of developing complex data solutions
* Experience working on end-to-end solution design
* Able to lead others in solving complex problems by taking a broad perspective to identify innovative solutions
* Willing to learn new skills and technologies
* Have a passion for data solutions
* Strong understanding of data structures and algorithms
* Strong understanding of solution and technical design
* Has a strong problem solving and analytical mindset
* Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
* Able to quickly pick up new programming languages, technologies, and frameworks