Lead Data Engineer Ii Big Data Multinational Consulting Firm 10 Years
What are We are looking for
Multinational Consulting Firm is hiring and this is a great opportunity for candidates to work with Fortune500 companies. We are looking at associating employees with Multinational Consulting Firm permanently, while they work on projects given by Fortune500 companies. If you think you have what it takes, apply now!
What will you work on
And middot; Design and build reusable components, frameworks and libraries at scale to support analytics data products.
And middot; Design and implement product features in collaboration with business and Technology stakeholders.
And middot; Anticipate, identify and solve issues concerning data management to improve data quality.
And middot; Clean, prepare and optimize data at scale for ingestion and consumption.
And middot; Drive the implementation of new data management projects and re-structure of the current data architecture.
And middot; Implement complex automated workflows and routines using workflow scheduling tools.
And middot; Build continuous integration, test-driven development and production deployment frameworks.
And middot; Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
And middot; Analyze and profile data for the purpose of designing scalable solutions.
And middot; Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues.
And middot; Mentor and develop other data engineers in adopting best practices.
Who will you work with
And middot; Work with product management to understand business requirements.
And middot; Work with Engineering leadership and architecture teams to align on design, architecture and enterprise strategy.
What you bring
And middot; 8 + Years experience of building big data solutions.
And middot; Advanced experience building cloud scalable, real time and high-performance data lake solutions leveraging AWS, EMR, S3, Hive and Spark.
And middot; experience working in an agile and iterative landscape.
And middot; experience with relational SQL.
And middot; experience with scripting languages such as Shell, Python.
And middot; experience with source control tools such as Git Hub and related dev process.
And middot; experience with workflow scheduling toolslike Airflow.
And middot; In-depth understanding of micro service architecture.
And middot; Strong understanding of developing complex data solutions.
And middot; experience working on end-to-end solution design.
And middot; Able to lead others in solving complex problems by taking a broad perspective to identify innovative solutions.
And middot; Willing to learn new skills and technologies.
And middot; Have a passion for data solutions.
And middot; Strong understanding of data structures and algorithms.
And middot; Strong understanding of solution and technical design.
And middot; Has a strong problem solving and analytical mindset.
And middot; Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders.
And middot; Able to quickly pick up new programming languages, technologies, and frameworks.