Will be responsible for the design and development of technical solutions utilizing the big data and cloud platform.
Responsibilities will include defining technical requirements, loading data into HDFS, managing Linux directory structure, managing HDFS framework, managing Hive databases, data extraction, data transformation, automating jobs, creating complex reports, productizing jobs, and exploring new big data technologies within a Massively Parallel Processing environment.
Perform code reviews, suggest improvements, Perform Testing of the code developed by developers.
Take part in conducting POCs by evaluating Big Data tools.
Create and maintain optimal data pipeline architectures.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Big Data and Azure Cloud.
Keep our data separated and secure across national boundaries as per the platform and data governance rules.
- Undergraduate degree or equivalent experience.
Educational Qualification: Graduate in CSE/IT or any science-technology-engineering-math related field.
experience of 4-6 years for SG 26 and 7-9 years for SG 27, in Big Data Hadoop Architecture and Azure Cloud.
Hive QL, Spark, HDFS, Sqoop, Pig, Python, PySpark, HBase, Mllib, Docker, Kubernetes, Git Hub, Authorization Models, Java for managing the Big Data platform, understanding, and resolving the errors.
Unix/Linux, Shell Scripting, Automations, Scheduling.
Very Good communication skills
*Extensive SQL and RDBMS background
Careers with Optum. Here\'s the idea. We built an entire organization around one giant objective; make the health system work better for everyone. So when it comes to how we use the world\'s large accumulation of health-related information, or guide health and lifestyle choices or manage pharmacy benefits for millions, our first goal is to leap beyond the status quo and uncover new ways to serve. Optum, part of the United Health Group family of businesses, brings together some of the greatest minds and most advanced ideas on where health care has to go in order to reach its fullest potential. For you, that means working on high performance teams against sophisticated challenges that matter. Optum, incredible ideas in one incredible company and a singular opportunity to do your life\'s best work. SM.
Diversity creates a healthier atmosphere: United Health Group is an Equal Employment Opportunity/Affirmative Action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status, sexual orientation, gender identity or expression, marital status, genetic information, or any other characteristic protected by law.
United Health Group is a drug-free workplace. Candidates are required to pass a drug test before beginning employment.