Hadoop Data and Information Specialist

at MHCM  

in Johannesburg, Gauteng
created 1 month ago
Expires 22 Jun
viewed 9
Salary: Undisclosed cost to company

One of MHCMs clients a giant in the financial sector has an exciting opportunity. The company is looking for a Hadoop Data and Information Specialist with Hadoop development experience to join their team. We are looking for a unique type of Hadoop Developer who is ready to take on an adventure by being responsible for the design, development and support of application solutions with focus primarily on Hadoop for a financial services environment. The main responsibilities of this position will entail the following: - Strong conceptual understanding of the context and business requirements. Should be able to understand the business needs, High Level design and produce Low level design documents, implement code in accordance with the best practices. - Hadoop development and implementation. - Loading from disparate data sets - Pre-processing using Hive and Pig - Expert level programming skills using Hadoop to meet the challenges of advanced data manipulation, complicated programming logic, and large data volumes is required - Design conceptual and physical data model for a global datawarehouse.in the Hadoop world (ETL versus ELT) - High Level and low-Level design for ETL components in Hadoop - Test prototypes and oversee handover to operational teams. - Analyse business requirements and translate them into technical and system requirements to best satisfy these requirements - Write and maintain technical documentation - Develop end to end Big Data solutions - Build monitoring and testing mechanisms around Sqooping and data transformations The successful incumbent will possess the following knowledge and experience: - Tertiary qualifications with majors in at least one of the following: Computer Science, Information Systems or similar - Certification in Hadoop Development. - Strong experience in Hadoop - HIVE, Pig, Spark, Impala, Oozie, Sqoop, and Map Reduce - Writing high-performance, reliable and maintainable code. - Ability to write MapReduce jobs and Pig Latin scripts. - Good knowledge of database structures, theories, principles, and practices. - Hands on experience in HiveQL. - Familiarity with data loading tools like Flume, Sqoop and Kafka. - Knowledge of workflow/schedulers like Oozie. - Analytical and problem-solving skills, applied to Big Data domain - Proven understanding with Hadoop, HBase, Hive, Pig, and HBase. - Must have Java and financial services experience. - In-depth knowledge of Data Warehouse and Big Data best practices. - Knowledge and technical appreciation of the interconnectivities and interfaces between various technical platforms, operating systems and processes. - Good understanding of data ITIL and IT and business strategies If you meet the criteria, have the necessary skills, experience and can-do attitude, dont delay and apply today!! Send a detailed Word CV to (email address)

Apply Now job source

Recent jobs at MHCM

Senior analyst apa at MHCM in Other 3 weeks ago
Senior specialist ifrs & compliance at MHCM in Other 3 weeks ago
Senior Specialist IFRS & Compliance at MHCM in Midrand 3 weeks ago
C# Developer at MHCM in Sandown 4 weeks ago
Business and Data Analyst at MHCM in Midrand 1 month ago
Chartered Accountant at MHCM in Midrand 1 month ago
Senior UX Designer at MHCM in Midrand 1 month ago
Solution Developer and Implementer at MHCM in Midrand 1 month ago
Sharepoint Developer x 5 at MHCM in Johannesburg 1 month ago
Front End Web Developer at MHCM in Midrand 1 month ago