Big Data Specialist

Job Category:

Arab Bank

Key Roles and Responsibilities:

Building and optimizing data pipelines architectures and data sets; both batch-oriented and real time using Informatica BDM from both relational & non-relational DBs
Designing, developing and customizing mappings/workflows for different types of loads using Informatica BDM
Leveraging various transformations in Informatica BDM tool to work on data ingestion, data profiling & data quality
Leveraging Hadoop ecosystem knowledge to design, and develop capabilities to deliver our solutions
Supporting and playing a pivotal role as part of data engineering team to build the data lake on Cloudera for Enterprise analytics
Working hands on with Spark & KAFKA in addition to Informatica platform
Designing recommend best approach suited for data movement from different sources to HDFS
Ensuring optimum performance of the Informatica mappings and workflow
Working with dynamic cross functional teams including business, Solution architects & Data engineers

Job Requirements:

Education:

Bachelor’s degree in Computer Science or equivalent; Master’s degree in Programming is preferred.

Experience:

Minimum 5 years of Experience in Development in Informatica Big Data Management/ DEI & Informatica Power Center
Minimum 2 Years of Experience in Development using Informatica components such as CDC PWX for Kafka, EDC, Data Quality.. etc.

Technical Competencies:

Extensive experience in delivering data pipelines using Cloudera distributions
Hands on experience with extraction of unstructured and semi structured data using data processor transformation
Working experience on streaming processing & analytics using KAFKA & Informatica BDS
Working Knowledge of Informatica EDC tool is desirable
Solid programming skills in SQL & Scala is preferred
Knowledge in Data Architecture, Designing Workflows and in building Ingestion Framework
Expertise of working on Enterprise Big data distribution like Cloudera. Exposure to big data components HDFS, HIVEQL, Spark, HBase, Impala is essential

Soft Competencies:

Fluent in English.
Excellent analytical and problem solving, conflict resolution, communication and Interpersonal skills.
Ability to work and communicate collectively with business.

Tagged as: , ,

Upload your CV/resume or any other relevant file. Max. file size: 5 MB.