Kindly find the job description below:
* Understand the source systems data, gather & able to transfer the data into HDFS as RAW and Decomposed layer (including writing Oozie workflow, coordinators, Sqoop and Flume).
* Exposure in handling to massive quantities of data by taking advantage of both batch and speed methods.
* Strong knowledge of and experience with statistics; potentially other advanced math as well and good working knowledge of SQL ability.
* Deep knowledge in data mining, data modelling, data processing, machine learning, natural language processing or information retrieval.
* Experience in processing large amounts of structured / unstructured data.
* Capability to design and document solutions independently.
* Having over all 10+ years of IT development experience in Data, Database, JAVA or any programming languages.
* Minimum 5+ years of working experience in the Apache Hadoop framework, HDFS, Map Reduce, Hive, Flume, Sqoop, Oozie, Spark, Spark Streaming and Scala.
* Minimum of 5+ years of experience in Big Data and batch/real-time ingestion and analytical solutions leveraging transformational technologies.
* Minimum of 5+ years of experience in JAVA, spring, Elasticsearch and Cassandra. Good understanding about Lambda architecture and Big Data analytics framework.
* Implements security and recovery tools and techniques as required.
* Ensures all automated processes preserve data by managing the alignment of data availability and integration processes.
* Having exposure on the Cloudera Manager, Cloudera Navigator, Hue, Shell Scripting, Apache Pig and Python would be a plus.
Sthree UAE is acting as an Employment Business in relation to this vacancy.
|Job Location:||Dubai, United Arab Emirates|
|Job Role:||Information Technology|
Search jobs on Bayt.com, the Middle East’s #1 job site