Data Engineer (Informatica,BDM, ECF,CDH)
Preferred Australian PR’s / Citizens
1 Hands-on experience in Cloudera (v 5.12) – development/build as well as design
2 Experience in HDFS, MapReduce, Yarn, Hive, Pig, Sqoop, Oozie, HBase
3 Experience in using Informatica BDM (big data manager) to ingest data
4 Experience in Kafka message broker configuration, Flume ingestion configuration.
5 Experience in processing unstructured, semi structured and structured data.
6 Experience in developing batch jobs and real time jobs using MapReduce
7 Experience in writing Scala/Python codes on top on Spark.
8 Experience in script-based Hadoop ingestion.