Hadoop Developer With Python

Newark, NJ

Company Name :IBA Infotech LLC

Type : Contract

Primary Skills : Scala, PySpark, Python, SQL

Location : Newark

CTC : DOE

Job Description:

Job description

  • Need a strong Scala/PySpark programmer. Python experience also.
  • Expert SQL background
  • 8+ years of experience in data analysis, data modelling and implementation of enterprise class systems spanning Big Data, Data Integration, Object Oriented programming and Advanced Analytics
  • Excellent understanding of Hadoop architecture and different demons of Hadoop clusters which include Job Tracker, Task Tracker, Name Node and Data Node
  • Good understanding of Data Mining and techniques
  • Experience in importing and exporting data from RDBMS to HDFS, Hive tables and HBase by using Sqoop
  • Experience in importing streaming data into HDFS using flume sources, and flume sinks and transforming the data using flume interceptors
  • Exposure on usage of Apache Kafka develop data pipeline of logs as a stream of messages using producers and consumers
  • Knowledge of HBase and Json.