Roles & Responsibilities
* As Data Engineer, you will develop, maintain, evaluate and test big data solutions.
* You will be involved in the design of data solutions using Hadoop based technologies along with Python & Spark programming.
* Responsible to Ingest data from Files, Streams and Databases.
* Process the data with Spark, Scala, Kafka, Hive and scoop.
* Develops Hadoop applications using Horton Works or other Hadoop distribution.
* Experienced with pulling data from various database systems.
* Network Elements and unstructured text from web.
* Social Media sites and other Domain Specific file.