Hadoop Architect with strong HBase, Storm, Phoenix, Spark experience for a Top Ten E-commerce Retailer

Project Description

We are one of the top 10 e-commerce retailers in the world and are looking for Hadoop Architect with strong HBase, Storm, Phoenix, Spark experience

Job Description:

1. Assist in architecture and implentation review of HDB ingesting data at scale (~2-3 TB/Day)

Data is ingested from site servers

JVM --> Kafka --> Storm --> Hbase / .ORC --> Spark SQL

JVM --> Kafka --> Storm --> Hbase --> Phoenix SQL

Assist with Spark Streaming and Spark SQL guidance and development tasks as per use case above

Perform architecture review of existing HDP solution and provide written Power Point report on findings and recommendations.

2. Assist Customer with HDP configurations to address identified findings, focusing on the following:

a. Kafka

b. Storm

c. HBase / ORC

d. HDP architecture scaling for increased ingested data volume and processing

e. Phoenix / Spark SQL

3. Assist to perform an end to end data ingestion flow from servers’ JVM, through Kafka, Storm and HBaseThis is a two-week project, involves working remotely and would need to start as soon as possible.

This is a two-week project, involves working remotely and would need to start as soon as possible.