Big Data Developer/Intellect HR Pvt Ltd/Noida

This job has been Expired
Intellect HR Pvt Ltd
Job Overview

Build, design and implement large scale Big Data solutions for storage, processing, and analysis of data from a variety of relational and non-relational sources into the Big Data environment

Architect, build, and maintain highly-scalable ETL pipelines and data-driven systems

Collaborate with cross-functional teams. Works closely with data scientists and product owners to prioritize business and information needs

Provide support, on-going maintenance, and required modifications to multiple Hadoop environments

Leverage industry knowledge and stay close to technology developments in the open-source and cloud communities

Practice and enforce Agile and Scrum development methodologies 

Experienced in communicating with senior level business leaders and stakeholders

Explore and evaluate new ideas and technologies in cloud, big data, and machine learning software development. Train and mentor other team members.

Job Requirements:

Graduate / Post Graduate in technical fields such as Engineering, Science, IT, Computers.

Experienced working in UNIX/Linux environments, as well as scripting languages like shell, Perl, Python, etc.

1-3 years of hands on experience in Big data technologies – MapReduce, Pig, Hive, HBase, Sqoop, Spark, Flume, YARN, Kafka, Storm etc.

Experienced in working with commercial distributions of HDFS (Hortonworks, Cloudera, Pivotal HD, MapR)

1 or more years of hands on experience designing and implementing data ingestion techniques for real time and batch processes for structured and unstructured data into Hadoop ecosystems and HDFS clusters.

1 or more years of hands on experience with data integration products like Informatica Power Center, Talend etc.

Firm understanding of SQL and RDBMS concepts.

Preferred Skills:

Experience in Java and one or more programming languages like Scala, Python. 

Understanding of Cloud Computing infrastructure like AWS EC2, AWS Elastic Map Reduce and Microsoft Azure.

Experience with statistical platforms is a major plus, such as R, SAS

Experience with data visualization tools like Tableau

Job Detail
  • Career LevelOthers
  • Gender*Both
  • Qualification*B.E, B.Tech, M.Tech
  • Experience*2 Year- 5 Years
  • Salary*Best in Industry