Build, design and implement large scale Big Data solutions for storage, processing, and analysis of data from a variety of relational and non-relational sources into the Big Data environment
Architect, build, and maintain highly-scalable ETL pipelines and data-driven systems
Collaborate with cross-functional teams. Works closely with data scientists and product owners to prioritize business and information needs
Provide support, on-going maintenance, and required modifications to multiple Hadoop environments
Leverage industry knowledge and stay close to technology developments in the open-source and cloud communities
Practice and enforce Agile and Scrum development methodologies
Experienced in communicating with senior level business leaders and stakeholders
Explore and evaluate new ideas and technologies in cloud, big data, and machine learning software development. Train and mentor other team members.
Graduate / Post Graduate in technical fields such as Engineering, Science, IT, Computers.
Experienced working in UNIX/Linux environments, as well as scripting languages like shell, Perl, Python, etc.
1-3 years of hands on experience in Big data technologies – MapReduce, Pig, Hive, HBase, Sqoop, Spark, Flume, YARN, Kafka, Storm etc.
Experienced in working with commercial distributions of HDFS (Hortonworks, Cloudera, Pivotal HD, MapR)
1 or more years of hands on experience designing and implementing data ingestion techniques for real time and batch processes for structured and unstructured data into Hadoop ecosystems and HDFS clusters.
1 or more years of hands on experience with data integration products like Informatica Power Center, Talend etc.
Firm understanding of SQL and RDBMS concepts.
Experience in Java and one or more programming languages like Scala, Python.
Understanding of Cloud Computing infrastructure like AWS EC2, AWS Elastic Map Reduce and Microsoft Azure.
Experience with statistical platforms is a major plus, such as R, SAS
Experience with data visualization tools like Tableau
Qualification*B.E, B.Tech, M.Tech
Experience*2 Year- 5 Years
Salary*Best in Industry