Hadoop Developer Job at innovitusa, Des Moines, IA

VUtlRWlkTndYUlRCdmQ0dEk0YmlKcEJ2R0E9PQ==
  • innovitusa
  • Des Moines, IA

Job Description

Hiring: W2 Candidates Only

Visa: Open to any visa type with valid work authorization in the USA

Key Responsibilities

  • Design, develop, and implement scalable big data solutions using Hadoop .

  • Work with Hadoop ecosystem tools such as HDFS, MapReduce, YARN, Hive, Pig, HBase, and Spark .

  • Develop and optimize ETL pipelines for large datasets.

  • Write and optimize HiveQL queries for data analysis and reporting.

  • Integrate Hadoop systems with data sources like RDBMS, NoSQL databases, and streaming systems .

  • Monitor Hadoop cluster performance and troubleshoot issues.

  • Ensure data security, governance, and compliance.

  • Collaborate with data engineers, data scientists, and business teams.

  • Document system designs, workflows, and best practices.

Required Skills

  • Strong experience with Hadoop framework and ecosystem .

  • Proficiency in Java, Scala, or Python .

  • Hands-on experience with Hive, Pig, HBase, Spark, and Sqoop .

  • Knowledge of Linux/Unix environments.

  • Experience with SQL and NoSQL databases .

  • Understanding of distributed systems and data processing concepts .

  • Familiarity with data warehousing and ETL tools .

Preferred Qualifications

  • Experience with Apache Spark and real-time processing tools like Kafka or Flume .

  • Knowledge of cloud platforms (AWS EMR, Azure HDInsight, or Google Dataproc).

  • Understanding of DevOps tools (Git, Jenkins, CI/CD pipelines).

  • Hadoop certification (Cloudera, Hortonworks) is a plus.

Education & Experience

  • Bachelor’s degree in Computer Science, Engineering, or related field .

  • 8 years of experience in Big Data or Hadoop development (varies by role level).

Job Tags

Similar Jobs

SIU Consultant Group

Data Entry Assistant Job at SIU Consultant Group

 ...litigation defense. We are seeking a dependable Remote Data Entry Assistant to help with basic data entry tasks. This role...  ...entering and updating information in our systems while working from home. The tasks are straightforward and suitable for beginners or... 

National DCP, LLC

Selector, Freezer Job at National DCP, LLC

 ...Schedule: Sunday - Thursday 12 pm - until complete (fridays as needed & saturdays off) Position Overview : Operates an electric pallet jack and/or forklift to select products from warehouse pick locations using Vocollect (voice command) system. Responsible for... 

Infuse

WordPress Developer Job at Infuse

 ...WordPress Developer Innovation is a core value of INFUSE. We are bringing together people, who can look into the future to better understand how technology will shape businesses, people, who create and navigate projects with great potential impact. We're looking... 

Veracity

A - Shift Production General Manager Job at Veracity

 ...A-Shift Production General Manager Onsite Morning Hours Waterloo, IA What are the 3-4 non-negotiable requirements of this position? Processing Knowledge: Familiarity with processing floor operations is highly required, with a focus on knowledge of fresh meats processing... 

Colorado Staffing

Construction Laborer Job at Colorado Staffing

 ...Adams, Arapahoe, Boulder, Denver, Douglas, Jefferson, El Paso, Weld. Job duties include performing tasks involving physical labor at construction sites, mostly pertaining to ground preparation, ground compaction, assisting with form setting, moving concrete materials to...