Hadoop Platform Engineer Job at RAMPS International Inc., San Jose, CA

V3FPSGdkOXlYUmZFdU40a0lJbmlJNTVzR3c9PQ==
  • RAMPS International Inc.
  • San Jose, CA

Job Description

Job Description

Job Description

Hadoop Platform Engineer
San Jose, CA
4-12 Months

Position summary
The Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation and ongoing administration of Hadoop infrastructure including designing, deploying, monitoring, tuning and troubleshooting.

Job Responsibilities
Responsibilities:
• Design and develop different architectural models for our scalable data processing as well as scalable data storage
• Build data pipelines and ETL using heterogeneous sources
• Build data ingestion from various source systems to Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc.
• Transform data using data mapping and data processing capabilities like MapReduce, Spark SQL
• Supports Big Data and batch/real time analytical solutions
• Own the platform architecture and drive it to the next level of effectiveness to support current and future requirements
• Design, implement, deploy and maintain security, data capacity, node forecasting and planning.
• Provide hardware architectural guidance, plan and estimate cluster capacity, and create roadmaps for the Hadoop cluster deployment.
• Closely work with the Hadoop development, infrastructure, network, database, and business intelligence teams.
• Participate in a 12x7 rotation for production issue escalations.
• Communicate effectively with people at all levels of the organization.

Requirements:
• B.S. degree in Computer Science, Electrical and Computer Engineering, or equivalent technical fields.
• Experience in tools integration, automation, configuration management systems.
• Experience with networking, systems administration skills.
• 3+ years of hands on working experience on Hadoop infrastructure stack (Ex: HDFS, MapReduce, HBase, Flume, Spark, Pig, Hive, Oozie, YARN, Zookeeper, Presto, etc). 2+ years of experience in Python or Perl.
• MapReduce, Hbase, Hive, Impala, Spark, Kafka, Kudu, Solr)
• Strong development/automation skills. Must be very comfortable with reading and writing Scala, Python or Java code.
• Proven Ability to build Curated Models for BI and Analytics
• Strong SQL Skills

Best regards,

 
Sridhar P
Senior Recruiter | RAMPS International, Inc
1199 Amboy Ave, Suite 2F, Edison, NJ 08837
email:  sridhar@rampscorp.com |url:

Job Tags

Work experience placement,

Similar Jobs

Tutor Me Education

Bilingual Spanish SPED Tutor - Reading & Writing Job at Tutor Me Education

 ...sessions a week for 2 hours Pay range is between $25 and $35 Ideal Candidate: Fluent in both Spanish and English, with the ability to deliver clear, bilingual instruction. Experienced in working with students with special education needs, including those with... 

Sanford Health

LPN or Certified Medical Assistant - Family Medicine Clinic Job at Sanford Health

 ...additional education, training or experience requirements. Must have attended a pre-licensure nursing program that included supervised clinical experience across the life span as part of the curriculum or have had a minimum of 400 hours of experience as a RN (or LPN) at... 

Postal Recruiters

Mail Processor - No Experience Required - Health insurance | Paid time off|Training - Ola, AR Job at Postal Recruiters

Role Overview USPS is accepting applications for PSE Mail Processing Clerks nationwide. This role is vital to ensuring the timely and accurate processing of mail. USPS provides comprehensive training to help you succeed, even if you have no prior experience. Position...

Lone Star College

Part-Time Tutor, Writing-All Levels Job at Lone Star College

 ...Independent School District. Location address is 30555 Tomball Parkway, Tomball, TX 77375. Job Description PURPOSE AND SCOPE: Tutors and instructs students and community members who need learning assistance in assigned discipline(s) and study skills. Primary... 

AMN Healthcare

Outpatient Psychiatry Opportunity in Savannah, Georgia Job at AMN Healthcare

 ...outpatient opportunity offering flexible scheduling and income potential of $350,000....  ...Highlights 100% Outpatient Ability to work up to 50% from home Flexible scheduling options 4-day work...  ...patient care that continually evolves to make healthcare more human, more effective,...