Lead Data Engineer Job at WorkHQ, Los Angeles, CA

VzZHR2pOTnhXaDNDdmRvdEpvdmlKcDF0SGc9PQ==
  • WorkHQ
  • Los Angeles, CA

Job Description

Company Context

Series A, well-funded US startup in HRTech developing WorkHQ.com and an AI Recruiter product.

This is a US-only, Remote role (Mainland).

Role Overview

Lead data infrastructure architect managing billions of data points across 250M+ professional profiles.

Hire data engineers to aid you in that journey.

Core Responsibilities

  • Design scalable data pipelines processing massive record volumes

  • Architect ETL processes using PySpark on Amazon EMR (Open to shifting to other solutions like Data Bricks / Snowflake)

  • Distribute enriched data through medallion architecture across Postgres, Athena, OpenSearch

  • Integrate new data sources into the main pipeline

  • Implement advanced data matching using Splink

Technical Requirements

  • 5-8 years professional data engineering experience

  • Good proficiency in:

    • PySpark and distributed computing

    • AWS data services (EMR, Glue, Athena)

    • Docker

    • Pandas and DataFrame manipulation

    • Complex data format handling (JSONL, Parquet)

  • Strong background in:

    • Big data processing architectures

    • Data warehouse design

    • Performance optimization

  • Advanced Python, SQL skills

Nice to Have

  • Probabilistic record linking expertise

  • OpenSearch/elasticsearch technologies

  • Machine learning data pipeline design

  • Recruitment tech ecosystem knowledge

Technical Stack

  • Big Data: PySpark, EMR

  • Databases: Postgres, OpenSearch

  • Cloud: AWS

  • Containerization: Docker

  • Data Formats: JSONL, Parquet

  • Analytics: Metabase, Athena, Glue

  • Data Processing: Pandas, Splink

Other Considerations

While this role has specific requirements - if you lack a few technical skills, but motivated to learn and lead the platform, please apply for consideration.

If you are coming from Director/Head of/VP levels that is relevant to this job, you can apply as well.

You will need to apply directly on our platform.

Thank you for your time.

Job Tags

Permanent employment, Remote work, Shift work,

Similar Jobs

Drax Co

Mobile Equipment Operator (Kelly) Job at Drax Co

Mobile Equipment Operator Full-time, Permanent On-Site Location: Urania, LA Were notjust talking about making a difference, were making it happen. We generatedispatchable, renewable power and create stable energy in an uncertain world.Building on our proud...

Life Care Center of Casper

Physical Therapy (PT) Aide Job at Life Care Center of Casper

 ...Position Summary The Physical Therapy Aide assists in carrying out rehab related activities which are pre determined for each patient and assigned by the supervising licensed therapist in accordance with all applicable laws, regulations, and Life Care standards.... 

Chirocom

ASSOCIATE CHIROPRACTOR NEEDED LA QUINTA, CA (California) Job at Chirocom

ASSOCIATE CHIROPRACTOR NEEDED LA QUINTA, CA Popular Busy, 20 year-established Chiropractic and Acupuncture clinic needs an associate DC now! Great opportunity for a new graduate. You will grow your practice quickly. Mentoring provided. Full time or Part time position...

MetroDerm PC

Mohs Surgeon Job at MetroDerm PC

 ...MetroDerm P.C. is seeking a Mohs Surgeon with knowledge in all areas of general dermatology to see patients in an established and expanding practice in Atlanta, GA. Significant income potential with first year guarantee, plus benefits Opportunity for Mohs... 

Vermont Staffing

Construction Laborer Job at Vermont Staffing

 ...Laborer Position The laborer performs tasks involving physical labor at various jobsites. The position may operate a variety of hand and power tools and may clean and prepare sites, clean up rubble and debris, and remove waste materials. The position may assist other...