Lead Data Engineer Job at Purple Drive, Seattle, WA

VUtlRGlOTjNXQkREdnRnZ0o0N2tKWmhvRUE9PQ==
  • Purple Drive
  • Seattle, WA

Job Description

Role: Lead Data Engineer
Location: Seattle, WA
Duration: 6 months

Responsibilities:

• Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files.
• Develop and support data pipelines within a Cloud Data Platform, such as Databricks
• Build data models that reflect domain expertise, meet current business needs, and will remain flexible as strategy evolves
• Monitor and optimize Databricks cluster performance, ensuring cost-effective scaling and resource utilization
• Demonstrates ability to communicate technical concepts to non-technical audiences both in written and verbal form.
• Demonstrates strong understanding with coding and programming concepts to build data pipelines (e.g. data transformation, data quality, data integration, etc.).
• Demonstrates strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
• Implement and maintain Delta Lake for optimized data storage, ensuring data reliability, performance, and versioning
• Automate CI/CD pipelines for data workflows using Azure DevOps
• Collaborate with cross-functional teams to support data governance using Databricks Unity Catalog

Qualifications:

• 7+ years of experience in data engineering or a related field
• Expertise with programming languages such as Python/PySpark, SQL, or Scala
• Experience working in a cloud environment (Azure preferred) with strong understanding of cloud data architecture
• Hands-on experience with Databricks Cloud Data Platforms Required
• Experience with workflow orchestration (e.g., Databricks Jobs, or Azure Data Factory pipelines) Required

Job Tags

Flexible hours,

Similar Jobs

Taymax

Planet Fitness - General Manager - Hegenberger Rd. Oakland Job at Taymax

 ...Qualifications/Requirements Must be 18 years of age or older, have a high school diploma/GED equivalent and have a passion for fitness and health. One to three years of experience in a management role preferred. Computer Proficiency (Microsoft Suite) and the... 

Phase2 Technology

Remote Scrum Master with TS/SCI Clearance Job at Phase2 Technology

 ...A technology services company in Herndon, Virginia is seeking a Scrum Master responsible for facilitating Agile best practices within a development team. The ideal candidate will support sprint planning and team mentorship while collaborating with clients and stakeholders... 

Providence Health and Services

Manager Surgical Services RN Job at Providence Health and Services

 ...Manager Surgical Services RN at Providence Health and Services summary: The Manager Surgical Services RN oversees daily operations of operating rooms, endoscopy, and central processing departments, ensuring quality patient care and clinical standards. They participate... 

Constellation Brands

Manager, Wine Club and eComm Sales - Booker Job at Constellation Brands

 ...Summary Were the producers, creators and marketers of beer, wine and spirits brands that people love. At Constellation Brands, we...  ...will be responsible for managing club memberships, driving sales, enhancing communication with club members, and ensuring that members... 

FocusGroupPanel

Work At Home Data Entry Remote Admin Assistant Job at FocusGroupPanel

 ...Remote Work From Home Data Entry Clerk for Entry Level Position Work at home position for job seekers from virtually any work background who are interested in part-time, side gigs, micro jobs, work from home jobs and remote telecommute jobs. We're looking for folks...