Data Engineer

Description

Responsibilities: • Picking up user stories to code • Writing python code, testing it, taking through code review, pushing out to production • Heavy python • Writing config files • Design, develop, and maintain scalable data pipelines using Databricks notebooks and Apache Spark • Building the factory that builds the cars" don't build the actual notebooks, they build the python code that builds the notebooks • Solid troubleshooting & identifying RCA skills Soft skills: • Strong technical and business communication • Being able to read their audience and speak to this level

Skills

Python, databricks, data engineer, applications, airflow, apache, Sql, Data

Top Skills Details

Python,databricks,data engineer,applications,airflow,apache

Additional Skills & Qualifications

Tech stack: • Databricks (full migration from Synapse to Databricks in 2026, depending on Epic) • ADF • Synapse (won't use it) • Airflow (ditching astronomer and going to airflow) • GCP (nurse assignment tool, UKG data, anything FHIR) CANNOT RESIDE IN THE FOLLOWING STATES: California, Connecticut, Maryland, Massachusetts, Minnesota, Montana, New Jersey, New York, North Dakota, Oregon, Rhode Island, Washington, Washington DC, Wyoming

Experience Level

Intermediate Level