Data Engineer with AWS Databricks at VDart Inc

Role: Data Engineer Healthcare (AWS Databricks). Location: Eagan MN (Onsite). Duration: Long Term Contract. Overview: Seeking an experienced Data Engineer with strong healthcare domain expertise and proficiency in AWS-native services Databricks SQL and PySpark. This role involves designing and orchestrating ETL/ELT pipelines leveraged through Databricks Workspace and Medallion Architecture to support robust compliant healthcare data transformation initiatives. Key Responsibilities: Build complex ETL/ELT pipelines using Databricks Workspace and PySpark ensuring secure processing of sensitive healthcare data. Architect and optimize solutions using Databricks Medallion Architecture and AWS data stack (e.g. S3 Glue Redshift). Orchestrate jobs via Databricks Workspace for seamless workflow automation. Leverage Data Vault 2.0 methodologies in pipeline design (preferred but not mandatory). Collaborate on data migration projects as needed. Write advanced SQL queries for data analysis and transformation tasks. Ensure compliance with security and healthcare data governance standards. Engage with cross-functional teams to deliver scalable reliable healthcare analytics solutions. Required Skills & Experience: Healthcare data engineering experience (mandatory). Advanced SQL proficiency. Experience with AWS native services and Databricks development (using AWS or equivalent cloud stack). Strong PySpark and pipeline orchestration capability. Familiarity with Databricks Medallion Architecture. Exposure to Data Vault 2.0 methodologies. Data migration project experience (preferred). Strong communication and collaboration skills. Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala Employment Type : Full Time Experience: years Vacancy: 1