DataBrick Engineer at Shrive Technologies LLC

Mandatory Skills: Databricks Developer and DataBric Admin and Databricks Support. 8 years of experience in data engineering with at least 3 years on Databricks. - Strong proficiency in PySpark SQL and Delta Lake. - Hands-on experience with GCP Dataproc. **Responsibilities:** 1. **Administration**: - Lead the installation and configuration of Databricks on GCP cloud platforms. - Monitor platform health performance and cost optimization. - Implement governance logging and auditing mechanisms. 2. **Development / Enhancements**: - Design and develop scalable ETL/ELT pipelines using PySpark SQL and Delta Lake. - Collaborate with data engineers and analysts to enhance data workflows and models. - Optimize existing notebooks and jobs for performance and reliability. 3. **Operations Support & Troubleshooting**: - Provide L2/L3 support for Databricks-related issues and incidents. - Troubleshoot cluster failures job errors and performance bottlenecks. - Maintain technical documentation for platform setup operations and development standards Key Skills ASP.NET,Health Education,Fashion Designing,Fiber,Investigation Employment Type : Full Time Experience: years Vacancy: 1