Azure Databricks Developer at HCLTech

HCLTech is looking for a highly talented and self- motivated Azure Databricks Engineer to join it in advancing the technological world through innovation and creativity.Job Title: Azure Databricks EngineerJob ID: 1634281BRPosition Type: Full-timeLocation: Dallas, TX || SFO, CARole/Responsibilities The Data Engineer - Databricks will be responsible for building and optimizing our data pipelines, architectures, and data sets. He will work closely with data scientists, analysts, and other engineers to support their data needs and maximize the value of our data processing capabilities.Responsibilities• Design, develop, and maintain scalable and robust data pipelines on Databricks.• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.• Optimize and troubleshoot existing data pipelines for performance and reliability.• Ensure data quality and integrity across various data sources.• Implement data security and compliance best practices.• Monitor data pipeline performance and conduct necessary maintenance and updates.• Document data pipeline processes and technical specifications.Qualifications• A bachelor’s degree in computer science, Engineering, or a closely related discipline is required.• 5+ years of experience in data engineering.• Proficiency with Databricks, Python and Spark.• Strong SQL skills and experience with relational databases.• Experience with big data technologies (e.g., Hadoop, Kafka).• Knowledge of data warehousing concepts and ETL processes.• Excellent problem-solving and analytical skills.Pay and Benefits Pay Range Minimum: $92,000/AnnumPay Range Maximum: $128,000/AnnumHCLTech is an equal opportunity employer, committed to providing equal employment opportunities to all applicants and employees regardless of race, religion, sex, color, age, national origin, pregnancy, sexual orientation, physical disability or genetic information, military or veteran status, or any other protected classification, in accordance with federal, state, and/or local law. Should any applicant have concerns about discrimination in the hiring process, they should provide a detailed report of those concerns to [email protected] for investigation.Compensation and BenefitsA candidate’s pay within the range will depend on their work location, skills, experience, education, and other factors permitted by law. This role may also be eligible for performance-based bonuses subject to company policies. In addition, this role is eligible for the following benefits subject to company policies: medical, dental, vision, pharmacy, life, accidental death & dismemberment, and disability insurance; employee assistance program; 401(k) retirement plan; 10 days of paid time off per year (some positions are eligible for need-based leave with no designated number of leave days per year); and 10 paid holidays per year.How You’ll GrowAt HCLTech, we offer continuous opportunities for you to find your spark and grow with us. We want you to be happy and satisfied with your role and to really learn what type of work sparks your brilliance the best. Throughout your time with us, we offer transparent communication with senior-level employees, learning and career development programs at every level, and opportunities to experiment in different roles or even pivot industries. We believe that you should be in control of your career with unlimited opportunities to find the role that fits you best.