Senior Data Engineer (Glendale) at KellyMitchell Group

Job Summary:Our client is seeking a Senior Data Engineer to join their team! This position is located in Glendale, California. Duties:Contribute to maintaining, updating, and expanding existing Core Data platform data pipelinesBuild tools and services to support data discovery, lineage, governance, and privacyCollaborate with other software and data engineers and cross-functional teamsWork with a tech stack that includes Airflow, Spark, Databricks, Delta Lake, Kubernetes, and AWSCollaborate with product managers, architects, and other engineers to drive the success of the Core Data platformContribute to developing and documenting internal and external standards and best practices for pipeline configurations, naming conventions, and moreEnsure high operational efficiency and quality of Core Data platform datasets to meet SLAs and ensure reliability and accuracy for stakeholders in Engineering, Data Science, Operations, and AnalyticsParticipate in agile and scrum ceremonies to collaborate and refine team processesEngage with customers to build relationships, understand needs, and prioritize both innovative solutions and incremental platform improvementsMaintain detailed documentation of work and changes to support data quality and data governance requirementsDesired Skills/Experience:5+ years of data engineering experience developing large data pipelinesProficiency in at least one major programming language such as: Python, Java or ScalaStrong SQL skills and the ability to create queries to analyze complex datasetsHands-on production experience with distributed processing systems such as SparkExperience interacting with and ingesting data efficiently from API data sourcesExperience coding with the Spark DataFrame API to create data engineering workflows in DatabricksHands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelinesExperience developing APIs with GraphQLDeep understanding of AWS or other cloud providers, as well as infrastructure-as-codeFamiliarity with data modeling techniques and data warehousing best practicesStrong algorithmic problem-solving skillsExcellent written and verbal communication skillsAdvanced understanding of OLTP versus OLAP environmentsBenefits:Medical, Dental, & Vision Insurance PlansEmployee-Owned Profit Sharing (ESOP)401K offeredThe approximate pay range for this position is between $51.00 and $73.00. Please note that the pay range provided is a good faith estimate. Final compensation may vary based on factors including but not limited to background, knowledge, skills, and location. We comply with local wage minimums.