Data Engineer at Dcode Talent LLC

Data Engineer - Role: Data Engineer (6 months W2 only) - Location: NYC NY (3 days onsite per week) - F2F interview - Core Requirement: Horizon Core Banking knowledge is essential; experience with core banking systems required - Technical Skills: - Proficient in Python (read and write) - Strong experience with Databricks for building scalable data pipelines - Data processing tools: SQL Python Spark - Experience with Azure and cloud integrations with Databricks - Knowledge of ETL tools and data architecture principles - Data Focus: - Strong understanding of data quality data cleansing transformation and aggregation - Ensures data integrity security and compliance with regulations - Collaboration & Communication: - Works closely with data scientists analysts and business stakeholders to deliver data solutions - Effective communicator and team player - Responsibilities: - Design develop and maintain scalable data pipelines and architectures - Implement data management best practices for storage retrieval and performance optimization - Monitor troubleshoot and document data processes - Stay updated on latest data engineering and Databricks advancements - Perform other related duties as assigned - Qualifications: - Bachelors degree in CS IT Engineering or related field (or equivalent experience) - 3 years experience as a Data Engineer with proven Databricks expertise - Strong problem-solving and multitasking abilities Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala Employment Type : Full Time Experience: years Vacancy: 1