Senior Data Engineer at Diligent Tec Inc

Position: Senior Data Engineer (PySpark Databricks Oracle/PostgreSQL Migration)Location: Alpharetta GAJob type: ContractONLY W2Interview Levels: 2 Rounds1st Round-Webex Video2nd round-Coding F2F Exp Level: Min 10 YearsExpert-level proficiency in PySpark and Databricks.Primary Skill Focus: PySpark Databricks (Hands-on coding test expected) Skills Required: 1. RDBMS Expertise:Strong hands-on experience with Oracle and PostgreSQL databases.Deep understanding of database architecture design indexing and performance tuning.Expert-level SQL skills: queries stored procedures functions triggers and views. MigrationProven experience in end-to-end database migration projects (preferred: Oracle PostgreSQL).Strong ability to perform data mapping transformation validation and reconciliation.Experience using migration tools scripts and automation frameworks. Engineering & AnalysisAdvanced proficiency in Databricks for large-scale data processing.Expert in PySpark and Python for data transformation and analytics.Ability to build enhance and optimize complex ETL/ELT data pipelines. Scheduling & AutomationExperience creating and maintaining Databricks jobs for scheduled reporting.Familiarity with workflow orchestration tools (Airflow ADF Step Functions etc.). OptimizationStrong background in performance tuning for Oracle and PostgreSQL.Experience with index strategies query optimization execution plan analysis and caching. PlatformsGood understanding of AWS Cloud including RDS S3 EMR Lambda Glue or similar services. Required Skills:PYSPARKDATA MAPPINGPOSTGRESQL Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala Employment Type : Full Time Experience: years Vacancy: 1