Sr. Data Engineer at Sumeru Solutions

Note: Need a Senior Data Engineer(Individual contributor) who can guide team members contribute to design and bring new ideas with minimal client guidance. Primary Skills: PySpark Databricks Python SQL / Data Manipulation Data Modelling Secondary Skills: AI/ML DevOps Job Responsibilities: Technical Engineering Services Supports engineering projects by developing software solutions; conducting tests and inspections; preparing reports and calculations. Expected to supervise associate engineers on occasion. Understands system protocols how systems operate and data flows. Aware of current technology benefits. Expected to independently develop a full software stack. Understands the building blocks interactions dependencies and tools required to complete software and automation work. Independent study of current technology. Technical Leadership Collaborates with technical teams and utilizes system expertise to deliver technical solutions. Continuously learns new technologies. Technical Writing Writes basic documentation on how technology works. Contributes clear documentation for new code and systems used. Documenting systems designs presentations and business requirements for consumption at the engineer level. Technology Strategy Contributes to emerging technologies to deliver business goals. Understands current technology that supports business goals. Understands system protocols how systems operate and data flows. Aware of current technology benefits. Expected to independently develop a full software stack. Understands the building blocks interactions dependencies and tools required to complete software and automation work. Independent study of current technology is expected. Interact with system engineers to define system requirement and/or necessary requirements for automation. Innovation Presents new ideas which improve an existing system/process/service utilizing new frameworks. Express new perspectives based on independent study of the industry. Review current company processes to highlight questions that may drive process refinement. Education: Bachelors Degree Computer Science or Engineering (Required) Work Experience: 2-4 years Technical engineering experience. (Required) 2-4 years Data Modeling Data Analysis Software/Functional Design. (Strongly Preferred) Knowledge Skills and Abilities: Databricks (Required) PySpark (Required) Python (Required) SQL/Data Manipulation (Required) Azure Cloud Storage (Preferred) Shell scripting (Preferred) Devops Experience AI/ML added advantage Communication (Required) Customer Service (Required) Analytics (Required) Technical Writing (Required) Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala Employment Type : Full Time Experience: years Vacancy: 1