Senior Snowflake Data Engineer at Confie

Pay Range:$140000 - $160000 / yearOur Perks:Generous PTO plans sick pay and health benefitsAnnual bonus based on employment standing*Work from home and hybrid model employmentConfie Enablement Fund/ Scholarship ProgramI-Care Recognition ProgramCorporate Social Responsibility ProgramDiversity Equity and Inclusion InitiativesConfie Hub and Discount Programs (Gym Membership)PurposeWork under the guidance and supervision of the Director Enterprise Architecture to build Confies next-generation Enterprise Data Solutions. Responsible for developing robust data models creating efficient ELT processes and optimizing performance to support the organizations data needs. Requires expertise in designing implementing and maintaining data solutions on Snowflake data cloud environments that drive critical business insights and operationsEssential Duties & ResponsibilitiesDesign and develop data pipelines ETL workflows to populate the cloud Data Lake and Data Warehouse on Snowflake with a transformation tool (e.g. Coalesce WhereScape Azure Data Factory) and replication tools (e.g. Fivetran Airbyte etc.)Translate business requirements into technical specifications; establish and define details definitions and requirements of applications components and enhancementsDesign and develop robust and scalable data pipelines to support data integrations using Snowflake Coalesce Python Airflow and FivetranDesign and develop Snowflake data objects (tables views stored procedures UDFs etc.)Implement ELT (Extract Load Transform) processes using Snowflakes features such as Snowpipe Streams and TasksPerform data cleaning analysis and integration using PythonAbility to work with multiple data sources and types (structured/semi-structured/unstructured)Design and implement efficient data models and schemas within Snowflake to support reporting analytics and business intelligence needsMonitor and optimize query performance and resource utilization within Snowflake using query profiling query optimization techniques and workload management featuresIdentify and resolve performance bottlenecks and optimize data warehouse configurations for maximum efficiencyImplement processes and systems to monitor data quality ensuring production data is always accurate and available for key stakeholders and business processes that depend on itMonitor data pipelines for timely and accurate completionStay up-to-date with industry trends and advancements in data engineering continuously improving the teams technical knowledge and skillsOn-call supportQualification and Education Requirements6 years of professional experience in data engineering designing and implementing data pipelines and building data infrastructure5 years of strong experience required in Snowflake data cloud and ETL development including Snowflake procedures UDFs in Python and SQL streams tasks Snowpipe and working with semi-structured data etc.5 years of strong experience with Python programming and extensively used frameworks/packages like Snowpark pandas numpy and requests for Data Analysis and integrationSolid understanding of data warehousing concepts dimensional modeling and data integration techniques5 years of strong experience with Data Integration & transformation tools like Coalesce WhereScape and Azure Data FactoryExperience with Databricks Google BigQuery and AWS Redshift is a plusExperience with data quality and observability concepts is a plusExperience with cloud platforms (e.g. AWS Azure GCP) and cloud-based data technologies is a plusSkills:A Love for All Things Data - The backbone of a good data engineer is to understand the life cycle of data movements from source to final interpretations on a reportA Passion to Learn - Strong desire and ability to learn new tools skills and acquire knowledgeListening Skills - The ability to understand what people sayAnalytical Skills - The ability to critically evaluate the information from multiple sources and break down high-level information into detailsObservation Skills - The ability to validate data obtained via other techniques and expose new areas for elicitationOrganizational Skills - The ability to work with the vast array of information gathered during analysis and to cope with rapidly changing informationInterpersonal Skills - The ability to help set prioritiesOral and Written Skills - Excellent written and verbal communication with little to no supervisionCritical thinking and problem-solving skillsConfidence in communicating and translating data-driven insights and technical concepts into simple terminology for business clients of various levelsAbility to work and communicate effectively with any level of the user communityQualifications and Education RequirementsBachelors degree in Computer Science Engineering or a related fieldSnowflake Advanced Certification is a plusAdditional certifications related to data platforms are a plusOther DutiesThis job description is not designed to cover or contain a comprehensive listing of activities duties or responsibilities that are required of the employee for this job. Duties responsibilities and activities may change at any time with or without noticeAs permitted by applicable law and from time-to-time Confie may use a computer system that has elements of artificial intelligence to help make decisions about your employment including recruitment hiring renewal of employment or the terms and conditions of your employment. Employees with questions about Confies use of these computer systems should contact Human Resources at Required Experience:Senior IC Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala Employment Type : Full-Time Department / Functional Area: Administration Experience: years Vacancy: 1 Yearly Salary Salary: 140000 - 160000