Data Engineer, IMDb at IMDb

IMDb is the worlds most popular and authoritative source for information on movies TV shows and celebrities. With more than 250 million monthly unique visitors IMDb connects entertainment fans worldwide with comprehensive information on over 12 million titles and 13 million cast and crew members.Were seeking a Data Engineer who is both a fan of entertainment and understands the business of film and television. Youll help modernize our data infrastructure by upgrading legacy systems with scalable cloud-native solutions - while leveraging AI to automate and enhance data pipelines. This role requires technical depth industry knowledge and a willingness to experiment with emerging technologies.Key job responsibilities Design build and maintain batch and streaming data pipelines processing terabytes of entertainment metadata user traffic and engagement metrics and entertainment industry data Build ETL CDK pipelines using AWS services including S3 Glue EMR Redshift Kinesis and MWAA (Airflow) Implement AI-assisted data engineering workflows including LLM-powered data quality checks automated schema evolution and intelligent data cataloging Collaborate with Data Scientists to productionize GenAI and ML models that support content moderation user personalization customer segmentation and more Partner with Business Intelligence Engineers to build data models supporting analytics reporting and business decision-making Optimize query performance and data storage costs across petabyte-scale datasets Establish data quality frameworks and monitoring systems to ensure accuracy of entertainment industry data Mentor junior engineers on data engineering best practices and AWS technologiesAbout the teamYoull work alongside Data Engineers who are building the data foundation for IMDbs reporting and Insight products; Data Scientists that are building prediction and customer segmentation models; and Business Intelligence Engineers that deliver insights to IMDb stakeholders. Our team values technical excellence experimentation and using data to improve the entertainment discovery experience for millions of users.- 4 years of data engineering experience- Experience with data modeling warehousing and building ETL pipelines- Experience with SQL- Knowledge of professional software engineering & best practices for full software development life cycle including coding standards software architectures code reviews source control management continuous deployments testing and operational excellence- Knowledge of distributed systems as it pertains to data storage and computing- Experience programming with at least one modern language such as C C# Java Python Golang PowerShell Ruby- Knowledge of data governance privacy compliance and security best practices- Experience with AWS technologies like Redshift S3 AWS Glue EMR Kinesis FireHose Lambda and IAM roles and permissions- Experience with non-relational databases / data stores (object storage document or key-value stores graph databases column-family databases)- Experience in the entertainment industry- Experience applying generative AI and LLMs to data engineering challengesAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118900/year in our lowest geographic market up to $205600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge skills and experience. Amazon is a total compensation company. Dependent on the position offered equity sign-on payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and/or other benefits. For more information please visit This position will remain posted until filled. Applicants should apply via our internal or external career site. Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala Employment Type : Full-Time Department / Functional Area: Data Engineering Experience: years Vacancy: 1 Yearly Salary Salary: 118900 - 205600