Data Engineer at LLNL

We have an opening for a Data Engineer to architect and modernize the data lifecycle for Strategic Deterrence (SD). In this role you will move beyond legacy tooling to build robust automated data pipelines that capture characterize and democratize critical test data. By championing DataOps principles and modern software practices you will enable seamless data sharing and real-time decision-making within LLNL and across the NNSA complex. This position is in the Applications Simulations and Quality (ASQ) Division within the Computing Directorate supporting the SD Applications Data Lifecycle Management (DLM) Team.This position will be filled at the SES.1 or SES.2 level based on knowledge and related experience as assessed by the hiring team. Additional job responsibilities (outlined below) will be assigned if hired at the higher level.In this role you willDesign and implement data pipelines using both scripting and modern orchestration tools to process unstructured test data from diverse sources.Champion DataOps and Software Engineering best practices by implementing version control (Git) CI/CD workflows containerization and automated testing to ensure software and pipeline reliability and reproducibility.Develop interactive dashboards to democratize data access for scientists and engineers working with subject matter experts (SMEs) to define programmatic data needs.Translate scientific requirements into technical specifications for APIs pipelines and visualization tools acting as a bridge between SMEs and the software team.Collaborate with customers to define schemas/ontologies for their data utilizing tools for data quality validation to ensure standardized characterization of experiments.Perform other duties as assigned.Additional job responsibilities at the SES.2 LevelExercise independent discretion and judgement to define develop and implement original solutions to complex data management across a broad set of disciplines at the team directorate and institutional level. Provide formal/informal technical leadership and/or domain expertise in researching advising and recommending technical solutions and approaches.Qualifications : Ability to obtain and maintain a US DOE Q-level security clearance which requires U.S. Citizenship.Bachelors degree in a Computer Engineering or Mathematics related field or equivalent combination of technical training and extensive experience.Experience with Python including modern development practices visualization libraries (Plotly Streamlit) and the scientific stack (pandas numpy).Experience with modern version control (Git) CI/CD platforms and containers.Experience handling structured and unstructured data formats (JSON YAML Parquet XML) and utilizing RESTful APIs.Experience working with scientific or manufacturing data and developing business requirements with customers.Proficient verbal and written communication skills necessary to present technical architectures to non-technical stakeholders and advocate for modern tooling.Additional Qualifications at the SES.2 LevelComprehensive experience with Python. Broad experience collaborating with management customers or high-level technical personnel to provide direction in the design evaluation recommendation and implementation of systems services or processes.Broad experience independently analyzing and interpreting complex data/business processes requiring advanced knowledge of materials management manufacturing data management and/or scientific experimentation.Qualifications We Desire Knowledge and experience with LLNL process and procedures.Comfortable being an advocate for a new technical product.Knowledge of SD/NNSA data domains and use cases.Experience with workflow orchestration tools (e.g. Airflow Prefect Dagster).Knowledge of S3-compatible object storage and Data Lake architectures.Additional Information : All your information will be kept confidential according to EEO guidelines.Position InformationThis is a Career Indefinite position open to Lab employees and external candidates.Why Lawrence Livermore National LaboratoryIncluded in 2025 Best Places to Work by Glassdoor!Flexible Benefits Package401(k)Relocation AssistanceEducation Reimbursement ProgramFlexible schedules (*depending on project needs)Our values - visit  ClearanceThis position requires a Department of Energy (DOE) Q-level clearance.  If you are selected we will initiate a Federal background investigation to determine if you meet eligibility requirements for access to classified information or matter. Also all L or Q cleared employees are subject to random drug testing.  Q-level clearance requires U.S. citizenship. Pre-Employment Drug TestExternal applicant(s) selected for this position must pass a post-offer pre-employment drug test. This includes testing for use of marijuana as Federal Law applies to us as a Federal Contractor.Wireless and Medical DevicesPer the Department of Energy (DOE) Lawrence Livermore National Laboratory must meet certain restrictions with the use and/or possession of mobile devices in Limited Areas. Depending on your job duties you may be required to work in a Limited Area where you are not permitted to have a personal and/or laboratory mobile device in your possession.  This includes but not limited to cell phones tablets fitness devices wireless headphones and other Bluetooth/wireless enabled devices.  If you use a medical device which pairs with a mobile device you must still follow the rules concerning the mobile device in individual sections within Limited Areas.  Sensitive Compartmented Information Facilities require separate approval. Hearing aids without wireless capabilities or wireless that has been disabled are allowed in Limited Areas Secure Space and Transit/Buffer Space within buildings.How to identify fake job advertisementsPlease be aware of recruitment scams where people or entities are misusing the name of Lawrence Livermore National Laboratory (LLNL) to post fake job advertisements. LLNL never extends an offer without a personal interview and will never charge a fee for joining our company. All current job openings are displayed on the Career Page under Find Your Job of our website. If you have encountered a job posting or have been approached with a job offer that you suspect may be fraudulent we strongly recommend you do not respond.To learn more about recruitment scams:  Employment OpportunityWe are an equal opportunity employer that is committed to providing all with a work environment free of discrimination and harassment. All qualified applicants will receive consideration for employment without regard to race color religion marital status national origin ancestry sex sexual orientation gender identity disability medical condition pregnancy protected veteran status age citizenship or any other characteristic protected by applicable laws.Reasonable AccommodationOur goal is to create an accessible and inclusive experience for all candidates applying and interviewing at the Laboratory.  If you need a reasonable accommodation during the application or the recruiting process please use our online form to submit a request. California Privacy NoticeThe California Consumer Privacy Act (CCPA) grants privacy rights to all California residents. The law also entitles job applicants employees and non-employee workers to be notified of what personal information LLNL collects and for what purpose. The Employee Privacy Notice can be accessed here.Remote Work : NoEmployment Type : Full-time Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala Experience: years Vacancy: 1