Generative AI Engineer at Regard

As a Generative AI Engineer at Regard, you’ll work across the full lifecycle of developing and deploying AI-driven features, from ideation and design to prototyping, implementation, evaluation, and iteration. You’ll collaborate closely with product and clinical teams to build systems that transform medical records into structured insights and clinician-ready documentation.Your work will center on applying modern LLMs to extract, summarize, normalize, and generate clinical information from diverse electronic health record (EHR) data sources. This includes developing robust pipelines, running model and prompt-engineering experiments, integrating models into production services, and ensuring outputs remain factual, safe, and clinically aligned.You’ll directly contribute to high-priority product initiatives, shape new AI capabilities, and advance our LLM platform. Your work will have a tangible impact on how clinicians understand patient data and how healthcare organizations improve care quality.About RegardOur mission is to bring world-class healthcare to everyone. Regard is an AI-powered Proactive Documentation platform that advances how care is delivered by reviewing all patient data in the EHR to recommend diagnoses and surface clinical evidence. Regard drafts a note even before the physician sees the patient, enabling an approach that gets  documentation right at the point of care - we call it Proactive Documentation. This improves quality of care, reduces physician burden, and improves hospital finances. We are excited by challenges, mission-oriented work, and meaningful relationships. We work closely with some of the top health systems in the country and are leading the change that healthcare - one of the largest and most inefficient industries in the world - needs. We want you to join us.Our Tech Stack:Frontend: TypeScript, ReactBackend: Python, PostgreSQL, Redis, AWSAI: OpenAI, Anthropic, LangfuseResponsibilities:Build and refine LLM-powered systems to extract structured medical concepts, diagnoses, medications, labs, and timelines from unstructured recordsDevelop generation pipelines that produce clinically accurate drafts of notes (H&P, progress notes, discharge summaries, etc.) from factual inputsDesign, prototype, and evaluate prompts, agent workflows, and retrieval-augmented generation (RAG) componentsBenchmark LLM systems to evaluate new models and audit accuracyOptimize inference cost, latency, and throughput through batching, caching, and model-selection strategiesQualifications:BS in Computer Science or equivalent experience3+ years of professional experience with software development in one or more programming languages (Python preferred)1+ years of professional experience building generative AI products, such as RAGs, agents and chatbotsAble to participate in on-call operational support for their areas of responsibilityAble to travel up to 4 weeks a year for company co-working and/or retreat weeksStrong verbal and written communication skillsPreferred Qualifications:Familiarity with vector databases and embeddings generationExperience working on a mature enterprise SaaS technology productExposure to startup and/or high growth environments Hybrid Work | Location | Work AuthorizationFor this role, Regard is currently only considering candidates who are authorized to work in the US without visa sponsorship, and are within the New York City metro areaWe expect our Engineers to be in the office on Tuesdays and Thursdays. We may request more frequent in-office work during the onboarding periodWe will provide relocation assistance to anyone who does not already reside in the NYC metro areaWe prefer hiring people within commuting distance of our NYC office because we value getting together in person regularlyFor those who enjoy working from our Manhattan office on a more regular basis, we offer catered lunches and other fun perksAdditionally, hybrid employees have the flexibility to work from locations outside of their home office from up to 6 weeks per yearComp | Perks | Benefits Eligible for equity 99% employer paid health benefits (Medical, Dental, and Vision) + One Medical subscription18 PTO days/yr + 1 week holiday breakAnnual $750 learning & development stipendCompany-sponsored team retreat + social eventsA sabbatical program$170,000 - $240,000 a yearAt Regard, we carefully consider a wide range of factors when determining compensation, including your skills, qualifications, location, and experience. We expect the base salary range for this position to be $170,000 to $240,000. This is subject to change and may be modified in the future. We encourage all interested candidates to apply. Our goal at Regard is to provide and maintain a work environment that fosters mutual respect, professionalism and cooperation. Regard is proud to be an equal opportunity employer that does not discriminate on the basis of actual or perceived race, creed, color, religion, national origin, ancestry, alienage or citizenship status, age, disability or handicap, sex, gender identity, marital status, familial status, veteran status, sexual orientation or any other characteristic protected by applicable federal, state or local laws. We celebrate diversity and are proud of our supportive, inclusive workplace.All candidates must successfully complete a background check as part of the hiring process.