Senior Automation Engineer (Remote Opportunity)

About This Opportunity

We are representing a confidential healthcare technology organization on a senior-level automation engineering role supporting a federal government healthcare modernization initiative. This is a 100% remote position for candidates residing within the continental United States.

You will play a critical role in developing, validating, and automating testing for an AI-powered patient health data summarization capability within a clinical decision support platform. This position requires deep healthcare interoperability expertise, proficiency with clinical data standards, and hands-on experience with test automation and AI-enabled quality engineering.

Responsibilities

• Develop comprehensive test plans, test cases, and acceptance criteria for AI-powered patient summarization capabilities
• Create traceability between business requirements, clinical data standards, and test scenarios
• Design test coverage across clinical document types, including Continuity of Care Documents, Discharge Summaries, Progress Notes, and History & Physical documents
• Develop positive, negative, boundary, and edge-case testing scenarios for AI-enabled clinical applications
• Analyze and validate C-CDA XML documents, including headers, sections, templates, and clinical entries
• Verify accurate extraction and summarization of clinical information, including medications, allergies, laboratory results, procedures, care plans, and diagnoses
• Ensure AI-generated summaries accurately reflect source clinical documentation and maintain traceability to original clinical sources
• Perform functional, integration, system, regression, performance, and user acceptance testing
• Develop and maintain automated test suites for document ingestion, AI summarization, APIs, and user interfaces
• Test clinical decision support workflows and patient-context-driven launch scenarios across multiple data sources
• Support CI/CD pipelines through automated quality gates and continuous testing
• Build automated validation frameworks for AI-generated summaries
• Evaluate AI-generated content for clinical completeness, consistency, usability, accuracy, and reliability
• Identify omissions, inaccuracies, hallucinations, and other AI-generated defects that could impact clinical workflows
• Validate AI guardrails, monitoring capabilities, auditability, and quality controls
• Participate in defect triage, root-cause analysis, and release-readiness activities
• Create test documentation, defect reports, traceability matrices, and quality assessments
• Collaborate with software engineers, solution architects, clinicians, product owners, cybersecurity teams, and government stakeholders
• Leverage AI-assisted tools to accelerate test development, automation, regression testing, defect analysis, and quality assurance activities

What We're Looking For

Required Qualifications:

• Bachelor's degree in Computer Science, Information Technology, Health Informatics, Engineering, or related technical discipline, or equivalent experience
• Minimum 5 years of experience testing healthcare software applications
• Strong knowledge of Consolidated Clinical Document Architecture (C-CDA) standards, including clinical document structure, sections, templates, and entries
• Hands-on experience reading, validating, and troubleshooting XML-based healthcare data
• Experience with healthcare interoperability standards and clinical data exchange
• Experience testing Clinical Decision Support applications and workflows
• Familiarity with SMART on FHIR, CDS Hooks, REST APIs, and related interoperability technologies
• Experience with test automation frameworks, API testing tools, and defect management platforms
• Experience developing and maintaining automated testing solutions within Agile and DevSecOps environments
• Experience with AI-assisted testing tools and techniques for test case generation, automation development, regression testing, and defect analysis
• Familiarity with Generative AI and Large Language Models, including using AI to create and maintain automated test scripts and validation frameworks
• Experience validating AI-generated outputs and establishing quality controls for accuracy, consistency, and reliability
• Strong analytical, troubleshooting, and problem-solving skills
• Excellent written and verbal communication skills
• U.S. Citizenship required
• Ability to obtain and maintain a Government/Public Trust clearance

Preferred Qualifications:

• Experience supporting Department of Veterans Affairs healthcare systems or similar clinical viewer applications
• Knowledge of USCDI and healthcare interoperability requirements
• Familiarity with healthcare terminologies such as SNOMED CT, LOINC, RxNorm, and ICD
• Experience validating AI/ML-enabled healthcare solutions
• Experience with AI-powered testing platforms such as GitHub Copilot, Microsoft Copilot, Testim, Functionize, Mabl, or similar tools
• Experience creating autonomous or semi-autonomous AI testing workflows
• Understanding of prompt engineering and AI evaluation methodologies for software quality assurance
• Knowledge of accessibility and usability testing within healthcare environments
• Exposure to healthcare data analytics and modernization initiatives within federal healthcare agencies

Note: Visa sponsorship is not available for this position.

How We Work With You

When you apply through Get A Job.ai, our talent team will review your qualifications and conduct an initial screening. If there's a strong match, we will submit your profile to our client for consideration. Please do not contact the client directly—all communication and coordination will flow through our recruiting team to ensure the best experience for you and proper representation of your candidacy.

Pay

Compensation details will be discussed with qualified candidates during the screening process.

Equal Employment Opportunity

Get A Job.ai is committed to equal employment opportunity. We evaluate qualified applicants without regard to race, color, religion, sex, national origin, disability, veteran status, age, sexual orientation, gender identity, or other protected characteristics.