Role Overview
We are seeking an experienced Dermatologist to help evaluate and enhance large language model (LLM) outputs in the medical domain. You’ll assess AI-generated clinical content for dermatological accuracy, safety, and relevance, contributing to the development of responsible AI in healthcare. We are seeking US-based dermatologists to review dermatology images using a structured online evaluation tool. The work involves assessing image quality and diagnostic usability; identifying concerns such as blur, lighting, exposure, colour, and framing; and, where applicable, identifying likely skin conditions, assigning confidence ratings, and documenting rationale.
What You'll Do Day-to-Day
- Review AI-generated medical text for accuracy, harmfulness, and completeness, with focus on dermatology.
- Evaluate diagnoses, treatment plans, and summaries for dermatologic cases.
- Provide expert feedback to improve medical integrity and safety of LLM outputs.
- Collaborate with AI researchers and clinicians to align model performance with evidence-based dermatology standards.
- Requirements:
- Based in the US (mandatory).
- Licensed Medical Doctor (MD or MBBS) with specialization in Dermatology or equivalent qualification.
- Must be fully licensed and practicing medicine within the USA.
- Minimum 5 years post-residency experience practicing as dermatologist.
- Strong visual attention to detail
- Comfortable reviewing sensitive or graphic medical images
- Technically savvy—able to navigate web-based annotation platforms, use image zoom/tools, follow detailed guidelines, and accurately complete structured questionnaires.
- Experience in medical content review, clinical research, annotation or AI/ML evaluation preferred.
Offer Details:
- Remote
- Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST.
- Location: United States
Engagement: 8 weeks
Important note: Due to the high volume of applications, we are unable to provide individual feedback at this stage. Only candidates shortlisted for the next steps will be contacted by our team.