Resources

2 results for "llm-as-a-judge"

Database Credentialed Access

MIMIC-IV-Ext-SDBench: Sequential Diagnosis Benchmark Cases Derived from MIMIC-IV

Harsha Nori, Mayank Daswani, Christopher Kelly, et al.

MIMIC-IV-Ext-SDBench contains 488 case records derived from MIMIC-IV emergency department encounters in which the patient was subsequently admitted as an inpatient. Each case is formatted primarily for use with the Sequential Diagnosis Benchmark, an…
benchmark diagnostic reasoning llm evaluation large language models sdbench sequential diagnosis clinical reasoning cost-aware diagnosis
Published: Oct. 22, 2026. Version: 1.0.0
Database Credentialed Access

MIMIC-III-Ext-VeriFact-BHC: Labeled Propositions From Brief Hospital Course Summaries for Long-form Clinical Text Evaluation

Philip Chung, Akshay Swaminathan, Alex Goodell, et al.

The VeriFact-BHC dataset is designed to verify the factuality of long-form text written about a patient against their own electronic health record. There is increasing interest in using large language models (LLMs) to generate clinical text in patie…
natural language processing clinical informatics formal logic chart review text embedding brief hospital course long-form text logical atomism retrieval-augmented generation text reranking clinical medicine atomic claim fact verification hybrid retrieval llm-as-a-judge llm evaluation clinical notes large language models electronic health records artificial intelligence
Published: Aug. 27, 2026. Version: 1.1.0