Resources
47 results for "benchmark dataset"
Database
Credentialed Access
MedVAL-Bench: Expert-Annotated Medical Text Validation Benchmark
MedVAL-Bench is a dataset containing physician evaluations of errors in language model (LM)-generated medical text. The dataset spans 6 diverse medical text generation tasks and includes annotations from 12 physicians on clinically significant error…
Database
Credentialed Access
CXR-Align: A Benchmark for CXR-Report Alignment with Negations
CXR-Align is a benchmark dataset designed to evaluate vision-language processing (VLP) models' ability to accurately interpret negations in chest X-ray (CXR) reports. Negations are prevalent in medical documentation and pose significant challenges f…
Database
Open Access
PTB-XL, a large publicly available electrocardiography dataset
Electrocardiography (ECG) is a key diagnostic tool to assess the cardiac condition of a patient. Automatic ECG interpretation algorithms as diagnosis support systems promise large reliefs for the medical personnel - only on the basis of the number o…
Database
Credentialed Access
DrugEHRQA: A Question Answering Dataset on Structured and Unstructured Electronic Health Records For Medicine Related Queries
Electronic Health Records (EHR) contain patient records, stored in structured tables as well as unstructured clinical notes. The information in structured and unstructured EHR records is not strictly disjoint: information may be duplicated, contradi…
Database
Open Access
MIMIC-IV Clinical Database Demo on FHIR
Interoperability of healthcare data has become increasingly important given the increase in deployment of data driven algorithms in clinical settings. The Fast Healthcare Interoperability Resources (FHIR) standard has emerged as a promising mechanis…
Database
Credentialed Access
MS-CXR: Making the Most of Text Semantics to Improve Biomedical Vision-Language Processing
We release a new dataset, MS-CXR, with locally-aligned phrase grounding annotations by board-certified radiologists to facilitate the study of complex semantic modelling in biomedical vision–language processing. The MS-CXR dataset provides 1162 imag…
Database
Credentialed Access
Lunguage: A Benchmark for Structured and Sequential Chest X-ray Interpretation
Radiology reports convey detailed clinical observations and capture diagnostic reasoning that evolves over time. However, existing evaluation methods are limited to single-report settings and rely on coarse metrics that fail to capture fine-grained …
fine-grained structured reports
attribute-level clinical reasoning
medical text structuring
longitudinal clinical reasoning
chest x-ray report parsing
medical information structuring
benchmark dataset for radiology report
medical information extraction
structured radiology reports
temporal relation extraction
radiology report benchmarking
longitudinal clinical understanding
Database
Credentialed Access
MS-CXR-T: Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing
MS-CXR-T is a multi-modal benchmark dataset for evaluating biomedical vision-language processing (VLP) models on two distinct temporal tasks in radiology: image classification and sentence similarity. The former comprises multi-image frontal chest X…
Database
Credentialed Access
MIMIC-III-Ext-tPatchGNN
This dataset is a curated subset of MIMIC-III (v1.4), specifically formatted to facilitate reproducibility of the experiments in the work t-PatchGNN. It serves as part of a benchmark designed for forecasting irregular multivariate clinical time seri…
Model
Credentialed Access
Medical AI Research Foundations: A repository of medical foundation models
Medical AI Research Foundations is a repository of open-source medical foundation models. With this collection of non-diagnostic models, APIs, and resources like code and data, researchers and developers can accelerate their medical AI research. Thi…