Resources
56 results for "benchmarking"
Database
Credentialed Access
CXR-Align: A Benchmark for CXR-Report Alignment with Negations
CXR-Align is a benchmark dataset designed to evaluate vision-language processing (VLP) models' ability to accurately interpret negations in chest X-ray (CXR) reports. Negations are prevalent in medical documentation and pose significant challenges f…
Database
Credentialed Access
ODD: A Benchmark Dataset for the NLP-based Opioid Related Aberrant Behavior Detection
Opioid related aberrant behaviors (ORAB) present novel risk factors for opioid overdose. Previously, ORAB have been mainly assessed by survey results and by monitoring drug administrations. Such methods however, cannot scale up and do not cover the …
Database
Open Access
VTaC: A Benchmark Dataset of Ventricular Tachycardia Alarms from ICU Monitors
False arrhythmia alarms are a persistent problem in intensive care units despite considerable effort from industrial and academic algorithm developers. Among the various arrhythmias, ventricular tachycardia (VT) is particularly challenging to detect…
Database
Credentialed Access
MIMIC-III-Ext-PPG: A PPG Benchmark Dataset for Cardiorespiratory Analysis
MIMIC-III-Ext-PPG is a large-scale, annotated, and quality-assessed dataset of photoplethysmogram (PPG) segments extracted from the MIMIC-III Waveform Database Matched Subset. It contains around 6.3 million non-overlapping 30-second segments from 6,…
Database
Restricted Access
VinDr-Mammo: A large-scale benchmark dataset for computer-aided detection and diagnosis in full-field digital mammography
Breast cancer is one of the most prevalent types of cancer and the leading type of cancer death. Mammography is the recommended imaging modality for periodic breast cancer screening. A few datasets have been published to develop computer-aided tools…
Database
Credentialed Access
MIMIC-III-Ext-MIMIC-Patient: Structured Per-Patient JSON Records for Clinical Question Answering
This project provides MIMIC-Patient, a structured, per-patient representation of the MIMIC-III database designed for large language model (LLM)–based clinical question answering. For each of 500 admissions, we reconstruct the patient’s episode into …
Database
Credentialed Access
MIMIC-IV-Ext-MedicalBench: Evaluating Large Language Models Towards Improved Medical Concept Extraction
Medical concept extraction from electronic health records underpins many downstream applications, yet remains challenging because medically meaningful concepts, such as diagnosis, are frequently implied rather than explicitly stated in medical narra…
Database
Credentialed Access
MedVH: Towards Systematic Evaluation of Hallucination for Large Vision Language Models in the Medical Context
Large Vision Language Models (LVLMs) have recently achieved superior performance in various tasks on natural image and text data, which inspires a large amount of studies for LVLMs fine-tuning and training. Despite their advancements, there has been…
Database
Credentialed Access
A Temporal Dataset for Respiratory Support in Critically Ill Patients
We present a temporal benchmark dataset for clinical respiratory intervention tasks in intensive care unit (ICU) patients, derived from the MIMIC-IV v2.2 dataset. The data consists of 50,920 adult ICU patients and includes 90-day hourly ventilation …
Database
Credentialed Access
MIMIC-III-Ext-tPatchGNN
This dataset is a curated subset of MIMIC-III (v1.4), specifically formatted to facilitate reproducibility of the experiments in the work t-PatchGNN. It serves as part of a benchmark designed for forecasting irregular multivariate clinical time seri…