Resources
56 results for "benchmarking"
Model
Credentialed Access
Asclepius-R : Clinical Large Language Model Built On MIMIC-III Discharge Summaries
The development of large language models tailored for handling patients’ clinical notes is often hindered by the limited accessibility and usability of these notes due to strict privacy regulations. To address these challenges, we first create synth…
Software
Open Access
Transformer-DeID: Deidentification of free-text clinical notes with transformers
Sharing patient data such as clinical notes among clinicians and researchers is fundamental to advancements in clinical practice and biomedical research. Prior to distribution, it is often necessary and legally mandated to remove identifiers such as…
Database
Credentialed Access
ReFiSco: Report Fix and Score Dataset for Radiology Report Generation
Automated generation of clinically accurate radiology reports can improve patient care. In order to improve automatic report generation, it is helpful to understand what types of errors are common in generated reports. Thus, we introduce the Report …
Model
Credentialed Access
Medical AI Research Foundations: A repository of medical foundation models
Medical AI Research Foundations is a repository of open-source medical foundation models. With this collection of non-diagnostic models, APIs, and resources like code and data, researchers and developers can accelerate their medical AI research. Thi…
Database
Credentialed Access
MS-CXR-T: Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing
MS-CXR-T is a multi-modal benchmark dataset for evaluating biomedical vision-language processing (VLP) models on two distinct temporal tasks in radiology: image classification and sentence similarity. The former comprises multi-image frontal chest X…
Model
Credentialed Access
Clinical-T5: Large Language Models Built Using MIMIC Clinical Text
Recent advances in scaling large language models (LLMs) has resulted in significant improvements over a number of natural language processing benchmarks. There has been some work to pretrain these language models over clinical text. These works demo…
Database
Open Access
PTB-XL, a large publicly available electrocardiography dataset
Electrocardiography (ECG) is a key diagnostic tool to assess the cardiac condition of a patient. Automatic ECG interpretation algorithms as diagnosis support systems promise large reliefs for the medical personnel - only on the basis of the number o…
Database
Credentialed Access
Chest X-ray segmentation images based on MIMIC-CXR
As more and more artificial intelligence (AI) or deep learning technologies have been applied to medical image applications such as radiological finding identification in chest X-rays (CXRs), the interpretability of the prediction model is crucial f…
Database
Credentialed Access
DrugEHRQA: A Question Answering Dataset on Structured and Unstructured Electronic Health Records For Medicine Related Queries
Electronic Health Records (EHR) contain patient records, stored in structured tables as well as unstructured clinical notes. The information in structured and unstructured EHR records is not strictly disjoint: information may be duplicated, contradi…
Database
Credentialed Access
RuMedNLI: A Russian Natural Language Inference Dataset For The Clinical Domain
There is a shortage of text medical resources for the Russian language. This is a substantial obstacle in state-of-the-art NLP deep learning models research and development. To mitigate this issue we translated the MedNLI data from English to Russia…