PhysioNet/CinC Challenge 2011 FAQ


What are the deadlines?

To be eligible for one of the major awards, you must:


Are the base and gain values the same for all signals?

For all records, the base value should be 0 and the gain 200/mV. If you plan to rely on this feature, however, it is best if your software simply checks the input, and normalizes it (i.e., scales and shifts the sample values) only if needed.


Are improperly formatted entries counted?

Only entries that yield a valid score will be counted against the 5 entry limit for event 1.


What are the best scores?

Top 10 scores in event 1:

0.932 xzh
0.926 gar
0.920 cth
0.916 die
0.912 gga
0.912 nir
0.908 ire
0.904 seb
0.900 nop
0.896 ben

These scores measure classification accuracy (the fraction of ECGs for which a participant's entry includes a classification that matches the reference classification for that ECG). Only matches contribute to the scores (there is no deduction for an error or a missing classification).

The scores visible on this page prior to 20 July were preliminary scores, because they were based on preliminary reference classifications. Now that the final reference classifications are available, the scores shown above are final scores. The list above shows the final ranking in event 1, since the deadline for submitting additional entries has passed.

The final scores for all three events are here.


How is the computation time incorporated into the scoring function?

Scoring for event 2 is based on accuracy only, although there will be a time limit, which we will enforce only if the submitted code appears to be "stuck". Currently, the time limit has not been set, but (based on the intended application, which is to provide feedback on the quality of an ECG while the patient is still present) the limit is likely to be 30 seconds or a minute per ECG on our reference phone.

Scoring for event 3 will be directly related to computation time (as measured by the Android app framework). You can safely assume that (1) the faster of two entries with the same accuracy will receive a higher event 3 score, and (2) speed will not be able to make up for a significant difference in accuracy (for example, if entry A is half as accurate and fifty times faster than entry B, entry B will receive the higher score).