All

What are you looking for?

All
Projects
Results
Organizations

Quick search

  • Projects supported by TA ČR
  • Excellent projects
  • Projects with the highest public support
  • Current projects

Smart search

  • That is how I find a specific +word
  • That is how I leave the -word out of the results
  • “That is how I can find the whole phrase”

Why rankings of biomedical image analysis competitions should be interpreted with care

The result's identifiers

  • Result code in IS VaVaI

    <a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14330%2F18%3A00101338" target="_blank" >RIV/00216224:14330/18:00101338 - isvavai.cz</a>

  • Result on the web

    <a href="http://doi.org/10.1038/s41467-018-07619-7" target="_blank" >http://doi.org/10.1038/s41467-018-07619-7</a>

  • DOI - Digital Object Identifier

    <a href="http://dx.doi.org/10.1038/s41467-018-07619-7" target="_blank" >10.1038/s41467-018-07619-7</a>

Alternative languages

  • Result language

    angličtina

  • Original language name

    Why rankings of biomedical image analysis competitions should be interpreted with care

  • Original language description

    International challenges have become the standard for validation of biomedical image analysis methods. Given their scientific impact, it is surprising that a critical analysis of common practices related to the organization of challenges has not yet been performed. In this paper, we present a comprehensive analysis of biomedical image analysis challenges conducted up to now. We demonstrate the importance of challenges and show that the lack of quality control has critical consequences. First, reproducibility and interpretation of the results is often hampered as only a fraction of relevant information is typically provided. Second, the rank of an algorithm is generally not robust to a number of variables such as the test data used for validation, the ranking scheme applied and the observers that make the reference annotations. To overcome these problems, we recommend best practice guidelines and define open research questions to be addressed in the future.

  • Czech name

  • Czech description

Classification

  • Type

    J<sub>imp</sub> - Article in a specialist periodical, which is included in the Web of Science database

  • CEP classification

  • OECD FORD branch

    10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Result continuities

  • Project

    Result was created during the realization of more than one project. More information in the Projects tab.

  • Continuities

    P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Others

  • Publication year

    2018

  • Confidentiality

    S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Data specific for result type

  • Name of the periodical

    Nature Communications

  • ISSN

    2041-1723

  • e-ISSN

  • Volume of the periodical

    9

  • Issue of the periodical within the volume

    5217

  • Country of publishing house

    CH - SWITZERLAND

  • Number of pages

    13

  • Pages from-to

    1-13

  • UT code for WoS article

    000452282700012

  • EID of the result in the Scopus database