Browsing by Author "Reyes, Mauricio"

Now showing 1 - 3 of 3
  • Thumbnail Image
    Item
    Evaluation of the Pediatric Neuro-Oncology Resources Available in Chile
    (American Society of Clinical Oncology, 2021-03) Abu-Arja, Mohammad H.; Rojas del Río, Nicolás; La Madrid, Andres Morales; Lassaletta, Alvaro; Coven, Scott L.; Moreno, Rosa; Valero, Miguel; Perez, Veronica; Espinoza, Felipe; Fernandez, Eduardo; Santander, José; Tordecilla, Juan; Oyarce, Veronica; Kopp, Katherine; Bartels, Ute; Qaddoumi, Ibrahim; Finlay, Jonathan L.; Cáceres, Adrián; Reyes, Mauricio; Espinoza, Ximena; Osorio, Diana S.; Pediatrics, School of Medicine
    Purpose: Pediatric neuro-oncology resources are mostly unknown in Chile. We report the human and material resources available in Chilean hospitals providing pediatric neuro-oncology services. Methods: A cross-sectional survey was distributed to 17 hospitals providing pediatric neuro-oncology services (Programa Infantil Nacional de Drogas Antineoplásicas [PINDA] hospitals, 11; private, 6). Results: Response rate was 71% (PINDA, 8; private, 4). Pediatric neuro-oncology services were mainly provided within general hospitals (67%). Registries for pediatric CNS tumors and chemotherapy-related toxicities were available in 100% and 67% of hospitals, respectively. CNS tumors were treated by pediatric oncologists in 92% of hospitals; none were formally trained in neuro-oncology. The most used treatment protocols were the national PINDA protocols. All WHO essential medicines for childhood cancer were available in more than 80% of the hospitals except for gemcitabine, oxaliplatin, paclitaxel, and procarbazine. The median number of pediatric neurosurgeons per hospital was two (range, 2-6). General neuroradiologists were available in 83% of the centers. Pathology specimens were sent to neuropathologists (58%), adult pathologists (25%), and pediatric pathologists (17%). Intensity-modulated radiotherapy, conformal radiotherapy, and cobalt radiotherapy were used by 67%, 58%, and 42% of hospitals, respectively. Only one private hospital performed autologous hematopoietic cell transplant for children with CNS tumors. Conclusion: A wide range of up-to-date treatment modalities are available for children with CNS tumors. Our survey highlights future directions to improve the pediatric neuro-oncology services available in Chile such as the expansion of multidisciplinary clinics, palliative care services, long-term cancer survivorship programs, dedicated clinical research support teams, establishing standardized mechanism for sending pathologic specimen for second opinion to international specialized centers, and establishing specialized neuro-oncology training program.
  • Thumbnail Image
    Item
    Metrics reloaded: recommendations for image analysis validation
    (Springer Nature, 2024) Maier-Hein, Lena; Reinke, Annika; Godau, Patrick; Tizabi, Minu D.; Buettner, Florian; Christodoulou, Evangelia; Glocker, Ben; Isensee, Fabian; Kleesiek, Jens; Kozubek, Michal; Reyes, Mauricio; Riegler, Michael A.; Wiesenfarth, Manuel; Kavur, A. Emre; Sudre, Carole H.; Baumgartner, Michael; Eisenmann, Matthias; Heckmann-Nötzel, Doreen; Rädsch, Tim; Acion, Laura; Antonelli, Michela; Arbel, Tal; Bakas, Spyridon; Benis, Arriel; Blaschko, Matthew B.; Cardoso, M. Jorge; Cheplygina, Veronika; Cimini, Beth A.; Collins, Gary S.; Farahani, Keyvan; Ferrer, Luciana; Galdran, Adrian; van Ginneken, Bram; Haase, Robert; Hashimoto, Daniel A.; Hoffman, Michael M.; Huisman, Merel; Jannin, Pierre; Kahn, Charles E.; Kainmueller, Dagmar; Kainz, Bernhard; Karargyris, Alexandros; Karthikesalingam, Alan; Kofler, Florian; Kopp-Schneider, Annette; Kreshuk, Anna; Kurc, Tahsin; Landman, Bennett A.; Litjens, Geert; Madani, Amin; Maier-Hein, Klaus; Martel, Anne L.; Mattson, Peter; Meijering, Erik; Menze, Bjoern; Moons, Karel G. M.; Müller, Henning; Nichyporuk, Brennan; Nickel, Felix; Petersen, Jens; Rajpoot, Nasir; Rieke, Nicola; Saez-Rodriguez, Julio; Sánchez, Clara I.; Shetty, Shravya; van Smeden, Maarten; Summers, Ronald M.; Taha, Abdel A.; Tiulpin, Aleksei; Tsaftaris, Sotirios A.; Van Calster, Ben; Varoquaux, Gaël; Jäger, Paul F.; Pathology and Laboratory Medicine, School of Medicine
    Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. In biomedical image analysis, chosen performance metrics often do not reflect the domain interest, and thus fail to adequately measure scientific progress and hinder translation of ML techniques into practice. To overcome this, we created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. Developed by a large international consortium in a multistage Delphi process, it is based on the novel concept of a problem fingerprint-a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), dataset and algorithm output. On the basis of the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as classification tasks at image, object or pixel level, namely image-level classification, object detection, semantic segmentation and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. Its applicability is demonstrated for various biomedical use cases.
  • Thumbnail Image
    Item
    Understanding metric-related pitfalls in image analysis validation
    (ArXiv, 2023-09-25) Reinke, Annika; Tizabi, Minu D.; Baumgartner, Michael; Eisenmann, Matthias; Heckmann-Nötzel, Doreen; Kavur, A. Emre; Rädsch, Tim; Sudre, Carole H.; Acion, Laura; Antonelli, Michela; Arbel, Tal; Bakas, Spyridon; Benis, Arriel; Blaschko, Matthew B.; Buettner, Florian; Cardoso, M. Jorge; Cheplygina, Veronika; Chen, Jianxu; Christodoulou, Evangelia; Cimini, Beth A.; Collins, Gary S.; Farahani, Keyvan; Ferrer, Luciana; Galdran, Adrian; Van Ginneken, Bram; Glocker, Ben; Godau, Patrick; Haase, Robert; Hashimoto, Daniel A.; Hoffman, Michael M.; Huisman, Merel; Isensee, Fabian; Jannin, Pierre; Kahn, Charles E.; Kainmueller, Dagmar; Kainz, Bernhard; Karargyris, Alexandros; Karthikesalingam, Alan; Kenngott, Hannes; Kleesiek, Jens; Kofler, Florian; Kooi, Thijs; Kopp-Schneider, Annette; Kozubek, Michal; Kreshuk, Anna; Kurc, Tahsin; Landman, Bennett A.; Litjens, Geert; Madani, Amin; Maier-Hein, Klaus; Martel, Anne L.; Mattson, Peter; Meijering, Erik; Menze, Bjoern; Moons, Karel G. M.; Müller, Henning; Nichyporuk, Brennan; Nickel, Felix; Petersen, Jens; Rafelski, Susanne M.; Rajpoot, Nasir; Reyes, Mauricio; Riegler, Michael A.; Rieke, Nicola; Saez-Rodriguez, Julio; Sánchez, Clara I.; Shetty, Shravya; Summers, Ronald M.; Taha, Abdel A.; Tiulpin, Aleksei; Tsaftaris, Sotirios A.; Van Calster, Ben; Varoquaux, Gaël; Yaniv, Ziv R.; Jäger, Paul F.; Maier-Hein, Lena; Pathology and Laboratory Medicine, School of Medicine
    Validation metrics are key for the reliable tracking of scientific progress and for bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately in relation to the underlying research problem. This could be attributed to a lack of accessibility of metric-related knowledge: While taking into account the individual strengths, weaknesses, and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multi-stage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides the first reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Focusing on biomedical image analysis but with the potential of transfer to other fields, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. To facilitate comprehension, illustrations and specific examples accompany each pitfall. As a structured body of information accessible to researchers of all levels of expertise, this work enhances global comprehension of a key topic in image analysis validation.