CHAOS - Combined (CT-MR) Healthy Abdominal Organ Segmentation

CHAOS challenge was held in The IEEE International Symposium on Biomedical Imaging (ISBI) on April 11, 2019 Venice, ITALY. The results of the challenge was published:

If you would like to attend to CHAOS but missed it, do not worry. The online submission of the challenge is open. It is possible to join CHAOS and submit results online. The actual scores are being updated on our Results page. The archived results can be accessed from previous leaderboards [1, 2]. Please read information on this website and our Google group.!forum/chaos-challenge

Challenge Description

Understanding prerequisites of complicated medical procedures plays an important role on the success of the operations. To enrich the level of understanding, physicians use advanced tools such as three dimensional visualization and printing, which require extraction of the object(s) of interest from DICOM images. Accordingly, the precise segmentation of abdominal organs (i.e. liver, kidney(s) and spleen) has critical importance for several clinical procedures including but not limited to pre-evaluation of liver for living donor based transplantation surgery or detailed analysis of abdominal organs to determine the vessels arising from and entering them for correct positioning of a graft prior to abdominal aortic surgery. This motivates an ongoing research to achieve better segmentation results and overcoming countless challenges originating from both highly flexible anatomical properties of abdomen and limitations of modalities reflected to image characteristics.
In this context, the proposed challenge has two separate but related aims:

  1. Segmentation of liver from computed tomography (CT) data sets, which are acquired at portal phase after contrast agent injection for pre-evaluation of living donated liver transplantation donors.
  2. Segmentation of four abdominal organs (i.e. liver, spleen, right and left kidneys) from magnetic resonance imaging (MRI) data sets acquired with two different sequences (T1-DUAL and T2-SPIR).

There will be five competition categories in which the participating teams can take place and submit their result(s):

  1. Liver Segmentation (CT-MRI)
  2. Liver Segmentation (CT only)
  3. Liver Segmentation (MRI only)
  4. Segmentation of abdominal organs (CT+MRI)
  5. Segmentation of abdominal organs (MRI only)

Due to above mentioned significance of the problem, the challenge will serve several purposes:

  • In the last decade, not only the number of segmentation methods increased significantly, but also applicability is aimed to be extended to multiple segmentation tasks (For instance, a single deep network, which can segment multiple organs [category 4] or more rarely, a system that can segment the same organ(s) from different modalities [category 1 and 5]).
  • On the other hand, it is known that many new architectures significantly depend on the training data set, which yields to poor generalization capability. Besides physicians, who are the final user of the medical segmentation methods, even experienced researchers still struggle at choosing appropriate techniques or tweaking optimal model parameters for a particular problem.
  • Thus, by providing data sets from two different modalities, the participants are encouraged to develop a system that would work on both (The data sets from CT and MR databases are acquired from different patients).
  • Nevertheless, organ segmentation from abdominal MRI sets is being proposed as a challenge for the first time and therefore, systems that would only work on a single modality (e.g. MRI or CT) are also accepted.

How to join and submit to CHAOS?

Since the challenge contains human data, there are some critical rules for the CHAOS challenge according to ethical permissions:

1) Please read rules of the challenge. All participants are considered to have read and accepted the rules.

2) Create an account on website with your official mail account (school/university/institution/company, any address appearing on an official webpage or a scientific work is also accepted). Make a join request for the challenge by using the Join link.

3) Download the data, submission manual and template from Download page.

4) Save your result in template file and prepare unique paper (PDF file) that is mentioned in Rules 5.

4) Submit your results. After a short time, the scores will be available at Results page.


Number of users: 1417

Last update: 07/08/2019