First Leaderboard
Two evaluations were formed for the submitted results of the first validation set. The first leaderboard is based on the people's opinion and the second is based on the professinal photographer's opinion, which is explained in more detail here.People's choice
The leaderboard was formed by including every submission in 9500 comparisons using the Toloka platform. The score mean multiplied by 9500 gives the number of actual votes that a particular submission received.| Rank | Team | Member(s) | Affiliation | Score mean |
|---|---|---|---|---|
| 1 | dh_isp (submission II) | Yuanfeng Su, Wei Wang, Xing Wu | Zhejiang Dahua Technology | 0.683 |
| 2 | DH_AISP (submission II) | Jin Guo, Yangfan Sun, Tianli Liu | Zhejiang Dahua Technology | 0.680 |
| 3 | IVL_Team (submission II) | Simone Zini, Claudio Rota, Marco Buzzelli, Simone Bianco, Raimondo Schettini | University of Milano - Bicocca | 0.679 |
| 4 | isp_come (submission I) | Shuai Liu, Qian Wu,Jiang Hua | Zhejiang Dahua Technology | 0.678 |
| 5 | IVL_Team (submission I) | Simone Zini, Claudio Rota, Marco Buzzelli, Simone Bianco, Raimondo Schettini | University of Milano - Bicocca | 0.675 |
| 6 | Photoshop image enhancement | Maria Efimova | Organizers Team | 0.646 |
| 7 | isp_come (submission II) | Shuai Liu, Qian Wu,Jiang Hua | Zhejiang Dahua Technology | 0.639 |
| 8 | dh_isp (submission I) | Yuanfeng Su, Wei Wang, Xing Wu | Zhejiang Dahua Technology | 0.614 |
| 9 | MiAlgo (submission I) | Shuai Liu | Xiaomi | 0.574 |
| 10 | DH_AISP (submission I) | Jin Guo, Yangfan Sun, Tianli Liu | Zhejiang Dahua Technology | 0.484 |
| 11 | Justones (submission I) | Cheng Zhang | Northwestern Polytechnical University | 0.456 |
| 12 | NTU607 (ex ROCC) (submission II) | Wei-Ting Chen, Hao-Hsiang Yang, Zhi-Kai Huang, Hua-En Chang, Chia-Hsuan Hsieh, I-Hsiang Chen, Yi-Chung Chen, Yuan-Chun Chiang | Stanford University, Google, National Taiwan University, ServiceNow | 0.421 |
| 13 | ZYS_NWPU (submission I) | Yushi Zhou | Northwestern Polytechnical University | 0.414 |
| - | baseline | - | Organizers Team | 0.403 |
| 14 | NTU607 (submission I) | Wei-Ting Chen, Hao-Hsiang Yang, Zhi-Kai Huang, Hua-En Chang, Chia-Hsuan Hsieh, I-Hsiang Chen, Yi-Chung Chen, Yuan-Chun Chiang | Stanford University, Google, National Taiwan University, ServiceNow | 0.356 |
| 15 | OzUVGL (submission I) | Furkan Kınlı, Barış Özcan, Furkan Kıraç | Özyeğin University | 0.349 |
| 16 | OzUVGL (submission II) | Furkan Kınlı, Barış Özcan, Furkan Kıraç | Özyeğin University | 0.344 |
| 17 | MiAlgo (submission II) | Shuai Liu | Xiaomi | 0.318 |
| 18 | The_Majestic_Mavericks2 (submission I) | Hyerin Chung, Nakung Lee, Sung Geun Kwak | CJ OliveNetworks | 0.187 |
Photographer's choice
| Rank | Team | Member(s) | Affiliation | Photographer's comment |
|---|---|---|---|---|
| 1 | dh_isp (submission II) | Yuanfeng Su, Wei Wang, Xing Wu | Zhejiang Dahua Technology | The standout entry with good contrast, detail in the shadow areas and control of the highlights. Images are punchy. |
| 2 | DH_AISP (submission II) | Jin Guo, Yangfan Sun, Tianli Liu | Zhejiang Dahua Technology | A very close second place with also good contrast control across shadows and highlights. |
| 3 | Photoshop image enhancement | Maria Efimova | Organizers Team | Probably the most ‘natural’ images in the group. Again, good control of light and dark but maybe a little less punchy than the top two. |
| 4 | ZYS_NWPU (submission I) | Yushi Zhou | Northwestern Polytechnical University | Very good control of shadow detail but images are rather grainy. Very impactful and punchy however. |
| 5 | isp_come (submission I) | Shuai Liu, Qian Wu,Jiang Hua | Zhejiang Dahua Technology | Good colour control and contrast is decent but images are overall a little too dark. |
| 6 | DH_AISP (submission I) | Jin Guo, Yangfan Sun, Tianli Liu | Zhejiang Dahua Technology | Overall control is good but the rendering is rather flat and lacking in contrast. |
| 7 | dh_isp (submission I) | Yuanfeng Su, Wei Wang, Xing Wu | Zhejiang Dahua Technology | Rather too dark, but colour control is decent. |
| 8 | MiAlgo (submission I) | Shuai Liu | Xiaomi | Good contrast but again rather dark. |
| 9 | IVL_Team (submission I) | Simone Zini, Claudio Rota, Marco Buzzelli, Simone Bianco, Raimondo Schettini | University of Milano - Bicocca | Too flat and snow is not rendered well. |
| 10 | IVL_Team (submission II) | Simone Zini, Claudio Rota, Marco Buzzelli, Simone Bianco, Raimondo Schettini | University of Milano - Bicocca | Images very flat and lacking contrast. |
| 11 | NTU607 (ex ROCC) (submission II) | Wei-Ting Chen, Hao-Hsiang Yang, Zhi-Kai Huang, Hua-En Chang, Chia-Hsuan Hsieh, I-Hsiang Chen, Yi-Chung Chen, Yuan-Chun Chiang | Stanford University, Google, National Taiwan University, ServiceNow | All images suffer from a green colour cast. |
| 12 | isp_come (submission II) | Shuai Liu, Qian Wu,Jiang Hua | Zhejiang Dahua Technology | Highlights are blown in many of the images. |
| 13 | Justones (submission I) | Cheng Zhang | Northwestern Polytechnical University | All images suffer from a very pronounced yellow colour cast. |