Second Leaderboard
Two evaluations were formed for the submitted results of the first validation set. The second leaderboard is based on the people's opinion and the second is based on the professinal photographer's opinion.People's choice
The leaderboard was formed by including every submission in 18900 comparisons using the Toloka platform. The score mean multiplied by 18900 gives the number of actual votes that a particular submission received.| Rank | Team | Member(s) | Affiliation | Score mean |
|---|---|---|---|---|
| 1 | DH-AISP (submission I) | Jin Guo, Yangfan Sun, Tianli Liu, Dejun Hao | Zhejiang Dahua Technology | 0.703 |
| 2 | DH-AISP (submission II) | Jin Guo, Yangfan Sun, Tianli Liu, Dejun Hao | Zhejiang Dahua Technology | 0.7 |
| 3 | MiAlgo (submission II) | Shuai Liu | Xiaomi | 0.699 |
| 4 | HDU-EGOV (submission II) | Xiangwen Liu | Hangzhou Dianzi University | 0.667 |
| 5 | HDU-EGOV (submission I) | Xiangwen Liu | Hangzhou Dianzi University | 0.664 |
| 6 | MiAlgo (submission I) | Shuai Liu | Xiaomi | 0.634 |
| 7 | LVGroup_HFUT (submission I) | Zhicheng Ji, Jiahuan Ren | Hefei University Of Technology | 0.593 |
| 8 | LVGroup_HFUT (submission II) | Zhicheng Ji, Jiahuan Ren | Hefei University Of Technology | 0.59 |
| 9 | IVL_Team (submission II) | Simone Zini, Claudio Rota, Marco Buzzelli, Simone Bianco, Raimondo Schettini | University of Milano - Bicocca | 0.572 |
| 10 | test_03 (submission II) | Wan Zhong | Shaodu, LVMI | 0.57 |
| 11 | night_go (submission II) | Feng Chaoyu | 0.561 | |
| 12 | IVL_Team (submission I) | Simone Zini, Claudio Rota, Marco Buzzelli, Simone Bianco, Raimondo Schettini | University of Milano - Bicocca | 0.558 |
| 13 | The_Majestic_Mavericks2 (submission II) | Hyerin Chung, Nakung Lee, Sung Geun Kwak | CJ OliveNetworks | 0.545 |
| 14 | night_go (submission I) | Feng Chaoyu | 0.5446 | |
| 15 | test_03 (submission I) | Wan Zhong | Shaodu, LVMI | 0.539 |
| 16 | The_Majestic_Mavericks2 (submission I) | Hyerin Chung, Nakung Lee, Sung Geun Kwak | CJ OliveNetworks | 0.508 |
| 17 | Photoshop image enhancement | Maria Efimova | Organizers Team | 0.487 |
| 18 | Team_Andromeda (submission I) | Jinwei Yuan | Macau University of Science and Technology | 0.467 |
| - | baseline | - | Organizers Team | 0.445 |
| 19 | OzUVGL (submission II) | Furkan Kınlı, Barış Özcan, Furkan Kıraç | Özyeğin University | 0.41 |
| 20 | OzUVGL (submission I) | Furkan Kınlı, Barış Özcan, Furkan Kıraç | Özyeğin University | 0.407 |
| 21 | Team_Andromeda (submission II) | Jinwei Yuan | Macau University of Science and Technology | 0.403 |
| 22 | EZIE (submission I) | Minsu Kwon, Jinseong Kim | ENERZAi | 0.376 |
| 23 | The Majestic Mavericks (submission I) | Hyerin Chung, Nakyung Lee, Sung Keun Kwak | CJ OliveNetworks | 0.372 |
| 24 | NTU607 (submission I) | Wei-Ting Chen, Hao-Hsiang Yang, Zhi-Kai Huang, Hua-En Chang, Chia-Hsuan Hsieh, I-Hsiang Chen, Yi-Chung Chen, Yuan-Chun Chiang | Stanford University, Google, National Taiwan University, ServiceNow | 0.307 |
| 25 | The Majestic Mavericks (submission II) | Hyerin Chung, Nakyung Lee, Sung Keun Kwak | CJ OliveNetworks | 0.276 |
| 26 | EZIE (submission II) | Minsu Kwon, Jinseong Kim | ENERZAi | 0.275 |
| 27 | CEVI_LowLightHypnotize (submission I) | Amogh Joshi, Chinmayee Mandi, Sampada Malagi | KLE Technological University | 0.121 |
Photographer's choice
Small glossary of the photography terms used in the recent professional photographer's comments:
- ‘Punch’, ‘punchy’: a characterization of the visual impact of an image, it is one of the most powerful factors that drives the mood of the users.
This term shows to what degree the tones and the contrasts between light and dark grab the viewer’s attention.
The following illustrative comparisons could help in understanding:
it is a difference between a tune being played nicely on one piano and between the same tune being played by a concert orchestra -
they are both technically correct, but the latter one is significantly more impactful; or, it is a difference between
driving down the same road in an old VW Beetle versus driving down in a brand new Porsche.
They both get you to your destination, but one ride is more visceral!
- ‘Colour control’: a characterization of the quality of colour rendering. For example, when evaluating the colour control quality, in the second validation set there was an image with a green and yellow bin next to each other. The best entries rendered both colours well, but natural. The not so good entries either lacked colour here or had pushed the colours too far.
- ‘Flat’, ‘flat rendering’: it is meant describe what appears as the lack of contrast between highlights and shadow values.
| Rank | Team | Member(s) | Affiliation | Photographer's comment |
|---|---|---|---|---|
| 1 | DH-AISP (submission I) | Jin Guo, Yangfan Sun, Tianli Liu, Dejun Hao | Zhejiang Dahua Technology | Very natural and good balance of light and shadow. Contrast good. |
| 2 | DH-AISP (submission II) | Jin Guo, Yangfan Sun, Tianli Liu, Dejun Hao | Zhejiang Dahua Technology | Also very good and natural and actually hard to separate these top two. Maybe contrast not quite as strong here. |
| 3 | MiAlgo (submission II) | Shuai Liu | Xiaomi | Good control of light and shadow but colours a little too saturated and not as natural. |
| 4 | MiAlgo (submission II) | Shuai Liu | Xiaomi | Also good but again the colours are a little unnatural and also a bit dark overall. |
| 5 | LVGroup_HFUT (submission I) | Zhicheng Ji, Jiahuan Ren | Hefei University Of Technology | Too dark. |
| 6 | LVGroup_HFUT (submission II) | Zhicheng Ji, Jiahuan Ren | Hefei University Of Technology | Also too dark (even darker than above). |
| 7 | HDU-EGOV (submission I) | Xiangwen Liu | Hangzhou Dianzi University | Good contrast and brightness but there is a slight yellow caste on every image. |
| 8 | HDU-EGOV (submission II) | Xiangwen Liu | Hangzhou Dianzi University | Also good contrast but an even more pronounced yellow/orange colour caste. |
| 9 | IVL_Team (submission II) | Simone Zini, Claudio Rota, Marco Buzzelli, Simone Bianco, Raimondo Schettini | University of Milano - Bicocca | Very flat and lacking in colour. No contrast. |
| 10 | test_03 (submission II) | Wan Zhong | Shaodu, LVMI | Very lacking in colour to the point where some images are completely desaturated. |