Validation 4 Results Released!

 

Dear participants,

We are excited to share the intermediate results of our competition based on the Validation 4 checkpoint.

For this evaluation, we considered all relevant solutions submitted before 14.03.2025, 00:00 UTC+0. A total of 11 submissions were received by the deadline.

Objective metric evaluation

We remind you that for objective metric evaluation, your final score is given by 0.4 * PSNRRank + 0.6 * SSIMRank. The standings are as follows:

Participant	PSNR	PSNR Rank	SSIM	SSIM Rank	Final Score
Daniil_S	21.60	1	0.731	1	1.0
Gideon	21.35	2	0.730	2	2.0
Stangeriness	20.44	3	0.728	3	3.0
ps	20.41	4	0.703	4	4.0
AnasM	20.12	5	0.702	5	5.0
MaXiaoyang	19.77	7	0.697	6	6.4
zongqihe	19.89	6	0.695	8	7.2
gwxysyhljt	19.44	8	0.696	7	7.4
camera_mi	17.95	9	0.668	9	9.0
gwan	17.28	10	0.630	10	10.0
azwaad.mohiuddin	7.71	11	0.120	11	11.0

Perceptual quality evaluation

We remind you that for the perceptual quality evaluation, we conduct a pairwise comparison of images generated by the solutions against the original DSLR images. Survey participants were asked to select which image in each pair better matched the original DSLR image. The score represents the average win percentage across all evaluated images. The standings are as follows:

Participant	Score
Gideon	116.51
Daniil_S	106.90
Stangeriness	99.25
zongqihe	88.62
ps	80.50
gwxysyhljt	75.57
MaXiaoyang	71.37
gwan	54.34
AnasM	47.18
camera_mi	43.50
azwaad.mohiuddin	0.56

Soon we will allow submissions for the final testing. Please be ready to submit your solutions as docker containers as well as reports describing your solution.

Thank you for participating and best of luck in the final checkpoint!