r16 - 22 May 2019 - 17:19:16 - TWikiGuestYou are here: TWiki >  Main Web > PhatResults > Phase0TestingResults

Results for the Phase0Testing simulations

As of Nov 27, 2008, fourteen people replied to the Phase0Testing simulations. In the following the results for the blind run on the noise.cat catalogue are presented in two ways:

  • plots showing the model redshift vs. the estimated redshift
  • Mean and RMS values of the quantity Δz=zmodel-zphot together with outlier rates. We calculated the mean and the RMS of the redshift differences twice, once with an iterative 5-sigma outliers rejection and once rejecting all objects with Δz>0.1.

No cuts were applied to the various quality indicators put out by the different codes.


First, see as a reference the output of the code "Le Phare" when Stephane ran it with the noise.cat catalogue.

Arnouts, Stephane (Le Phare, template-based):

  • zmodel vs. zphot:
    zz_AS.png

  • statistics:
    • iterative 5-σ outlier rejection: 0.423916% outliers, Δz=1.77827e-05 +/- 0.00961287
    • Δz>0.1 outlier rejection: 0.0441579% outliers, Δz=3.00583e-05 +/- 0.0103438


In the following, the results from all other people are presented. Note, that suboptimal results do not indicate necessarily an inaccurate code in general. Deviations should only be interpreted in the way, that this particular code does not agree perfectly well with Stephane's "Le Phare" code, which was used for the creation of the simulations.

Abdalla, Filipe (ANNz, neural-network code, see Collister & Lahav 2004):

  • zmodel vs. zphot:
    zz_AF.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.22079% outliers, Δz=9.15565e-05 +/- 0.0106914
    • Δz>0.1 outlier rejection: 0.0176632% outliers, Δz=9.46557e-05 +/- 0.0110893

Assef, Roberto (LRT, template-based code, optimised for low-resolution templates, see Assef, et al. 2008):

  • zmodel vs. zphot:
    zz_AR.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.750684% outliers, Δz=0.000129027 +/- 0.0121307
    • Δz>0.1 outlier rejection: 0.247284% outliers, Δz=0.000131031 +/- 0.0134385

Brammer, Gabriel (EAZY, template-based code, see Brammer et al. 2008):

  • zmodel vs. zphot:
    zz_BG.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.203126% outliers, Δz=-0.000555487 +/- 0.0118434
    • Δz>0.1 outlier rejection: 0% outliers, Δz=-0.000628809 +/- 0.0123139

Carliles, Sam (empirical code, ensemble of "randomized" regression trees trained on bootstrap samples from the training set):

  • zmodel vs. zphot:
    zz_CS.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.256116% outliers, Δz=7.36852e-05 +/- 0.0125069
    • Δz>0.1 outlier rejection: 0.00883158% outliers, Δz=0.000128865 +/- 0.013035

Coe, Dan (BPZ, template-based code, see Benitez 2000):

  • zmodel vs. zphot:
    zz_CD.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.291442% outliers, Δz=-0.00492117 +/- 0.0102579
    • Δz>0.1 outlier rejection: 0.0264947% outliers, Δz=-0.00499912 +/- 0.0107985

Dahlen, Tomas (template-based code):

  • zmodel vs. zphot:
    zz_DT.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.397421% outliers, Δz=8.77815e-05 +/- 0.0108293
    • Δz>0.1 outlier rejection: 0.0176632% outliers, Δz=0.000128081 +/- 0.0116462

Feldmann, Robert (ZEBRA, template-based code, see Feldmann et al. 2006):

  • zmodel vs. zphot:
    zz_FR.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.512232% outliers, Δz=-6.39148e-05 +/- 0.00970347
    • Δz>0.1 outlier rejection: 0.0618211% outliers, Δz=-0.000118063 +/- 0.0105582

Gerdes, David (training-set-based approach using boosted decision trees):

  • zmodel vs. zphot:
    zz_GD.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.415084% outliers, Δz=-0.00368305 +/- 0.0185263
    • Δz>0.1 outlier rejection: 0.38859% outliers, Δz=-0.00365651 +/- 0.0185952

Gillis, Bryan (ZEBRA, template-based code, see Feldmann et al. 2006):

  • zmodel vs. zphot:
    zz2_GB.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.468074% outliers, Δz=-0.00481047 +/- 0.0100153
    • Δz>0.1 outlier rejection: 0.0441579% outliers, Δz=-0.00487675 +/- 0.0108845
  • Notes on setting up ZEBRA for running this data: ZebraNotes

Kotulla, Ralf (GALEV, template-based code, see Kotulla et al. 2009, IRAC bands not included):

  • zmodel vs. zphot:
    zz_KR.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.344432% outliers, Δz=-8.78235e-05 +/- 0.0132298
    • Δz>0.1 outlier rejection: 0.0529895% outliers, Δz=-6.14209e-05 +/- 0.0139058

Li, Tornado (empirical code, polynomial fitting):

  • zmodel vs. zphot:
    zz_LT.png
  • statistics:
    • iterative 5-σ outlier rejection: 1.75748% outliers, Δz=0.000672984 +/- 0.0191082
    • Δz>0.1 outlier rejection: 1.66917% outliers, Δz=0.000654796 +/- 0.0193264

Miralles, Joan-Marc (Hyperz, template-based code, see Bolzonella et al. 2000):

  • zmodel vs. zphot:
    zz_MJ.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.803674% outliers, Δz=-0.00185141 +/- 0.0120707
    • Δz>0.1 outlier rejection: 0.185463% outliers, Δz=-0.00181295 +/- 0.0134263

Purger, Norbert (empirical neural-network & template-based code):

  • zmodel vs. zphot (empirical):
    zz_PN.png
  • statistics (empirical):
    • iterative 5-σ outlier rejection: 0.141305% outliers, Δz=0.000155656 +/- 0.0169082
    • Δz>0.1 outlier rejection: 0.0529895% outliers, Δz=0.000190863 +/- 0.0171598

  • zmodel vs. zphot (template-based):
    zz2_PN.png
  • statistics (template-based):
    • iterative 5-σ outlier rejection: 0.3356% outliers, Δz=-0.00467166 +/- 0.0102862
    • Δz>0.1 outlier rejection: 0.0529895% outliers, Δz=-0.00466801 +/- 0.0109

Singal, Jack (neural-network code):

  • zmodel vs. zphot:
    zz_SJ.png
  • statistics:
    • iterative 5-σ outlier rejection: 0% outliers, Δz=0.0114871 +/- 0.0753925
    • Δz>0.1 outlier rejection: 18.2019% outliers, Δz=-0.00467356 +/- 0.0494039

Vicente, Juan (DNF, Directional Neighbourhood Fit):

  • zmodel vs. zphot:
    zz_JV.png
  • statistics:
    • iterative 5-σ outlier rejection: 0.264947% outliers, Δz=-9.90097e-05 +/- 0.0112621
    • Δz>0.1 outlier rejection: 0.0264947% outliers, Δz=-9.61207e-05 +/- 0.0117431

-- HendrikHildebrandt - 17 March, 2016 Juegos de cocinar

Topic attachments
I Attachment Action Size Date Who Comment
pngpng zz2_GB.png manage 13.2 K 27 May 2008 - 07:17 TWikiGuest zmodel vs. zphot
pngpng zz2_PN.png manage 13.1 K 14 May 2008 - 21:47 TWikiGuest zmodel vs. zphot
pngpng zz_AF.png manage 13.0 K 14 May 2008 - 20:39 TWikiGuest zmodel vs. zphot
pngpng zz_AR.png manage 14.6 K 14 May 2008 - 21:39 TWikiGuest zmodel vs. zphot
pngpng zz_AS.png manage 13.0 K 18 May 2008 - 20:35 TWikiGuest zmodel vs. zphot
pngpng zz_BG.png manage 27.7 K 21 Aug 2008 - 11:17 TWikiGuest zmodel vs. zphot
pngpng zz_CD.png manage 13.4 K 14 May 2008 - 21:40 TWikiGuest zmodel vs. zphot
pngpng zz_CS.png manage 13.5 K 15 May 2008 - 18:15 TWikiGuest zmodel vs. zphot
pngpng zz_DT.png manage 13.7 K 14 May 2008 - 21:40 TWikiGuest zmodel vs. zphot
pngpng zz_FR.png manage 13.3 K 22 May 2008 - 08:06 TWikiGuest zmodel vs. zphot
pngpng zz_GB.png manage 19.8 K 14 May 2008 - 21:41 TWikiGuest zmodel vs. zphot
pngpng zz_GD.png manage 14.4 K 14 May 2008 - 21:41 TWikiGuest zmodel vs. zphot
pngpng zz_JV.png manage 13.0 K 17 Mar 2016 - 07:38 TWikiGuest zmodel vs. zphot
pngpng zz_KR.png manage 13.8 K 22 May 2008 - 08:05 TWikiGuest zmodel vs. zphot
pngpng zz_LT.png manage 16.1 K 14 May 2008 - 21:42 TWikiGuest zmodel vs. zphot
pngpng zz_MJ.png manage 29.0 K 27 Nov 2008 - 08:19 TWikiGuest z=zmodel-zphot
pngpng zz_PN.png manage 16.1 K 14 May 2008 - 21:42 TWikiGuest zmodel vs. zphot
pngpng zz_SJ.png manage 32.5 K 29 Jun 2009 - 10:05 TWikiGuest zmodel vs. zphot
Edit | Attach | Printable | Raw View | Backlinks: Web, All Webs | History: r16 < r15 < r14 < r13 < r12 | More topic actions

tip TWiki Tip of the Day
Revision control
TWiki has "Soft security" anyone can change anything, but changes are logged. There is a complete ... Read on Read more

 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback