Processing GALEX Grism Data


#
#     Processing GALEX Grism Data  (August 2005)
#
# This process prepares scripts to run orbpipe and targpipe for grism reductions and
# creates QA files and tables in the visit and current directories.
#
# Try using ops version of these programs, if unsuccessful, try /home/galex/tab/bin/ .
#
#
# STEP  1:: RUN 'near 1 1 1 eclipsefile=eclipse.list  out=paths.txt'    (may not be necessary)
#    --> given a list of eclipse numbers in 'eclipse.list', creates a list of paths (##-try directories):
#
# STEP  2:: CREATE file with list of paths (##-try directories) to process.
#
# STEP  3:: ASK Tom if /home/galex/tab/ECL/eclipse1.txt is up to date.
#
# STEP  4:: RUN 'grism_pipeqa  -paths paths.txt  -orbpipe  -script script0.out'   (may not be necessary)
#    --> produces script of initial orbpipe runs in 'script0.out'
#
# STEP  5:: RUN 'source script0.out'    (may not be necessary)
#
# STEP  6:: RUN 'galex_tabqa -auto paths.txt -no04only'
#    --> produces paths.txt.out and appends to ./qa/*-qa_tab.txt files. (notes=)
#
# STEP  7:: CREATE a file called VQA.txt of *_qareport.txt files for the direct visits.
#            (See example:  VQA.txt )
#
# STEP  8:: RUN 'grism_pipeqa  -paths paths.txt  -spac  -write_qa_file  -allow_all  -VQA VQA.txt >&! out1.txt'
#      (this requires direct visit QA data files *_qareport.txt listed in VQA.txt)
#      (this matches up the best -xd-mcat.fits file which each grism visit)
#    --> produces script of orbpipe/spac runs in 'script.out'
#    --> creates summary of mcat and visit path status in 'info.out'
#    --> standard output in 'out1.txt' is a record of which mcat files were available.
#    --> appends to ./qa/*-qa_tab.txt (e.g. mcatcode=, mcat_ratio=, passfail=, flags=)
#
# STEP  9:: RUN 'source script.out' and check slates for progress.
#
# STEP 10:: RUN 'galex_tabqa -auto paths.txt -no04only'  (again)
#    --> produces paths.txt.out and appends to ./qa/*-qa_tab.txt files. (notes=)
#
# STEP 11:: RUN 'grism_pipeqa  -paths paths.txt  -spac  -write_qa_file  mcatrank_allow=3  -VQA VQA.txt >&! out2.txt'
#      (this repeats step 1 in order to write additional information into ./qa/*-qa_tab.txt files)
#      (this requires direct visit QA data files *_qareport.txt listed in VQA.txt)
#    --> produces a new script of orbpipe runs in 'script.out' (execution probably not needed)
#    --> creates a new summary of mcat and visit path status in 'info.out'
#    --> standard output in 'out2.txt' is a record of which mcat files were available.
#    --> appends to ./qa/*-qa_tab.txt (e.g. mcatcode=, mcat_ratio=, passfail=, flags=)
#
# STEP 12:: ASK Tom to run galex_webreport for these paths to create JPEG-profiles web tables.
#
# STEP 13:: USE results of the webreport to create *_keys.txt files with grism visit QA and 
#           coadd status for each visit (example:  tab_keys.txt ).
#
# STEP 14:: RUN 'grism_pipeqa  -paths paths.txt  -coadd_qa  -COA COA.txt'
#    (this requires grism visit QA data files *_keys.txt listed in COA.txt)
#    (see example:  COA.txt )
#    --> appends to ./qa/*-qa_tab.txt the coadd data (COA) (e.g. coadd_status=).
#
# STEP 15:: RUN 'grism_pipeqa -paths paths.txt qar=grism_qareport.txt'
#      (this uses all the ./qa/*-qa_tab.txt information)
#    --> creates (final) grism _qareport.txt
#
# STEP 16:: RUN 'grism_pipeqa -paths paths.txt -addscript script.add.out  -COA COA.txt'
#      (this uses the coadd QA information)
#    --> creates script.add.out with targpipe commands.
#    --> creates mains.txt with list of main directories.
#
# STEP 17:: RUN 'source script.add.out'
#
# STEP 18:: RUN 'galex_tabqa -auto mains.txt -no04only'
#      (this uses the coadd QA information)
#    --> creates mains.txt.out with QA on targpipe runs from Out.txt
#    --> creates/appends to -qa_tab.txt in main directories.
#
# STEP 19:: RUN 'grism_pipeqa -paths paths.txt -mains mains.txt qar=grism_qareport_mains.txt'
#      (this uses all the ./qa/*-qa_tab.txt information)
#    --> creates (final) coadd grism_qareport.txt
#
#