PNMFOF

This process is stage 1 of the EDR Pipeline. It normally is a File Polling Process and its purpose is to poll for and process PNM files sent to the EDR Pipeline from the CCS system. Processing the PNM files involves reading the file and verifying that all the named FOF files reside on the same input disk as the PNM file. It also checks that none of the FOF files have been received before. Missing files produce an error status and the PNM file will be renamed to indicate a bad file. Duplicates files produce a duplicate status and the PNM file will be renamed to indicate duplicate FOF files were received.After the verification is successful, the FOF files are moved to the EDR_FOF_DIR and a fof OSF is generated for each FOF file. The FOF OSF has the ZI stage set to wait, so that the fof class ZIPFOF process will unzip the file in the EDR_FOF_DIR.

When PNMFOF is triggered by a pnm class OSF with a shove (s) status in stage 1, it will look for the duplicate PNM file and process all of its FOF files whether or not they have been processed previously.  It will replace the existing records in pnmfof_table that are used to track duplicates, and it will reset the eng_ready flag to "N" in the product_eng_map table for every FOF rootname in this PNM file.

When a file event triggers the pnmfof process, the value "_proc" is appended to the file name to avoid retriggering. If the process goes absent while processing a PNM file this append value will remain. If the file is processed without error, the "_proc" is replaced by "_done". If the PNM file has an invalid format or the resource file has missing values, the pnmfof process closes the event by changing the file from "_proc" to "_bad". If duplicate FOF files are found in the pnmfof_table, the file is changes from "_proc" to "_duplicate".

PNMFOF Process Modes

• Pipeline Mode

       pnmfof -p $PATH_FILE -r pnmfof  (in task line of resource file)

              where: pnmfof = command name

                         -p = denotes path file specification follows

                 $PATH_FILE = path file of the pipeline

                         -r = denotes resource name follows

                     pnmfof = the name of the resource file

PNMFOF Process I/O

       INPUT:

          EDR_RECEIPT_DIR: PNM_yyyydddhhmmss.txt  - PNM text files

          EDR_RECEIPT_DIR: Tyyyydddhhmm.mrg-gz  - zipped FOF files

       OUTPUT:

          EDR_RECEIPT_DIR: PNM_yyyydddhhmmss.txt_done  - processed PNM text files

          EDR_RECEIPT_DIR: PNM_yyyydddhhmmss.txt_bad  - bad PNM text files

          EDR_RECEIPT_DIR: PNM_yyyydddhhmmss.txt_duplicate  - duplicate PNM text files

          EDR_FOF_DIR: Tyyyydddhhmm.mrg-gz  - zipped FOF files (moved without change)

PNMFOF Process Error Handling