Output Process

---

• $CGI/ColoSkimUpdate.pl:
  • Description:
    • When all files from one input tape are analized, verifies that tape against the factoids database
    • If the tape is ok, and there is enough room, adds the run number to the list to be spooled out to a stream
  • WWW: http://antero.colorado.edu:8080/ColoSkim.html
  • Submission: crontab job every 15 minutes
  • Files:
    • $DOC/ColoSkim/SkimStatus.lock --> lock file (prevents two ColoSkimUpdate processes to run at the same time)
    • $DOC/ColoFarm/factoids.db --> text file factoids database (from Pass1)
    • $OUTPUT/data/ColoSkimUpdate.log --> log file
    • ~e831/Error.LOG --> summary error file
    • ~e831/Error.log --> temporary error file used by ColoSkimUpdate.pl
    • ~e831/Error2.log --> list of Input tapes whose events differ from factoids.db (if less than +-10 the tape is considered ok)
    • $OUTPUT/data/skm${i}db/Skim${i}.lock --> locks the stream directory (i.e. that stream is skipped by ColoSkimUpdate.pl).
  • Subroutines: ReadFactoids, TapeIsOk

• $CGI/ColoSkimSpool.pl:
  • Description:
    • Whenever an output stream reaches the critical size (between 3.8 and 4.2 Gb), it spools the stream out to magnetic tape
    • At job completion, the magnetic tape is read back one file at a time, and each file's size is compared against the OutputTapeTable database entry
    • Finally, the log file for the output process is examined against the dabase, and if no descrepancies are found, the corresponding data is deleted from disk
  • WWW: http://antero.colorado.edu:8080/ColoSkim.html
  • Submission:
    • by the ColoSkimUpdate process if some streams are ready to be spooled out (and the "auto-spool" flag is set)
    • by the user via the "SPOOL" button on the WWW page
  • Files:
    • $OUTPUT/data/ColoSkimSpool.lock --> global lock file (prevents two ColoSkimSpool processes to run at the same time)
    • $OUTPUT/data/skm{i}db/Skim{i}.lock --> individual stream lock file (prevents that stream from being updated by the ColoSkimUpdate process or to be spooled out by another incoming ColoSkimSpool process)
    • $OUTPUT/data/ColoSkimSpool.log --> log file
    • $OUTPUT/data/ColoSkimSpool.auto --> enable automatic start of the ColoSkimSpool process at the end of the ColoSkimUpdate process
    • $OUTPUT/data/skm{i}db/FilesToBeSpooled_skm{i}.txt --> namelist of output subfiles to be written out, parsed by the e831 copy job
    • $OUTPUT/data/skm{i}db/TapesToBeSpooled_skm{i}.txt --> list of runs assigned to the that skim tape
    • $OUTPUT/data/lastSlotUsed.txt --> running count of next stacker slot to be loaded
    • $OUTPUT/data/cleanTapeDrive_pyramid.txt --> running count of pyramid tape drive cleaning
  • Subroutines: FileHasDoubleLines, GetNextSlot, WriteSlot, CleanStacker, CheckCopyLog, RcpFile
  • Perl programs: SpoolBackToDisk.pl

---