CVS log for Elf/ElfProduction.tcl

Up to [BaBar] / Elf

Request diff between arbitrary revisions

Keyword substitution: kv
Default branch: MAIN

added ElfMonitorPrescaleFactor for controlling the QA histogram prescale factor for Bear

- Disable ElfBGFilterSpecial by default (this should be the standard
setting)

- Added FwkConfigVar ElfBGFilterSpecial that enables
  RecoBGFilterSubset filter in RecoBGFilter. The default value is
  currently "yes", so the module is activated. Will tag this and then
  commit a version with default set to nothing (RecoBGFilterSubset
  disabled)

Move TrkFixup out of Elf executable.  Handled in BearRecoSequence.  Tag V01-09-08

Reconfigure to set up trickle injection veto window processing.

Change TrkFixup default to 'yes'

Add option to run TrkFixup as part of Elf.  Remove obsolete manipulation of PidSequence

add fwkvar for cachemaxpages

remove extra tags hack, turn off EmcChiCalib

add capability of extra patches file

make autosave a fwkvar

adding root as default option for histograms

fixed a problem with ER settings. the calibration sequence is enabled only when ElfPromptCalib=PromptCalib; updated README and History files

fixed a problem with ER settings. the calibration sequence is enabled only when ElfPromptCalib=PromptCalib

more changes to fix the ER pass and retain the flexibility of
turning off the storing in the spatial/temporal DB in PC pass
when running offline. Had to redefine a new variable.


# PC pass
set ElfPromptCalib PromptCalib
set ElfOprConfig
set ElfOprStorePC

# ER pass
set ElfPromptCalib Default
set ElfOprConfig


# testing PC pass offline
set ElfPromptCalib PromptCalib
set ElfOprConfig

General cleanup of the Elf*.tcl tcl files in order to remove support for Bdb output

ElfProduction.tcl
------------------
removed unnecessary 'sourceFoundFile's that are now provided by default.

many variables are now decalred deprecated:

+FwkCfgVarDeprecate ElfWriteRec      ;#  Turns on output of Reco data
+
+FwkCfgVarDeprecate ElfOprDb         ;# Turns on writing to Opr spatial/temporal
+                                    ;# databases if set
+                                    ;# This MUST be set for the PC pass
+
+FwkCfgVarDeprecate ElfNoBdbRandomize   ;# turns off transaction randomization if present
+FwkCfgVarDeprecate ElfMasterCollection ;# used in Bdb OPR
+FwkCfgVarDeprecate ElfOutputPrefix     ;# used in Bdb OPR
+FwkCfgVarDeprecate ElfOutputStreams    ;# The comma-separated list of output streams
+                                       ;# If set to yes, all streams are turned on
+                                       ;# If unset only default stream is on
+                                       ;# ElfOutputStreams=Stream1,Stream15
+
+
+FwkCfgVarDeprecate ElfWriteOldMicro ;# Write the old micro in addition to the (split)
+                                    ;# mini implmentation of the micro (intended for�
+                                    ;# debugging only). [Turned on if set to anything]

ElfOprConfig and ElfPromptCalib are the only variables needed for the PC pass (+ output control of course)

ElfProductionSetup.tcl
----------------------
removed unnecessary sourceFoundFile's.

moved around some of the code to make it  it more organzied in blocks that can
be moved around futher.

removed support for Bdb configuration in I/O



ElfSetup.tcl
------------
moved a PC-configuration block down to ElfProductionSetup.tcl
removed use of deprecated variables

modfied the header comments to fit 80 characters. This way the users can see
all the available config variables and their meaning by doing


$ grep ";#" Elf/ElfProduction.tcl | head
set ProdTclOnly true          ;# Disable the use of envvars with the FwkCfgVar
FwkCfgVar ElfConfigPatchSet   ;# Name of the config patch set to apply.
                              ;# Choices are listed in the README file.
FwkCfgVar ElfPromptCalib      ;# Can be set to one of:
                              ;# PromptCalib   : To pass 1
                              ;# Default       : To pass 2
                              ;# noPromptCalib : Configure for the old rolling
                              ;#                  calibrations
                              ;# If not set it will default to "Default"

This will be useful as part of the CM2 documentation

cleaned up the header descrbing the available options.
Now using the same style as in SkimMiniProductions.tcl
where each variable is described when declared.

users can do
grep ";#" ElfProduction.tcl

to see all the options and what they do

added also a fatal failure when the user asks for
ElfOutputType = Kan  && ElfOutputCollection=<something> && !RunMini

this is because Elf will crash in 14.3.1 and later because of the new
persistency cod for the EMC.

NB: for this condition to happen the user should change ElfProduction.tcl
and comment RunMini out which is currently enabled by default.

ElfOutputType is now FwkCfgVar (was FwkCfgVarRequire) and is set to Kan by default

RunMini=yes by default as required by the latest EMC code from Dave Brown. All releases >=14.3.1 must use this new default

updated the description of the new and deprecated variables in the header comments; now ElfNoPhysProd=true by default

deprecated ElfWriteDb and ElfWriteKan now replaced by ElfOutputType = Kan || Bdb

removed 2 variables: ElfCalibStream, ElfBkgRawStream
now using the output collection names for these streams to
turn on the relevant code.

rearranged the definition of the ElfTriggerPaths list of skims needed
for the calib stream. The list is defined in ElfSetup.tcl and
used in SkimMini/SkimMiniBearSequence.tcl to set them up
when ElfRunSkims=Default.

Physics sequence changes

added BetaLoadSequence to load both Reco and Mini objects

Add binlist file putting ElfUserXtcApp/ElfOprApp in binary category "recoprod".
Add tclvar to disable the possibility to configure Elf with envvars with
the FwkCfgVar mechanism.

Remove spurious 'path list'.  Add ElfVerbose fwkcfgvar, to set tcl ErrLogger verbosity

added output of a raw stream

Switch to FwkCfgVar

Restore head of ElfSetup.tcl to work with -kan builds (last commit made
it work for -roo builds). The ElfProduction.tcl change is just some
stupid spurious space in some line.

Switch to using ElfFwkDump to control whether path/sequences/modules are
printed.

Add option for writing the calibration stream. Switch ElfWriteRoo to
ElfWriteKan. Remove old, deprecated options like: ElfWriteEsd,
ElfRooOutputFile, ElfOprRoo. Add option for ElfWriteOldMicro.

tcl fix for BetaMiniSequences usage

replaced old RooSequence configuration by a writeMini call

some changes (not yet fully working) to switch to writeMini to configure Kanga output

tcl cleanup of kanga output

Changes to accommodate OprRooEventOutput

added support for New Micro output

Removed debug printout

First steps in cleaning up and modifying the configuration of Elf.

 o ElfConfigPatchSet does not have to be set. The configuration for
   processing Run1, Run2, and Run3 is default.

 o ElfProduction.tcl now converts env vars to tcl vars.

added Elf OCP output and removed environment variables from ElfProduction.tcl and added ElfProductionOptions.tcl

Change such that ElfPromptCalib does not have to be set, if not set it defaults to 'Default'

BearBasePath was used at the HEAD to determine which events to write out; changed back to BearRecoFinalPath until determined how to select the events to be output.

Add options to turn off hyper-verbose output and to not randomize Bdb transactions

 Changes to make the digi writing work:

diff -r1.4 ElfConfigPatchSet_TcToDigi.tcl
27,30c27,30
< path disable ElfMultiHadronStreamPath
< path disable ElfCalibStreamPath
< path disable ElfTriggerStreamPath
< path disable ElfPhysicsStreamPath
---
> #path disable ElfMultiHadronStreamPath
> #path disable ElfCalibStreamPath
> #path disable ElfTriggerStreamPath
> #path disable ElfPhysicsStreamPath

and

diff -r1.53 ElfProduction.tcl
208c208
<          bdbOprSetStream Default BearRecoFinalPath $env(ElfOutputCollection)
---
>          bdbOprSetStream Default BearBasePath  $env(ElfOutputCollection)
272a273,275
>

shifted usage of environment variables to ElfProduction.tcl

moved setup of Roo output to ElfProductionSetup.tcl

tcl fixes for the OCP

Some more changes

Add fix so writing to database will work for standalone Elf (I'll probably
clean some more things up in a few minutes)

small tcl changes for the OCP

Disable PrintParms again, too.

changes for the OCP

Changes to support the different Elf passes

Now use the SvtReco/SvtPromptCalib.tcl file

Added in control to run the calibration pass

  Made one of more of the following changes:
    Changed "collectionName set" to "input add" in input module
    Changed "collectionName list" to "input add" in input module
    Added CVS Id keyword

Moved FltBldEnv to BearInitAppSequence and source patches for Elf dir.

Disable PrintParms

  Disable CpuCheck in XxxPatches.tcl file (R5711), make changes to make
_not_ writing the rec the default.

 Did the following change:

diff -r1.37 ElfProduction.tcl
157c157
<          bdbOprSetStream Default BearBasePath $env(ElfOutputCollection)
---
>          bdbOprSetStream Default BearRecoFinalPath $env(ElfOutputCollection)


such that only events that pass the BGFilter are actually written to the
event store when running Elf with ElfProduction.tcl

Move setting of ElfOprDb such that it is set prior to sourcing
ElfProductionSetup.tcl, so that it will actually have an effect. This
was noticed and called to my attention by Jamie Boyd some time ago,
somehow I never actually got it fixed and committed.

- Set default streamList to Run2. Needed with FilterTools V00-03-22

Fix small printout typo

Tue Jan 16 01:28:50 PST 2001 yury

- Changed default collection name prefix to "" to let Bdb code handle it

Tue Jan  9 06:27:50 PST 2001 yury

- Added prefix to the stream collection name to allow testing against
  production federations. Default is /users/$USER/, but should be
  /groups/ in PRproduction.tcl

Sun Dec 24 23:22:09 PST 2000 yury

- Added master collection setup in FilterTools

Fix error in comparision.

Default is to write one stream now. Also add commented out line to turn
on tcl tracing.

Wed Nov 29 21:50:44 PST 2000 yury

- Set up Objy streams in FilterTools

  Do v4  slow migration (migrate old Framework macros, migrate forwarding
    includes, etc.)
  Removed rcsid and "rscid"
  Stick in CVS Id keyword where missing
  Removed source of sourceFoundFile proc from Framescripts (now defined
    in Framework)

Update History, README, add some $Id:$ in various files

ElfApp.cc:
	Add RooSequence and a special version of RooEventOutput.

ElfProduction.tcl:
	Set output file name if using Roo.

ElfProductionSet.tcl:
	Setup Roo output if using it.

bin_Elf.mk:
	Elf now depends on RooSequences and RooModules.

Stephen J. Gowdy

ths is the part I forgot last time:  set the input collectin in
BdbEventInput rather than OprBdbEventInput.

testing will happen in two parts
	a)  test ElfUsrXtcApp.  To hell with ElfUserDbApp
	b)  Make ElfUserDbApp work too.

	-Ed

Update README file w.r.t. recipe for creating a test federation.

Add a comment to ElfProduction.tcl mentioning the Env override for
the framework.hbook name.

Mon Jun 14 15:41:12 PDT 1999 yury

- Moved "path create ElfPhysicsFilterPath" to Bear/BearPathSetup.tcl
- Removed the second instance of EvtCounter from ElfOepPath
- Commented out second stream output in ElfProduction.tcl

Sun Jun 13 23:42:04 PDT 1999 yury

- Added 6 instances of TagFilterByName to ElfApp.cc to set up
  filtering for physics
- Added PhysicsFilterPath to ElfProductionSetup.tcl
- Added an example of output module setup to ElfProduction.tcl

ElfConfigPatchSet_Run1.tcl
   Add SVT.  Gerhard signed off on DCH.  I think EMC is OK, but not
   sure.  Drc may be right but am waiting to hear.  IFR is a no op
   no matter what:  absenst in both May99Cosmic and Run1 config sets.

   Also, added Env variable ElfISolenoid that is used to set the
   current in the solenoid.  This is NOT an official interface and
   should go away soon, but it seemed prudent to add and was asked
   for.

ElfProduction.tcl
   Turned HBOOK file dump back on.  ElfPRodcutionSetup.tcl still keeps
   it turned off (for PR).  So this supports single users, per rerquest.

add support for new streams capability (BdbEventOutput).  not tested.

WARNING:  Elf Patches sets db:Model2 for the time to dist calib set
*unconditionally*.  This is so wrong it hurts, but I'm committing
it for the moment as it should help Jacek.

	-Ed

Continue inverting the dependency so that systems provide config
Tcl for different run condtions.

Added option to control spatial/temporal database writing

Trying to clean up the configuration mess and invert the dependency.
From the README:


      ElfConfigPatchSet- Name of the config patch set to apply.
                         Choices are:
			   Run1		  Beam data from Run 1 (summer 99)
			   Jan99Cosmics   Cosmics from Winter of 99
			   May99Cosmics   Cosmics from Spring of 99.

Configuration Patch Sets
========================

   These patch sets are not like ElfPatches.tcl.  They are required
configuration for some running conditions, e.g., Beam data vs. MC vs.
Cosmics and one of them will be sourced by the ElfProductionSetup.tcl.
They hold perturbations on the base set of configurations provided in
the XxxRecoSequence.tcl and related Tcl files.  By contrast,
ElfPatchs.tcl is fixes for user specific choices or sometimes
emergency fixes for a release.  It is only sourced if present in the
current directory.  To the greatest extent possible, all config should
happen in the base XxxRecoSequence.tcl and related files, not in the
ConfigPatchSets.

Each Patch set defers to sequences maintained by the subsytems.  To
install a configuration patch set for DCH for Run1 data, for example,
you would edit ElfConfigPatchSet_Run1.tcl and insert a line like
	sourceFoundFile  DchSomePackage/DchElfConfigPatchSet_Run1.tcl
All real code lives in the DchSomePackage, _not_ in Elf.


From ElfProduction.tcl:

##
# Real Production running will not depend on the environment, if possible.
# Private users may wish to use the environment for configuration.  So
# ElfProductionSetup.tcl does not use env vars, as much as is possible.
# Here we transfer ElfConfigPatchSet from the env to Tcl itself so
# tht ElfProductionSetup.tcl can get it, i.e., ElfProduction.tcl is
# just a wrapper to help a user run from a config in the env.
##

if [ info exists env(ElfConfigPatchSet) ] {
   set ElfConfigPatchSet $env(ElfConfigPatchSet)
}


From ElfProductionSetup.tcl:

##
# Elf needs to be configured in one of several ways depending upon
# what kind of processing we are doing (beam, cosmics, MC).  We handle
# that by applying a number of overrides that come from files chosen
# with a key.
##

if { [info exists ElfConfigPatchSet ] } {
   echo "ElfProductionSetup.tcl:  Using ElfConfigPatchSet= " $ElfConfigPatchSet
   sourceFoundFile Elf/ElfConfigPatchSet_$ElfConfigPatchSet.tcl
} else {
   echo "ERROR:  ****************************************************"
   echo "ERROR:  ElfProductionSetup.tcl:  No ElfConfigPatchSet given."
   echo "ERROR:  ElfProductionSetup.tcl:  I wish I could abort!"
   echo "ERROR:  ****************************************************"
}

More cleaning of elf, pushing for production quality encapsulation.

General goings on:
	a)  defering more and more to bear.  in this case, we now defer
		to BearWriteDb.tcl for setting up output collections.

	b)  ElfApp.cc:  added event cache for physics group

	c)  ElfPatces_*.tcl:  I don't do it yet, but we'll look at
		an env var or something to souce one of these t
		handle the  MC vs. Beam vs. Cosmics[N] problem.  This
		is really gross but it's all I can think of right now.

	d)  ElfPatches:  pushing to make it empty, even if that breaks
		subsystems.  We must rech a state where _they_ can run
		and where they are responsible to run, and give them
		a framework in which to install their fixes.  that is
		what I'm building.  then things will go quickly.

holy cow.  we just read the DB and did not crash on 5 events.
DrcT0 is off
EmcCal is off for pi0 and minI

	-Ed

making Elf use the new paths setup in Bear.  also cleaning up as
much as possible, pushing for a stable framework that systems can
use for testing from now on.

ElfApp.cc
	Removed all #ifdefs.  No more special -D's to compile

ElfCalibrationSeq:
	Emc had been commented out because it did not run.
	infomed those involved not to do this, but to
	turn off proken stuff w/ tcl.  as a result, elf does
	not even link any more since emc had no feedback on
	the link.

ElfProduction.tcl
	accommodating the BearPathSetup plus other mods.

GNUMakefile:
	bin: no  longer builds anything.  Just prints a help message.
	To get one of the desired executable you muse use one of
	three targets:
		ElfApp		Opr multinode app
		ElfUserDb	Stand alone app.  reads DB
		ElfUserXtc	Stand alone app.  reads Xtc


Various new .cc files:
	Hold indirection to the Opr files that have the various
	main()'s.  Excluded from the library.


DOES NOT LINK YET.
sync and move to new machine.

	-Ed