Link

Command

export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase
alias setupATLAS='source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh'
setupATLAS

lsetup 'asetup AtlasProduction 20.7.5.5 here'

pkgco.py InDetPrepRawDataToxAOD-00-01-35
cmt find_packages
cmt compile

lsetup emi
voms-proxy-init -voms atlas

lsetup panda

pathena \
--outDS=user.oda.data15_13TeV.00284484.express_express.merge.RAW.DAOD_SCTVALID/ \
--inDS=data15_13TeV.00284484.express_express.merge.RAW \
--nFilesPerJob=1 \
--destSE=CERN-PROD_SCRATCHDISK \
--trf="Reco_tf.py --conditionsTag 'default:CONDBR2-BLKPA-2016-02' --beamType 'collisions' --ignoreErrors 'True' --autoConfiguration 'everything' --maxEvents 'default:-1' --ignorePatterns 'ToolSvc.InDetSCTRodDecoder.+ERROR.+Unknown.+offlineId.+for.+OnlineId' --postExec 'ESDtoDPD:from AthenaCommon.AppMgr import ServiceMgr;import MuonRPC_Cabling.MuonRPC_CablingConfig;ServiceMgr.MuonRPC_CablingSvc.RPCMapfromCool=False;ServiceMgr.MuonRPC_CablingSvc.CorrFileName=\"LVL1confAtlasRUN2_ver016.corr\";ServiceMgr.MuonRPC_CablingSvc.ConfFileName=\"LVL1confAtlasRUN2_ver016.data\";' 'RAWtoESD:ToolSvc.MuidRefitTool.DeweightEEL1C05=True;ToolSvc.OutwardsRefitTool.DeweightEEL1C05=True;' 'all:from IOVDbSvc.CondDB import conddb;conddb.addFolderSplitOnline(\"INDET\",\"/Indet/Onl/IBLDist\",\"/Indet/IBLDist\");' --preExec 'all:jobproperties.Beam.bunchSpacing.set_Value_and_Lock(25);DQMonFlags.enableLumiAccess=False;' 'RAWtoESD:from LArConditionsCommon.LArCondFlags import larCondFlags;larCondFlags.OFCShapeFolder.set_Value_and_Lock(\"4samples1phase\");' 'RAWtoESD:from InDetPrepRawDataToxAOD.SCTxAODJobProperties import SCTxAODFlags; SCTxAODFlags.Prescale.set_Value_and_Lock(50)' --geometryVersion 'default:ATLAS-R2-2015-03-01-00' --inputBSFile %IN --outputDAOD_SCTVALIDFile %OUT.DAOD_SCTVALID.pool.root"
# Based on r7562 (25ns standard reco tag of Second Bulk reprocessing with 20.7.3.8)

Command with release 21

Step 1

Copy input RAW files using Rucio Rule. Follow the instruction in Rucio Rule.

Step 2

Run a local job that creates SCT AxAOD.

Step 2.1

Get a RAW file.

setupATLAS
lsetup emi
voms-proxy-init -voms atlas
lsetup rucio

rucio get --nrandom 1 user.kkoda.data16_13TeV.00309390.physics_Main.daq.RAW._lb0110_lb0113

ls -l ./user.kkoda.data16_13TeV.00309390.physics_Main.daq.RAW._lb0110_lb0113/

Step 2.2

Configure Athena release.

asetup AtlasOffline 21.0.17

Run a Reco_tf.py job

Reco_tf.py --AMI r9144 --inputBSFile  ./user.kkoda.data16_13TeV.00309390.physics_Main.daq.RAW._lb0110_lb0113/* --outputDAOD_SCTVALIDFile DAOD_SCTVALID.pool.root --maxEvents 10

r9144 was taken from https://twiki.cern.ch/twiki/bin/view/Atlas/Winter2017Run2Reprocessing#Configuration_AN1

Step 3

Run a grid job

Step 3.1

# TestArea is needed for Pathena
asetup AtlasOffline 21.0.17 here

# Since memory usage is restricted, you need to use multicore jobs.
export ATHENA_PROC_NUMBER=8

# Set up Panda
lsetup panda

# Run a Pathena job
pathena --inDS=user.kkoda.data16_13TeV.00309390.physics_Main.daq.RAW._lb0110_lb0113 --outDS=user.oda.data16_13TeV.00309390.physics_Main.lb0110_lb0113.DAOD_SCTVALID --nFilesPerJob=1 --trf="Reco_tf.py --AMI r9144 --inputBSFile %IN --outputDAOD_SCTVALIDFile %OUT.DAOD_SCTVALID.pool.root --maxEvents -1"

Step 3.2

You can monitor your jobs on BigPanda. My case is
http://bigpanda.cern.ch/user/Susumu%20Oda/?display_limit=200
You need to replace "Susumu%20Oda" by your registered name. "%20" means a space.

Step 3.3

If some jobs failed, you can retry them by pbook of panda.

pbook
retry(62118)

62118 is jobsetid. You need to change this number to jobsetid of your job.

Step 3.4

If the input container gets more files, you can process the new files by running the same pathena command in step 3.1.

Only SCT information

With AtlasOffline 21.0.20 --> Athena 21.0.69
cd $TestArea
mkdir InDetPrepRawDataToxAOD
cd InDetPrepRawDataToxAOD
get_files InDetPrepRawDataToxAOD/SCTxAOD.py
I commented out the following lines
# from DerivationFrameworkInDet.DerivationFrameworkInDetConf import DerivationFramework__TrackStateOnSurfaceDecorator
# DFTSOS = DerivationFramework__TrackStateOnSurfaceDecorator(name = "SCTxAOD_DFTrackStateOnSurfaceDecorator",
#                                                           ContainerName = "InDetTrackParticles",
#                                                           DecorationPrefix = prefixName,
#                                                           StoreTRT   = False,
#                                                           StoreSCT   = True,
#                                                           StorePixel = False,
#                                                           IsSimulation = isSctDxAODSimulation,
#                                                           OutputLevel = INFO)
# ToolSvc += DFTSOS
# augmentationTools+=[DFTSOS]
Reco_tf.py --AMI f806 --preExec 'r2a:from InDetPrepRawDataToxAOD.SCTxAODJobProperties import SCTxAODFlags;SCTxAODFlags.Prescale.set_Value_and_Lock(1); TriggerFlags.AODEDMSet="AODFULL"; rec.doFwdRegion=False; rec.doTau=False; rec.doMuon=False; rec.doEgamma=False; rec.doMuonCombined=False; rec.doCalo=False;rec.doJetMissingETTag=False; InDetFlags.disableTracking.set_Value_and_Lock(True); InDetFlags.doStatistics.set_Value_and_Lock(False); from AthenaCommon.DetFlags import DetFlags; DetFlags.all_setOff(); DetFlags.ID_setOn(); DetFlags.BField_setOn(); DetFlags.TRT_setOn(); DetFlags.makeRIO.TRT_setOff()' --outputDAOD_SCTVALIDFile DAOD_SCTVALID.319473.pool.root --inputBSFile root://eosatlas//eos/atlas/atlastier0/rucio/data_test/calibration_DcmDummyProcessor/00319473/data_test.00319473.calibration_DcmDummyProcessor.daq.RAW/data_test.00319473.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-1._0001.data
Reco_tf.py --AMI f806 --preExec 'r2a:from InDetPrepRawDataToxAOD.SCTxAODJobProperties import SCTxAODFlags;SCTxAODFlags.Prescale.set_Value_and_Lock(1); TriggerFlags.AODEDMSet="AODFULL"; rec.doFwdRegion=False; rec.doTau=False; rec.doMuon=False; rec.doEgamma=False; rec.doMuonCombined=False; rec.doCalo=False;rec.doJetMissingETTag=False; InDetFlags.disableTracking.set_Value_and_Lock(True); InDetFlags.doStatistics.set_Value_and_Lock(False); from AthenaCommon.DetFlags import DetFlags; DetFlags.all_setOff(); DetFlags.ID_setOn(); DetFlags.BField_setOn(); DetFlags.TRT_setOn(); DetFlags.makeRIO.TRT_setOff()' --outputDAOD_SCTVALIDFile DAOD_SCTVALID.319482.pool.root --inputBSFile root://eosatlas//eos/atlas/atlastier0/rucio/data_test/calibration_DcmDummyProcessor/00319482/data_test.00319482.calibration_DcmDummyProcessor.daq.RAW/data_test.00319482.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-1._0001.data
Reco_tf.py --AMI f806 --preExec 'r2a:from InDetPrepRawDataToxAOD.SCTxAODJobProperties import SCTxAODFlags;SCTxAODFlags.Prescale.set_Value_and_Lock(1); TriggerFlags.AODEDMSet="AODFULL"; rec.doFwdRegion=False; rec.doTau=False; rec.doMuon=False; rec.doEgamma=False; rec.doMuonCombined=False; rec.doCalo=False;rec.doJetMissingETTag=False; InDetFlags.disableTracking.set_Value_and_Lock(True); InDetFlags.doStatistics.set_Value_and_Lock(False); from AthenaCommon.DetFlags import DetFlags; DetFlags.all_setOff(); DetFlags.ID_setOn(); DetFlags.BField_setOn(); DetFlags.TRT_setOn(); DetFlags.makeRIO.TRT_setOff(); InDetFlags.doxAOD.set_Value_and_Lock(False); from AthenaCommon.BeamFlags import jobproperties;jobproperties.Beam.beamType.set_Value_and_Lock("cosmics");' --outputDAOD_SCTVALIDFile DAOD_SCTVALID.319489.pool.root --inputBSFile root://eosatlas//eos/atlas/atlastier0/rucio/data17_comm/calibration_DcmDummyProcessor/00319489/data17_comm.00319489.calibration_DcmDummyProcessor.daq.RAW/data17_comm.00319489.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-1._0001.data
Reco_tf.py --AMI f806 --preExec 'r2a:from InDetPrepRawDataToxAOD.SCTxAODJobProperties import SCTxAODFlags;SCTxAODFlags.Prescale.set_Value_and_Lock(1); TriggerFlags.AODEDMSet="AODFULL"; rec.doFwdRegion=False; rec.doTau=False; rec.doMuon=False; rec.doEgamma=False; rec.doMuonCombined=False; rec.doCalo=False;rec.doJetMissingETTag=False; InDetFlags.disableTracking.set_Value_and_Lock(True); InDetFlags.doStatistics.set_Value_and_Lock(False); from AthenaCommon.DetFlags import DetFlags; DetFlags.all_setOff(); DetFlags.ID_setOn(); DetFlags.BField_setOn(); DetFlags.TRT_setOn(); DetFlags.makeRIO.TRT_setOff(); InDetFlags.doxAOD.set_Value_and_Lock(False); from AthenaCommon.BeamFlags import jobproperties;jobproperties.Beam.beamType.set_Value_and_Lock("cosmics");' --outputDAOD_SCTVALIDFile DAOD_SCTVALID.319696.pool.root --inputBSFile root://eosatlas//eos/atlas/atlastier0/rucio/data_test/calibration_DcmDummyProcessor/00319696/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-1._0001.data,root://eosatlas//eos/atlas/atlastier0/rucio/data_test/calibration_DcmDummyProcessor/00319696/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-2._0001.data,root://eosatlas//eos/atlas/atlastier0/rucio/data_test/calibration_DcmDummyProcessor/00319696/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-3._0001.data,root://eosatlas//eos/atlas/atlastier0/rucio/data_test/calibration_DcmDummyProcessor/00319696/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-4._0001.data,root://eosatlas//eos/atlas/atlastier0/rucio/data_test/calibration_DcmDummyProcessor/00319696/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-5._0001.data,root://eosatlas//eos/atlas/atlastier0/rucio/data_test/calibration_DcmDummyProcessor/00319696/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-6._0001.data,root://eosatlas//eos/atlas/atlastier0/rucio/data_test/calibration_DcmDummyProcessor/00319696/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-7._0001.data,root://eosatlas//eos/atlas/atlastier0/rucio/data_test/calibration_DcmDummyProcessor/00319696/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW/data_test.00319696.calibration_DcmDummyProcessor.daq.RAW._lb0000._SFO-8._0001.data
Reco_tf.py --conditionsTag all:CONDBR2-ES1PA-2017-05 --ignoreErrors 'False' --autoConfiguration='everything' --maxEvents '-1' --AMITag 'x558' --preExec  'r2a:rec.doExpressProcessing.set_Value_and_Lock(True);from InDetRecExample.InDetJobProperties import InDetFlags; InDetFlags.useDynamicAlignFolders.set_Value_and_Lock(True);from InDetPrepRawDataToxAOD.SCTxAODJobProperties import SCTxAODFlags;SCTxAODFlags.Prescale.set_Value_and_Lock(1); rec.doFwdRegion=False; rec.doTau=False; rec.doMuon=False; rec.doEgamma=False; rec.doMuonCombined=False; rec.doCalo=False;rec.doJetMissingETTag=False; InDetFlags.doStatistics.set_Value_and_Lock(False); from AthenaCommon.DetFlags import DetFlags; DetFlags.all_setOff(); DetFlags.ID_setOn(); DetFlags.BField_setOn(); DetFlags.TRT_setOn(); DetFlags.makeRIO.TRT_setOff();InDetFlags.disableTracking.set_Value_and_Lock(True);InDetFlags.doParticleConversion.set_Value_and_Lock(False);InDetFlags.doParticleCreation.set_Value_and_Lock(False);' --geometryVersion all:ATLAS-R2-2016-01-00-01 --steering='doRAWtoALL' --inputBSFile /eos/atlas/atlastier0/rucio/data18_13TeV/physics_Main/00349309/data18_13TeV.00349309.physics_Main.daq.RAW/data18_13TeV.00349309.physics_Main.daq.RAW._lb0118._SFO-1._0001.data --outputDAOD_SCTVALIDFile DAOD_SCTVALID.pool.root --maxEvents 10

Only SCT information with a git nightly

asetup Athena 21.0 r31
source ../build/x86_64-slc6-gcc62-opt/setup.sh
mkdir InDetPrepRawDataToxAOD
cd InDetPrepRawDataToxAOD
get_files -jo InDetPrepRawDataToxAOD/SCTxAOD.py
emacs -nw SCTxAOD.py
# from DerivationFrameworkInDet.DerivationFrameworkInDetConf import DerivationFramework__TrackStateOnSurfaceDecorator
# DFTSOS = DerivationFramework__TrackStateOnSurfaceDecorator(name = "SCTxAOD_DFTrackStateOnSurfaceDecorator",
#                                                           ContainerName = "InDetTrackParticles",
#                                                           DecorationPrefix = prefixName,
#                                                           StoreTRT   = False,
#                                                           StoreSCT   = True,
#                                                           StorePixel = False,
#                                                           IsSimulation = isSctDxAODSimulation,
#                                                           OutputLevel = INFO)
# ToolSvc += DFTSOS
# augmentationTools+=[DFTSOS]
cd ..
lsetup pathena
pathena --inDS data17_13TeV.00324340.express_express.merge.RAW --outDS user.oda.data17_13TeV.00324340.express_express.DAOD_SCTVALID.v1/ --nFilesPerJob=1 --trf="Reco_tf.py --AMITag f822 --preExec 'r2a:from InDetRecExample.InDetJobProperties import InDetFlags; InDetFlags.useDynamicAlignFolders.set_Value_and_Lock(True); from InDetPrepRawDataToxAOD.SCTxAODJobProperties import SCTxAODFlags;SCTxAODFlags.Prescale.set_Value_and_Lock(1);' 'all:rec.doFwdRegion=False;rec.doTau=False;rec.doMuon=False;rec.doEgamma=False;rec.doMuonCombined=False;rec.doCalo=False;rec.doJetMissingETTag=False; InDetFlags.disableTracking.set_Value_and_Lock(True); InDetFlags.doParticleCreation.set_Value_and_Lock(False); InDetFlags.doStatistics.set_Value_and_Lock(False); from AthenaCommon.DetFlags import DetFlags; DetFlags.all_setOff(); DetFlags.ID_setOn(); DetFlags.BField_setOn(); DetFlags.makeRIO.TRT_setOff()' --outputDAOD_SCTVALIDFile %OUT.DAOD_SCTVALID.pool.root --inputBSFile %IN --conditionsTag all:CONDBR2-BLKPA-2017-08 --ignoreErrors 'False' --autoConfiguration='everything' --maxEvents '-1' --geometryVersion all:ATLAS-R2-2016-01-00-01 --steering='doRAWtoALL'"

トップ   編集 凍結解除 差分 バックアップ 添付 複製 名前変更 リロード   新規 一覧 単語検索 最終更新   ヘルプ   最終更新のRSS
Last-modified: 2018-05-03 (木) 20:38:08 (473d)