https://twiki.cern.ch/twiki/bin/view/AtlasProtected/AtlasProductionGroupMC16e

AMI tag for reconstruction

r10724: Default reco tag, 21.0.77

Pileup HITS datasets

  • mc16_13TeV.361238.Pythia8EvtGen_A3NNPDF23LO_minbias_inelastic_low.simul.HITS.e4981_s3087_s3111
  • mc16_13TeV.361239.Pythia8EvtGen_A3NNPDF23LO_minbias_inelastic_high.simul.HITS.e4981_s3087_s3111

Signal HITS dataset

  • mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.simul.HITS.e6337_s3126

Single-tag container of AOD of this DSID with full simulation

  • mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.recon.AOD.e6337_s3126_r10724
rucio list-dataset-replicas mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.recon.AOD.e6337_s3126_r10724

DATASET: mc16_13TeV:mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.merge.AOD.e6337_e5984_s3126_r10724_r10726_tid14795494_00
+--------------------+---------+---------+
| RSE                |   FOUND |   TOTAL |
|--------------------+---------+---------|
| IN2P3-CC_DATADISK  |    5972 |    5972 |
| TRIUMF-LCG2_MCTAPE |    5972 |    5972 |
+--------------------+---------+---------+

DATASET: mc16_13TeV:mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.merge.AOD.e6337_e5984_s3126_r10724_r10726_tid15611619_00
+--------------------+---------+---------+
| RSE                |   FOUND |   TOTAL |
|--------------------+---------+---------|
| BNL-OSG2_MCTAPE    |    5992 |    5992 |
| CA-SFU-T2_DATADISK |    5992 |    5992 |
+--------------------+---------+---------+

DATASET: mc16_13TeV:mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.merge.AOD.e6337_e5984_s3126_r10724_r10726_tid15259803_00
+------------------------+---------+---------+
| RSE                    |   FOUND |   TOTAL |
|------------------------+---------+---------|
| USTC-T3_LOCALGROUPDISK |       0 |    3950 |
| TAIWAN-LCG2_DATADISK   |    3950 |    3950 |
| IN2P3-CC_MCTAPE        |    3950 |    3950 |
+------------------------+---------+---------+

DATASET: mc16_13TeV:mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.merge.AOD.e6337_e5984_s3126_r10724_r10726_tid15611634_00
+--------------------------------+---------+---------+
| RSE                            |   FOUND |   TOTAL |
|--------------------------------+---------+---------|
| RRC-KI-T1_MCTAPE               |    4008 |    4008 |
| UKI-NORTHGRID-MAN-HEP_DATADISK |    4008 |    4008 |
+--------------------------------+---------+---------+

Private reproduction of this AOD dataset using pathena

setupATLAS
lsetup emi
voms-proxy-init -voms atlas
asetup Athena 21.0.77
lsetup panda

pathena \
--nCore=2 \
--nJobs=100 \
--inDS=mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.simul.HITS.e6337_s3126/ \
--nFilesPerJob=1 \
--lowMinDS=mc16_13TeV.361238.Pythia8EvtGen_A3NNPDF23LO_minbias_inelastic_low.simul.HITS.e4981_s3087_s3111/ \
--nLowMin=6 \
--highMinDS=mc16_13TeV.361239.Pythia8EvtGen_A3NNPDF23LO_minbias_inelastic_high.simul.HITS.e4981_s3087_s3111/ \
--nHighMin=4 \
--outDS=user.oda.mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.recon.AOD.HITS.e6337_s3126_r10724.v3/ \
--trf="Reco_tf.py --AMI r10724 --maxEvents 1000 --inputHITSFile %IN --inputLowPtMinbiasHitsFile %LOMBIN --inputHighPtMinbiasHitsFile %HIMBIN --outputAODFile %OUT.AOD.pool.root --jobNumber %RNDM:0 --digiSeedOffset1 %RNDM:0 --digiSeedOffset2 %RNDM:0"

https://bigpanda.cern.ch/task/21685831/

nCore=2 is to use AthenaMP. 2 means MP and does not mean 2 processors. Use of AthenaMP is the key point. Otherwise, jobs do not run due to memory limit.

https://twiki.cern.ch/twiki/bin/view/PanDA/PandaAthena#options

--nCore
The number of CPU cores. Note that the system distinguishes only nCore=1 and nCore>1. This means that even if you set nCore=2 jobs can go to sites with nCore=8 and your application must use the 8 cores there. The number of available cores is defined in an environment variable, $ATHENA_PROC_NUMBER, on WNs. Your application must check the env variable when starting up to dynamically change the number of cores

If you want to write all parameters explicitly, ...

pathena \
--nCore=2 \
--nJobs=100 \
--inDS=mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.simul.HITS.e6337_s3126/ \
--nFilesPerJob=1 \
--lowMinDS=mc16_13TeV.361238.Pythia8EvtGen_A3NNPDF23LO_minbias_inelastic_low.simul.HITS.e4981_s3087_s3111/ \
--nLowMin=6 \
--highMinDS=mc16_13TeV.361239.Pythia8EvtGen_A3NNPDF23LO_minbias_inelastic_high.simul.HITS.e4981_s3087_s3111/ \
--nHighMin=4 \
--outDS=user.oda.mc16_13TeV.410470.PhPy8EG_A14_ttbar_hdamp258p75_nonallhad.recon.AOD.HITS.e6337_s3126_r10724.v5/ \
--trf="Reco_tf.py --digiSteeringConf 'StandardSignalOnlyTruth' --conditionsTag 'default:OFLCOND-MC16-SDR-25' --valid 'True' --pileupFinalBunch '6' --numberOfHighPtMinBias '0.2595392' --autoConfiguration 'everything' --numberOfLowPtMinBias '99.2404608' --steering 'doRDO_TRIG' --preInclude 'HITtoRDO:Digitization/ForceUseOfPileUpTools.py,SimulationJobOptions/preInlcude.PileUpBunchTrainsMC16c_2017_Config1.py,RunDependentSimData/configLumi_run310000.py' --postExec 'all:CfgMgr.MessageSvc().setError+=[\"HepMcParticleLink\"]' 'ESDtoAOD:fixedAttrib=[s if \"CONTAINER_SPLITLEVEL = \\\"99\\\"\" not in s else \"\" for s in svcMgr.AthenaPoolCnvSvc.PoolAttributes];svcMgr.AthenaPoolCnvSvc.PoolAttributes=fixedAttrib' --postInclude 'default:PyJobTransforms/UseFrontier.py' --preExec 'all:rec.Commissioning.set_Value_and_Lock(True);from AthenaCommon.BeamFlags import jobproperties;jobproperties.Beam.numberOfCollisions.set_Value_and_Lock(20.0);from LArROD.LArRODFlags import larRODFlags;larRODFlags.NumberOfCollisions.set_Value_and_Lock(20);larRODFlags.nSamples.set_Value_and_Lock(4);larRODFlags.doOFCPileupOptimization.set_Value_and_Lock(True);larRODFlags.firstSample.set_Value_and_Lock(0);larRODFlags.useHighestGainAutoCorr.set_Value_and_Lock(True); from LArDigitization.LArDigitizationFlags import jobproperties;jobproperties.LArDigitizationFlags.useEmecIwHighGain.set_Value_and_Lock(False)' 'ESDtoAOD:from TriggerJobOpts.TriggerFlags import TriggerFlags;TriggerFlags.AODEDMSet.set_Value_and_Lock(\"AODSLIM\");' --triggerConfig 'RDOtoRDOTrigger=MCRECO:DBF:TRIGGERDBMC:2216,76,260' --geometryVersion 'default:ATLAS-R2-2016-01-00-01' --numberOfCavernBkg '0' --maxEvents 1000 --inputHITSFile %IN --inputLowPtMinbiasHitsFile %LOMBIN --inputHighPtMinbiasHitsFile %HIMBIN --outputAODFile %OUT.AOD.pool.root --jobNumber %RNDM:0 --digiSeedOffset1 %RNDM:0 --digiSeedOffset2 %RNDM:0"
'ESDtoAOD:fixedAttrib=[s if \"CONTAINER_SPLITLEVEL = \\\"99\\\"\" not in s else \"\" for s in svcMgr.AthenaPoolCnvSvc.PoolAttributes];svcMgr.AthenaPoolCnvSvc.PoolAttributes=fixedAttrib'

is a very tricky part...

https://bigpanda.cern.ch/task/21699181/


トップ   編集 凍結解除 差分 バックアップ 添付 複製 名前変更 リロード   新規 一覧 単語検索 最終更新   ヘルプ   最終更新のRSS
Last-modified: 2020-06-25 (木) 22:09:05 (161d)