Skip to content

DPL Analysis: refactor origin level mapping (reworked) - #16086

Open
aalkin wants to merge 3 commits into
AliceO2Group:devfrom
aalkin:refactor-origin-level-mapping-rework
Open

aalkin wants to merge 3 commits into
AliceO2Group:devfrom
aalkin:refactor-origin-level-mapping-rework

Conversation

@aalkin

@aalkin aalkin commented Nov 9, 2026

Copy link
Copy Markdown
Member

The standard behavior without origin level mapping is unaffected. When origin level mapping is used, the AOD metadata is taken from files on corresponding levels and propagated as per-origin labeled array to the devices in the workflow. For this, the metadata retrieval is refactored to only happen once in the driver, so that files are not re-opened later. The devices themselves, if they have origin replacement enabled, will modify their ConfigParamRegistry, replacing the standard aod-metadata- values there with the ones that conform to their origin, using the per-origin map that was passed to them via command line. This permits, for example, self-configuring tasks, such as event selection service, to be left as is - they will correctly get the metadata, corresponding to their replaced origin.

  • Re-add ConfigParamDiscovery test that was missing in the previous version

Replaces #15928.

The AOD reader replaces every occurrence of the
aod-parent-base-path-replacement pattern in a parent file path, while
metadata discovery replaced only the first one, so the two could open
different files. Use the same replacement in both. An empty pattern is
now ignored, as it is in the reader.
With --aod-origin-replace and --aod-origin-level-mapping, every device
received the metadata of level 0, even when different files are read.
Each device now sees the metadata of the level its origin maps to.

- Parse and validate aod-origin-level-mapping once during discovery, into
  the aod-origin-level-map LabeledArray which the AOD reader now consumes.
- Read each mapped level through AODInputFile, opening every file in the
  chain of parents only once, and forward the result as the
  aod-metadata-origins LabeledArray and aod-metadata-origin-<O>-tables.
- Overlay the row of the origin of the process on the plain
  aod-metadata-* options at the end of discovery, erasing the keys which
  are missing at that level.
- Add LabeledArray::getRow by label, and tests for the above.

Without a mapping the plain options are unchanged.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

1 participant