Skip to content

Add application: EUCAIM Federated Datasets Unbalance Checker #4

@carleshf

Description

@carleshf

EUCAIM Federated Datasets Unbalance Checker

Description

This is a tool generates a basic set of statistics per datasets and then aggregates those statistics to identify possible biases for federated experiments

Usage

Runner (datasets statistics)

docker run --rm \
  -v $(pwd)/example_datasets:/data:ro \ # mounting data volume (read-only)
  -v $(pwd)/out:/sandbox \              # mounting sandbox to save output (read and write)
  federated-unbalance-runner \          # image to run
  -i /data/ds-8 \                       # path to the input dataset
  -o /sandbox/output-dX.json            # path to the output file

Aggregator (federated statistics)

docker run --rm \
  -v $(pwd)/out:/sandbox \                             # mounting data volume (read-only)
  federated-unbalance-aggregator \                     # image to run
  -i /sandbox/output-dX.json /sandbox/output-dY.json \ # input (output from previous step)
  -o /sandbox/                                         # path for output files (json + html)

Authors

Carles Hernandez-Ferrer

Contact info

carles.hernandez2(at)bsc.es

URL

https://gitlab.bsc.es/fl/eucaim-cdm-federated-unbalance

License

MIT License

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions