Quality guidelines and standards for application cases
Updated 18 Oct 24

v0.1, published on September 23, 2024

Are you preparing one or several application cases for a data publication to accompany your journal article? Follow these guidelines to make your cases easier to integrate with the rest of the preCICE ecosystem and, thus, easier to reproduce, to maintain, and to build upon.

What exactly is an application case? It is everything that you need to run a coupled case: input files (configurations, meshes) of all coupled solvers, configuration files of all adapters, and the overall preCICE configuration file. Sometimes, also run scripts of the solvers, documentation, results, and postprocessing scripts are included. Application cases have many different purposes: to study application-based research questions, to study coupling methods, to test for regression during software development, or to learn preCICE. Users as well as developers of preCICE develop application cases. The preCICE tutorials are also application cases, but with specific requirements, which are collected in the tutorials contribution guidelines.

A data publication can include one or more application cases. Each application case can again include several experiments or a parameter study. Some examples for such data publications:

While being documented fairly well, these application cases do not yet follow all of the guidelines below, but use various structures and styles.

For the guidelines, we distinguish between metadata and best practices, with three levels: bronze, silver, and gold. We plan to publish a list of all application cases that have achieved at least bronze level, together with the respective metadata. Higher levels bring higher visibility and further benefits. New application cases should be significantly different from existing ones. It is possible to submit an updated version of an existing case.

By submitting your data publication for review, you can expect a thorough check from the preCICE team on whether the application case guidelines are met and how to improve your cases. We are not doing a scientific review, however. If your data publication is part of a journal article, for example, the scientific review is part of the review process of the journal instead. Let us know about your cases early on, then we can help from the beginning. If you submit too late, it might be that you can no longer edit your data publication or that it would simply be too much hassle to still change fundamental things.

Metadata

  • M.1: Title of the case
  • M.2: DOI or other URL
  • M.3: License
  • M.4: Authors, including contact information
  • M.5: Coupled solvers, including used versions
  • M.6: Used preCICE version (release/branch/commit), including build config if different from default
  • M.7: Short description of the case (max 300 characters)
  • M.8: (Optional) URL of development repository
  • M.9: (Optional) Related publication
  • M.10: Used preCICE features. Curated list includes:
    • explicit coupling
    • implicit coupling
    • compositional coupling
    • multi coupling
    • quasi-Newton acceleration
    • nearest-projection mapping or linear cell interpolation
    • RBF data mapping
    • GPU computing
    • direct access
    • geometric multi-scale data mapping
    • adaptive time stepping
    • waveform relaxation (order >= 2)
    • two-level initialization
    • dynamic meshes

Best practices

We distinguish between three levels: bronze, silver, and gold.

If an application case includes several experiments, they can be structured in individual folders. Then, each experiment should follow the guidelines individually.

- <some-application-case>/
  - README.md                # a single overall README file is enough
  - <experiment1>/
    - precice-config.xml
    - ...
  - <experiment2>/
  - <experiment3>/
  - ...
  - <some-other-files>

Bronze

We consider an application case fulfilling all of these criteria as Findable and Accessible. This means that the case is working and documented. Others can find the case and all prerequisites, build all necessary components, and run the case.

  • B.1: All coupled solvers are available (open or commercial)
  • B.2: There is a README.md file with at least the following information:
    • physics of the case: the setup including a simple sketch, boundary conditions, …
    • list of dependencies with versions
    • how to build solvers if necessary
    • how to run the case including approximate run time (e.g. a few minutes on a laptop or several hours on a cluster with 128 MPI ranks) and system-specific configuration (e.g. network="ib0" in m2n) if necessary
    • how to check the expected outcome, at least qualitatively (e.g. preCICE watchpoint or visualization screenshot)
    • how to clean the case
    • how the case was created (e.g. how geometries and meshes were created)
  • B.3: The preCICE configuration passes the offline check

Silver

We consider an application case fulfilling all of these criteria as Interoperable. The case follows the standards in terms of structure and style. It could, thus, be potentially run with other solvers without modifications (e.g. of the preCICE configuration). The case feels part of the preCICE ecosystem.

  • S.1: The structure of the case should be as follows:

      - <some-application-case>/        # or <some_experiment>
        - README.md                     # see B.2 and S.6
        - precice.config.xml            # preCICE configuration file
        - run-all.sh                    # run the complete case, multiple times if necessary (optional)
        - clean.sh                      # clean the complete case (mandatory, see S.4)
        - <solver1>/
          - run.sh                      # run the solver (mandatory, see S.5)
          - clean.sh                    # individual clean script (optional)
          - <the-solver1-files>
        - <solver2>/
          - run.sh
          - clean.sh
          - <the-solver2-files>
    

    Each solver is started from its separate folder. All M2N exchange directories are thus .., for example:

      <m2n:sockets acceptor="Fluid" connector="Solid" exchange-directory=".." />
    
  • S.2 The preCICE configuration is named precice-config.xml. Templated files (e.g. via jinja2) or symbolic links are possible and updated in an outer script (e.g. run-all.sh).
  • S.3 The preCICE configuration is formatted with format_precice_config.py. In the future, we will provide a more accessible solution.
  • S.4 There is a cleaning script clean.sh to clean the complete case.
  • S.5 There is an individual run script run.sh for each solver.
  • S.6 The README file follows the following structure:
    • Setup: the physics of the case including a simple sketch
    • Configuration: the config visualized by the preCICE config visualizer
    • Solvers: list of solvers, their dependencies, and potentially how to build them
    • Running the simulation: how to run the case and approximate runtimes. This can include information on how to run a parameter study or similar.
    • Post-processing: how to visualize and (at least) qualitatively check the results
    • Background (optional): how the case was created or any other information
    • References (optional)
  • S.7 Names in the preCICE configuration follow the following conventions:
    • Participant names reflect the subdomain, not the solver, e.g. Fluid or Left-Muscle.
    • Participant, data, and mesh names start with uppercase and use - as separator.
    • Data names are in singular, e.g. Stress, Heat-Flux.
    • Mesh names concatenate the participant name and -Mesh, e.g. Fluid-Mesh.
      • Mesh names of participants with multiple interfaces contain the interface in the mesh name, e.g. Fluid-Upstream-Mesh. For meshes on which it is important to distinguish between face centers and face nodes (or similar), the modifier comes at the end, e.g. Fluid-Upstream-Mesh-Centers.
    • Watchpoint names should be describing the point, not be a generic name.
  • S.8 Any vertices defined through setMeshVertex or setMeshVertices need to be real locations in space and the data written to the mesh needs to be data located there, i.e., it is not allowed to decode any other information.
  • S.9 The case needs to have a DOI.
  • S.10 The case runs with released versions of preCICE and related components, without any modifications.

Gold

We consider an application case fulfilling all of these criteria as Reusable, reproducible, and integrated. We can integrate the case into our development workflows and make sure that we will not break it. Other users can easily reuse and extend the case for their own needs, including adding further solvers. All tooling works seamlessly.

  • G.1: The case is ready to be integrated into the preCICE system tests: It includes a metadata.yaml file, as described in the system tests documentation.
  • G.2: The case either includes or links to full results, including documented versions of all dependencies
  • G.3: If possible, there is a “coarse” variant of the case to run on a laptop.
  • G.4: There are exports to replay each participant with ASTE.