Skip to content

Add support for the CTRACK benchmarking tool and instrument the Ensemble-Stat tool to report metrics #3065

@bikegeek

Description

@bikegeek

Describe the Task

Utilize a benchmarking tool to generate benchmarking/performance metrics when running the ensemble stat tool.

Provide support for:

  • Running multiple METplus use cases
  • Running a single MET command line command
  • Save output generated by the benchmarking tool into a consolidated file (.csv and .txt)
  • Allow user to determine how many times the ensemble stat tool is to be run
  • Create output files that have the timestamp of when the benchmarking was performed

Time Estimate

1-2 weeks

Sub-Issues

Consider breaking the task down into sub-issues.

  • Identify tool for generating benchmarking metrics
  • Obtain data and METplus configuration files for development
  • create support for running multiple METplus use cases
  • create support for running MET ensemble stat tool
  • document background information on the benchmarking tool and how it is set up and used.

Relevant Deadlines

end of period of performance is January 31, 2025

Funding Source

2771024 (AF)

Define the Metadata

Assignee

  • Select **engineer(s)**Minna Win
  • Select scientist(s) Michelle Harrold

Labels

  • Review default alert labels
  • Select component(s)
  • Select priority
  • Select requestor(s)

Milestone and Projects

  • Select Milestone as a MET-X.Y.Z version, Consider for Next Release, or Backlog of Development Ideas
  • For a MET-X.Y.Z version, select the MET-X.Y.Z Development project

Define Related Issue(s)

Consider the impact to the other METplus components.

Task Checklist

See the METplus Workflow for details.

  • Complete the issue definition above, including the Time Estimate and Funding Source.
  • Fork this repository or create a branch of develop.
    Branch name: feature_<Issue Number>_<Description>
  • Complete the development and test your changes.
  • Add/update log messages for easier debugging.
  • Add/update unit tests.
  • Add/update documentation.
  • Push local changes to GitHub.
  • Submit a pull request to merge into develop.
    Pull request: feature <Issue Number> <Description>
  • Define the pull request metadata, as permissions allow.
    Select: Reviewer(s) and Development issue
    Select: Milestone as the next official version
    Select: MET-X.Y.Z Development project for development toward the next official release
  • Iterate until the reviewer(s) accept and merge your changes.
  • Delete your fork or branch.
  • Close this issue.

Metadata

Metadata

Type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions