Skip to content

Conversation

jcwchen
Copy link
Member

@jcwchen jcwchen commented Mar 7, 2023

Description

Add ONNX Runtime tests in CI pipelines with installed ONNX Runtime.

Motivation and Context

Currently these are some new tests which need installed onnxruntime. Add a section in release CI pipelines to run these tests with installed onnxruntime.

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
@jcwchen jcwchen added topic: test module: CI pipelines Issues related to the CI pipeline labels Mar 7, 2023
@jcwchen jcwchen requested a review from a team as a code owner March 7, 2023 00:04
@jcwchen jcwchen added the run release CIs Use this label to trigger release tests in CI label Mar 7, 2023
jcwchen added 3 commits March 6, 2023 16:21
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
jcwchen added 5 commits March 7, 2023 07:45
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
@jcwchen jcwchen changed the title Add ONNX Runtime tests in CI pipelines with installed ONNX Runtime [WIP] Add ONNX Runtime tests in CI pipelines with installed ONNX Runtime Mar 8, 2023
jcwchen added 2 commits March 8, 2023 09:27
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
@jcwchen jcwchen changed the title [WIP] Add ONNX Runtime tests in CI pipelines with installed ONNX Runtime Add ONNX Runtime tests in CI pipelines with installed ONNX Runtime Mar 8, 2023
@jcwchen jcwchen requested a review from xadupre March 16, 2023 23:02
jcwchen added 4 commits March 17, 2023 16:31
… ORT

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
@jcwchen jcwchen requested a review from xadupre March 21, 2023 16:21
@jcwchen jcwchen merged commit d9f7739 into onnx:main Mar 21, 2023
@jcwchen jcwchen deleted the jcw/add-ort-ci branch March 21, 2023 20:20
broune pushed a commit to broune/onnx that referenced this pull request May 6, 2023
…nnx#4966)

* Add ONNX Runtime tests in CI pipelines with installed ONNX Runtime

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* unittest test_with_ort

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* skip unsupported ONNX ir by ORT

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* skip tests correctly

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* install onnx from source

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* introduce max supported opset version

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* fix lint

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* refactor test_with_ort

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* black

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* use make_model_gen_version to cover more test cases when IR bumps

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* fix lint

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* use env variables instead of helper.py for max supported version from ORT

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* add missing

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* string to int

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* set env variables in CIs

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

---------

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module: CI pipelines Issues related to the CI pipeline run release CIs Use this label to trigger release tests in CI topic: test
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants