Skip to content

Conversation

jcwchen
Copy link
Member

@jcwchen jcwchen commented May 17, 2022

Description
Currently ONNX only tests test_driver_gtests on Linux and Mac. We should enable the test on Windows as well

  • Enable test_driver.cc on Windows
  • Add test command in Windows-CI

Motivation and Context
Closes #4200.

Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen jcwchen added topic: test module: CI pipelines Issues related to the CI pipeline run release CIs Use this label to trigger release tests in CI labels May 17, 2022
@jcwchen jcwchen requested review from a team as code owners May 17, 2022 15:58
@@ -206,6 +198,11 @@ ResolvedTestCase LoadSingleTestCase(const UnsolvedTestCase& t) {
std::string input_data;
ONNX_NAMESPACE::ValueInfoProto input_info;
LoadSingleFile(input_file, input_data);
if (test_data_counter >= st.model_.graph().input().size()) {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nip: shall we take into consideration on feed name and check all model's required inputs get mapped to from the feed?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't quite understand -- what kind of feed name you were saying? If you were saying input/output names, then ONNX uses naming like input_X.pb and output_X.pb for input/output files. If added .pb files do not follow this naming, other CIs will catch this kind of error (during test generation). For here, I believe it will simply fail due to unfound data. I added the size check here, because previously wrong test data size will lead to segmentation fault (access out of range), which is not acceptable.

Copy link
Member Author

@jcwchen jcwchen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@onnx/sig-operators-approvers Could you please review/approve this PR? Thank you for your time!

@@ -206,6 +198,11 @@ ResolvedTestCase LoadSingleTestCase(const UnsolvedTestCase& t) {
std::string input_data;
ONNX_NAMESPACE::ValueInfoProto input_info;
LoadSingleFile(input_file, input_data);
if (test_data_counter >= st.model_.graph().input().size()) {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't quite understand -- what kind of feed name you were saying? If you were saying input/output names, then ONNX uses naming like input_X.pb and output_X.pb for input/output files. If added .pb files do not follow this naming, other CIs will catch this kind of error (during test generation). For here, I believe it will simply fail due to unfound data. I added the size check here, because previously wrong test data size will lead to segmentation fault (access out of range), which is not acceptable.

@jcwchen
Copy link
Member Author

jcwchen commented Sep 15, 2022

Close it since the files do not exist after the deprecation of ONNXIFI.

@jcwchen jcwchen closed this Sep 15, 2022
@jcwchen jcwchen deleted the jcw/fix-test-driver-win branch September 15, 2022 16:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module: CI pipelines Issues related to the CI pipeline run release CIs Use this label to trigger release tests in CI topic: test
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

onnxifi_test_driver_gtests onnx/backend/test/data/node is missing on Windows
2 participants