Skip to content

Fix benchmark fails

Context

Many xfail on aidge_benchmark should be fixed. some issues come from

Some issues (attributes and dimensions checks) do not need to be fixed now as they will be fixed when these attributes are checked during each forward call.

Here is a list of issues to solve first

  • BitShift_Broadcasted
    • ".round": "inconsistent fail: assert False",
    • "big shift": "assert False"
  • ConstantOfShape
    • "n_dims.0": "Resizing output tensor to scalar (shape = ()) leads to undefined Tensor and failed ONNX export.",
  • FC
    • "expected_error.incompatible_types": "DID NOT RAISE <class 'Exception'>",
  • Hardmax
    • "expected_error.axis_oob": "Failed: DID NOT RAISE <class 'Exception'>"
  • Ln
    • "expected_error.zeros": "got log(0.00000000000000000001) instead of log(0.0)."
  • LRN
    • "ok": "TypeError: init(): incompatible constructor arguments. The following argument types are supported: aidge_core.aidge_core.LRNOp(size: typing.SupportsInt)",
    • "error": "TypeError: init(): incompatible constructor arguments. The following argument types are supported: aidge_core.aidge_core.LRNOp(size: typing.SupportsInt)",
  • MatMul
    • "dtype_mismatch": "DID NOT RAISE <class 'Exception'>",
  • MaxPool
    • "attributes.ceil_mode.flag.true": "inconsistent fail: assert False"
  • PaddedAvgPooling2D
    • "asymmetric_padding": "assert False",
    • "symmetric_padding": "assert False",
  • ReduceMean
    • "n_dims": "'axes' should be made an input to be compatible with opset > 10.",
    • "size": "'axes' should be made an input to be compatible with opset > 10.",
    • "axes": "'axes' should be made an input to be compatible with opset > 10.",
    • "keep_dims": "'axes' should be made an input to be compatible with opset > 10.",
    • "noop_with_empty_axes": "'axes' should be made an input to be compatible with opset > 10." ReduceSum
    • "n_dims": "'axes' should be made an input to be compatible with opset > 10.",
    • "size": "'axes' should be made an input to be compatible with opset > 10.",
    • "axes": "'axes' should be made an input to be compatible with opset > 10.",
    • "keep_dims": "'axes' should be made an input to be compatible with opset > 10.",
    • "noop_with_empty_axes": "'axes' should be made an input to be compatible with opset > 10.",
  • Scatter
    • ".overlap": "assert False",
    • "mul.no_overlap": "assert False",
    • "min.no_overlap": "assert False",
    • "add.no_overlap": "assert False",
    • "mul.no_overlap": "assert False",
    • "max.no_overlap": "assert False",
    • "expected_error.axis.0.none.overlap": "Should raise an exception",
    • "expected_error.axis.1.none.overlap": "Should raise an exception",
    • "expected_error.axis.2.none.overlap": "Should raise an exception",
    • "expected_error.axis_oob": "Should raise an exception",
  • Slice
    • "ok.all_axes_unit_steps": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "ok.omit.axes": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "ok.omit.steps": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "ok.negative_indexes.axes": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "ok.negative_indexes.indices": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "ok.reverse_step_axis1": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "ok.stride_2_axis2": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "ok.mixed_reverse_and_stride2": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "expected_error.axes_oob.positive": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "expected_error.axes_oob.negative": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "expected_error.step_zero_forbidden": "incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "expected_error.length_mismatch.starts_ends": "Fail for bad reasons. Incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "expected_error.length_mismatch.axes": "Fail for bad reasons. Incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "expected_error.length_mismatch.steps": "Fail for bad reasons. Incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "expected_error.axes_repeated": "Fail for bad reasons. Incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
    • "expected_error.starts_ends_not_1d": "Fail for bad reasons. Incompatible constructor for operator. It should accept 'start' and 'end' as external inputs.",
Edited by Maxence Naud