Skip to content

[ARM] Unit test failure on Neoverse-N1 - CPUReproTests.test_lstm_packed #146483

@robert-hardwick

Description

@robert-hardwick

🐛 Describe the bug

We see this test failure on Neoverse-N1. inductor/test_cpu_repro tests are not currently enabled on CI. I have made some comments in #146479 with suggestion to mark failing tests on Aarch64 in test/inductor/test_cpu_repro.py as skipped.

AssertionError: False is not true

To execute this test, run the following from the base repo dir:
    python test/inductor/test_cpu_repro.py CPUReproTests.test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_7

This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
Traceback (most recent call last):
  File "/var/lib/jenkins/workspace/test/inductor/test_cpu_repro.py", line 607, in test_lstm_packed
    self._test_lstm_packed(
  File "/opt/conda/envs/py_3.10/lib/python3.10/unittest/mock.py", line 1379, in patched
    return func(*newargs, **newkeywargs)
  File "/opt/conda/envs/py_3.10/lib/python3.10/contextlib.py", line 79, in inner
    return func(*args, **kwds)
  File "/opt/conda/envs/py_3.10/lib/python3.10/contextlib.py", line 79, in inner
    return func(*args, **kwds)
  File "/opt/conda/envs/py_3.10/lib/python3.10/contextlib.py", line 79, in inner
    return func(*args, **kwds)
  [Previous line repeated 1 more time]
  File "/var/lib/jenkins/workspace/test/inductor/test_cpu_repro.py", line 558, in _test_lstm_packed
    self.assertTrue("aten.mkldnn_rnn_layer" in code)
  File "/opt/conda/envs/py_3.10/lib/python3.10/unittest/case.py", line 687, in assertTrue
    raise self.failureException(msg)
AssertionError: False is not true

Versions

Seen at pytorch commit = 354fe48 on Neoverse-N1. But unable to reproduce on torch 2.5. Will run again and run collect.py for complete environment data.

cc @mruberry @ZainRizvi @malfet @snadampal @milpuz01 @chauhang @penguinwu

Metadata

Metadata

Assignees

No one assigned

    Labels

    module: armRelated to ARM architectures builds of PyTorch. Includes Apple M1module: testsIssues related to tests (not the torch.testing module)oncall: cpu inductorCPU Inductor issues for Intel team to triageoncall: pt2

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions