Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-20984

tst_macgui autotest is unstable

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • P2: Important
    • None
    • 4.8.2, 5.0.0, 5.2.1, 6.0
    • Widgets: Widgets and Dialogs
    • qtbase 8455b13feeb1441bc1b9d615ca8c67d8831c2d8c
      OSX 10.6, mac mini
      OSX_10.7
      cocoa port (not qpa)
    • macOS

    Description

      On consecutive repeated runs, this autotest sometimes fails and sometimes passes.

      8/18/11 1:50:55 PM EST: ********* Start testing of tst_MacGui *********
8/18/11 1:50:55 PM EST: Config: Using QTest library 5.0.0, Qt 5.0.0
8/18/11 1:50:55 PM EST: PASS   : tst_MacGui::initTestCase()
8/18/11 1:50:55 PM EST: FAIL!  : tst_MacGui::scrollbarPainting() 'isContent(pixmap.toImage(), verticalScrollbar.geometry(), GuiTester::Horizontal)' returned FALSE. ()
8/18/11 1:50:55 PM EST:    Loc: [tst_macgui.cpp(104)]
8/18/11 1:50:55 PM EST: PASS   : tst_MacGui::dummy()
8/18/11 1:50:55 PM EST: PASS   : tst_MacGui::splashScreenModality()
8/18/11 1:51:00 PM EST: PASS   : tst_MacGui::nonModalOrder()
8/18/11 1:51:00 PM EST: PASS   : tst_MacGui::spinBoxArrowButtons()
8/18/11 1:51:00 PM EST: PASS   : tst_MacGui::cleanupTestCase()
8/18/11 1:51:00 PM EST: Totals: 6 passed, 1 failed, 0 skipped
8/18/11 1:51:00 PM EST: ********* Finished testing of tst_MacGui *********
8/18/11 1:51:00 PM EST: QtQA::App::TestRunner: test failed, running again to see if it is flaky...
8/18/11 1:51:00 PM EST: ********* Start testing of tst_MacGui *********
8/18/11 1:51:00 PM EST: Config: Using QTest library 5.0.0, Qt 5.0.0
8/18/11 1:51:00 PM EST: PASS   : tst_MacGui::initTestCase()
8/18/11 1:51:00 PM EST: PASS   : tst_MacGui::scrollbarPainting()
8/18/11 1:51:05 PM EST: PASS   : tst_MacGui::dummy()
8/18/11 1:51:05 PM EST: PASS   : tst_MacGui::splashScreenModality()
8/18/11 1:51:05 PM EST: PASS   : tst_MacGui::nonModalOrder()
8/18/11 1:51:07 PM EST: PASS   : tst_MacGui::spinBoxArrowButtons()
8/18/11 1:51:07 PM EST: PASS   : tst_MacGui::cleanupTestCase()
8/18/11 1:51:07 PM EST: Totals: 7 passed, 0 failed, 0 skipped
8/18/11 1:51:07 PM EST: ********* Finished testing of tst_MacGui *********
8/18/11 1:51:07 PM EST: QtQA::App::TestRunner: test failed on first attempt and passed on second attempt!
8/18/11 1:51:07 PM EST: QtQA::App::TestRunner:   first attempt:  exited with exit code 1
8/18/11 1:51:07 PM EST: QtQA::App::TestRunner: the test seems to be flaky, please fix this
8/18/11 1:51:07 PM EST: make[4]: *** [check] Error 1

      Attachments

        Issue Links

          is required for

          Bug - A problem which impairs or prevents the functions of the product. QTQAINFRA-4348 macOS 10.15 still has insignificantTest flag in 6.0 branch

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Closed

          Task - A task that needs to be done. QTBUG-24131 Autotests for Qt 5.0 on OSX

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. QTBUG-26372 [autotests] tst_MacGui::spinBoxArrowButtons fails.

          • P3: Somewhat important - Should be fixed, but doesn't affect the release in any way.
          • Open
          replaces

          Bug - A problem which impairs or prevents the functions of the product. QTBUG-26371 [autotests] tst_MacGui::scrollbarPainting fails.

          • Not Evaluated - Not yet evaluated/prioritized
          • Closed
          For Gerrit Dashboard: QTBUG-20984
          # Subject Branch Project Status CR V
          3129,1 test: marked tst_macgui as insignificant master qt/qtbase Status: MERGED +2 0
          83698,1 increase timeouts to make tst_macgui autotest more stable 4.8 qt/qt Status: MERGED +2 0
          332928,3 Blacklist tst_macgui::scrollBarPainting() dev qt/qtbase Status: MERGED +2 0
          341343,2 Blacklist tst_macgui::scrollBarPainting() 6.1 qt/qtbase Status: MERGED +2 0
          341344,2 Remove QEXPECT_FAIL from passing test dev qt/qtbase Status: MERGED +2 0
          341397,2 Remove QEXPECT_FAIL from passing test 6.1 qt/qtbase Status: MERGED +2 0
          347641,2 Blacklist tst_macgui::scrollBarPainting() 6.0 qt/qtbase Status: MERGED +2 0

          Activity

            People

              richard Richard Moe Gustavsen
              rmcgover Rohan McGovern (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes