Understanding the WinRunner Report View Results Window - WinRunner

If you have worked with previous versions of WinRunner, and you are not analyzing the results of a called QuickTest test, you may feel more comfortable using WinRunner report view.

To view the WinRunner report, choose Tools > General Options. In the Run category, confirm that WinRunner report view is selected.

Note :By default, the WinRunner report is displayed and unified report files are created so that you can choose to view the Unified report for the test run at a later time. If you do not want WinRunner to generate unified report files, clear the Generate unified report information option.

To open the Test Results window, choose Tools > Test Results or click the Test Results button. The WinRunner Test Results window opens in the WinRunner report view.

Understanding the WinRunner Report View Results Window

Test Name

The Test Results title bar displays the full path of the test.

Menu Bar and Toolbar

The menu bar contains the options that you can use to analyze the test results. Several of these options can also be performed using the corresponding Test Results toolbar button, as indicated below.

  • File menu—Contains options for opening, closing, and printing test results, and exiting the Test Results window.
  • Open—Enables you to select a test and open the most recent results for that test.
  • Close—Closes the active test results window.
  • Print—Opens the Print dialog box, enabling you to print a text-only version of the information displayed in the test summary and test log panes.
  • Exit—Exits the WinRunner Test Results viewer.
  • Options menu—Contains options for viewing and analyzing specific elements of the test results.
  • Filters—Opens the Filters dialog box, which enables you to select which events are included in the test log.
  • Bitmap Controls—Opens the Bitmap Controls dialog box, which enables you to select which images to include in the bitmaps display for bitmap checkpoints. For more information, see “Analyzing the Results of a Bitmap Checkpoint”
  • Show TSL—Opens the WinRunner test in the WinRunner window (if it is not already open) and highlights the line in the WinRunner test corresponding to the results line currently selected in the test log.
  • Display—Opens the results details for the currently selected line in the test log. Choosing this option is equivalent to double-clicking the line in the test log.
  • Update—Updates the expected data for the selected bitmap, GUI, or database checkpoint to match the actual results of the selected checkpoint. Enabled only when a failed bitmap, GUI, or database checkpoint is selected.
  • Mismatches Only—Hides bitmap, database, and GUI checkpoint events with Pass or OK status. This option does not affect property checks or other non-checkpoint events.
  • Tools menu—Contains options for generating text-only results files and reporting defects to TestDirector.
  • Text Report—Generates and displays a text-only version of the test results for the active test results window.
  • Report Bug—Reports a bug for the selected event in the test log to the TestDirector project to which you are currently connected.(This option is enabled only when you are connected to a TestDirector project).
  • Window menu—Contains options for opening additional test results windows and arranging them within the main Test Results window.
  • New Window—Opens a new Test Results window containing a copy of the results of the currently active results window. To view the results for a different run of the displayed results, select the results name from the Results location box.
  • Cascade—Displays all open Test Results windows in a cascading display.
  • Tile—Horizontally tiles all open Test Results windows.
  • Arrange Icons—Arranges minimized test results icons in the Test Results window.

Results Location

The results location box enables you to choose which results to display for the test. You can view the expected results (exp) or the actual results for a specified test run.

Test Tree

The test tree shows all tests executed during the test run. The first test in the tree is the calling test. Tests below the calling test are called tests. To view the results of a test, click the test name in the tree.

Test Summary

The following information appears in the test summary:

  • Test Results
  • Indicates whether the test passed or failed. For a batch test, this refers to the batch test itself and not to the tests that it called. Double-click the Test Result branch in the tree to view the following details:

    Total number of bitmap checkpoints: The total number of bitmap checkpoints that occurred during the test run. Double-click to view a detailed list of the checkpoints. Each listing contains important information about the checkpoint. For example:

    Test Summary

    provides the following information:

    Test Summary

    Double-click the bitmap checkpoint listing to display the contents of the bitmap checkpoint.

    Total number of GUI checkpoints: The total number of GUI and database checkpoints that occurred during the test run.

    NoteUnlike the Unified report view, the WinRunner report view does not count single-property checks in the GUI checkpoint summary. Therefore, the total number of GUI checkpoints in the WinRunner report view may differ from the number displayed in the Unified report view.

    Double-click to view a detailed list of the checkpoints. For example, the elements in the listing

    gui1:4 checkpt_loop (12)

    have the following meanings:

    Total number of GUI checkpoints

    Double-click the detailed description of the GUI checkpoint to display the GUI Checkpoint Results dialog box for that checkpoint.

  • General Information

Double-click the General Information icon to view the following test details:

Date: The date and time of the test run.

Operator Name: The name of the user who ran the test.

Expected Results Folder: The name of the expected results folder used for comparison by the GUI and bitmap checkpoints.

Total Run Time: Total time (hr:min:sec) that elapsed from start to finish of the test run.

Test Log

The test log provides detailed information on every major event that occurred during the test run. These include the start and termination of the test, GUI and bitmap checkpoints, file comparisons, changes in the progress of the test flow, changes to system variables, displayed report messages, calls to other tests, and run time errors.

  • A row describing a mismatch or failure appears in red; a row describing a successful event appears in green.
  • The Line column displays the line number in the test script at which the event occurs.
  • The Event column describes the event, such as the start or end of a checkpoint or of the entire test.
  • The Details column provides specific information about the event, such as the name of the test (for starting or stopping a test), the name of the expected results file (for a checkpoint), or a message (for a tl_step statement).
  • The Result column displays whether the event passed or failed, if applicable.
  • The Time column displays the amount of time elapsed (in hours:minutes:seconds) from when the test started running until the start of the event.

Double-click the event in the log to view the following information:

  • For a bitmap checkpoint, you can view the expected bitmap and the actual bitmap captured during the run. If a mismatch was detected, you can also view an image showing the differences between the expected and actual bitmaps.
  • For a GUI checkpoint, you can view the results in a table. The table lists all the GUI objects included in the checkpoint and the results of the checks for each object.
  • For a file comparison, you can view the two files that were compared to each other. If a mismatch was detected, the non-matching lines in the files are highlighted.
  • For a call to another test in batch mode, you can view whether the call statement passed. Note that even though a call statement is successful, the called test itself may fail, based on the usual criteria for tests failing. You can set criteria for failing a test in the Run > Settings category of the General Options dialog box. For additional information, see “Setting Global Testing Options.”

All rights reserved © 2018 Wisdom IT Services India Pvt. Ltd DMCA.com Protection Status

WinRunner Topics