UML Testing Profile 2 Avatar
  1. OMG Specification

UML Testing Profile 2 — Open Issues

  • Acronym: UTP2
  • Issues Count: 24
  • Description: Issues not resolved
Open Closed All
Issues not resolved

Issues Descriptions

Empty sections shall be removed from the spec

  • Key: UMLTP23-61
  • Status: open  
  • Source: Fraunhofer FOKUS ( Mr. Marc-Florian Wendland)
  • Summary:

    The empty sections 8.7.1 Arbitration Specifications and section 8.7.1.1 Arbitration Facility are relicts from UTP 2.1. They should be removed from the editorial contents of the spec. This will cause a renumbering of current section 7.2 to 7.1 and current section 7.3 to 7.2. The renumbering affects all subsection of these two sections transitively.

  • Reported: UTP2 2.2 — Fri, 4 Oct 2024 08:26 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Make clear which elements are conceptually deprecated

  • Key: UMLTP23-48
  • Status: open  
  • Source: Fraunhofer FOKUS ( Mr. Marc-Florian Wendland)
  • Summary:

    The arbitration specification binding mechanism that was introduced in UTP 2.2 supersedes the former binding of arbitration specifications directly from the stereotypes. This direct binding is deprecated (since it does not scale) and should be marked as such. It should be kept nonetheless for backward compatibility

  • Reported: UTP2 2.2 — Thu, 26 Sep 2024 20:26 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Typo in caption of that section

  • Key: UMLTP23-49
  • Status: open  
  • Source: Fraunhofer FOKUS ( Mr. Marc-Florian Wendland)
  • Summary:

    The caption says "estSetArbitrationSpecification" but it should be "TestSetArbitrationSpecification".

  • Reported: UTP2 2.2 — Thu, 26 Sep 2024 20:51 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Icons used in the specification should be included for implementors

  • Key: UMLTP23-47
  • Status: open  
  • Source: Dassault Systemes ( Mr. Daniel Brookshier)
  • Summary:

    The icons for the stereotypes should be added to the specification as a non-normative attachment.
    Files for Icons would allow the specification to have a default set of common icons associated with the stereotypes, enabling users to use them without creating their own icons. This would also create a de facto style to aid in the adoption and consistency of implementations.

    Note that icons should be provided as SVG. There is also a mechanism to include these icons in the XMI, but the SVG should also be a zipped attachment to the public non-normative attachments.

  • Reported: UTP2 2.2 — Wed, 18 Sep 2024 14:48 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT
  • Attachments:


OMG UTP Graphics

  • Key: UMLTP23-29
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Graphics do not align between the UTP spec and the XMI.

  • Reported: UTP2 2.2b1 — Wed, 14 Aug 2024 21:59 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

TestObjective

  • Key: UMLTP23-20
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Why is the specification for TestObjective a value specification? What is the use case for making it a value specification versus a primitive string and are there any case studies/examples demonstrating the application of the an expression or opaque expression.

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:29 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Test Requirement

  • Key: UMLTP23-19
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Figure 7.2 seems to imply that test requirements are derived from System requirements. Can we clarify the relationship between SysML requirements and UTP test requirements?

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:27 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Schedule in Test Planning

  • Key: UMLTP23-18
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Test planning should incorporate schedule and budget. Should it have the equivalent of a Gantt chart? How do we incorporate a time phased approach and get that embedded into the standard? TestExecutionSchedule helps allude to schedule, but the spec would benefit from more thought on this.

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:25 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Data Stereotype

  • Key: UMLTP23-17
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Is there a missing stereotype for instances of data ? In the conceptual section there is a mention of actual data pool which would be an instance specification of the data pool or data partition

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:21 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

CompoundProceduralElements

  • Key: UMLTP23-16
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Given the constraints applied to the <<Alternative>> construct why would we not just simply have it extend the ConditionalNode instead of StructuredActivityNode?

    See section 8.5.2.3.1

    Same for <<Loop>> should be restricted to loop node metaclass

    <<Parallel>> seems to have a contradiction between the description and the constraint "Application in Activities
    In an Activity, «Parallel» must only be applied to SequenceNode". We think that this is meant to say a Conditional Node not a sequence node.

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:20 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

DRAS01

  • Key: UMLTP23-15
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    We feel that this definitional rule should be applied to the arbitration result not the specification. 

    DRAS01 It is necessary that an arbitration specification determines exactly one verdict.

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:17 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Relationship Between Test Case and Test Objective

  • Key: UMLTP23-14
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    We feel like there should be a relationship defined between a test case and a test objective in which the role is defined as "acceptanceCriteria" (this may be captured by the arbitration specifications and underlying expected response and check property actions) so perhaps a better role definition would be "testCaseObjective" or "goal". 

    Another idea is that if we make it best practice to use test objectives to capture initial requirement success criteria then the Arbitration Specification would refine or be a lower level of abstraction in some way.

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:16 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT
  • Attachments:

At most one precondition

  • Key: UMLTP23-12
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Why is it that there are definitional rules for limits number of preconditions to AT MOST one, couldn't there be more than one?

    There are definitional rules limiting the number of test levels and test types of a test context to AT MOST one,  think of scenarios where a test context may cover more than one type and level (the XMI shows the upper limit value to be * therefore not enforcing this rule).

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:12 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT
  • Attachments:

Test design technique structures

  • Key: UMLTP23-13
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    There are predefined test design techniques in the spec but don't have predefined test design technique structures to be the classifiers of the instances

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:14 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

DataProvider

  • Key: UMLTP23-10
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Believe there is an error in the definition here " 8.6.1.2.4 DataProvider
    Description DataProvider: A test component that is able to deliver (i.e., either select and/or generate) data according to a data specification.
    The stereotype «DataProvider» is a specialization of stereotype «TestComponent». Such a test component is used to provide a data partition, represented as a Constraint extended by the stereotype «DataPartition» (SHOULD READ classifier extended by <<Data Partition>>), by generating some new data or by selecting some existing data from another data partition or a data pool according to some data specifications (represented as a Constraint extended by the stereotype 
    «DataSpecification»)."

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:07 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Data pool and data partitions

  • Key: UMLTP23-11
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Morphing should be between data pool and data partitions for a true structure morphing mapping from one format of data to another, look into other OMG specifications to bridge concepts

    DRTD04 contradicts the definition of the constraint

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:09 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Test configurations and test items

  • Key: UMLTP23-8
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    How do we handle that a test item is a part of a particular system? How can we point to a part property of a composite structure? Can we use dot notation to say my test item is not just the type OpticalSensor but the UAV.PayloadCage.OpticalSensor ?

    Why does the UTP not specify InstanceSpecifications of test configurations?  Perhaps we handle this through the test log structure to have test log entries that are instances of test configurations.

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:03 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

DRTP04

  • Key: UMLTP23-9
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    It seems that this definitional rule should not be defined as a constraint on the test procedure but actually on the TestCase

    DRTP04: It is necessary that each test case invokes at least one test procedure as a main procedure invocation.

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 03:05 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Definitional Rules

  • Key: UMLTP23-6
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Definitional rules don't have unique identifiers in the spec. For clarification, it would be good for these not to have repeated numbers.

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 02:44 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT
  • Attachments:

Elements are found in the XMI file but not defined within the pdf spec

  • Key: UMLTP23-7
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    This was true for v2.1 but have not confirmed that they still exist in the xmi for v2.2

    The following elements are found in the XMI file but not defined within the pdf spec:

    • OpaqueProceduralElementArbitrationSpecification
    • ProceduralElementASBinding
    • TestCaseASBinding
    • TestSetASBinding
  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 02:50 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Arbitration result to testlogentry relationship

  • Key: UMLTP23-5
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Made the relationship between the arbitration result relationship to the testlogentry item, currently this is a directional relationship but made it a derived property specification for bidirectional linking therefore a tag value for verdict appears in every log entry type. We did this to make metachain queries in Cameo easier for generating a RVTM. 

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 02:42 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT
  • Attachments:

Test Case Stereotype

  • Key: UMLTP23-4
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Does SysmL2 drop the <<TestCase>> stereotype and to UTP2, or will it be maintained.  What’s the expectation between rectifying potential conflicts/confusion in using both in the same model?

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 02:38 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT

Verifies vs verify relationship

  • Key: UMLTP23-3
  • Status: open  
  • Source: Lockheed Martin ( Ms. Annemarie Kibbe)
  • Summary:

    Will SysML2 <<verify>> and UTP2 <<verifies>> stereotypes become the same eventually? This is a stereotype that seems like it could become the same in both specs if worked between groups. The different stereotypes lead to unnecessary complexity which hurts adoption for users trying to use both specs.

    Section 8.3.1.4.5 describes verifies.

  • Reported: UTP2 2.2b1 — Sat, 23 Dec 2023 02:25 GMT
  • Updated: Fri, 1 Nov 2024 01:16 GMT