Model Probability may depend on the broader context
-
Key: TDAI11-3
-
Status: open
-
Source: BAE SYSTEMS ( Mr. Simon Mettrick)
-
Summary:
The description of the modelProbability attribute in the Confidence class states that this relates to probability given model inputs. There are circumstances where this it would be appropriate for this to be conditional on the broader context as well (i.e. not just on those parameters that are model inputs).
This is about whether the case in point is representative of the training (or design space). Whilst an estimation could be made on how well represented the inputs were in the training set (e.g. are they near a corner case of which there are few prior examples), or it could be known that the current example is from a very different context (e.g. geographical location) from the training set. This would lead to model probability being set low on a somewhat different basis. -
Reported: TDAI 1.0 — Thu, 19 Dec 2024 16:52 GMT
-
Updated: Thu, 19 Dec 2024 16:52 GMT