Skip to 0 minutes and 7 secondsWelcome back. We have now seen that we can model shape variation by modelling deformations using a Gaussian Process. In this video, we'll show you how you can use example data to estimate the mean and the covariance function of such a Gaussian Process.
Skip to 0 minutes and 29 secondsWe have started with the reference shape gamma r.
Skip to 0 minutes and 36 secondsWe have seen how any shape gamma can be obtained by moving the points of this reference shape.
Skip to 0 minutes and 46 secondsWe notice that by construction, the target shape gamma will be described by the same number of points as the reference shape. Furthermore, we find, for each point of the reference shape, the corresponding point in the shape gamma. We say that the shapes are in correspondence or that u establishes correspondence between the two shapes.
Skip to 1 minute and 14 secondsIf we have a set of shapes that are in correspondence, we can easily compare them and use them to compute statistics. Consider, for example, the point at the tip of the thumb. We can find that point in all the example shapes.
Skip to 1 minute and 40 secondsAnd we can observe its deformation in all the examples.
Skip to 1 minute and 56 secondsNow, what we can do is we can compute the average deformation at this point. We could even go further and we could estimate correlations from these examples. This can be done by taking a second point.
Skip to 2 minutes and 27 secondsSimilarly, we can take these deformation and estimate from them the correlations.
Skip to 2 minutes and 36 secondsWith these ideas, we can compute our first mean and covariance function for the Gaussian Process model. If we are given n deformations here, we can estimate from these deformations the mean and the covariance using the standard formulas for the sample mean and the sample covariance from basic statistics.
Skip to 3 minutes and 4 secondsLet us summarise how we build a shape model. We first select a reference shape. We find deformations from the hand to the example data. This gives us correspondence.
Skip to 3 minutes and 21 secondsWe then estimate the mean and the covariance function. We define a Gaussian Process using the estimated parameters.
Skip to 3 minutes and 32 secondsAs the u here in this formula is a probabilistic quantity, so is the shape that it generates. So this gamma in this formula is actually a probabilistic description of a shape. Congratulations. Now, you know how to build a shape model. As a first result, we see here the average hand shape.
Skip to 4 minutes and 1 secondThis simple procedure is everything that is needed to build the most important class of statistical shape model as they are currently used in research and industry.
Skip to 4 minutes and 14 secondsThe only important point that we have not discussed here is how we get these deformations that relates the reference shape to the example shapes. We will come back to this question towards the end of the course.
Learning a model from example data
It is very difficult to explicitly model the shape variations that define a shape family. Fortunately, we can still obtain very powerful shape models, by learning the typical deformations that occur within a shape family from a set of normal example shapes.
In this video we will explain what it means for shapes to be in correspondence, and how this helps us to learn shape variations from data. At the end of this video you will be familiar with the most popular type of shape models currently used in science and industry.
© University of Basel