Update skeleton_kinematics.md

docs/animation/skeleton_kinematics.md

@@ -8,15 +8,15 @@ permalink: /animation/skeleton_kinematics
 
 A `Skeleton`(defined in `scene/skeleton.h`) is what we use to drive our animation. You can think of them like the set of bones we have in our own bodies and joints that connect these bones. For convenience, we have merged the bones and joints into the `Joint` class which holds the orientation of the joint relative to its parent as euler angle in its `pose`, and `extent` representing the direction and length of the bone with respect to its parent `Joint`. Each `Mesh` has an associated `Skeleton` class which holds a rooted tree of `Joint`s, where each `Joint` can have an arbitrary number of children.
 
-All of our joints are ball `Joint`s which have a set of 3 rotations around the <img src=task2_media/0027.png height="20">, <img src=task2_media/0028.png height="20">, and <img src=task2_media/0029.png height="20"> axes, called _Euler angles_. Whenever you deal with angles in this way, a fixed order of operations must be enforced, otherwise the same set of angles will not represent the same rotation. In order to get the full rotational transformation matrix, <img src=task2_media/0030.png height="20">, we can create individual rotation matrices around the<img src=task2_media/0031.png height="20">, <img src=task2_media/0032.png height="20">, and <img src=task2_media/0033.png height="20"> axes, which we call <img src=task2_media/0034.png height="20">, <img src=task2_media/0035.png height="20">, and <img src=task2_media/0036.png height="20"> respectively. The particular order of operations that we adopted for this assignment is that <img src=task2_media/0037.png height="20">.
+All of our joints are ball `Joint`s which have a set of 3 rotations around the <img src="task2_media/0027.png" height="20">, <img src="task2_media/0028.png" height="20">, and <img src="task2_media/0029.png" height="20"> axes, called _Euler angles_. Whenever you deal with angles in this way, a fixed order of operations must be enforced, otherwise the same set of angles will not represent the same rotation. In order to get the full rotational transformation matrix, <img src="task2_media/0030.png" height="20">, we can create individual rotation matrices around the<img src="task2_media/0031.png" height="20">, <img src="task2_media/0032.png" height="20">, and <img src="task2_media/0033.png" height="20"> axes, which we call <img src="task2_media/0034.png" height="20">, <img src="task2_media/0035.png" height="20">, and <img src="task2_media/0036.png" height="20"> respectively. The particular order of operations that we adopted for this assignment is that <img src="task2_media/0037.png" height="20">.
 
 ### Forward Kinematics
 
 _Note: These diagrams are in 2D for visual clarity, but we will work with a 3D kinematic skeleton._
 
-When a joint's parent is rotated, that transformation should be propagated down to all of its children. In the diagram below, <img src=task2_media/0038.png height="20"> is the parent of <img src=task2_media/0039.png height="20"> and <img src=task2_media/0040.png height="20"> is the parent of <img src=task2_media/0041.png height="20">. When a translation of <img src=task2_media/0042.png height="20"> and rotation of <img src=task2_media/0043.png height="20"> is applied to <img src=task2_media/0044.png height="20">, all of the descendants are affected by this transformation as well. Then, <img src=task2_media/0045.png height="20"> is rotated by <img src=task2_media/0046.png height="20"> which affects itself and <img src=task2_media/0047.png height="20">. Finally, when rotation of <img src=task2_media/0048.png height="20"> is applied to <img src=task2_media/0049.png height="20">, it only affects itself because it has no children.
+When a joint's parent is rotated, that transformation should be propagated down to all of its children. In the diagram below, <img src="task2_media/0038.png" height="20"> is the parent of <img src="task2_media/0039.png" height="20"> and <img src="task2_media/0040.png" height="20"> is the parent of <img src="task2_media/0041.png" height="20">. When a translation of <img src="task2_media/0042.png" height="20"> and rotation of <img src="task2_media/0043.png" height="20"> is applied to <img src="task2_media/0044.png" height="20">, all of the descendants are affected by this transformation as well. Then, <img src="task2_media/0045.png" height="20"> is rotated by <img src="task2_media/0046.png" height="20"> which affects itself and <img src="task2_media/0047.png" height="20">. Finally, when rotation of <img src="task2_media/0048.png" height="20"> is applied to <img src="task2_media/0049.png" height="20">, it only affects itself because it has no children.
 
-<img src=task2_media/forward_kinematic_diagram.jpg>
+<img src="task2_media/forward_kinematic_diagram.jpg">
 
 You need to implement these routines in `student/skeleton.cpp` for forward kinematics.
 
@@ -48,37 +48,37 @@ Note that the skeleton does not yet influence the geometry of the cube in this s
 
 #### Single Target IK
 
-Now that we have a logical way to move joints around, we can implement Inverse Kinematics, which will move the joints around in order to reach a target point. There are a few different ways we can do this, but for this assignment we'll implement an iterative method called gradient descent in order to find the minimum of a function. For a function <img src=task2_media/0050.png height="20">, we'll have the update scheme:
+Now that we have a logical way to move joints around, we can implement Inverse Kinematics, which will move the joints around in order to reach a target point. There are a few different ways we can do this, but for this assignment we'll implement an iterative method called gradient descent in order to find the minimum of a function. For a function <img src="task2_media/0050.png" height="20">, we'll have the update scheme:
 
-<img src=task2_media/0051.png height="20">
+<img src="task2_media/0051.png" height="20">
 
-Where <img src=task2_media/0052.png height="9"> is a small timestep. For this task, we'll be using gradient descent to find the minimum of the cost function:
+Where <img src="task2_media/0052.png" height="9"> is a small timestep. For this task, we'll be using gradient descent to find the minimum of the cost function:
 
-<img src=task2_media/0053.png>
+<img src="task2_media/0053.png">
 
-Where <img src=task2_media/0054.png height="20"> is the position in world space of the target joint, and <img src=task2_media/0055.png height="20"> is the position in world space of the target point.
+Where <img src="task2_media/0054.png" height="20"> is the position in world space of the target joint, and <img src="task2_media/0055.png" height="20"> is the position in world space of the target point.
 
 More specifically, we'll be using a technique called Jacobian Transpose, which relies on the assumption that:
 
-<img src=task2_media/0056.png height="20">
+<img src="task2_media/0056.png" height="20">
 
 Where:
 
-*   <img src=task2_media/0057.png height="14"> (n x 1) is the function <img src=task2_media/0058.png height="19">, where <img src=task2_media/0059.png height="19"> is the angle of joint <img src=task2_media/0060.png height="14"> around the axis of rotation
-*   <img src=task2_media/0061.png height="9"> is a constant
-*   <img src=task2_media/0062.png height="16"> (3 x n) is the Jacobian of <img src=task2_media/0063.png height="14">
+*   <img src="task2_media/0057.png" height="14"> (n x 1) is the function <img src="task2_media/0058.png" height="19">, where <img src="task2_media/0059.png" height="19"> is the angle of joint <img src="task2_media/0060.png" height="14"> around the axis of rotation
+*   <img src="task2_media/0061.png" height="9"> is a constant
+*   <img src="task2_media/0062.png" height="16"> (3 x n) is the Jacobian of <img src="task2_media/0063.png" height="14">
 
-Note that here <img src=task2_media/0064.png height="9"> refers to the number of joints in the skeleton. Although in reality this can be reduced to just the number of joints between the target joint and the root, inclusive, because all joints not on that path should stay where they are, so their columns in <img src=task2_media/0065.png height="16"> will be 0\. So <img src=task2_media/0066.png height="9"> can just be the number of joints between the target and the root, inclusive. Additionally note that since this will get multiplied by <img src=task2_media/0067.png height="9"> anyways, you can ignore the value of <img src=task2_media/0068.png height="9">, and just consider the timestep as <img src=task2_media/0069.png height="18">.
+Note that here <img src="task2_media/0064.png" height="9"> refers to the number of joints in the skeleton. Although in reality this can be reduced to just the number of joints between the target joint and the root, inclusive, because all joints not on that path should stay where they are, so their columns in <img src="task2_media/0065.png" height="16"> will be 0\. So <img src="task2_media/0066.png" height="9"> can just be the number of joints between the target and the root, inclusive. Additionally note that since this will get multiplied by <img src="task2_media/0067.png" height="9"> anyways, you can ignore the value of <img src="task2_media/0068.png" height="9">, and just consider the timestep as <img src="task2_media/0069.png" height="18">.
 
-Now we just need a way to calcluate the Jacobian of <img src=task2_media/0070.png height="14">. For this, we can use the fact that:
+Now we just need a way to calcluate the Jacobian of <img src="task2_media/0070.png" height="14">. For this, we can use the fact that:
 
-<img src=task2_media/0071.png height="20">
+<img src="task2_media/0071.png" height="20">
 
 Where:
 
-*   <img src=task2_media/0072.png height="16"> is the <img src=task2_media/0073.png height="16"> column of <img src=task2_media/0074.png height="19">
-*   <img src=task2_media/0075.png height="14"> is the axis of rotation
-*   <img src=task2_media/0076.png height="16"> is the vector from the base of joint <img src=task2_media/0077.png height="14"> to the end point of the target joint
+*   <img src="task2_media/0072.png" height="16"> is the <img src="task2_media/0073.png" height="16"> column of <img src="task2_media/0074.png" height="19">
+*   <img src="task2_media/0075.png" height="14"> is the axis of rotation
+*   <img src="task2_media/0076.png" height="16"> is the vector from the base of joint <img src="task2_media/0077.png" height="14"> to the end point of the target joint
 
 For a more in-depth derivation of Jacobian transpose (and a look into other inverse kinematics algorithms), please check out [this presentation](https://web.archive.org/web/20190501035728/https://autorob.org/lectures/autorob_11_ik_jacobian.pdf). (Pages 45-56 in particular)
 
@@ -88,13 +88,13 @@ Now, all of this will work for updating the angle along a single axis, but we ha
 
 We'll extend this so we can have multiple targets, which will then use the function to minimize:
 
-<img src=task2_media/0078.png>
+<img src="task2_media/0078.png">
 
 which is a simple extension actually. Since each term is independent and added together, we can get the gradient of this new cost function just by summing the gradients of each of the constituent cost functions!
 
 You should implement multi-target IK, which will take a `vector` of `IK_Handle*`s called `active_handles` which stores the information a target point for a joint. See `scene/skeleton.h` for the definition of `IK_Handle` structure.
 
-In order to implement this, you should update `Joint::compute_gradient` and `Skeleton::step_ik`. `Joint::compute_gradient` should calculate the gradient of <img src=task2_media/0079.png height="14"> in the x,y, and z directions, and add them to `Joint::angle_gradient` for all relevant joints. `Skeleton::step_ik` should actually do the gradient descent calculations and update the `pose` of each joint. In this function, you should probably use a very small timestep, but do several iterations (say, 10s to 100s) of gradient descent in order to speed things up. For even faster and better results, you can also implement a variable timestep instead of just using a fixed one. Note also that the root joint should never be updated.
+In order to implement this, you should update `Joint::compute_gradient` and `Skeleton::step_ik`. `Joint::compute_gradient` should calculate the gradient of <img src="task2_media/0079.png" height="14"> in the x,y, and z directions, and add them to `Joint::angle_gradient` for all relevant joints. `Skeleton::step_ik` should actually do the gradient descent calculations and update the `pose` of each joint. In this function, you should probably use a very small timestep, but do several iterations (say, 10s to 100s) of gradient descent in order to speed things up. For even faster and better results, you can also implement a variable timestep instead of just using a fixed one. Note also that the root joint should never be updated.
 
 A key thing for this part is to _remember what coordinate frame you're in_, because if you calculate the gradients in the wrong coordinate frame or use the axis of rotation in the wrong coordinate frame your answers will come out very wrong!