Meta's Movement SDK with Normcore

Hello, like mentioned previously, only the host character should have logic to drive the character. The client character should not contain any logic other than applying the pose that it receives over the network, which means that components that drive locomotion (such as the PlayerController) shouldn't be present on the client character. The pose that should be sent from the host should be the pose after all updates to the skeleton are done. To get the final pose, take the position and rotation of all of the bone transforms in the skeleton (i.e. Hips, Spine, Chest, UpperChest etc.) after all modifications to the skeleton are done (end of late update).

The pose data should be compressed and sent at a reasonable update rate, using networking optimization techniques. An article that explains some techniques can be found here: https://gafferongames.com/post/snapshot_compression/.

To summarize, the host performs all logic to make the character move, while the client has only the skinned mesh that is driven by the result of the host's work.

Hello, like mentioned previously, only the host character should have logic to drive the character. The client character should not contain any logic other than applying the pose that it receives over the network, which means that components that drive locomotion (such as the PlayerController) shouldn't be present on the client character. The pose that should be sent from the host should be the pose after all updates to the skeleton are done. To get the final pose, take the position and rotation of all of the bone transforms in the skeleton (i.e. Hips, Spine, Chest, UpperChest etc.) after all modifications to the skeleton are done (end of late update).

The pose data should be compressed and sent at a reasonable update rate, using networking optimization techniques. An article that explains some techniques can be found here: https://gafferongames.com/post/snapshot_compression/.

To summarize, the host performs all logic to make the character move, while the client has only the skinned mesh that is driven by the result of the host's work.

[RealtimeModel]
public partial class PoseModel {
    [RealtimeProperty(1, true)] private Vector3 _hipPosition;
    [RealtimeProperty(2, true)] private Quaternion _hipRotation;
    // Add more properties for other bones...
}

[RealtimeModel]
public partial class PoseModel {
    [RealtimeProperty(1, true)] private Vector3 _hipPosition;
    [RealtimeProperty(2, true)] private Quaternion _hipRotation;
    // Add more properties for other bones...
}

public class PoseSync : RealtimeComponent<PoseModel> {
    // Update the model when the game object changes
    private void LateUpdate() {
        model.hipPosition = /* Get hip position from the skeleton */;
        model.hipRotation = /* Get hip rotation from the skeleton */;
        // Update other bones...
    }

    // Update the game object when the model changes
    protected override void OnRealtimeModelReplaced(PoseModel previousModel, PoseModel currentModel) {
        if (currentModel != null) {
            /* Apply currentModel's pose data to the skeleton */;
        }
    }
}

public class PoseSync : RealtimeComponent<PoseModel> {
    // Update the model when the game object changes
    private void LateUpdate() {
        model.hipPosition = /* Get hip position from the skeleton */;
        model.hipRotation = /* Get hip rotation from the skeleton */;
        // Update other bones...
    }

    // Update the game object when the model changes
    protected override void OnRealtimeModelReplaced(PoseModel previousModel, PoseModel currentModel) {
        if (currentModel != null) {
            /* Apply currentModel's pose data to the skeleton */;
        }
    }
}