[WIP] RPM4Godot4 Design status and issues

[GeorgeS2019]

• rpm-unity-sdk-core

Once there is a growth in the usage of RPM in Godot4, there may be a need for the avatar creator and customization in Godot4.

• RPM-Smart-NPC

Right now, we have OpenAI (TTS, STT) addons in Godot4, demonstrating it with more advanced features are feasible

• How to sync a Ready Player Me avatar over the network, with coherence
• metapress-plugin-rpm

We now have Godot4 RPM addon

• ReadyPlayerMe_BodyTracking
  https://youtu.be/puLAC1DB_nQ
  

• RPM TalkingHead

This is high in priority (in my view), next after having Godot4 RPM addon
We have Godot4 Mediapipe with c# wrapper with complete FacialLandmark captures which could be used to drive facial animation
However, what is demonstrated here is still missing in Godot4. A more complex text to lipsync that is worth evaluating.
Alignment with Text2Speech with lipsync and facial expression

• Multiple-Full-Body-Tracking-With-Fully-customizable-Avatar-Using-ZED-2i-Camera

Now it is possible to stream multiple different animation providers to RPM in Godo4