Cross Platform Screen Sharing

[DarshanSahay]

Hello @icywind , Yesterday I opened an issue describing the cross platform issue. The way I have implemented the screen sharing for webgl is through (RtcEngine.StartScreenCaptureForWeb) but this doesn't work with android platform. I saw on agora official site that they have a separate way of implementing the screen share. So I believe the data is being shared but not being displayed on Android since the voice chat feature is working fine.
Please let me know how should I approach this.

[icywind]

Hi @DarshanSahay, I am trying to be clear what the actual need is here. Did you mean the video doesn't show up on Android devices at all or did you mean you tried to call StartScreenCaptureForWeb on Android platform?
If it is latter, no, that's not gonna work. As the name implies, this API is written for invoking the browser's screensharing capabilities. For background knowledge, the WebGL SDK is based on the legacy Agora RTC SDK v3.x, which doesn't include native ScreenSharing capability. You'll get that in the current V4 version (demo code). But WebGL is not yet supported for V4. So it is a decision you'll make to see if you want to mix two SDKs for now (and wait for WebGL v4 comes out to match the APIs). Or, if you planned to stick with V3, you can refer to the screen buffer way to implement the screensharing on Android. You can refer to the legacy sample code for that.

[DarshanSahay]

Hello sir , Thanks for replying.

As for the above stated problem, I called the StartScreenCaptureForWeb method on webgl which later adds the VideoSurface component on other users who are also on webgl to see the screenshare. The same happens for android platform but the screenshare is not visible there.
I saw on API's examples that a video surface accompanied by its initialization is needed for screen share but it doesn't seems to work in my case. What am I doing wrong?
All I want to do is display my webgl screenshare on android as well. Webgl to webgl screensharing works perfectly.

[icywind]

I still don't understand what you did for Android exactly. The same StartScreenCaptureForWeb call won't work on Android. Can you share the code of what you implemented for Android?

[DarshanSahay]

Here is the code of ScreenSharing -

`

private VideoSurface localView;
private VideoSurface remoteView;
private uint localId;
private uint remoteId;

private void Start()
{
        localId = (uint)photonView.ViewID;
}

public void SetSurface(int id)                              //Sets the Correct TV Screen for screen share with Photon RPC call
{
    photonView.RPC("SetView", RpcTarget.AllBuffered, id);               
    OnScreenShareStarted?.Invoke();
}     

[PunRPC]
public void SetView(int id)
{
    screenId = id;

    if(screenCanvas[id].gameObject.GetComponent<VideoSurface>())             //check for video surface on screen
    {
        VideoSurface[] arr = screenCanvas[id].gameObject.GetComponents<VideoSurface>();

        for (int i = 0; i < arr.Length; i++)
        {
            arr[i].enabled = false;
        }
    }

    localView = screenCanvas[id].gameObject.AddComponent<VideoSurface>();         //Adding VideoSurface component for every client present in room
    localView.transform.localScale = new Vector3(1f,-1f,1f);                                             //rotating view
    remoteView = localView;
    localView.SetForUser(localId);
    localView.SetEnable(true);
}

 public void ToggleScreenShare()                            //Toggle between Sharing or Stopping screen share
 {
    if (!_isSharing)
    {
        if ((int)PhotonNetwork.CurrentRoom.CustomProperties["ScreenShared"] == 0)
        {
            playerVoice.mRtcEngine.StartScreenCaptureForWeb(false);

            startScreenShareBtn.gameObject.SetActive(false);
            stopScreenShareBtn.gameObject.SetActive(true);
            
            _isSharing = true;
        }
        else 
        {
            string userName = (string)PhotonNetwork.CurrentRoom.CustomProperties["ScreenSharer"];
            playerUI.SetWebViewMessage(userName + " is already sharing the screen");
            return;
        }
    }
    else
    {
        StopScreenShare();
    }
}
public void StopScreenShare()
{
    if(_isSharing)
    {
        if ((int)PhotonNetwork.CurrentRoom.CustomProperties["ScreenShared"] != 0)
        {
            if(!screenshareStop)
            {
                playerVoice.mRtcEngine.StopScreenCapture();
            }
            startScreenShareBtn.gameObject.SetActive(true);
            stopScreenShareBtn.gameObject.SetActive(false);

            _isSharing = false;
        }
    }

    photonView.RPC("RemoveVideoSurface", RpcTarget.AllBuffered, screenId);
}

[PunRPC]
public void RemoveVideoSurface(int id)                                    //Remove the video surface on screen sharing stops
{
    if (screenCanvas[id].GetComponent<VideoSurface>() != null)
    {
        screenCanvas[id].gameObject.transform.localScale =  Vector3.one;
        screenCanvas[id].GetComponent<VideoSurface>().enabled = false;
        videoPanelDeleted = true;
    }
    screenId = id;
}

 public void OnUserJoinedHandler(uint uid, int elapsed)                //Agora Callback
  {
    if(remoteView == null)
    {
        remoteView = localView;
    }
    if(_isSharing)
    {
        remoteView.SetForUser(uid);
        remoteView.SetEnable(true);
        remoteId = uid;
    }
}

`