MR and Azure 306:ビデオのストリーミング再生

2.カメラの設定、オブジェクトの設定

Position  | 全て0

Scale      | 全て1

Position  | X:3.6 | Y:1.3 | Z:0

Scale      | 全て1

ここでは二つのスクリプトを作成していきたいと思います。

・VideoController

・Gaze

スクリプトの作り方はまず、すべてのスクリプトをまとめておくフォルダーを作成します。[Project]->[Create]をクリックし、[Folder]を選択して新しいフォルダーを作ります。名前をScriptsとします。続いて[Project]->[Create]->[C# Script]をクリックし、クラス名をつけていきます。

このクラスにはMedia Serviceとやりとりするメソッド、ビデオを切り替えるメソッドなどを記述していきます。コードは以下の通りです。ここで、0.準備で取得した二つのダウンロードURLを所定の位置に挿入します。

using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.SceneManagement;
using UnityEngine.Video;

public class VideoController : MonoBehaviour {

/// <summary>
/// Provides Singleton-like behaviour to this class.
/// </summary>
public static VideoController instance;

/// <summary>
/// Reference to the Camera VideoPlayer Component.
/// </summary>
private VideoPlayer videoPlayer;

/// <summary>
/// Reference to the Camera AudioSource Component.
/// </summary>
private AudioSource audioSource;

/// <summary>
/// Reference to the texture used to project the video streaming
/// </summary>
private RenderTexture videoStreamRenderTexture;

/// <summary>
/// Insert here the first video endpoint
/// </summary>
private string video1endpoint = "--Insert video1 endpoint--";

/// <summary>
/// Insert here the second video endpoint
/// </summary>
private string video2endpoint = "--Insert video2 endpoint--";

/// <summary>
/// Reference to the Inside-Out Sphere.
/// </summary>
public GameObject sphere;

void Awake()
{
instance = this;
}

// Use this for initialization
void Start()
{
Application.runInBackground = true;
StartCoroutine(PlayVideo());
}

private IEnumerator PlayVideo()
{
// create a new render texture to display the video
videoStreamRenderTexture = new RenderTexture(2160, 1440, 32, RenderTextureFormat.ARGB32);

videoStreamRenderTexture.Create();

// assign the render texture to the object material
Material sphereMaterial = sphere.GetComponent<Renderer>().sharedMaterial;

//create a VideoPlayer component
videoPlayer = gameObject.AddComponent<VideoPlayer>();

// Set the video to loop.
videoPlayer.isLooping = true;

// Set the VideoPlayer component to play the video from the texture
videoPlayer.renderMode = VideoRenderMode.RenderTexture;

videoPlayer.targetTexture = videoStreamRenderTexture;

// Add AudioSource
audioSource = gameObject.AddComponent<AudioSource>();

// Pause Audio play on Awake
audioSource.playOnAwake = true;
audioSource.Pause();

// Set Audio Output to AudioSource
videoPlayer.audioOutputMode = VideoAudioOutputMode.AudioSource;
videoPlayer.source = VideoSource.Url;

// Assign the Audio from Video to AudioSource to be played
videoPlayer.EnableAudioTrack(0, true);
videoPlayer.SetTargetAudioSource(0, audioSource);

// Assign the video Url depending on the current scene
switch (SceneManager.GetActiveScene().name)
{
case "VideoScene1":
videoPlayer.url = video1endpoint;
break;

case "VideoScene2":
videoPlayer.url = video2endpoint;
break;

default:
break;
}

//Set video To Play then prepare Audio to prevent Buffering
videoPlayer.Prepare();

while (!videoPlayer.isPrepared)
{
yield return null;
}

sphereMaterial.mainTexture = videoStreamRenderTexture;

//Play Video
videoPlayer.Play();

//Play Sound
audioSource.Play();

while (videoPlayer.isPlaying)
{
yield return null;
}
}

public void ChangeScene()
{

SceneManager.LoadScene(SceneManager.GetActiveScene().name == "VideoScene1" ? "VideoScene2" : "VideoScene1");
}
}

記述し終えたら、このスクリプトを[Main Camera]にD&Dします。[Main Camera]の[Inspector]を見ると、[Video Controller]が追加されているのがわかります。この[Sphere]に[InsideOutSphere]をD&D します。

このクラスには、ユーザーがビデオ切り替えのための物体を見たかどうかを識別するメソッドなどを記述します。

コードは以下の通りです。

using System.Collections;
using System.Collections.Generic;
using UnityEngine;

public class GazeButton : MonoBehaviour {

/// <summary>
/// Provides Singleton-like behaviour to this class.
/// </summary>
public static GazeButton instance;

/// <summary>
/// Provides a reference to the object the user is currently looking at.
/// </summary>
public GameObject FocusedGameObject { get; private set; }

/// <summary>
/// Provides a reference to compare whether the user is still looking at
/// the same object (and has not looked away).
/// </summary>
private GameObject oldFocusedObject = null;

/// <summary>
/// Max Ray Distance
/// </summary>
float gazeMaxDistance = 300;

/// <summary>
/// Provides whether an object has been successfully hit by the raycast.
/// </summary>
public bool Hit { get; private set; }

private void Awake()
{
// Set this class to behave similar to singleton
instance = this;
}

void Start()
{
FocusedGameObject = null;
}

void Update()
{
// Set the old focused gameobject.
oldFocusedObject = FocusedGameObject;
RaycastHit hitInfo;

// Initialise Raycasting.
Hit = Physics.Raycast(Camera.main.transform.position, Camera.main.transform.forward, out hitInfo, gazeMaxDistance);

// Check whether raycast has hit.
if (Hit == true)
{
// Check whether the hit has a collider.
if (hitInfo.collider != null)
{
// Set the focused object with what the user just looked at.
FocusedGameObject = hitInfo.collider.gameObject;
}
else
{
// Object looked on is not valid, set focused gameobject to null.
FocusedGameObject = null;
}
}
else
{
// No object looked upon, set focused gameobject to null.
FocusedGameObject = null;
}

// Check whether the previous focused object is this same
// object (so to stop spamming of function).
if (FocusedGameObject != oldFocusedObject)
{
// Compare whether the new Focused Object has the desired tag we set previously.
if (FocusedGameObject.CompareTag("GazeButton"))
{
FocusedGameObject.SetActive(false);
VideoController.instance.ChangeScene();
}
}
}
}

このクラスも同様に[Main Camera]にD&Dします。

4.Sceneの追加

Position  | X:0 | Y:1.3 | Z:3.6

Scale      | 全て1

[File]->[Build Settings..]->[Build]の順に選択します。新しいフォルダー(BUILDS)を作成し、その中にさらにフォルダー(VideoStreaming_Build)を作ります。このフォルダーを選択し、保存します。

この後の手順については こちら を参照してください。

HoloLensで実行した時の様子です。見づらいですが以下のようになればオッケーです。GazeButtonを探して見てください。シーンが切り替わるはずです。

以上となります。 お疲れ様でした。