What’s Next with WebRTC Random Thoughts on area that we might consider Cullen Jennings Sept 2016

Dealing with 360 degree spherical video Dealing with stereo video New video types Dealing with 360 degree spherical video Dealing with stereo video

Virtual Augmented Reality Approaches to real time sending of: 3d point clouds video texture maps layered fragments of view Location and Orientation Of camera and microphones

Current approves reveal a lot about physical location of both parties. Location Privacy Current approves reveal a lot about physical location of both parties. See what it would take to improve privacy here

Replace SDP with better model ORTC largely is enshrining SDP in JSON syntax Be nice to get something that was way easier to work with and better fit with modern cloud approaches

Tie real time sensor location between devices synchronized with media Sensors Tie real time sensor location between devices synchronized with media Includes GPS, rotation, acceleration, magnetometer Common request from drone applications Way to access custom OS sensors (with appropriate permission model)

Still need basic STUN connectivity checks in browser Replace ICE Much simpler mechanism to move most of the ICE machinery out of browser and allow JS to use better apaches Still need basic STUN connectivity checks in browser

Better Data Channel Replace SCTP with QUIC Send RTP over QUIC

Resizable Video Make it so when the video receiver resizes the window, the sender dynamically changes the size of the transmitted to video to match the window

End to End Multi Party Security Currently most apps that support more than two users reveal all the media to the cloud Possible to provide end to end by providing browser support for IETF PERC WG

Simulcast / Scalable Codes WebRTC 1.0 has limited support for simulcast and scalable video codecs Provide full blown support for sending and receiving this

Pluggable Video Codecs Standardize a API to allow downloadable video codecs to avoid the codec wars (like to point out Bernard suggested this long long ago)

Make media move between Wi-Fi and cellular data with no hick ups Mobility Make media move between Wi-Fi and cellular data with no hick ups

Congestion Control JS does not have much fine grain control over hints to influence media resiliency and congestion control

Input / Output device selection Better API for JS to allow the user to configure what devices are used for given operations

Control pan / zoom / tilt of camera (digital or physical ) Camera Control Standardize ways to deal with things like white balance, contrast, brightness etc. on camera Control pan / zoom / tilt of camera (digital or physical )