RoSE Framework

MPEG‐V Sensory Informa3on (SI) 
a.k.a. RoSE WD v3.0 

Chris3an Timmerer 

Klagenfurt University (UNIKLU)  Faculty of Technical Sciences (TEWI) 
Department of Informa3on Technology (ITEC)  Mul3media Communica3on (MMC) 
hquot;p://research.,mmerer.com  hquot;p://blog.,mmerer.com  mailto:chris,an.,mmerer@itec.uni‐klu.ac.at

What is MPEG‐V Sensory Informa,on? 

2009/02/06  Chris,an Timmerer, Klagenfurt University, Austria  2

System Architecture 
Digital Content

Adaptation VV
Provider
(Virtual World,
(serious) game,

Virtual World Data
Representation R
simulator, DVD, …)

Adapta3on RV/VR  Virtual World Data Representa3on V 

Scope of this interna/onal 
standard 

Adapta3on RV  Adapta3on VR 

S  S  A  A 
Device Commands 

Real  Real 
Real 
World  World  World 
2009/02/06  Chris,an Timmerer, Klagenfurt University, Austria  3 
Dev2  Dev3 
Dev1

Author’s  Sensory  Sensory 
Inten3on to  Effect  Device 
trigger  Metadata  Capabili3es 

<elem‐1…/>  <cap‐1…/> 
single 
<elem‐2…/>  <cap‐2…/> 
sense 
RoSE 
<elem‐3…/>  <cap‐3…/> 
.  . 
Engine 
mul3ple 
(inform.) 
.  . 
senses 
.  . 
<elem‐n…/>  <cap‐n…/> 

Scope of Standardiza/on 

SEM elements/types provides tools for expressing sensory effects, i.e., the elements 
may be used by content authors to trigger a single or mul,ple human senses. Note 
that there is not necessarily a one‐to‐one mapping between senses and elements of 
the sensory effect metadata. 
SEM elements/types are mapped to commands that control sensory devices based on 
their capabili,es. Note that there is not necessarily a one‐to‐one mapping between  4 
2009/02/06  Chris,an Timmerer, Klagenfurt University, Austria 
SEM elements and sensory device capabili,es.

Working Dra Structure 
•  Sensory Effect Descrip,on Language 
–  Basic building blocks: Descrip,onMetadata, Declara,on, Effect, 
GroupOfEffects, Parameter 
–  Common aquot;ributes: XSI, ac,vate, dura,on, fade‐in, fade‐out, alt, 
priority, intensity, posi,on, adaptType, adaptRange, autoExtrac,on,  
–  Low‐level datatypes: vacant 
•  Sensory Effect Vocabulary 
–  (Color) Light, Temperature, Wind, Vibra,on 
–  Flash Light, Water Sprayer, Perfumer/Scent, Fog, Window Blind/
Shadow, Sound, Color Correc,on 
•  Sensory Effect Context Descrip,ons 
–  User sensory preferences  moved to MPEG‐V 
–  Sensory device capabili,es  Control Informa3on 
–  Sensory device commands 


MPEG‐V SI References 
•  N9896, A Summary of the Representa,on of 
Sensory Eﬀects (RoSE) 
•  N10498, Requirements for MPEG‐V Version 3.2  

•  WD of Sensory Informa,on 
•  Ad‐hoc Group 
N10475 
–  metaverse@lists.uni‐klu.ac.at 
–  hquot;p://lists.uni‐klu.ac.at/mailman/lis,nfo/metaverse  


Thank you for your aquot;en,on 

... ques,ons, comments, etc. are welcome … 
Thanks to the contributors 
ETRI, Klagenfurt University, MyongJi University, 
Philips, and Sharp 

 Ass.‐Prof. Dipl.‐Ing. Dr. Chris,an Timmerer 
Klagenfurt University, Department of Informa,on Technology (ITEC) 
Universitätsstrasse 65‐67, A‐9020 Klagenfurt, AUSTRIA 
chris,an.,mmerer@itec.uni‐klu.ac.at 
hquot;p://research.,mmerer.com/ 
Tel: +43/463/2700 3621 Fax: +43/463/2700 3699 
© Copyright: Chris.an Timmerer 

RoSE Framework

Recommended

Recommended

More Related Content

Similar to RoSE Framework

Similar to RoSE Framework (20)

More from Alpen-Adria-Universität

More from Alpen-Adria-Universität (20)

Recently uploaded

Recently uploaded (20)

RoSE Framework