Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 1 Content-aware and context- aware resource adaptation Juan Hamers (06/06/2006)

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 2 Content providers offer multiple versions : which to choose Media stream low medium high small medium large 56k 100k 300k

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 3 2 Major issues for client when selecting media Decoder powerful enough –No skipping distortion Sufficient battery life Battery Empty

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 4 Impact of content itself on decoding time / Energy consumption Platform capacity

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 5 Exploiting this variance to adapt resources for energy efficiency P(W) t (ms) 5 DVS (P ~ fV², V ~ f) frequency power

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 6 Oracle needed for accurate timing information Missed deadline Less Energy conserved P(W) t (ms) 5

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 7 Content-provider has to add scenario information Platform & decoder independent Adequate Resources

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 8 Looking into content structure …… Decoder MB type Scaling

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 9 A Macroblock profile summarizes the structure of a GOP/frame Histogram

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 10 Macroblock profile relates to decode time MB- profile Decode time

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 11 Provider determines scenarios based upon macroblock profiles Content Provider

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 12 Client trains Scenario Adaptation Table with representative samples freqVEn (J)dtime (ms) Client Side Content Provider

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 13 What about new content ???

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 14 Determining resource needs during handshake Energy / Time

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 15 Client uses scenario IDs and its SAT to scale frequency & voltage freqV Decoder … …

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 16 Experimental setup 12 Video sequences (300 frames) Macroblock profiles per GOP/frame Train with 11, test other Cluster centroid for training target platform (+ Additional offset) 12/32 scenarios performed best

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 17 Predicting decode complexity

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 18 Decoder Adaption : 3 Cases considered

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 19 We realized an average energy reduction of 46%

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 20 Results energy prediction

Content-aware and context-aware resource adaptation Juan Hamers – Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen pag. 21 Conclusion Macroblock profiles correlate well with decoding time/Energy usage. Recognizing scenarios derived from macroblock profiles allows for –efficient resource adaption –Predicting required resources –In a platform independent way Average energy reduction of 46% Used for resource prediction < 2 % error