YONSEI Univ. High Dimensional Signal Processing Lab. 1 Comparison of DSCQS and SSCQE Chulhee Lee Yonsei University.

Slides:

Advertisements

Similar presentations

Project VIABLE: Behavioral Specificity and Wording Impact on DBR Accuracy Teresa J. LeBel 1, Amy M. Briesch 1, Stephen P. Kilgus 1, T. Chris Riley-Tillman.

Advertisements

Class 21: Tues., Nov. 23 Today: Multicollinearity, One-way analysis of variance Schedule: –Tues., Nov. 30 th – Review, Homework 8 due –Thurs., Dec. 2 nd.

Observational Research

Proposal for 3D evaluation test plan in VQEG Dec Jun Okamoto (NTT)

Covariance and Correlation

Chapter 11: The t Test for Two Related Samples

Using Scatter Plots to Identify Relationships Between Variables LG: I can create a scatter plot LG: I can interpret a scatter plot by identifying the dependent.

Correlation and regression Dr. Ghada Abo-Zaid

Statistical Issues in Research Planning and Evaluation

Comparison of subjective test methodologies VQEG Berlin meeting June 2009 P. Le Callet, R. Pépion.

© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 7 Using Nonexperimental Research.

Designing QoE experiments to evaluate Peer-to-Peer streaming applications Tom Z.J. Fu, CUHK Dah Ming Chiu, CUHK Zhibin Lei, ASTRI VCIP 2010, Huang Shan,

1 Examining the role of Self-Regulated Learning on Introductory Programming Performance Susan Bergin, Ronan Reilly and Des Traynor Department of Computer.

MAE 552 Heuristic Optimization

SWRK 171 Qualitative Research in Social Work. What is qualitative research?

Chapter 2 – Tools of Positive Analysis

RESEARCH METHODS IN EDUCATIONAL PSYCHOLOGY

Damian Gordon.  Summary and Relevance of topic paper  Definition of Usability Testing ◦ Formal vs. Informal methods of testing  Testing Basics ◦ Five.

Measuring attitudes Direct measures Semantic differential scale Likert scale Indirect measures Physiological measurements Projective tests psychlotron.org.uk.

Evaluation and analysis of the application of interactive digital resources in a blended-learning methodology for a computer networks subject F.A. Candelas,

Principal Components Analysis BMTRY 726 3/27/14. Uses Goal: Explain the variability of a set of variables using a “small” set of linear combinations of.

A P STATISTICS LESSON 3 – 2 CORRELATION.

Scientific Process ► 1) Developing a research idea and hypothesis ► 2) Choosing a research design (correlational vs. experimental) ► 3) Choosing subjects.

Fundamentals of Data Analysis Lecture 10 Management of data sets and improving the precision of measurement pt. 2.

ANALYSIS ON THE VIDEO CLIP PUBLISHED BY CHANNEL-4,UK.

4) It is a measure of semi-independence and your PI may treat you differently since your fellowship will be providing salary support. 2) Fellowship support.

What is Usability? Usability Is a measure of how easy it is to use something: –How easy will the use of the software be for a typical user to understand,

R. Ray and K. Chen, department of Computer Science engineering  Abstract The proposed approach is a distortion-specific blind image quality assessment.

A preliminary experiment on the simulation of thunderstorm electrification through GRAPES Yijun Zhang Chinese Academy of Meteorological Sciences, Beijing,

1 Technical & Business Writing (ENG-315) Muhammad Bilal Bashir UIIT, Rawalpindi.

A Cross-Sensor Evaluation of Three Commercial Iris Cameras for Iris Biometrics Ryan Connaughton and Amanda Sgroi June 20, 2011 CVPR Biometrics Workshop.

 Used to observe and describe behavior  Help to answer questions such when do certain behaviors occur  How often does the behavior occur  Is the behavior.

COPYRIGHT © All rights reserved by Sound acoustics Germany The averaged quality measures over all test cases indicate the real influence of a test object.

Dr. Engr. Sami ur Rahman Data Analysis Correlational Research.

Towards a unique subjective experiment dataset for 3DTV – « 3DTV phase 1 » Marcus Barkowsky.

Comparative Analyses of Three Measures of Concordance between Current and Longest Held Jobs Orlando Gómez-Marín MSc PhD, Lora E. Fleming MD PhD, William.

EXPERIMENT VS. CORRELATIONAL STUDY. EXPERIMENT Researcher controls all conditions Experimental group – 1 or more groups of subjects Control group – controlled.

BTEC First Diploma in Sport 6.4 Review and provide evidence of possible progress Reviewing your progress.

INFORMAL REPORTS. 2 SPECIFIC GUIDELINES 3 III. SPECIFIC GUIDELINES TYPES of INFORMAL REPORTS A. Problem Analyses B. Recommendation Reports C. Equipment.

Nippon Telegraph and Telephone Corporation (NTT), Japan Taichi Kawano.

The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.

Biostatistics Case Studies 2006 Peter D. Christenson Biostatistician Session 2: Correlation of Time Courses of Simultaneous.

Criteria for selection of a data collection instrument. 1.Practicality of the instrument: -Concerns its cost and appropriateness for the study population.

USE OF UNCERTAINTY OF MEASUREMENT IN TESTING ROHAN PERERA MSc ( UK ), ISO/IEC Technical Assessor, Metrology Consultant.

Teaching & Inquiry I: Fundamentals of Teaching Through Inquiry Todd Twyman 9/18(20)

Writing an abstract Does consulting with the professor result in greater improvement on the grade of a revised written assignment? John Moeller and G.R.

>> HIGHERVIEW Team: A. Sasse J. D. McCarthy D. Miras J. Riegelsberger Presentation to UCL Network Group: 3rd March 2004.

Distance-Reciprocal Distortion Measure for Binary Document Images IEEE Signal Processing Letters, vol.11,No.2, Feb

3DTV Work Group VQEG meeting Krakow 28 June – 2 July 2010.

1 RRNR-TV (September 2008 Ghent). 2 Proponents NEC NTIA KWILL Yonsei.

Predicting User Interests from Contextual Information R. W. White, P. Bailey, L. Chen Microsoft (SIGIR 2009) Presenter : Jae-won Lee.

Correlation  We can often see the strength of the relationship between two quantitative variables in a scatterplot, but be careful. The two figures here.

Regression Several Explanatory Variables. Example: Scottish hill races data. These data are made available in R as data(hills, package=MASS) They give.

GOAL: I CAN USE TECHNOLOGY TO COMPUTE AND INTERPRET THE CORRELATION COEFFICIENT OF A LINEAR FIT. (S-ID.8) Data Analysis Correlation Coefficient.

1 Hybrid Bit-stream Models. 2 Hybrid bit-stream model: Type 1  Pros: Simple. All we need are open-source codecs.  Cons: May lose some available information.

Assessing Students' Understanding of the Scientific Process Amy Marion, Department of Biology, New Mexico State University Abstract The primary goal of.

In other words the relationship between variables

Immediate activity What is this an example of?.

Which of the following would be necessary to establish a cause-and- effect relationship between two variables? Strong association between the variables.

In other words the relationship between variables

دانشگاه شهیدرجایی تهران

تعهدات مشتری در کنوانسیون بیع بین المللی

Clinical Assessment and Diagnosis

In other words the relationship between variables

Rubrics for academic assessment

TECHNICAL COMMUNICATION 1

EXPERIMENT VS. CORRELATIONAL STUDY

In other words the relationship between variables

Presentation transcript:

YONSEI Univ. High Dimensional Signal Processing Lab. 1 Comparison of DSCQS and SSCQE Chulhee Lee Yonsei University

YONSEI Univ. High Dimensional Signal Processing Lab. 2 Test Envioroment Test tapes were made in accordance with the RRTV test plan. Subjective test using the SSCQE method was performed (23 evaluators, non-expert). From the test tapes, 64 8-second video sequences were taken and subjective test using the DSCQS was also performed (18 evaluators, non-expert) Viewing conditions: in accordance with the FRTV and RRTV test plans.

YONSEI Univ. High Dimensional Signal Processing Lab. 3 Detailed information for SSCQE Two 60 minutes tapes (T3, T4) which have the same PVSs in different ordering. Each 60 minutes tape has two different ordering (T312, T321, T412, T421). Number of evaluators: 6, 6, 6, 5. There are always source video sequences (SRCs) in each tape.

YONSEI Univ. High Dimensional Signal Processing Lab. 4 Comparison of DSCQS and SSCQE There are three subjective scores: DSCQS DMOS: FR_DMOS SSCQE MOS: RR_MOS SSCQE DMOS: RR_DMOS SSCQE_DMOS was obtained by subtracting the score of PVS from the score of the corresponding SRC.

YONSEI Univ. High Dimensional Signal Processing Lab. 5 FR_DMOS vs RR_MOS

YONSEI Univ. High Dimensional Signal Processing Lab. 6 FR_DMOS vs RR_DMOS

YONSEI Univ. High Dimensional Signal Processing Lab. 7 RR_DMOS vs RR_MOS

YONSEI Univ. High Dimensional Signal Processing Lab. 8 FR_DMOS vs PSNR

YONSEI Univ. High Dimensional Signal Processing Lab. 9 RR_MOS vs PSNR

YONSEI Univ. High Dimensional Signal Processing Lab. 10 RR_DMOS vs PSNR

YONSEI Univ. High Dimensional Signal Processing Lab. 11 Comparison of correlation coefficients FR_DMOSRR_MOSRR_DMOSPSNR FR_DMOS RR_MOS RR_DMOS PSNR

YONSEI Univ. High Dimensional Signal Processing Lab. 12 RRS3 (psnr)

YONSEI Univ. High Dimensional Signal Processing Lab. 13 RRS4 (psnr)

YONSEI Univ. High Dimensional Signal Processing Lab. 14 Observations and Comments The SSCQE method is an interesting method. However, this preliminary study indicates that there exist differences between DSCQS and SSCQE. Depending on analyses, the evaluation of models might be different. Thus, there need to be agreements on how to analyze the data before the test plan is finalized. It is strongly recommended that other laboratories conduct similar comparison studies to better understand the SSCQE method.

YONSEI Univ. High Dimensional Signal Processing Lab. 15 Further Comments on SSCQE Attention issue: It is observed that evaluators do not record a short period of degradation. For instance, they tend to omit blocking artifacts of 1-2 seconds. Fatigue issue: It appears that 1 hour is too long for SSCQE. Variable response delay. Subjective scores tend to be more influenced by context.

YONSEI Univ. High Dimensional Signal Processing Lab. 16 Thank you!