1. LCC, MIERSI SM 14/15 – T6 Sensing Technology Miguel Tavares Coimbra

2. References Slides from Edward A. Lee & Sanjit Seshia, UC Berkeley, EECS 149 Fall 2013 –Copyright © 2008-date, Edward A. Lee & SanjitA. Seshia, All rights reserved Pedro Brandão, Sistemas Embutidos, DCC/FCUP –https://moodle.up.pt/course/view.php?id=3162 SM 14/15 – T5 – Sensing Technology

3. Reality SM 14/15 – T5 – Sensing Technology

4. Quantifying Reality Rain Ball Speed Stress Fatigue Heart Rate Emotions Muscle strength Wind Body posture SM 14/15 – T5 – Sensing Technology

5. Into a Digital World

6. I want to transform real variables into digital ones Real-time, unobtrusively, in real situations, for long periods of time, with very high accuracy

7. Cyber-Physical Systems SM 14/15 – T5 – Sensing Technology

8. (More) Pieces of the Puzzle Input –Reality (cameras, microphones, sensors, mocap, controllers,…) –Synthetic (computer graphics, sound synthesis,…) Processing –Digital, Analogue –Transform data, generate new data Output –Video, audio, actuators SM 14/15 – T5 – Sensing Technology Just a bit…

9. SM 14/15 – T5 – Sensing Technology

12. Sensor Components

13. SM 14/15 – T5 – Sensing Technology

18. CCD (charge coupled device) Higher dynamic range High uniformity Lower noise CMOS (complementary metal Oxide semiconductor) Lower voltage Higher speed Lower system complexity Light Sensors Convert light into an electric charge SM 14/15 – T5 – Sensing Technology

19. Environmental Sensors –Temperature –Humidity –Air quality SM 14/15 – T5 – Sensing Technology

20. Case Study: UrbanSense @ Porto SM 14/15 – T5 – Sensing Technology

21. Case Study: UrbanSense @ Porto SM 14/15 – T5 – Sensing Technology

22. Wearable Sensors

23. Erik Topol, 2009 SM 14/15 – T5 – Sensing Technology

26. Case Study: Vital Responder Monitoring Stress Among First Responder Professionals SM 14/15 – T5 – Sensing Technology

28. Electrocardiogram

29. SM 14/15 – T5 – Sensing Technology Electrocardiogram

30. SM 14/15 – T5 – Sensing Technology RR Variability

31. SM 14/15 – T5 – Sensing Technology EEG https://www.youtube.com/watch?t=55&v=T7CiiWBwMgw

32. EMG SM 14/15 – T5 – Sensing Technology Wearable EMG Very Famous Person

33. Smartphone Sensing Samsung S4 Accelerometer Gyroscope Light Magnetic Field Atmospheric Pressure Proximity Temperature Humidity Sound Levels GPS SM 14/15 – T5 – Sensing Technology

34. Smartwatch Sensing SM 14/15 – T5 – Sensing Technology

35. Some fundamental concepts

36. SM 14/15 – T5 – Sensing Technology

37. Analog to Digital SM 14/15 – T5 – Sensing Technology

38. Sampling Continuous signal: Shah function (Impulse train): Sampled function:

39. SM 14/15 – T5 – Sensing Technology Aliasing Picket fence receding into the distance will produce aliasing… Input signal: x = 0:.05:5; imagesc(sin((2.^x).*x)) Matlab output: WHY? Sampling frequency must be greater than

40. SM 14/15 – T5 – Sensing Technology Quantization G - number of levels m – storage bits Round each value to its nearest level

41. SM 14/15 – T5 – Sensing Technology Noise Noise is a distortion of the measured signal Every physical system has noise Various strategies: –Better sensors –Digital Filters –Restoration models

42. SM 14/15 – T5 – Sensing Technology Processing Signal Processing –Analysis, interpretation, transformation of a signal Example –In order to measure temperature I ‘process’ the length of a volume of mercury I am processing a signal

43. So what do I do with all this? You do cool stuff of course…

44. SM 14/15 – T5 – Sensing Technology Videogames that change with your heart signals

45. SM 14/15 – T5 – Sensing Technology Sounds controlled by gestures

46. EEG Generated Art SM 14/15 – T5 – Sensing Technology

47. Dating using GPS trajectories

48. SM 14/15 – T5 – Sensing Technology Use CG to replay the coolest goal from your football match

49. Get Creative SM 14/15 – T5 – Sensing Technology

50. What will you quantify? Rain Ball Speed Stress Fatigue Heart Rate Emotions Muscle strength Wind Body posture SM 14/15 – T5 – Sensing Technology