1. Cameras Andrew Curtin, Noah Klugman, Jack Schultz

2. Overview Camera Overview o Camera Basics What to look for in an embedded camera Camera Examples

3. Overview Camera Overview o Camera Basics What to look for in an embedded camera Camera Examples

4. Camera Basics Quick Overview Lens o Focus o Zoom Shutter SLR vs. point and shoot o minor differences

5. Camera Basics: Quick Overview

6. Camera Basics: Lens

7. Camera Basics: Lens

8. Camera Basics: Shutter

9. Camera Basics: SLR vs. Point and Shoot

10. Overview Camera Overview o Camera Basics What to look for in an embedded camera Camera Examples

11. What to look for in a Camera Image Sensor o Color o Resolution o Digital Shutter o Artifacts o Power & Heat Interface o Speed & Frame Rate Auxiliary components o Flash o Compression

12. Image Sensors Convert photons to electrons Integrating the amount of light over time o photons hit a pixel and are converted to charge o charge directly proportional to amount of light

13. Image Sensors: CCD Older technology Higher quality o CMOS is catching up Pixels must be read one at a time o O(mn)

15. Image Sensors: CMOS Lower power o CCD is catching up Smaller physical size Can be manufactured on with standard chip making equipment Can read a whole row at once o O(n)

18. Image Sensors: Color

19. Image Sensors: Color

20. Image Sensors: Color

21. Image Sensors: Resolution

22. Image Sensors: Digital Shutter CMOS can use a digital shutter o CMOS sensors can reset individual rows o this allows for a rolling shutter, which is completely electronic o can read one row and reset another simultaneously CCD requires mechanical shutter o CMOS can use mechanical shutter too

24. Image Sensors: Artifacts: CCD Vertical Smearing

25. Artifacts: CCD Vertical Smearing CMOS CCD

26. Image Sensors: Artifacts: CMOS Rolling shutter o Video 1 Video 1 o Video 2 Video 2

27. Image Sensors: Artifacts: CMOS Partial Exposure

28. Image Sensors: Power & Heat CCD traditionally uses more power than CMOS o more power usage = more heat o this gap is closing with time

29. Interfaces UART SPI I2C Camera Interface (CSI) USB GigE Vision Composite

30. Interfaces: Speed & Frame Rate High resolution photos take up a lot of space Frame rate is frequency of images Higher frame rate requires more bandwidth o or use real time image compression Can increase frame rate based on baud rate

31. Interfaces: UART 4 pins o Tx, Rx, Power, GND 0-5 V signal Short distance, standard around 10 feet large voltage swing o typical camera interface around 100KHz

32. Interfaces: SPI 4 wire o MOSI, MISO, SCK, SS easy to understand Faster than I2C o Speeds of over 10Mb/s o higher throughput than I2C Requires more pins Short distances, standard around 10 ft o longer if careful with noise or use repeaters

33. Interfaces: i2c 2 wires o SDA/SCL Original SCL speed is 100kHz o 5MHz Ultra Fast-mode with version 4.0 in 2012 Harder to use than SPI but more elegant Easier to put multiple cameras on bus Throughput down due to overhead of addressing and acknowledgements Short distance, standard around 10 ft, o goes up as frequency descreases o bus must have less than 400pF capacitance

34. Interfaces Camera Interface (CSI) 8 to 12 bit parallel data line Horizontal Sync, one line of frame transmitted Vertical Sync, entire frame transferred Pixel Clock, change on every pixel Cellphones Raspberry Pi o 15 pin CSI interface o no supported camera module yet High resolution, high bandwidth

35. Interfaces: Camera Interface (CSI)

36. Interfaces: USB Refer to USB group's presentation Common, cheap Fast, high bandwidth A pain to work with Medium distance

37. Interfaces: GigE Vision transmitting high-speed video over Ethernet used for industrial machine vision open standard 1000Mbit/s 100m length, can use switches and repeaters expensive o starting around 800 dollars high speed scalable around 200 cameras support it

38. Interfaces: Composite Video Analog Old standard o from 1950s! Low resolution o 480i (640x480, interleave) o 576i (704x576, interleave) Needs a decoder o Hardware decoder  fast  more expensive o Software decoder  needs lots of cpu resources  high bandwidth

39. Interfaces: Summary higher resolution and higher frame rate lead to higher bandwidth requirements low level protocols are good but distance limited o cheap and easy o SPI is fast o I2C is elegant consumer protocols are good o a pain to work with industrial protocols are good and not as distance limited o but they are expensive

40. Auxiliary Components: Flash Xenon o More expensive than LED o More power than LED o No continuous mode o Closeups ruined o Need capacitor and boost circuit o Much brighter LED o Not as bright as Xenon o Continuous mode Dual LED o minimize shadows o not twice range

41. Auxiliary Components: Off Board Memory Secure Digital (SD) card o class 2, 4, 6, 10 o microSD o cheap SDHC o different hardware level, backward compatible o UHS-II 312 MBs! o getting cheaper Compact flash o 20 MBs typical o 1 GBit/s new generation! o memory controller on card o less common, more expensive

42. Image Compression RAW o Minimally processed o Very large files o Lossless o Like a negative Compression starts from this

43. Image Compression JPEG o Smaller format o different levels of compression o lossy  as compression increases artifacts increase and high frequency data is lost

44. Image Compression VGA, QVGA, QQVGA o Confusing and can mean lots of different things o VGA resolution: 640x480 o QVGA is a quarter of that, QQVGA... o most common 16 colors, 60Hz, non-interlaced  each frame is drawn in sequence

45. Overview Camera Overview o Camera Basics What to look for in an embedded camera Camera Examples

46. CMOS Camera Sparkfun 640x480 pixel 30fps 2.8V Supply Based on Fast Mode I2C RGB color filter 6x6x4.5 mm $9.95

47. CMOS Camera: Interfacing

48. CMOS Camera: Interfacing

49. CMOS Camera: Interfacing

50. LinkSprite JPEG Color UART 5V power 32x32 mm Works with arduino $44.95 VGA resolution Great documentation

51. LinkSprite JPEG Color: Interface UART o Power (5V) o Ground o RX o TX JST jumper o connect to Arduino

52. LinkSprite JPEG Color: Operations Reset Take a picture Read JPEG file size Read JPEG file content Stop taking pictures Change compression ratio Change image size Power saving Change baud rate

53. LinkSprite JPEG Color: Take picture Send 56 00 36 01 00 hex Arduino code mySerial.begin(38400); //Send take picture command void SendTakePhotoCmd() { mySerial.print(0x56, BYTE); mySerial.print(0x00, BYTE); mySerial.print(0x36, BYTE); mySerial.print(0x01, BYTE); mySerial.print(0x00, BYTE); }

54. LinkSprite JPEG Color: receive image //Read data void SendReadDataCmd() { MH=a/0x100; ML=a%0x100; mySerial.print(0x56, BYTE); mySerial.print(0x00, BYTE); mySerial.print(0x32, BYTE); mySerial.print(0x0c, BYTE); mySerial.print(0x00, BYTE); mySerial.print(0x0a, BYTE); mySerial.print(0x00, BYTE); mySerial.print(0x00, BYTE); mySerial.print(MH, BYTE); //starting address mySerial.print(ML, BYTE); mySerial.print(0x00, BYTE); mySerial.print(0x00, BYTE); mySerial.print(0x00, BYTE); mySerial.print(0x20, BYTE); //data length mySerial.print(0x00, BYTE); mySerial.print(0x0a, BYTE); a+=0x20; }

55. HackHD - 1080p 65x40x25 mm Video - 30fps AVI - codec? SD storage o video can be viewed while recording 3.7V On board mic $159.95

56. HackHD - 1080p

57. HackHD - 1080p: Handheld Use Power o 3.7V o 3 AA 1.5V batteries Button to start and stop recording o can be interfaced with microcontroller Audio o has on board mic o can use better mic if attached Storage o on board SD o can do live stream too

58. HackHD - 1080p: Arduino Mimic button press when event Check status with LED signals Reactive applications

59. HackHD - 1080p: Real Time Composite Output o Decoder Chips  Software Decoding Needs bandwidth Processing power  Hardware Decoding Fancier hardware More expensive Large processing requirements Wireless video transmitter o off board processing/viewing

60. HackHD - 1080p: Uses High Altitude balloon RC airplanes Robots Helmet Camera Game Camera

61. Camera Examples: Review CMOS sensor o specific, custom applications LinkSprite JPEG Color o anything you could want a camera for HackHD o really good video o tougher real time with composite

62. Questions?

63. Thank You Sources: Wikipedia http://dvxuser.com/jason/CMOS-CCD/ https://www.dalsa.com/public/corp/Photonics_Spectra_CCDvsCMOS_Litwi ller.pdf http://www.eeherald.com/section/design-guide/esmod11.html http://www.ni.com/white-paper/3287/en#toc3 http://www.visiononline.org/vision-standards-details.cfm?type=5