Skidmore

College Faculty/Student Research Project Summer 2011

Digital Image Source Identi2ication

Adam Steinberger '12 Michael Eckmann, Assistant Professor, Mathematics and Computer Science Department

Abstract

How can we iden+fy where photos come from?

Source: buyingguideonline.com Skidmore College 2

Digital Forensics
We extract a7ributes in digital images to determine source camera.
Source: trigonit.com Skidmore College 3

Classifying Cameras
We created a classier that creates a ngerprint for each camera. A7ributes come from pixel colors in digital images.
Sources: jeanierhoades.com, mpc.edu, idfpr.com Skidmore College 4

Color Filter Arrays

Digital cameras take photos using a Color Filter Array (CFA). CFA is matrix of +ny sensors inside cameras that capture one color per pixel.
Skidmore College

Source: en.wikipedia.org

Demosaicing
Demosaicing processes compute the 2 missing colors for each pixel from some neighborhood around it. Typically, cameras use unique proprietary demosaicing processes. Smooth vs edge pixels are usually processed dierently.
Skidmore College 6

Software Development
I developed original so*ware designed to compute a7ributes that relate to a camera's demosaicing processes.
Skidmore College Source: computerhistory.org 7

Smooth Error Calculations

206 202 197 ORIGIN PIXEL 200 MEDIAN NEIGHBOR ERROR 1 204 200 196

199

201

195

194

199

194

195

196

197

201

202

204

206
8

Skidmore College

Edge Error Calculations

105 204 205 ORIGIN PIXEL 200 MEDIAN NEIGHBOR ERROR 2 100 200 197

198

96

198

194

194

197

198
Skidmore College

204

205
9

Statistics from Errors

Pixel errors taken for red, green and blue colors using 3x3, 5x5 and 7x7 pixel windows over en+re image. Sta+s+cs generated from errors include: average, standard devia+on, skewness, kurtosis, energy and entropy.

Source: allpsych.com Skidmore College 10

Attribute Sets
6 stats: mean, sd, skew, kurt, energy, entropy 3 neighborhoods: 3x3, 5x5, 7x7 3 colors: red, green, blue 2 pixel types: smooth, edge 18 other unrelated a;ributes 6 x 3 x 3 x 2 + 18 = 126 a5ributes per image Our database has over 5,500 images from 25 cameras.

Skidmore College

11

Results
Our original classier used smooth errors a7ributes, and had a 34.96% accuracy rate. We added a7ributes for edge errors, and our accuracy rate rose to 36.72%. The classier results for the above are from 25 cameras. By random chance: 1/25 is 4% accuracy. Our results are much higher! A classier with a7ributes from just 3 iPhones had an accuracy rate of 79.1%. These results are much higher than the rst two classiers results.
Skidmore College 12

Future Work
We want to incorporate our a7ributes along with our colleagues a7ribute set for improved accuracy. Also, we plan to extract the top N (say 5) camera choices for each test image with high accuracy. We will implement common demosaicing processes that cameras use to compute more a7ribute sets.
Skidmore College 13

QUESTIONS?
For further informa+on, ques+ons or concerns, please check out my website:

amsteinberger.com

Skidmore College

14