FW: [IP] Nat'l Research Council report on data mining report: it doesn't work

Not surprising, the software guys have been saying this for years.  The bad news is that this won't kill it, it will be too easy for someone new to come along every 6 months and claim they have new technology that this report didnt count on.

Sam

-----Original Message-----
From: David Farber
To: ip
Sent: 10/8/2008 3:26 PM
Subject: [IP] Nat'l Research Council report on data mining report: it doesn't work

Begin forwarded message:

From: Peter Swire <peter@peterswire.net>
Date: October 8, 2008 2:45:24 PM EDT
To: "dave@farber.net" <dave@farber.net>
Subject: RE: [IP] Nat'l Research Council report on data mining report: 
it doesn't work

Dave:

I did not participate in writing the report, but attended the roll-out 
event yesterday and have read through most of it.

I really commend this report to your readers.  It does high quality 
work on data mining and behavioral surveillance.

A particularly strong aspect of the report is a detailed and usable 
"framework for program assessment."  This essentially takes the 
Privacy Impact Assessment required by the E-Gov Act of 2002 and 
deepens the process considerably.  Although designed specifically for 
assessment of federal programs, the step-by-step framework would be 
easily usable in private-sector, state, and local programs.

One noteworthy point in the report is that compliance with the "law" 
is not enough (in part because the laws lag behind technical 
developments).  Too often officials defend a bad program by saying "it 
complies with all laws."  Program assessment also must look at 
upholding "values," and the framework sets out a step-by-step way to 
do that.

Along with the committee members mentioned, your readers should know 
that the lead drafter of the report (who was presented as such at the 
event yesterday) was Fred Cate of Indiana University.

I think this is the best single document I have seen for how privacy 
issues should be addressed in the federal government going forward.

Peter

Prof. Peter P. Swire
C. William O'Neil Professor of Law
   Moritz College of Law
   The Ohio State University
Senior Fellow, Center for American Progress
(240) 994-4142, www.peterswire.net

-----Original Message-----
From: David Farber [mailto:dave@farber.net]
Sent: Wednesday, October 08, 2008 1:34 PM
To: ip
Subject: [IP] Nat'l Research Council report on data mining report: it 
doesn't work

http://news.cnet.com/8301-13578_3-10059987-38.html?part=rss&subj=news&ta
g=2547-1_3-0-20

October 7, 2008 9:30 AM PDT
Government report: Data mining doesn't work well
Posted by Declan McCullagh

The most extensive government report to date on whether terrorists can
be identified through data mining has yielded an important conclusion:
It doesn't really work.

A National Research Council report, years in the making and scheduled
to be released Tuesday, concludes that automated identification of
terrorists through data mining or any other mechanism "is neither
feasible as an objective nor desirable as a goal of technology
development efforts." Inevitable false positives will result in
"ordinary, law-abiding citizens and businesses" being incorrectly
flagged as suspects.

The whopping 352-page report, called "Protecting Individual Privacy in
the Struggle Against Terrorists," amounts to at least a partial
repudiation of the Defense Department's controversial data-mining
program called Total Information Awareness, which was limited by
Congress in 2003.

But the ambition of the report's authors is far broader than just
revisiting the problems of the TIA program and its successors.
Instead, they aim to produce a scholarly evaluation of the current
technologies that exist for data mining, their effectiveness, and how
government agencies should use them to limit false positives--of the
sort that can result in situations like heavily-armed SWAT teams
raiding someone's home and shooting their dogs based on the false
belief that they were part of a drug ring.

The report was written by a committee whose members include William
Perry, a professor at Stanford University; Charles Vest, the former
president of MIT; W. Earl Boebert, a retired senior scientist at
Sandia National Laboratories; Cynthia Dwork of Microsoft Research; R.
Gil Kerlikowske, Seattle's police chief; and Daryl Pregibon, a
research scientist at Google.
<snip>

DISCLAIMER:
E-mail Confidentiality/Proprietary Notice: The information contained in this transmission may be proprietary and subject to protection under the law. The message is intended for the sole use of the individual or entity to whom it is addressed. If you are not the intended recipient, you are notified that any use, distribution or copying of the message is strictly prohibited. If you received this transmission in error, please contact the sender immediately by replying to this e-mail and delete the material from any computer. Thank you.