December 16, 2004

A PICTURE IS WORTH A THOUSAND LIES:

THE PICTURE PROBLEM: Mammography, air power, and the limits of looking. (MALCOLM GLADWELL, 2004-12-06, The New Yorker)

At the beginning of the first Gulf War, the United States Air Force dispatched two squadrons of F-15E Strike Eagle fighter jets to find and destroy the Scud missiles that Iraq was firing at Israel. The rockets were being launched, mostly at night, from the backs of modified flatbed tractor-trailers, moving stealthily around a four-hundred-square-mile “Scud box” in the western desert. The plan was for the fighter jets to patrol the box from sunset to sunrise. When a Scud was launched, it would light up the night sky. An F-15E pilot would fly toward the launch point, follow the roads that crisscrossed the desert, and then locate the target using a state-of-the-art, $4.6-million device called a lantirn navigation and targeting pod, capable of taking a high-resolution infrared photograph of a four-and-a-half-mile swath below the plane. How hard could it be to pick up a hulking tractor-trailer in the middle of an empty desert?

Almost immediately, reports of Scud kills began to come back from the field. The Desert Storm commanders were elated. “I remember going out to Nellis Air Force Base after the war,” Barry Watts, a former Air Force colonel, says. “They did a big static display, and they had all the Air Force jets that flew in Desert Storm, and they had little placards in front of them, with a box score, explaining what this plane did and that plane did in the war. And, when you added up how many Scud launchers they claimed each got, the total was about a hundred.” Air Force officials were not guessing at the number of Scud launchers hit; as far as they were concerned, they knew. They had a four-million-dollar camera, which took a nearly perfect picture, and there are few cultural reflexes more deeply ingrained than the idea that a picture has the weight of truth. “That photography not only does not, but cannot lie, is a matter of belief, an article of faith,” Charles Rosen and Henri Zerner have written. “We tend to trust the camera more than our own eyes.” Thus was victory declared in the Scud hunt—until hostilities ended and the Air Force appointed a team to determine the effectiveness of the air campaigns in Desert Storm. The actual number of definite Scud kills, the team said, was zero.

The problem was that the pilots were operating at night, when depth perception is impaired. lantirn could see in the dark, but the camera worked only when it was pointed in the right place, and the right place wasn’t obvious. Meanwhile, the pilot had only about five minutes to find his quarry, because after launch the Iraqis would immediately hide in one of the many culverts underneath the highway between Baghdad and Jordan, and the screen the pilot was using to scan all that desert measured just six inches by six inches. “It was like driving down an interstate looking through a soda straw,” Major General Mike DeCuir, who flew numerous Scud-hunt missions throughout the war, recalled. Nor was it clear what a Scud launcher looked like on that screen. “We had an intelligence photo of one on the ground. But you had to imagine what it would look like on a black-and-white screen from twenty thousand feet up and five or more miles away,” DeCuir went on. “With the resolution we had at the time, you could tell something was a big truck and that it had wheels, but at that altitude it was hard to tell much more than that.” The postwar analysis indicated that a number of the targets the pilots had hit were actually decoys, constructed by the Iraqis from old trucks and spare missile parts. Others were tanker trucks transporting oil on the highway to Jordan. A tanker truck, after all, is a tractor-trailer hauling a long, shiny cylindrical object, and, from twenty thousand feet up at four hundred miles an hour on a six-by-six-inch screen, a long, shiny cylindrical object can look a lot like a missile. “It’s a problem we’ve always had,” Watts, who served on the team that did the Gulf War analysis, said. “It’s night out. You think you’ve got something on the sensor. You roll out your weapons. Bombs go off. It’s really hard to tell what you did.”

You can build a high-tech camera, capable of taking pictures in the middle of the night, in other words, but the system works only if the camera is pointed in the right place, and even then the pictures are not self-explanatory. They need to be interpreted, and the human task of interpretation is often a bigger obstacle than the technical task of picture-taking. This was the lesson of the Scud hunt: pictures promise to clarify but often confuse. The Zapruder film intensified rather than dispelled the controversy surrounding John F. Kennedy’s assassination. The videotape of the beating of Rodney King led to widespread uproar about police brutality; it also served as the basis for a jury’s decision to acquit the officers charged with the assault. Perhaps nowhere have these issues been so apparent, however, as in the arena of mammography. Radiologists developed state-of-the-art X-ray cameras and used them to scan women’s breasts for tumors, reasoning that, if you can take a nearly perfect picture, you can find and destroy tumors before they go on to do serious damage. Yet there remains a great deal of confusion about the benefits of mammography. Is it possible that we place too much faith in pictures?


It's science though.....

Posted by Orrin Judd at December 16, 2004 8:40 PM
Comments

Indeed it is.

How would identify tumors or trucks? Wait for god to tell you?

Posted by: Harry Eagar at December 17, 2004 12:10 AM

Yes, OJ, what are the track records of faith-based mammography and battlefield surveillance?

Posted by: PapayaSF at December 17, 2004 2:41 AM

Yes, it is science. Having run the experiment, we adjust the theory. We wouldn't hunt Scuds now the same way as then. And in twenty years, we will be successfully finding breast cancer more often and earlier than now.

I notice your wife doesn't put much stock in Christian Science. Hmmm... Wonder why.

Posted by: Jeff Guinn at December 17, 2004 7:15 AM

Harry:

The same way we always have--rip open the body and look.

Posted by: oj at December 17, 2004 7:22 AM

Jeff:

Yes, we're using new methods to not find them.

Posted by: oj at December 17, 2004 7:23 AM

OJ:

Which bodies do you rip open and look at?

Since it isn't all, then what is the basis for choosing who gets biopsies?

Posted by: Jeff Guinn at December 17, 2004 11:39 AM

Jeff:

It is all. That's all a biopsy is.

Posted by: oj at December 17, 2004 1:04 PM

Nothing new here at all.

The problem comes from the people who confuse the idea that the model and the subject being studied are two different things, and the model may not be complete. Another example are all those computer simulations being used to set policy for the next few centuries.

In these cases, image recognition is just damn hard, for pilots or computers, and all we've got so far are ad hockludges that work in limited and specific cases which always seem to fail whenever applied outside the narrow range in which they were designed to operate, or when presented with any condition the programmers didn't know about. Sometimes you 've just got to admit that vision is not theonly sense possible, and you need to use the others, as in the case of a biopsy, go in and feel around, orin the case of Scuds, get close enough to "feel" that they aren't decoys.

Posted by: Raoul Ortega at December 17, 2004 4:19 PM

Well, we've disposed of the women.

How about the trucks?

If we don't need infantry, how come we aren't doing a better job in Iraq?

Posted by: Harry Eagar at December 17, 2004 4:20 PM

Just got off the phone with a lawyer I know.

He missed a few court dates.

Turns out, he thought he had a hernia and went to his doctor, who put him in the CAT machine.

Response: 'You don't have a hernia, but I want to talk to you about that shadow on your pancreas.'

The idea that medical imagery does not work is one of those silly corners Orrin is always backing into, painting industriously all the time.

Posted by: Harry Eagar at December 17, 2004 4:29 PM

They'd have found it when they went in to fix the hernia.

Posted by: oj at December 17, 2004 10:01 PM

Because the infantry stayed--we should have been gone by Memorial Day 2003.

Posted by: oj at December 17, 2004 10:03 PM

Ask you wife about that, Orrin.

He didn't have a hernia, so they wouldn't have gone in.

But if they had, they wouldn't have found it. You cannot see the pancreas from the front.

I'm speaking from experience with my own pancreas.

Posted by: Harry Eagar at December 18, 2004 1:21 AM

Harry:

They would have without the mammography.

Posted by: oj at December 18, 2004 8:16 AM

OJ:

Which breasts to you biopsy, and where?

If your answer isn't all of them, everywhere, then you must have an revolutionary means of distinguishing the ones that need it from those that don't.

Perhaps you should tell your wife straightaway. No doubt she would have a professional interest in such a diagnostic breakthrough.

Posted by: Jeff Guinn at December 19, 2004 7:28 AM

It may make sense to treat breasts as we do men's prostate glands and just assume they have to be removed at a certain age.

Posted by: oj at December 19, 2004 8:15 AM

OJ:

Have you asked your wife about this?

Posted by: Jeff Guinn at December 19, 2004 3:18 PM

She's more skeptical on most health issues than I am.

Posted by: oj at December 19, 2004 4:35 PM

OJ:

That's wonderful, but that wasn't the question.

Does she advocate double radical mastectomies for the 9/9 of women, taking into account 8/9 of them will die of something other than breast cancer?

Posted by: Jeff Guinn at December 19, 2004 10:18 PM

No one advocates it--doesn't mean it doesn't make more medical sense than what we do now.

Posted by: oj at December 19, 2004 10:36 PM
« WHY DO IL DEMOCRATIC LEADERS GET IT? | Main | INCONVENIENT FACTS? IGNORE THEM: »