Investigation Of ShotSpotter's Practices Is Raising Questions The Company's Angry Statement Really Doesn't Answer

from the bleeding-from-self-inflicted-wounds-always-sucks dept

Earlier this month, another courtroom challenge of evidence exposed another questionable alteration of a gunshot report by law enforcement tech supplier, ShotSpotter. In 2018, a man shot by police officers claimed in his lawsuit that ShotSpotter altered gunshot detection records at the request of law enforcement to back up the officers' narrative -- one that claimed he had shot at them first. No gun was ever recovered and the number of shots originally detected by ShotSpotter matched the number fired by officers, leaving them at least one shot short of their "he shot first" story.

This appears to have happened again. A man, apparently falsely arrested for a murder he didn't commit, was put in jail for eleven months based almost solely on ShotSpotter reports. The problem with the ShotSpotter report is that it kept changing. And again, the alterations made the report align with the presuppositions of law enforcement. The original detection didn't classify the "percussive noise" as a gunshot. This non-determination was manually overridden by a ShotSpotter "analyst" to be classified as a gunshot.

Months later, ShotSpotter relocated the detected noise from where it was originally "heard" to the intersection where the wrongfully-arrested man's car was captured by a nearby surveillance camera, allowing prosecutors to tie together their theory that the person they had already pinned the crime on had actually committed the crime. But, as soon as the wrongfully-arrested man challenged this evidence, prosecutors dropped the case, citing a lack of evidence.

This reporting on ShotSpotter's apparent alteration of reports to better fit law enforcement claims and theories angered ShotSpotter. The company issued an angry statement claiming Motherboard's article on its latest evidentiary… oddities… was bogus and possibly capable of "confusing" readers.

First, ShotSpotter forensic evidence is 100% reliable and based entirely on the facts and science. ShotSpotter has never altered the information in a court-admissible detailed forensic report based on fitting a police narrative.

Whether or not this statement is true is yet to be determined. Its follow-up assertions added more detail but really didn't do much to refute the claims made in the Motherboard article.

VICE’s article falsely alleged that in the Williams case in Chicago, Illinois, prosecutors withdrew ShotSpotter evidence because it would not meet scientific evidentiary standards due to having been altered. This is 100% false. In fact, no ShotSpotter evidence for this case was altered at any time. ShotSpotter forensic analysts evaluated the incident to create a court-admissible forensic report. Based on publicly available data and our understanding of this case, the prosecutor’s theory was that the defendant shot the victim in a car. ShotSpotter detected a gunshot in the area, and we have always publicly stated that ShotSpotter does not guarantee detection of gunshots that are in cars or inside buildings.

This assertion means nothing. The prosecutors relied on the ShotSpotter report -- the one containing a shot the company claims it can't reliably detect (and one that moved several blocks away from its originally-detected location as the case moved forward) -- right up until they couldn't. When the evidence was challenged, prosecutors walked away. That's not a vote of confidence for ShotSpotter's evidentiary value.

The Associated Press has taken a long, detailed look at this case and uncovered plenty of information that casts doubt on the company's assertions about its practices and the value of its sole product: sensors that detect gunshots and provide their locations to law enforcement. In the middle of it all is 65-year-old Michael Williams who spent 11 months in jail, arrested for a homicide he didn't commit. In fact, Williams drove the gunshot victim to the ER after he was shot by someone in an adjacent car.

The AP report says everything Motherboard said (and more) -- the same things ShotSpotter publicly denied in its angry statement.

An Associated Press investigation, based on a review of thousands of internal documents, emails, presentations and confidential contracts, along with interviews with dozens of public defenders in communities where ShotSpotter has been deployed, has identified a number of serious flaws in using ShotSpotter as evidentiary support for prosecutors.

AP’s investigation found the system can miss live gunfire right under its microphones, or misclassify the sounds of fireworks or cars backfiring as gunshots. Forensic reports prepared by ShotSpotter’s employees have been used in court to improperly claim that a defendant shot at police, or provide questionable counts of the number of shots allegedly fired by defendants. Judges in a number of cases have thrown out the evidence.

As for the claim the company never alters reports, especially at the request of law enforcement, the AP found that claim is complete bullshit.

ShotSpotter employees can, and often do, change the source of sounds picked up by its sensors after listening to audio recordings, introducing the possibility of human bias into the gunshot detection algorithm. Employees can and do modify the location or number of shots fired at the request of police, according to court records. And in the past, city dispatchers or police themselves could also make some of these changes.

The company remains unrepentant, even in the face of mounting evidence the tech is faulty and its detections can be set to manual override at the whim of "analysts" or law enforcement officers.

When pressed about potential errors from the company’s algorithm, ShotSpotter CEO Ralph Clark declined to discuss specifics about their use of artificial intelligence, saying it’s “not really relevant.

Well, it was pretty "relevant" for Michael Williams, jailed for 11 months almost solely on the strength of a twice-altered ShotSpotter report.

As for the "analysts," there's a reason for the scare quotes. ShotSpotter -- in its defensive statement -- makes it appear it retains a host of skilled forensic technicians.

Our expert forensic analysts spend on average eight hours per incident to compile a court-admissible report using specialized tools that differ from those used for alerts. These reports are 100% exact on rounds fired, timing, sequence, and location of shots fired – something they can testify to in court under oath.

But ShotSpotter has made it clear it actually doesn't employ any forensic experts. It just has people it has hired as analysts who do not actually have the technical or scientific background to support the claims they make in court about the reliability of ShotSpotter evidence.

In court filings, ShotSpotter acknowledged: “Our experts are trained using a variety of ‘on the job’ training sessions, and transfer of knowledge from our scientists and other experienced employees. As such no official or formal training materials exist for our forensic experts.”

With experts like these, it's no wonder the court was given contradictory assertions by the company while aiding prosecutors in convicting a man for a crime he didn't commit. Prosecutors claimed Williams shot the victim in his own vehicle. ShotSpotter's own documentation and contract with the Chicago PD made it clear the tech could not reliably detect gunshots fired in vehicles or buildings. But when it came time to back the blue, ShotSpotter was there:

[T]he company declined to say at what point during Williams’ nearly yearlong incarceration it got in touch with prosecutors, or why it prepared a forensic report for a gunshot that allegedly was fired in Williams’ vehicle, given the fact that the system had trouble identifying gunshots in enclosed spaces. The report itself contained contradictory information suggesting the technology did, in fact, work inside cars. Clark, the company’s CEO, declined to comment on the case, but in a follow-up statement, the company equivocated, telling AP that under “certain conditions,” the system can actually pick up gunshots inside vehicles.

The "certain conditions" appear to be "whenever prosecutors need a little help."

ShotSpotter can keep being angry about how it's portrayed in the press. But it can't blame anyone else for its own missteps and failures. Not only does the company seem to overstate the reliability of its sensors, but admissions made in court make it clear the evidentiary value of its reports is, at best, extremely questionable.

Hide this

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team

Filed Under: evidence, police, shotspotter
Companies: shotspotter


Reader Comments

Subscribe: RSS

View by: Time | Thread


  1. identicon
    Anonymous Coward, 23 Aug 2021 @ 11:03am

    reliability

    First, ShotSpotter forensic evidence is 100% reliable

    They didn't say that there announcement was 100% reliable... it's maybe like 35% reliable based on my best guess.

    link to this | view in thread ]

  2. icon
    Thad (profile), 23 Aug 2021 @ 11:18am

    ShotSpotter has never altered the information in a court-admissible detailed forensic report based on fitting a police narrative.

    That's a lot of qualifiers.

    link to this | view in thread ]

  3. identicon
    Anonymous Coward, 23 Aug 2021 @ 11:19am

    I would also be interested in ShotSpotters demands that you alter your previous article, per Mike's tweet

    Any chance on a story about that?

    link to this | view in thread ]

  4. icon
    Stephen T. Stone (profile), 23 Aug 2021 @ 11:40am

    That level of specificity can only mean that lawyers were involved. And we all know lawyers never lie~.

    link to this | view in thread ]

  5. icon
    That One Guy (profile), 23 Aug 2021 @ 11:43am

    Even the prosecutors don't agree with you man...

    These reports are 100% exact on rounds fired, timing, sequence, and location of shots fired – something they can testify to in court under oath.

    Yes, I'm sure your 'evidence' is 100% reliable, that's why prosecutors pull it the second the accused are able to challenge it, they know it's just too reliable and keeping it in play would lead to a one-sided trial and if there's one thing prosecutors just hate it's heavily tilted trials where the defense doesn't have a chance.

    link to this | view in thread ]

  6. identicon
    MightyMetricBatman, 23 Aug 2021 @ 12:25pm

    Re:

    Just like the fae from Grimm's fairy tales, an attorney may not lie, but is also not telling the entire truth.

    link to this | view in thread ]

  7. identicon
    Anonymous Coward, 23 Aug 2021 @ 1:28pm

    ShotLifter makes a lot of "100%" claims... then backs off standing by the evidence and claims. Nothing of this nature is ever 100%, so this bullshit is 100% hyperbole (which they would probably claim if they ever end up in court over shit like this).

    Next: Turns out there were never any scientists ever working for ShotLifter.

    link to this | view in thread ]

  8. icon
    TKnarr (profile), 23 Aug 2021 @ 2:17pm

    I think their angry statement does answer the questions very clearly, the answer just isn't the one ShotSpotter wants to be able to give.

    link to this | view in thread ]

  9. identicon
    Anonymous Coward, 23 Aug 2021 @ 3:20pm

    | ShotSpotter has never altered the information in a court-admissible detailed forensic report

    But because they lied and made up evidence, "technically" that evidence shouldn't be court-admissible in the first place. so technically true.

    neither should anything Shotspotter claims it does with its data.

    link to this | view in thread ]

  10. identicon
    Anonymous Coward, 23 Aug 2021 @ 3:22pm

    Shotspotter can MANUALLY edit the sound file AND the metadata.

    This means nothing at all they submit is evidence. it's hearsay.

    It's as admissible as me using Windows Sound Recorder to "record" the sounds of the Lincoln Assassination.

    But look it MUST be true..it's called lincoln_got_shot_lol.mp3

    link to this | view in thread ]

  11. icon
    That Anonymous Coward (profile), 23 Aug 2021 @ 4:16pm

    Because I remember everything that ever happened here...
    One does wonder how they managed to stay in business after the LAST time it was revealed that one of their techs added gunshot records out of thin air based on cop demands.

    This really really shouldn't be one of those black boxes where no one is allowed to know how they ended up with the report, ala breathalyzers, so we can never challenge the findings because they told us it was perfect.

    I think everyone who was hauled in based on anything provided by shotspotter needs to have their cases reviewed by conviction integrity units because its very clear the truth was never in the reports.

    link to this | view in thread ]

  12. identicon
    Whoever, 23 Aug 2021 @ 5:51pm

    Perjury or libel?

    Isn't this a case of perjury (the DAs introducing "evidence" that isn't reliable) or libel (make a false statement that put someone in jail for 11 months)?

    link to this | view in thread ]

  13. icon
    That One Guy (profile), 23 Aug 2021 @ 6:40pm

    Re: Perjury or libel?

    It's certainly questionable but given how widespread the tech is used it's possible that the DA assumed it was solid and had no idea that Shotspotter 'evidence' has all the strength of a wet tissue until the defense challenged it and they looked into the issue and realized that if they continued to depend on said 'evidence' the defense could rip them to pieces for it.

    link to this | view in thread ]

  14. identicon
    Pixelation, 23 Aug 2021 @ 6:52pm

    Predetermined guilt

    Another tool for police when they have predetermined someone's guilt.

    link to this | view in thread ]

  15. icon
    Uriel-238 (profile), 23 Aug 2021 @ 9:31pm

    "100% Reliable"

    This kind of hyperbole from a firm that sells forensic detection and data technology is really not a good look.

    link to this | view in thread ]

  16. identicon
    Anonymous Coward, 24 Aug 2021 @ 12:41am

    Re: Predetermined guilt

    But hey America is great since everyone gets a trial by a jury of their peers*.

    *Agreement invalid for the 90%-95% of defendants who plea bargain, often due to threats by prosecutors.

    link to this | view in thread ]


Follow Techdirt
Essential Reading
Techdirt Deals
Report this ad  |  Hide Techdirt ads
Techdirt Insider Discord

The latest chatter on the Techdirt Insider Discord channel...

Loading...
Recent Stories

This site, like most other sites on the web, uses cookies. For more information, see our privacy policy. Got it
Close

Email This

This feature is only available to registered users. Register or sign in to use it.