science - search results

A Canadian high school student named Bronwyn Delacruz never imagined that her school science project would make headlines all over the world.  But that is precisely what has happened.  Using a $600 Geiger counter purchased by her father, Delacruz measured seafood bought at local grocery stores for radioactive contamination.  What she discovered was absolutely [...]

For independent reviewability, replication, and validation, lab reports should contain sufficient information to evaluate case notes and interpret the data as well as procedures, standards, blanks, observations, and  test results. Supporting documentation should include charts, graphs, and spectra generated during an analysis. [16]  Since Hartshorn provided none of these details, her reports could not be checked out and proved nothing, least of all that the suspected sample was marijuana.

The DEA founded and presently chairs Scientific Working Group on the Analysis of Seized Drugs (SWGDRUG) which provides minimum standards for  scientifically sound  lab and testing procedures. According to SWGDRUG:

Laboratories shall have documented policies establishing protocols for technical and administrative review.

Laboratories shall have and follow documented analytical procedures.

Laboratories shall have in place protocols for the sampling of evidence.

Laboratories shall monitor the analytical processes using appropriate controls and traceable standards.

Laboratories shall have and follow documented guidelines for the acceptance and interpretation of data.

Analytical procedures shall be validated in compliance with Section 11.

When analysts determine the identity of a drug in a sample, they shall ensure that the result relates to the right submission. This is best established by the use of at least two appropriate techniques based on different principles and two independent samplings.

Method validation is required to demonstrate that methods are suitable for their intended purpose. For qualitative analysis (identifying drugs), the parameters that need to be checked are selectivity, limit or detection and reproducibility.

Minimum acceptability criteria should be described along with the means for demonstrating compliance.

Validation documentation is required. Laboratories adopting methods validated elsewhere should verify their methods and establish their own limits of detection and reproducibility.

Documentation shall contain sufficient information to allow a peer to evaluate case notes and interpret the data.

Analytical documentation should include documentation including charts, graphs, and spectra generated during analysis.

Laboratories shall perform proficiency testing in order to verify the laboratory’s performance. [17]

Hartshorn was asked whether she followed DEA protocols or at least the guidelines of SWGDRUG.  “[T]hey aren’t laws, and so, as of right now, that is not our policy,”[18] she casually responded. In other words, the DEA does not follow its own regulatory body. Even worse, the “DEA does not have such guidance set forth in one particular document type or ‘protocol’ that would provide instruction on how one is to test cocaine or marijuana. . . There are no mandatory methods, and the forensic chemists are afforded considerable discretion in determining which testing methods and instruments to use.”[19] This according to Harshorn’s lab director, James Malone, who testified that the DEA has no protocol or standard methodology and does not validate its drug tests; calibrate its testing instrumentation right before testing; or run contemporaneous scientific controls to prevent and detect contamination.[20]

Judge: For marijuana in this case, for example, there is no calibration? 

James Malone: There is not. . .  So we’re not running a positive control on the Duquenois-Levine (marijuana test) on a daily basis.

Prosecutor: Now with regard to standard methodologies, DEA has a standard methodology on how to do examinations?

JM: No, we don’t.

P: So for qualitative analysis, the actual identification of a drug, you don’t have such (validation) studies, as you understood her (defense expert) to mean, correct?

JM: Correct. . . Identification – (validation) studies related to identification are not generally – there are no requirements for that. (SWGDRUG: “Method validation is required to demonstrate that methods are suitable for their intended purpose.”[21])

According to SWGDRUG Recommendations at Part IV.A.6.1.1 (“Laboratories shall have and follow documented analytical procedures”); id at Part IV.A.6.1.6 (“Analytical procedures shall be validated in compliance with Part IV B Validation”); id, at Part IV.B.IA (“All methods shall be validated or verified to demonstrate that they will perform in the normal operational environment when used by individuals expected to utilize the methods on casework”); id at Part IV.B.1.5 (“The entire validation/verification process shall be documented and the documentation shall be retained. Documentation shall include … personnel involved, dates, observations from the process, analytical data, a statement of conclusions and/or recommendations, authorization approval signature”).”

In short, the DEA is not engaged in scientific testing; a conviction machine. Voodoo science as someone commented. It also means that the DEA labs are, in fact, unaccredited because they received their accreditation on the basis that they follow strict protocols and SOPs, determine error rates and test limitations, validate its tests, and run positive and negative controls.

What really set off Ryan, however, was Hartshorn’s testimony that the DEA’s marijuana tests as well as her testing are infallible.  She claimed a zero percent (0%) error rate with the tests and her testing.[22] “Ridiculous on its face,”[23] said Ryan.  “Ms. Hartshorn makes a bold statement in her testimony in which she asserted that the three tests performed in these cases are infallible in their combined ability to conclusively identify marijuana,” wrote defense expert Heather Harris. “She was unable to offer any scientific studies to confirm this assertion, which is a scientific impossibility.”[24]  The NAS report concluded that “no forensic method has been rigorously shown to have the capacity to consistently, and with a high degree of certainty, demonstrate a connection between evidence and a specific individual or source.”[25]

Infallibility claims fly in the face of the fact that uncertainty enters testing in many ways, and each life stage of the evidence is susceptible to error. Contamination or misidentification can occur during the collection of the evidence. Analytical methods have practical and technical limitations. Reference standards and controls may fail quality control checks. Laboratory analysts who oversee the entire analytical process may make mistakes. Transcription errors can occur. In short, contrary to Hartshorn’s testimony, there is a panoply of errors that can occur. The three tests she used were: a microscopic examination, a presumptive color test named Duquenois-Levine (D-L), and Thin Layer Chromatography (TLC). None of these tests provide a specific identification to the exclusion of all other possible substances, and each of these tests has an associated degree of uncertainty or error rate.

With the microscopic exam, DEA analysts look for so-called cystolith hairs which occur on marijuana plants. But many other plant species unrelated to marijuana have cystolith hairs. Thus, a false positive (error) is possible with this examination.  Also according to the NAS report, the microscopic exam can only be done properly by a qualified botanist.[26] The DEA does not employ botanists.

George Nakamura, who is not a botanist, established use of the microscopic exam as a marijuana test. He examined 600 plants and found 80 with cystolith hairs. He then subjected the 80 “similar” plants to the D-L test, and only marijuana passed the entire test.[27]  However there was an elementary scientific flaw in Nakamura’s procedure for which reason his report should not have been published, let alone adopted as a protocol. His plant population sample was woefully inadequate since there are 200 –500, 000 plants he did not examine, and there are at least 24 species of plants with cystolith hairs. Nakamura himself admitted that there were some 30,000 plants which he did not examine.

Nakamura also claimed that the D-L was confirmatory of, and, specific to, marijuana, i. e. identified it to the exclusion of all other substances and did not render false positives. In fact, with the D-L test, false positives are expected based on the analytical mechanism of color tests. Color tests are screening tests that look at molecular groups rather than the specific molecule as a whole. Many unrelated molecules share common molecular groups, so any substance containing the target molecular group would give a positive response. In other words, the D-L test solely identifies the group of chemicals to which marijuana belongs. And there are other chemicals in that group which could give a positive D-L response, i.e., a false positive. Moreover, Nakamura himself reported that there were 25 substances that had been shown to cause false positives with the D-L test. So his claim was contrary to chemical facts and scientific demonstrations, and, again, should not have been published.

The D-L test is actually a combination of two individual tests. With the Duquenois test, a petroleum ether or chloroform extract of the plant extract is added to an ethanolic solution of vanillin and acetaldehyde, followed by addition of concentrated hydrochloric acid. Marijuana gives a deep blue-violet color. With the Levine modification, the blue-violet test mixture obtained in the Duquenois test is shaken with chloroform. With marijuana, the blue-violet color is transferred into the chloroform layer. However, at least 50 legal substances have been shown to give the same color reactions.

As early as 1938, the French pharmacist Pierre Duquenois, who developed the Duquenois test, found that it was not specific and gave false positives.[28] Yet, he reported that the test was specific.[29]  Although he claimed it was specific, he worked to modify the original test into the D-L test to eliminate false positives –  which as noted above was impossible given the nature of the D-L test. As he should have known in advance, the D-L test was no better and rendered false positives. Still, he reported that the D-L test was specific. Duquenois’s lie was repeated in 1972 by John Thornton and George Nakamura who falsely claimed that the D-L test was specific and in conjunction with a microscopic exam was a confirmatory, identification test.[30] Their study is still the protocol for marijuana identification in crime labs throughout the country even though it was false and rebutted by Fullerton and Kurzman and Whitehurst.

With regard to TLC, its ability to identify a substance, which in this case is not marijuana but rather its active ingredient THC, is limited by the number of distinguishable responses possible. TLC is a method of separation, not of identification. “It is prone to confusion because of the appearance of unrecognized peaks or spots on a chromatograph, particularly when an analyst is dealing with a wide variety of biological samples from a number of sources.”[31] The TLC test as generally performed for marijuana evidence has 100 distinct measurable values and 2 to 3 distinguishable colors. This allows for the distinct identification of at most 300 compounds without taking into account the possibility of compounds that will behave the same as the target molecule, THC.  In other words, a positive TLC test could indicate any one of some 300 compounds in addition to THC.

When these three tests are performed in sequence, the uncertainty of the final result is the sum of the uncertainties attributable to each test. In this case, where each of the tests can produce errors, the uncertainty can be great.  Moreover, a main concern with this sequence of testing is that the D-L and TLC tests produce results that are heavily dependent on the analyst’s subjective interpretation of the colors produced. What’s dark blue to one analyst, is purple to another. At a minimum, a standard reference material (a sample of known marijuana) should be tested along with the evidence sample as a comparison sample. The DEA does not do this. In addition, without the proper determination of the variability of positive results, the final identification is still simply the analyst’s subjective opinion.

Confirmation bias is also a concern with this sequence of testing. This is the tendency of an analyst to interpret analytical information in a way that confirms his/her preconceptions about an item of evidence as well as the results of the previous test. In a sequence of testing that relies entirely upon an analyst’s interpretation of test results, this is a likely source of error.

Hartshorn admitted that separately each of the tests is a screening test that renders false positives, i.e. errors. But miraculously when they are conducted in concert, they are error-free as is the analyst. In direct contradiction of Hartshorn’s claims of infallibility was a study done at her own lab which found false positives and a very high 20% error rate.[32] And every independent scientific study has found an error rate and false positives with these tests. For instance, a comprehensive series of studies in 1974 involving no fewer than 14 scientists and two attorneys concluded, in part, as follows.[33]

The probability of error in using screening tests for forensic identification is particularly great with marijuana because:

1. Screening tests are not specific;

2. Many common plants are confused with marijuana by “users” and law officers alike;

3. Inexpertly collected plant samples are not necessarily homogenous, i. e., only a single plant; and

4. The flowering plants include some 200,000 – 500,000 species besides marijuana.

As many as 20% (An Army study found 30%.) of the samples presumed to be marijuana and submitted to forensic laboratories have been found in recent years not to be Cannabis. “If BNDD (Bureau of Narcotics and Dangerous Drugs, predecessor to DEA) files are any indication, many. . . marijuana users are getting ‘high’ on parsely, alfalfa, or some other weed.” Common plants which have been confused with marijuana include tobacco, catnip, parsley, oregano, tea and other substances – sometimes laced with various chemicals.

Inexpertly collected plant samples commonly contain some extraneous plant materials – a weed grabbed by mistake, a plant which looked like the others, etc. The forensic analyst then needs to be concerned with one plant passing one screening test, and a contaminant passing another. (Furthermore, it’s not possible to determine if ground-up plant samples are from the same species. To avoid a misidentification, the analyst should assume the sample is adulterated or contaminated.) Because of this factor, and the common presence of added chemicals, the specificity of marijuana screening tests, even when used in combination, is no greater than the specificity of the most specific single test.

Because Hartshorne’s testimony raised serious concerns about her qualifications and “integrity” as well as a “flaw” in her testing, Ryan ordered that the prosecution produce all information verifying that the three tests in combination were infallible.[34] What Ryan apparently did not realize was that Hartshorn was repeating unsupported infallibility claims made by DEA lab directors since at least 1999. For instance, on April 9, 1999, Joseph P. Bono, director of the DEA’s Mid-Atlantic Laboratory submitted a sworn affidavit to the courts that all DEA analyses and tests are “incapable of producing a false positive. . . In other words, even if the test results are inaccurate, the results will not indicate the presence of a controlled substance when none is present in the unknown sample. Even if the instruments used in the testing are not properly calibrated, if no controlled substance is present in the exhibit, then no controlled substance will be identified . . . even when an instrument is not functioning properly, it will not identify cocaine, or any other controlled substance, as being present in a sample, unless that controlled substance is actually present.”[35]

Bono’s successor at this lab, Richard Fox, was more specific in his sworn affidavit which stated, in part, that:

“There is no other plant material that will give a positive result for all three tests. . . Neither the analyst in this case, nor any other DEA analyst, has ever misidentified marijuana. . . As such, the uncertainty measurement associated with the conclusions reached by the analyst resulting in the identification of marijuana is zero.”[36]

Fox’s successor, James Malone, who is also Hartshorn’s supervisor who has signed off on her reports, has testified, in part, as follows in another marijuana case in D.C.

Prosecutor: To your knowledge, while you’ve been at the lab, has the laboratory ever misidentified a controlled substance?

James Malone: No.

P: And when you say – what are you basing that on?

JM: On my knowledge of the operations of the laboratory. We have not misidentified anything.

P: Are you aware of anything which shows that a mis-calibrated system or chromatographer in this case, but any system that was not calibrated correctly would create a false positive for cocaine or a controlled substance?

JM: No

P: Have you ever seen it in the lab? 

JM: Have I ever seen what?

P: A false positive from a mis-calibrated system.

JM: No.

Judge: But Mr. Chawla’s position was, can it ever – can a mis-calibrated machine ever give a false positive?

JM:  No. A mis-calibrated machine isn’t going to give you a positive cocaine if there’s not cocaine.

Judge: Why not?

JM: It just wouldn’t. . .

P: More specifically, if the reagent isn’t working, is it going to show that the substance isn’t marijuana? In other words, if the reagent isn’t working, what’s the result of the Duquenois-Levine going to be?

JM: It’s going to be negative.

P: Would I get a positive out of a Duquenois-Levine test? If I used a reagent that wasn’t working anymore and tried to run a Duquenois-Levine with that reagent, what would happen?

JM: You wouldn’t get a false positive, no.

P: With regard to identification techniques, is there any – do you have any reason to believe that a mis-calibrated or non-calibrated device would result in a false positive?

JM: No, I don’t.[37]

Malone’s testimony makes clear that he is basing his infallibility claim on ipse dixit evidence as were Bono and Fox who have never presented data to support their unheard of assertions.

Decades before their infallibility claims, several high courts including the U.S. Supreme Court found that the tests did not prove the presence of marijuana beyond a reasonable doubt. The Supreme Court of Wisconsin ruled in 1973 that: “An expert opinion that the substance is probably marijuana (based on a microscopic examination, D-L test and TLC) is not sufficient to meet the burden of proving the identity of the substance beyond a reasonable doubt. . . If this were a possession case, the tests would be insufficient. . . It is quite true that the tests used by Mr. Michael Rehburg, a chemist and witness for the prosecution, were not specific for marijuana. . . . He admitted, . . .  these tests were not specific for marijuana.”[38]

In 1979, a trial judge in North Carolina found that the D-L test was “not specific for marijuana” and had “no scientific acceptance as a reliable and accurate means of identifying the controlled substance marijuana.”[39] This finding was upheld by the North Carolina Court of Appeals as well as the North Carolina Supreme Court which found that: “The determination that the test used was not scientifically acceptable because it was not specific for marijuana was amply supported by the facts. . . The trial court’s ruling that the results of the tests conducted on green vegetable matter by using the Duquenois-Levine color test in the Sirchie drug kit were inadmissible in evidence was supported by the court’s findings that the test is not scientifically accepted, reliable or accurate and that the test is not specific for marijuana because it reportedly also gives a positive reaction for some brands of coffee and aspirin. . . . The conclusion to exclude the test results is amply supported by these findings of fact . . . and the test results were properly suppressed . . .”[40]

Also in 1979, the U.S. Supreme Court in Jackson v Virginia ruled that nonspecific tests could not be the basis for advancing a prosecution or a conviction because they do not provide proof beyond a reasonable doubt.[41]

Ultimately, Judge Ryan concluded that “such claims of infallibility belie one of the most basic tenets of science: that some degree of error is inherent in every scientific test, process, or analysis. . .While explaining that each of these tests used alone is presumptive, as distinct from confirmatory, Ms. Hartshorn nonetheless maintained their infallibility when used in concert. With the designation that these tests are merely presumptive, the DEA chemist acknowledged that there is some degree of inherent error calculable with respect to each of these tests when they are performed in isolation. That there is some distinct and additional degree of error calculable with respect to this analyst’s performance of each test is also without question.”[42]

It is clear from Judge Ryan’s remarks that he would have denied admission of the test results as evidence as well as Hartshorn’s testimony at trial, and this would have resulted in a withdrawal of the charges. He did not do so because defense counsel did not request it. Since Kurzman’s study and others occurred before this case as well as applicable court decisions such as Jackson, Daubert and Kumho Tire, defense counsel should have requested an evidentiary hearing for challenging the tests and sufficiency of evidence. Their failure to do so amounted to ineffective counsel.

This is exactly what U.S. District Court Judge Nancy Gertner concluded in a similar case wherein the defense counsel did not request an evidentiary hearing to challenge the forensic evidence. This is seen if one simply substitutes “marijuana” in her following remarks. “Under the ‘prevailing professional norms,’ reasonably competent counsel should have moved for a Daubert/Kumho Tire hearing before trial on all the expert testimony — a) on the [marijuana] laboratory analysis based on the investigator’s failure to use a comparison or control sample and not test beyond the generic finding of [“Exhibit 1 contains a measurable amount of marijuana”]; b) on the [marijuana] evidence, highlighting problems with proficiency testing and emphasizing the limited scope of the testimony; and, c) on the expert cause-and-origin testimony, when the expert’s proposed testimony was scientifically flawed. If counsel had requested such a hearing, there is more than a ‘reasonable probability’ that it would have been granted, that the laboratory analysis and the [marijuana] evidence would have been excluded, or severely limited, at the very least. . . .  As the Court held in Daubert, some testimony may be so problematic that the usual trial techniques are just not enough to prevent a jury from giving it far more credence than it deserves. See Daubert, 509 U.S. at 596-97. The testimony should not reach the jury at all. (This was absolutely true with Judge Ryan’s case.) Here, the scientific literature cast doubt on the significance of the [marijuana tests] and even raised concerns about . . . “proficiency” testing, concerns counsel never raised. . . just what the law and literature caution against”[43]

It is instructive to compare the two cases in detail because like Judge Ryan, Judge Gertner also critiqued the government’s evidence and experts through the prism of the NAS report. Gertner pointed out that it was significant that by 2006, a number of articles in legal journals and cases had cast a critical eye on the scientific reliability of arson evidence, methodologies, and techniques. Because of this, competent counsel should have been aware that defendants had been convicted and sentenced on the basis of flawed arson evidence and taken appropriate steps to litigate the issues using all the tools available including challenging the tests and requesting an evidentiary hearing.

The same was even more true of marijuana evidence by the time of Judge Ryan’s case.  The marijuana tests had been scientifically established as unreliable and inaccurate, and previous court decisions had excluded admission of the marijuana test results as evidence.

Gertner found that there was ineffective counsel because the defense attorneys did not move for a Daubert hearing prior to trial on any expert issue. They did not seek exclusion of any of the proposed expert testimony or move for its limitation. They did not argue that the expert testimony failed to meet the minimal threshold for reliability of scientific evidence and should not have been admitted at all. They did not alert the Court to the ways in which the government’s investigation undermined their very ability to present a defense.

The same was true with the case of Judge Ryan who called Hartshorn’s testimony “[R]idiculous on its face” and lacking in “integrity.”

In addition, Gertner argued that it was crucial to try to exclude expert testimony before trial because “a certain patina attaches to an expert’s testimony unlike any other witness; this is ‘science,’ a professional’s judgment, the jury may think, and give more credence to the testimony than it may deserve. United States v. Hines, 55 F. Supp. 2d 62, 64 (D. Mass. 1999); see also Michigan Millers Mut. Ins. Corp. v. Benfield, 140 F.3d 915, 920 (11th Cir. 1998) (‘The use of ‘science’ to explain how something occurred has the potential to carry great weight with a jury, explaining both why counsel might seek to couch an expert witness’s testimony in terms of science, as well as why the trial judge plays an important role as the gate-keeper in monitoring the evidentiary reliability of such testimony.’).”[44]

This again was even more true with Judge Ryan’s case because DEA chemists were poised to testify that the marijuana tests as well as their testing were infallible, and that no DEA analyst had ever misidentified marijuana. In fact, defense counsel in Judge Ryan’s case had been involved in previous marijuana case wherein DEA analysts had claimed infallibility under oath. All the more reason why they should have sought to exclude the evidence.

For its part, the DEA was ethically and scientifically bound to suspend Hartshorn and Malone and investigate all their previous marijuana cases. In fact, Hartshorn and Malone were subsequently both witnesses in another discovery hearing in the same court room opposed by the same defense counsel who again had not requested an evidentiary hearing to challenge the same marijuana tests. This hearing was presided over by Judge Florence Y. Pan who had read Judge Ryan’s order.[45] Heather Harris, who was highly praised by Judge Ryan, was the defense expert in this hearing as well. With no justification, Pan found Hartshorn and Malone to be credible as opposed to Harris even though Malone claimed infallibility without any proof. “On my knowledge of the operations of the laboratory,” he said, “We have not misidentified anything.” He also said that “a mis-calibrated instrument would never cause a false positive result.” Asked why by Pan, he replied:  “It just wouldn’t.”[46]

As we saw, Malone further testified that the DEA has no protocols or standard operating procedures and does not validate its tests or run sufficient numbers of controls.[47]  He threw in that the Analysis of Drugs Manual and the Analytical Sufficiency Document  are “the closest thing the DEA has to standard operating procedures for the chemists.”[48] Again, no problem for Pan even though Malone said these documents were “DEA proprietary,”[49] and SWGDRUG and scientific practice require protocols, test validations, and controls. Malone claimed there were published studies validating the tests, but this is not true.

Harris disagreed with Malone on all accounts.  No problem for Pan who decreed that: “To the extent the testimony of the witnesses conflicts, however, the Court credits the testimony of Mr. Malone. . . the Court found the testimony of Mr. Malone to be extremely credible and persuasive [and was] impressed by Mr. Malone’s candor, expertise, and professional demeanor. . . His testimony was very clear and logical, and the Court found him to be forthright.”[50] Pan did not mention the lack of scientific data or explanations for Malone’s testimony or that it showed the DEA was at odds with SWGDRUG requirements and scientific practice.

In short, there were more than enough scientific studies and favorable case law before Judge Pan’s case, not to mention Judge Ryan’s order, to justify requesting an evidentiary hearing in an attempt to deny admission of the test results as evidence. Defense counsel also had a highly qualified expert to confirm that the tests results did not provide proof beyond a reasonable doubt, and that the DEA’s proffered evidence and testimony were false.

As Judge Gertner observed: “If the lawyers do not tee up the issue, the evidence will be introduced without objection.”[51] This is exactly what happens in nearly all marijuana cases. Defense attorneys do not challenge the tests or the sufficiency of the evidence. In 2010, 853, 839 people were arrested on marijuana charges, and you can count on one hand the number of defense attorneys who challenged the tests or even the subjective opinions of arresting police officers.

This failure on the part of defense attorneys is particularly irresponsible because claims of infallibility can be to the advantage of a defendant as they undermine the admissibility of marijuana test results and the credibility of a prosecutor’s expert witnesses. Before a trial, a defense attorney can request an evidentiary hearing wherein he or she can examine the qualifications of the prosecution’s forensic analysts, the laboratory, and the nature and manner of the testing procedures used in identifying the drug the defendant was charged with possessing or selling. If this examination reveals deficiencies or inadequacies, the attorney can challenge the sufficiency of the prosecution’s evidence and seek a dismissal.  Dr. Bruce Stein et al have reported that: “Based on our survey, such a challenge would be warranted in many cases.”[52]

The possibilities of these challenges was seen in a recent case in Michigan in 2010.   Defense attorney Michael Nichols obtained a pre-trial evidentiary hearing and cross examined Michigan State Police lab analyst Jerome Waldron who testified that in more than 6,000 cases, he had never encountered a false positive, and that the marijuana tests had an error rate of zero. Nichols then entered a motion to exclude Waldron’s testimony from trial as well as use of the test results as evidence, citing scientific articles, prior court decisions, and Waldron’s lack of credibility. Even before the judge rendered his decision, the prosecutor withdrew the charges.[53]

If lab conditions or procedures do not conform to scientific guidelines and principles or court rulings such as Daubert, the defense attorney can motion to exclude the test results as well as testimony from the analyst at trial. Below is a list of such requests which have led to pre-trial dismissals of marijuana charges because they revealed deficiencies in the lab.

1. Evidence collection forms or logs (description of evidence, packaging, identification of specimens, identification of individuals collecting samples, sample collection procedures.

2. Chain-of-custody records (field-to-lab transfers, and all transfers of evidence and associated analytical samples within the laboratory).

3. Laboratory receiving records (records documenting the date, time and condition of receipt of the evidence in question; laboratory-assigned identifiers; storage location).

4. Laboratory procedures for subsampling (collection of analytical aliquots) and contamination control.

5. Copies of technical procedures in effect at the time the subject testing was performed (often termed Standard Operating Procedures, or SOP’s) for each procedure used during sample screening and confirmation, including; sample preparation, sample analysis, data reporting, and instrument operation.

6. Copies of the two bracketing controlled substance proficiency results for each analyst and technician responsible for preparation or analysis of subject specimens, including raw data and reported results, target values and acceptance ranges, performance scores, and all related correspondence.

7. Copies of traceability documentation for standards and reference materials used during analysis, including unique identifications, origins, dates of preparation and use, composition and concentration of prepared materials, certifications or traceability records from suppliers, assigned shelf lives and storage conditions.

8. Sample preparation records, including dates and conditions of preparation, responsible analyst, procedural reference, purity, concentration and origins of solvents, reagents, and control materials prepared and used, samples processed concurrently, extract volume.

9. Copies of bench notes, log books, and any other records pertaining to case samples or instruments; records documenting observations, notations, or measurements regarding case testing.

10. Instrument run log with identification of all standards, reference materials, sample blanks, rinses, and controls analyzed during the day/shift with subject samples (as appropriate: run sequence, origins, times of analysis and aborted run sequences).

11. Record of instrument operating conditions and criteria for variables, including as appropriate: Gas chromatograph column, instrument file identification, tuning criteria, instrument performance check (e.g., ion abundance criteria), initial calibration, continuing calibration checks, calibration verification.

12. Record of instrument maintenance status and activities for instruments used in subject testing, documenting routine and as-needed maintenance activities in the weeks surrounding subject testing.

13. Raw data for the complete measurement sequence (opening and closing quality control included) that includes the subject samples.  For GC-MS analysis, this would include: areas and retention times, injection volumes, dilution factors, chromatograms and mass spectra.  As prepared and as determined values for all quality control samples.

14. A description of the library used for spectral matches for the purpose of qualitative identification of controlled substances, including source(s) and number of reference spectra.

15. Copy of records documenting computation of illicit drug laboratory’s theoretical production yield, including the basis for the computation, and the algorithm used, as appropriate.

16. Procedure(s) for operation and calibration checks of analytical balances used to weigh controlled substances

17. Results of calibration checks and documentation of mass traceability for gravimetric determinations.

18. Results of contamination control surveys for trace level analytes relevant to test methods at the time of analysis, including sampling design and analytical procedures.

19. Records and results of internal reviews of subject data.

20.  Method validation records documenting the laboratory’s performance characteristics for qualitative identification and quantitative determinations of the controlled substance, to include data documenting specificity, accuracy, precision, linearity, and method detection limits.

21. Copy of the laboratory’s Quality Manual in effect at the time the subject samples were tested as well as the laboratory’s most recent Quality Manual (however named; the document that describes the laboratory’s quality objects and policies).

22. Copy of the laboratory’s ASCLD-LAB application for accreditation, and most recent Annual Accreditation Review Report, as appropriate.

23. Statement of qualifications of each analyst and/or technician responsible for processing case samples to include all names, locations and jurisdictions of cases in which these personnel testified concerning the same substances found in the present case.

24. Copy of the laboratory’s ASCLD-LAB on-site inspection report, as appropriate, as well as any reports of on-site inspections by any other testing laboratory audit organization.

25.  Copy of internal audit reports generated during the period subject samples were tested..

26.  List of capital instrumentation in the laboratory at the time subject testing was performed, including manufacturer, model number, and major accessories.

27. Production throughput data for the drug testing section: numbers of tests performed per month or per year, and the number of Full Time Equivalent personnel in the drug testing section of the laboratory.[54]

Marijuana field tests also have specific requirements that are seldom observed by the police. For instance, the field tests used by police officers have expiration dates because the chemicals and reagents in the tubes deteriorate over time and as a result of heat or cold. Before going to a hearing or trial, a defense attorney can find out exactly what brand of field test kit was used with his/her client. This can be done through a public records request and sometimes by simply asking the prosecutor. The defense attorney can then purchase the exact same kit online. In court, the defense attorney can show the judge that the test has an expiration date after which the test would be inaccurate. If the police officer did not check the expiration date before using the test, then the test results should be assumed to be invalid. Under the law, any tests or equipment that are not in good working order produce results that are inadmissible as evidence. If the police officer cannot attest to the expiration date or whether the test was used after its expiration date, the drug charges should be dismissed. Some search warrants are based on positive kit results and may be ruled invalid if the police officer did not know the expiration date of the kit. This should also result in a dismissal of charges.

Even if the field test has not expired, the test does not prove the presence of marijuana in a seized substance because it is a presumptive or screening test only. Information accompanying the kits indicate this fact. For instance, the carton containing one commonly used NIK field test states that it is: “A specially formulated reagent system for the presumptive identification of Marijuana.”  In other words, the company itself is saying that the test does not prove the presence of marijuana. It is further stated that: “The results of a single test may or may not yield a valid result. . . There is no existing chemical reagent test, adaptable to field use that will continually eliminate the occurrence of an occasional invalid test results [sic]. A complete forensic laboratory would be required to qualitatively identify an unknown suspect substance.”[55]  A defense attorney can show this to a judge or jury and explain what it means. Therefore, if the only evidence is positive results from a field test, the charges should be dismissed or the defendant acquitted.

Recently, defense attorneys in Colorado did challenge the DEA’s test results and blocked their admission as evidence including results from Gas Chromatography/Mass Spectrometry (GC/MS) analysis, the gold standard of drug testing. U.S. District Court Judge Marcia S. Krieger of Colorado ruled on April 21, 2011 that based on DEA information and the testimony of DEA chemist Anthea Chan, the prosecution failed to show the existence of reliable, accurate testing being reliably applied that proved the presence of amphetamines. She therefore denied admission of the test results as evidence at trial.[56]

The hearing, known as a Rule 702 (of the Federal Rules of Evidence) Hearing, provided a rare glimpse into the inner workings of a DEA lab. It was meant to determine whether their testing conformed to Rule 702 requirements for scientifically sound testing. Rule 702 requirements are all but identical to Daubert requirements. Krieger’s first task was to determine whether Chan had correctly tested according to DEA protocols and SOPs. Chan testified that she followed no protocols or SOPs and, in fact, was not aware of any protocols or SOPs.[57] These facts alone, said Krieger, were enough to deny admission of the test results as evidence because it was impossible to determine whether Chan reliably applied reliable tests.

Krieger did, not, however, rule at this point because she wanted her ruling to encompass  defense expert Janine Arvizu’s findings. Arvizu attempted to reconstruct the practices, protocols, and results relevant to Chan’s qualitative and quantitative test conclusions and whether they adhered to quality requirements and universally accepted standards designed to ensure the quality and reliability of tests, specifically, what’s known as ISO 17025 standards. However, as was the case in Washington, only a very limited amount of laboratory discoverable material was made available making it impossible to determine or evaluate the laboratory’s technical requirements or quality controls during the subject testing.

“That’s exactly the position the Court finds itself in,” noted Judge Krieger, “because it does not have evidence as to the protocol that was used, the reliability of the protocol compared to other labs, or whether Ms. Chan complied with the protocol in a reliable fashion.”[58]

Arvizu was, however, able to determine that Chan’s testing in particular was unreliable and inaccurate. Chan first used the Marquis chemical color test as a screening test, and the suspected substance turned orange/brown suggesting it was amphetamines.  But the test was unreliable and meaningless because she did not use a color chart with which to compare her results. As she herself testified: “I believe it’s the same as you saying something is blue and me saying it’s light blue. It’s subjective.”[59] Subjective tests are unreliable by definition.

Her next test was a GC/MS analysis.  Chan first ran a “blank” or negative control to check for contamination. The test consisted of putting the suspected amphetamines into a solution and then placing this solution onto the machine. But she first put the solution alone onto the machine, to see whether it would register positive. It did, meaning the machine was contaminated.[60] As Arvizu testified: “When quality control samples fail, the run should be terminated and the failure should be investigated and corrective action taken before unknown sample are tested.”[61] Inexplicably, Chan continued the testing with the contaminated machine.

Actually, even before beginning her test, Chan should have also run a positive control by placing a known quantity of amphetamines, known as a standard, on the machine to calibrate it and see whether it was working properly. DEA analysts are required under ASCLD/LAB and ISO 17025 guidelines to run standards immediately before testing. Chan said she was not familiar with these guidelines and was not required to do so. Chan’s superior Shana Irby, who approved her testing, also testified that it is not required to run contemporaneous standards, and that it suffices if the machine has been checked ten months prior.[62] She claimed to have never seen any protocol requiring the running of contemporaneous standards, and that “as soon as I walk up to an instrument, I know – I generally know if it’s working or not.”[63] She also claimed it was not necessary to check beforehand whether the standard had disintegrated because “[M]ethamphetamine to my knowledge does not degrade.”[64] This is false, and these standards come with an expiration date beyond which they are not useable.

DEA labs are accredited by the American Society of Crime Laboratory Directors/ Laboratory Accreditation Board ((ASCLD/LAB) under the international criteria detailed in ISO/IEC 17025:2005 and the 2006 ASCLD/LAB International Supplemental Requirements. Accreditation certifies that the management and technical operations of the laboratory comply with the program requirements, including any corrective action that was required during any of audits. (Details regarding the accreditation program may be obtained from www.ascld-lab.org.) In other words, DEA labs are accredited on the basis that they ascribe to ISO/IEC 17025 and ASCLD/LAB International Supplemental Requirements. Arvizu said the DEA adheres to neither, and is, therefore, de facto, unaccredited.

Why Did Popular Science Can Its Comments Section?

Contributing Author - Oct 17, 2013: 8:33 pm

Why Did Popular Science Can Its Comments Section?

Email    Print    Share

Posted on Oct 17, 2013

kevin dooley (CC BY 2.0)

Editors of the Popular Science website last month announced they would no longer accept readers’ comments under new articles. Why? Because studies suggest Internet “trolls” don’t just spoil the chance for intellectual debate, they create doubt where there should be none.

“It wasn’t a decision we made lightly,” wrote Suzanne LaBarre, the magazine’s online content director. “As the news arm of a 141-year-old science and technology magazine, we are as committed to fostering lively, intellectual debate as we are to spreading the word of science far and wide. The problem is when trolls and spambots overwhelm the former, diminishing our ability to do the latter.”

LaBarre cited a study led by University of Wisconsin-Madison professor Dominique Brossard, in which 1,183 Americans were asked to read a fake blog post on a science topic and state in a survey how they felt about the subject. Then they were randomly assigned either “epithet- and insult-laden comments” or “civil comments,” LaBarre explained.

The study’s authors said of the results in a New York Times op-ed:

Uncivil comments not only polarized readers, but they often changed a participant’s interpretation of the news story itself.

In the civil group, those who initially did or did not support the technology — whom we identified with preliminary survey questions — continued to feel the same way after reading the comments. Those exposed to rude comments, however, ended up with a much more polarized understanding of the risks connected with the technology.

Simply including an ad hominem attack in a reader comment was enough to make study participants think the downside of the reported technology was greater than they’d previously thought.

Another similar study determined that disagreements between commenters that were firmly worded but not uncivil still impacted readers’ perception of science, LaBarre reported.

“If you carry out those results to their logical end,” LaBarre wrote, “commenters shape public opinion; public opinion shapes public policy; public policy shapes how and whether and what research gets funded—you start to see why we feel compelled to hit the ‘off’ switch.”

“A politically motivated, decades-long war on expertise has eroded the popular consensus on a wide variety of scientifically validated topics. Everything, from evolution to the origins of climate change, is mistakenly up for grabs again. Scientific certainty is just another thing for two people to ‘debate’ on television. And because comments sections tend to be a grotesque reflection of the media culture surrounding them, the cynical work of undermining bedrock scientific doctrine is now being done beneath our own stories, within a website devoted to championing science.”

“Even a fractious minority wields enough power to skew a reader’s perception of a story,” LaBarre wrote.

—Posted by Alexander Reed Kelly.

More Below the Ad

Get truth delivered to
your inbox every week.

Previous item: Americans Need More Downtime—Seriously

New and Improved Comments

If you have trouble leaving a comment, review this help page. Still having problems? Let us know. If you find yourself moderated, take a moment to review our comment policy.

Please enable JavaScript to view the comments powered by Disqus.