Researchers used machine learning and natural language processing to find bias in opioid misuse classifiers.
On August 19, 2021, researchers at Rush University Medical Center conducted a machine learning study to determine natural language processing (NLP) biases related to opioid abuse classifiers. For the past 20 years, smart computing and machine learning have led the way Gained important Instruments in patient-centered health care. Learning has shown that you can overcome population-level clinical judgment by reducing the burden of screening and exposing inequalities in chronic diseases and conditions. Any data may be biased in the analysis, including sample, measurement, representative, and historical bias. Biases can affect machine learning at every step of model development, testing, and implementation, leading to algorithmic biases and feedback loops.
The bias can have a significant impact on the health of the population and lead to inequalities in disadvantaged groups. “When natural language processing (NLP) classifiers are developed with biased or unbalanced datasets, disparities between subgroups can be encoded, maintained and exacerbated if biases are not assessed, identified and attenuated” layers of damage, “the researcher wrote in the study. According to the researchers, medical institutions and pharmaceutical companies in the United States had a significant impact on the opioid overdose epidemic. In 2011, opioid prescriptions and deaths from pharmaceutical opioids more than tripled.
As opioid use shifted to drugs and pain sufferers, opioid abuse expanded from criminalization and withdrawal models, primarily targeting black and brown men in cities, to a disease model or addiction. However, studies of substance misuse screening programs and treatment services illustrate how medicine retained racial biases and unequal access. Given the structural history of how the breed affects clinical drug abuse data, researchers applied the principles of fairness, accountability, transparency, and ethics (FATE) to examine the predictions of the NLP classifier of opioid abuse. Fairness in detection tools is critical in planning mitigation or removal prior to implementation. In this article, we will first apply techniques to check our classifier for fairness and bias by adjusting a number of bias tools, and then try to correct for bias using post-hoc methods, ”the researchers explained.
Researchers then examined facial validity by running Local Interpretable Model Diagnostic Explanations (LIME) on all predictions with average traits to look for differences in traits between racial / ethnic groups. Two experiments were carried out with data from electronic health records. Differences in Type II error rates between racial / ethnic subgroups (Black, Hispanic / Latino, Whites, others) using 95 percent bootstrap confidence intervals. (0.17) from the white subgroup. The main characteristics were “heroin” and “substance abuse” in all subgroups.
“Post-hoc recalibrations eliminated bias in FNR with minimal changes in other subgroup error metrics. The Black FNR subgroup had higher risk scores for readmission and mortality than the White FNR subgroup, and a higher mortality risk score than the Black true positive subgroup (P < .05),” the researchers wrote.
The researchers found that the black FNR subgroup had the highest disease severity and risk of poor outcome. Similar traits were also reflected between the subgroups to predict opioid abuse; However, there were inequalities. Post hoc mitigation techniques mitigated biases in Type II error rates without creating significant Type I error rates. Bias and data disadvantages should be systematically addressed throughout the process. The researchers concluded that standardized and transparent assessments of bias are necessary to improve confidence in clinical machine learning models.
Source link
