Best practices to evaluate the impact of biomedical research software-metric collection beyond citations.

MOTIVATION: Software is vital for the advancement of biology and medicine. Impact evaluations of scientific software have primarily emphasized traditional citation metrics of associated papers, despite these metrics inadequately capturing the dynamic picture of impact and despite challenges with improper citation. RESULTS: To understand how software developers evaluate their tools, we conducted a survey of participants in the Informatics Technology for Cancer Research (ITCR) program funded by the National Cancer Institute (NCI). We found that although developers realize the value of more extensive metric collection, they find a lack of funding and time hindering. We also investigated software among this community for how often infrastructure that supports more nontraditional metrics were implemented and how this impacted rates of papers describing usage of the software. We found that infrastructure such as social media presence, more in-depth documentation, the presence of software health metrics, and clear information on how to contact developers seemed to be associated with increased mention rates. Analysing more diverse metrics can enable developers to better understand user engagement, justify continued funding, identify novel use cases, pinpoint improvement areas, and ultimately amplify their software's impact. Challenges are associated, including distorted or misleading metrics, as well as ethical and security concerns. More attention to nuances involved in capturing impact across the spectrum of biomedical software is needed. For funders and developers, we outline guidance based on experience from our community. By considering how we evaluate software, we can empower developers to create tools that more effectively accelerate biological and medical research progress. AVAILABILITY AND IMPLEMENTATION: More information about the analysis, as well as access to data and code is available at https://github.com/fhdsl/ITCR_Metrics_manuscript_website.

Rarefaction is currently the best approach to control for uneven sequencing effort in amplicon sequence analyses.

Considering it is common to find as much as 100-fold variation in the number of 16S rRNA gene sequences across samples in a study, researchers need to control for the effect of uneven sequencing effort. How to do this has become a contentious question. Some have argued that rarefying or rarefaction is "inadmissible" because it omits valid data. A number of alternative approaches have been developed to normalize and rescale the data that purport to be invariant to the number of observations. I generated community distributions based on 12 published data sets where I was able to assess the ability of multiple methods to control for uneven sequencing effort. Rarefaction was the only method that could control for variation in uneven sequencing effort when measuring commonly used alpha and beta diversity metrics. Next, I compared the false detection rate and power to detect true differences between simulated communities with a known effect size using various alpha and beta diversity metrics. Although all methods of controlling for uneven sequencing effort had an acceptable false detection rate when samples were randomly assigned to two treatment groups, rarefaction was consistently able to control for differences in sequencing effort when sequencing depth was confounded with treatment group. Finally, the statistical power to detect differences in alpha and beta diversity metrics was consistently the highest when using rarefaction. These simulations underscore the importance of using rarefaction to normalize the number of sequences across samples in amplicon sequencing analyses. IMPORTANCE: Sequencing 16S rRNA gene fragments has become a fundamental tool for understanding the diversity of microbial communities and the factors that affect their diversity. Due to technical challenges, it is common to observe wide variation in the number of sequences that are collected from different samples within the same study. However, the diversity metrics used by microbial ecologists are sensitive to differences in sequencing effort. Therefore, tools are needed to control for the uneven levels of sequencing. This simulation-based analysis shows that despite a longstanding controversy, rarefaction is the most robust approach to control for uneven sequencing effort. The controversy started because of confusion over the definition of rarefaction and violation of assumptions that are made by methods that have been borrowed from other fields. Microbial ecologists should use rarefaction.

Waste not, want not: revisiting the analysis that called into question the practice of rarefaction.

In 2014, McMurdie and Holmes published the provocatively titled "Waste not, want not: why rarefying microbiome data is inadmissible." The claims of their study have significantly altered how microbiome researchers control for the unavoidable uneven sequencing depths that are inherent in modern 16S rRNA gene sequencing. Confusion over the distinction between the definitions of rarefying and rarefaction continues to cloud the interpretation of their results. More importantly, the authors made a variety of problematic choices when designing and analyzing their simulations. I identified 11 factors that could have compromised the results of the original study. I reproduced the original simulation results and assessed the impact of those factors on the underlying conclusion that rarefying data is inadmissible. Throughout, the design of the original study made choices that caused rarefying and rarefaction to appear to perform worse than they truly did. Most important were the approaches used to assess ecological distances, the removal of samples with low sequencing depth, and not accounting for conditions where sequencing effort is confounded with treatment group. Although the original study criticized rarefying for the arbitrary removal of valid data, repeatedly rarefying data many times (i.e., rarefaction) incorporates all the data. In contrast, it is the removal of rare taxa that would appear to remove valid data. Overall, I show that rarefaction is the most robust approach to control for uneven sequencing effort when considered across a variety of alpha and beta diversity metrics.IMPORTANCEOver the past 10 years, the best method for normalizing the sequencing depth of samples characterized by 16S rRNA gene sequencing has been contentious. An often cited article by McMurdie and Holmes forcefully argued that rarefying the number of sequence counts was "inadmissible" and should not be employed. However, I identified a number of problems with the design of their simulations and analysis that compromised their results. In fact, when I reproduced and expanded upon their analysis, it was clear that rarefaction was actually the most robust approach for controlling for uneven sequencing effort across samples. Rarefaction limits the rate of falsely detecting and rejecting differences between treatment groups. Far from being "inadmissible", rarefaction is a valuable tool for analyzing microbiome sequence data.

Machine learning classification by fitting amplicon sequences to existing OTUs.

The ability to use 16S rRNA gene sequence data to train machine learning classification models offers the opportunity to diagnose patients based on the composition of their microbiome. In some applications, the taxonomic resolution that provides the best models may require the use of de novo operational taxonomic units (OTUs) whose composition changes when new data are added. We previously developed a new reference-based approach, OptiFit, that fits new sequence data to existing de novo OTUs without changing the composition of the original OTUs. While OptiFit produces OTUs that are as high quality as de novo OTUs, it is unclear whether this method for fitting new sequence data into existing OTUs will impact the performance of classification models relative to models trained and tested only using de novo OTUs. We used OptiFit to cluster sequences into existing OTUs and evaluated model performance in classifying a dataset containing samples from patients with and without colonic screen relevant neoplasia (SRN). We compared the performance of this model to standard methods including de novo and database-reference-based clustering. We found that using OptiFit performed as well or better in classifying SRNs. OptiFit can streamline the process of classifying new samples by avoiding the need to retrain models using reclustered sequences. IMPORTANCE There is great potential for using microbiome data to aid in diagnosis. A challenge with de novo operational taxonomic unit (OTU)-based classification models is that 16S rRNA gene sequences are often assigned to OTUs based on similarity to other sequences in the dataset. If data are generated from new patients, the old and new sequences must be reclustered to OTUs and the classification model retrained. Yet there is a desire to have a single, validated model that can be widely deployed. To overcome this obstacle, we applied the OptiFit clustering algorithm to fit new sequence data to existing OTUs allowing for reuse of the model. A random forest model implemented using OptiFit performed as well as the traditional reassign and retrain approach. This result shows that it is possible to train and apply machine learning models based on OTU relative abundance data that do not require retraining or the use of a reference database.

Evaluation of software impact designed for biomedical research: Are we measuring what's meaningful?

Software is vital for the advancement of biology and medicine. Through analysis of usage and impact metrics of software, developers can help determine user and community engagement. These metrics can be used to justify additional funding, encourage additional use, and identify unanticipated use cases. Such analyses can help define improvement areas and assist with managing project resources. However, there are challenges associated with assessing usage and impact, many of which vary widely depending on the type of software being evaluated. These challenges involve issues of distorted, exaggerated, understated, or misleading metrics, as well as ethical and security concerns. More attention to the nuances, challenges, and considerations involved in capturing impact across the diverse spectrum of biological software is needed. Furthermore, some tools may be especially beneficial to a small audience, yet may not have comparatively compelling metrics of high usage. Although some principles are generally applicable, there is not a single perfect metric or approach to effectively evaluate a software tool's impact, as this depends on aspects unique to each tool, how it is used, and how one wishes to evaluate engagement. We propose more broadly applicable guidelines (such as infrastructure that supports the usage of software and the collection of metrics about usage), as well as strategies for various types of software and resources. We also highlight outstanding issues in the field regarding how communities measure or evaluate software impact. To gain a deeper understanding of the issues hindering software evaluations, as well as to determine what appears to be helpful, we performed a survey of participants involved with scientific software projects for the Informatics Technology for Cancer Research (ITCR) program funded by the National Cancer Institute (NCI). We also investigated software among this scientific community and others to assess how often infrastructure that supports such evaluations is implemented and how this impacts rates of papers describing usage of the software. We find that although developers recognize the utility of analyzing data related to the impact or usage of their software, they struggle to find the time or funding to support such analyses. We also find that infrastructure such as social media presence, more in-depth documentation, the presence of software health metrics, and clear information on how to contact developers seem to be associated with increased usage rates. Our findings can help scientific software developers make the most out of the evaluations of their software so that they can more fully benefit from such assessments.

The Riffomonas YouTube Channel: An Educational Resource To Foster Reproducible Research Practices.

Methods for analyzing data in a reproducible manner are often viewed as impenetrable to scientists more familiar with laboratory research. The Riffomonas YouTube channel is committed to teaching these scientists and others how to engage in reproducible research using modern data science tools.

Diluted Fecal Community Transplant Restores Clostridioides difficile Colonization Resistance to Antibiotic-Perturbed Murine Communities.

Fecal communities transplanted into individuals can eliminate recurrent Clostridioides difficile infection (CDI) with high efficacy. However, this treatment is only used once CDI becomes resistant to antibiotics or has recurred multiple times. We sought to investigate whether a fecal community transplant (FCT) pretreatment could be used to prevent CDI altogether. We treated male C57BL/6 mice with either clindamycin, cefoperazone, or streptomycin and then inoculated them with the microbial community from untreated mice before challenge with C. difficile. We measured colonization and sequenced the V4 region of the 16S rRNA gene to understand the dynamics of the murine fecal community in response to the FCT and C. difficile challenge. Clindamycin-treated mice became colonized with C. difficile but cleared it naturally and did not benefit from the FCT. Cefoperazone-treated mice became colonized by C. difficile, but the FCT enabled clearance of C. difficile. In streptomycin-treated mice, the FCT was able to prevent C. difficile from colonizing. We then diluted the FCT and repeated the experiments. Cefoperazone-treated mice no longer cleared C. difficile. However, streptomycin-treated mice colonized with 1:102 dilutions resisted C. difficile colonization. Streptomycin-treated mice that received an FCT diluted 1:103 became colonized with C. difficile but later cleared the infection. In streptomycin-treated mice, inhibition of C. difficile was associated with increased relative abundance of a group of bacteria related to Porphyromonadaceae and Lachnospiraceae. These data demonstrate that C. difficile colonization resistance can be restored to a susceptible community with an FCT as long as it complements the missing populations. IMPORTANCE Antibiotic use, ubiquitous with the health care environment, is a major risk factor for Clostridioides difficile infection (CDI), the most common nosocomial infection. When C. difficile becomes resistant to antibiotics, a fecal microbiota transplant from a healthy individual can effectively restore the gut bacterial community and eliminate the infection. While this relationship between the gut bacteria and CDI is well established, there are no therapies to treat a perturbed gut community to prevent CDI. This study explored the potential of restoring colonization resistance to antibiotic-induced susceptible gut communities. We described the effect that gut bacterial community variation has on the effectiveness of a fecal community transplant for inhibiting CDI. These data demonstrated that communities susceptible to CDI can be supplemented with fecal communities but that the effectiveness depended on the structure of the community following the perturbation. Thus, a reduced bacterial community may be able to recover colonization resistance in patients treated with antibiotics.

Intestinal Inflammation Reversibly Alters the Microbiota to Drive Susceptibility to Clostridioides difficile Colonization in a Mouse Model of Colitis.

Susceptibility to Clostridioides difficile infection (CDI) typically follows the administration of antibiotics. Patients with inflammatory bowel disease (IBD) have increased incidence of CDI, even in the absence of antibiotic treatment. However, the mechanisms underlying this susceptibility are not well understood. To explore the intersection between CDI and IBD, we recently described a mouse model where colitis triggered by the murine gut bacterium, Helicobacter hepaticus, in IL-10-/- mice led to susceptibility to C. difficile colonization without antibiotic administration. The current work disentangles the relative contributions of inflammation and gut microbiota in colonization resistance to C. difficile in this model. We show that inflammation drives changes in microbiota composition, which leads to CDI susceptibility. Decreasing inflammation with an anti-p40 monoclonal antibody promotes a shift of the microbiota back toward a colonization-resistant state. Transferring microbiota from susceptible and resistant mice to germfree animals transfers the susceptibility phenotype, supporting the primacy of the microbiota in colonization resistance. These findings shine light on the complex interactions between the host, microbiota, and C. difficile in the context of intestinal inflammation, and may form a basis for the development of strategies to prevent or treat CDI in IBD patients. IMPORTANCE Patients with inflammatory bowel disease (IBD) have an increased risk of developing C. difficile infection (CDI), even in the absence of antibiotic treatment. Yet, mechanisms regulating C. difficile colonization in IBD patients remain unclear. Here, we use an antibiotic-independent mouse model to demonstrate that intestinal inflammation alters microbiota composition to permit C. difficile colonization in mice with colitis. Notably, treating inflammation with an anti-p40 monoclonal antibody, a clinically relevant IBD therapeutic, restores microbiota-mediated colonization resistance to the pathogen. Through microbiota transfer experiments in germfree mice, we confirm that the microbiota shaped in the setting of IBD is the primary driver of susceptibility to C. diffiicile colonization. Collectively, our findings provide insight into CDI pathogenesis in the context of intestinal inflammation, which may inform methods to manage infection in IBD patients. More broadly, this work advances our understanding of mechanisms by which the host-microbiota interface modulates colonization resistance to C. difficile.

The Gut Bacterial Community Potentiates Clostridioides difficile Infection Severity.

The severity of Clostridioides difficile infections (CDI) has increased over the last few decades. Patient age, white blood cell count, and creatinine levels as well as C. difficile ribotype and toxin genes have been associated with disease severity. However, it is unclear whether specific members of the gut microbiota are associated with variations in disease severity. The gut microbiota is known to interact with C. difficile during infection. Perturbations to the gut microbiota are necessary for C. difficile to colonize the gut. The gut microbiota can inhibit C. difficile colonization through bile acid metabolism, nutrient consumption, and bacteriocin production. Here, we sought to demonstrate that members of the gut bacterial communities can also contribute to disease severity. We derived diverse gut communities by colonizing germfree mice with different human fecal communities. The mice were then infected with a single C. difficile ribotype 027 clinical isolate, which resulted in moribundity and histopathologic differences. The variation in severity was associated with the human fecal community that the mice received. Generally, bacterial populations with pathogenic potential, such as Enterococcus, Helicobacter, and Klebsiella, were associated with more-severe outcomes. Bacterial groups associated with fiber degradation and bile acid metabolism, such as Anaerotignum, Blautia, Lactonifactor, and Monoglobus, were associated with less-severe outcomes. These data indicate that, in addition to the host and C. difficile subtype, populations of gut bacteria can influence CDI disease severity. IMPORTANCE Clostridioides difficile colonization can be asymptomatic or develop into an infection ranging in severity from mild diarrhea to toxic megacolon, sepsis, and death. Models that predict severity and guide treatment decisions are based on clinical factors and C. difficile characteristics. Although the gut microbiome plays a role in protecting against CDI, its effect on CDI disease severity is unclear and has not been incorporated into disease severity models. We demonstrated that variation in the microbiome of mice colonized with human feces yielded a range of disease outcomes. These results revealed groups of bacteria associated with both severe and mild C. difficile infection outcomes. Gut bacterial community data from patients with CDI could improve our ability to identify patients at risk of developing more severe disease and improve interventions that target C. difficile and the gut bacteria to reduce host damage.

OptiFit: an Improved Method for Fitting Amplicon Sequences to Existing OTUs.

Assigning amplicon sequences to operational taxonomic units (OTUs) is an important step in characterizing microbial communities across large data sets. A notable difference between de novo clustering and database-dependent reference clustering methods is that OTU assignments from de novo methods may change when new sequences are added. However, one may wish to incorporate new samples to previously clustered data sets without clustering all sequences again, such as when comparing across data sets or deploying machine learning models. Existing reference-based methods produce consistent OTUs but only consider the similarity of each query sequence to a single reference sequence in an OTU, resulting in assignments that are worse than those generated by de novo methods. To provide an efficient method to fit sequences to existing OTUs, we developed the OptiFit algorithm. Inspired by the de novo OptiClust algorithm, OptiFit considers the similarity of all pairs of reference and query sequences to produce OTUs of the best possible quality. We tested OptiFit using four data sets with two strategies: (i) clustering to a reference database and (ii) splitting the data set into a reference and query set, clustering the references using OptiClust, and then clustering the queries to the references. The result is an improved implementation of reference-based clustering. OptiFit produces OTUs of a quality similar to that of OptiClust at faster speeds when using the split data set strategy. OptiFit provides a suitable option for users requiring consistent OTU assignments at the same quality as afforded by de novo clustering methods. IMPORTANCE Advancements in DNA sequencing technology have allowed researchers to affordably generate millions of sequence reads from microorganisms in diverse environments. Efficient and robust software tools are needed to assign microbial sequences into taxonomic groups for characterization and comparison of communities. The OptiClust algorithm produces high-quality groups by comparing sequences to each other, but the assignments can change when new sequences are added to a data set, making it difficult to compare different studies. Other approaches assign sequences to groups by comparing them to sequences in a reference database to produce consistent assignments, but the quality of the groups produced is reduced compared to that with OptiClust. We developed OptiFit, a new reference-based algorithm that produces consistent yet high-quality assignments like OptiClust. OptiFit allows researchers to compare microbial communities across different studies or add new data to existing studies without sacrificing the quality of the group assignments.

Developing and deploying an integrated workshop curriculum teaching computational skills for reproducible research.

Inspired by well-established material and pedagogy provided by The Carpentries (Wilson, 2016), we developed a two-day workshop curriculum that teaches introductory R programming for managing, analyzing, plotting and reporting data using packages from the tidyverse (Wickham et al., 2019), the Unix shell, version control with git, and GitHub. While the official Software Carpentry curriculum is comprehensive, we found that it contains too much content for a two-day workshop. We also felt that the independent nature of the lessons left learners confused about how to integrate the newly acquired programming skills in their own work. Thus, we developed a new curriculum that aims to teach novices how to implement reproducible research principles in their own data analysis. The curriculum integrates live coding lessons with individual-level and group-based practice exercises, and also serves as a succinct resource that learners can reference both during and after the workshop. Moreover, it lowers the entry barrier for new instructors as they do not have to develop their own teaching materials or sift through extensive content. We developed this curriculum during a two-day sprint, successfully used it to host a two-day virtual workshop with almost 40 participants, and updated the material based on instructor and learner feedback. We hope that our new curriculum will prove useful to future instructors interested in teaching workshops with similar learning objectives.

A Goldilocks Principle for the Gut Microbiome: Taxonomic Resolution Matters for Microbiome-Based Classification of Colorectal Cancer.

Colorectal cancer is a common and deadly disease in the United States accounting for over 50,000 deaths in 2020. This progressive disease is highly preventable with early detection and treatment, but many people do not comply with the recommended screening guidelines. The gut microbiome has emerged as a promising target for noninvasive detection of colorectal cancer. Most microbiome-based classification efforts utilize taxonomic abundance data from operational taxonomic units (OTUs) or amplicon sequence variants (ASVs) with the goal of increasing taxonomic resolution. However, it is unknown which taxonomic resolution is optimal for microbiome-based classification of colorectal cancer. To address this question, we used a reproducible machine learning framework to quantify classification performance of models based on data annotated to phylum, class, order, family, genus, OTU, and ASV levels. We found that model performance increased with increasing taxonomic resolution, up to the family level where performance was equal (P > 0.05) among family (mean area under the receiver operating characteristic curve [AUROC], 0.689), genus (mean AUROC, 0.690), and OTU (mean AUROC, 0.693) levels before decreasing at the ASV level (P < 0.05; mean AUROC, 0.676). These results demonstrate a trade-off between taxonomic resolution and prediction performance, where coarse taxonomic resolution (e.g., phylum) is not distinct enough, but fine resolution (e.g., ASV) is too individualized to accurately classify samples. Similar to the story of Goldilocks and the three bears (L. B. Cauley, Goldilocks and the Three Bears, 1981), mid-range resolution (i.e., family, genus, and OTU) is "just right" for optimal prediction of colorectal cancer from microbiome data. IMPORTANCE Despite being highly preventable, colorectal cancer remains a leading cause of cancer-related death in the United States. Low-cost, noninvasive detection methods could greatly improve our ability to identify and treat early stages of disease. The microbiome has shown promise as a resource for detection of colorectal cancer. Research on the gut microbiome tends to focus on improving our ability to profile species and strain level taxonomic resolution. However, we found that finer resolution impedes the ability to predict colorectal cancer based on the gut microbiome. These results highlight the need for consideration of the appropriate taxonomic resolution for microbiome analyses and that finer resolution is not always more informative.

Association of bacterial community types, functional microbial processes and lung disease in cystic fibrosis airways.

Bacterial infection and inflammation of the airways are the leading causes of morbidity and mortality in persons with cystic fibrosis (CF). The ecology of the bacterial communities inhabiting CF airways is poorly understood, especially with respect to how community structure, dynamics, and microbial metabolic activity relate to clinical outcomes. In this study, the bacterial communities in 818 sputum samples from 109 persons with CF were analyzed by sequencing bacterial 16S rRNA gene amplicons. We identified eight alternative community types (pulmotypes) by using a Dirichlet multinomial mixture model and studied their temporal dynamics in the cohort. Across patients, the pulmotypes displayed chronological patterns in the transition among each other. Furthermore, significant correlations between pulmotypes and patient clinical status were detected by using multinomial mixed effects models, principal components regression, and statistical testing. Constructing pulmotype-specific metabolic activity profiles, we found that pulmotype microbiota drive distinct community functions including mucus degradation or increased acid production. These results indicate that pulmotypes are the result of ordered, underlying drivers such as predominant metabolism, ecological competition, and niche construction and can form the basis for quantitative, predictive models supporting clinical treatment decisions.

An Osmotic Laxative Renders Mice Susceptible to Prolonged Clostridioides difficile Colonization and Hinders Clearance.

Antibiotics are a major risk factor for Clostridioides difficile infections (CDIs) because of their impact on the microbiota. However, nonantibiotic medications such as the ubiquitous osmotic laxative polyethylene glycol 3350 (PEG 3350) also alter the microbiota. Clinicians also hypothesize that PEG helps clear C. difficile. But whether PEG impacts CDI susceptibility and clearance is unclear. To examine how PEG impacts susceptibility, we treated C57BL/6 mice with 5-day and 1-day doses of 15% PEG in the drinking water and then challenged the mice with C. difficile 630. We used clindamycin-treated mice as a control because they consistently clear C. difficile within 10 days postchallenge. PEG treatment alone was sufficient to render mice susceptible, and 5-day PEG-treated mice remained colonized for up to 30 days postchallenge. In contrast, 1-day PEG-treated mice were transiently colonized, clearing C. difficile within 7 days postchallenge. To examine how PEG treatment impacts clearance, we administered a 1-day PEG treatment to clindamycin-treated, C. difficile-challenged mice. Administering PEG to mice after C. difficile challenge prolonged colonization up to 30 days postchallenge. When we trained a random forest model with community data from 5 days postchallenge, we were able to predict which mice would exhibit prolonged colonization (area under the receiver operating characteristic curve [AUROC] = 0.90). Examining the dynamics of these bacterial populations during the postchallenge period revealed patterns in the relative abundances of Bacteroides, Enterobacteriaceae, Porphyromonadaceae, Lachnospiraceae, and Akkermansia that were associated with prolonged C. difficile colonization in PEG-treated mice. Thus, the osmotic laxative PEG rendered mice susceptible to C. difficile colonization and hindered clearance. IMPORTANCE Diarrheal samples from patients taking laxatives are typically rejected for Clostridioides difficile testing. However, there are similarities between the bacterial communities from people with diarrhea and those with C. difficile infections (CDIs), including lower diversity than the communities from healthy patients. This observation led us to hypothesize that diarrhea may be an indicator of C. difficile susceptibility. We explored how osmotic laxatives disrupt the microbiota's colonization resistance to C. difficile by administering a laxative to mice either before or after C. difficile challenge. Our findings suggest that osmotic laxatives disrupt colonization resistance to C. difficile and prevent clearance among mice already colonized with C. difficile. Considering that most hospitals recommend not performing C. difficile testing on patients taking laxatives, and laxatives are prescribed prior to administering fecal microbiota transplants via colonoscopy to patients with recurrent CDIs, further studies are needed to evaluate if laxatives impact microbiota colonization resistance in humans.

mikropml: User-Friendly R Package for Supervised Machine Learning Pipelines.

Machine learning (ML) for classification and prediction based on a set of features is used to make decisions in healthcare, economics, criminal justice and more. However, implementing an ML pipeline including preprocessing, model selection, and evaluation can be time-consuming, confusing, and difficult. Here, we present mikropml (prononced "meek-ROPE em el"), an easy-to-use R package that implements ML pipelines using regression, support vector machines, decision trees, random forest, or gradient-boosted trees. The package is available on GitHub, CRAN, and conda.

Amplicon Sequence Variants Artificially Split Bacterial Genomes into Separate Clusters.

Amplicon sequencing variants (ASVs) have been proposed as an alternative to operational taxonomic units (OTUs) for analyzing microbial communities. ASVs have grown in popularity, in part because of a desire to reflect a more refined level of taxonomy since they do not cluster sequences based on a distance-based threshold. However, ASVs and the use of overly narrow thresholds to identify OTUs increase the risk of splitting a single genome into separate clusters. To assess this risk, I analyzed the intragenomic variation of 16S rRNA genes from the bacterial genomes represented in an rrn copy number database, which contained 20,427 genomes from 5,972 species. As the number of copies of the 16S rRNA gene increased in a genome, the number of ASVs also increased. There was an average of 0.58 ASVs per copy of the 16S rRNA gene for full-length 16S rRNA genes. It was necessary to use a distance threshold of 5.25% to cluster full-length ASVs from the same genome into a single OTU with 95% confidence for genomes with 7 copies of the 16S rRNA, such as Escherichia coli. This research highlights the risk of splitting a single bacterial genome into separate clusters when ASVs are used to analyze 16S rRNA gene sequence data. Although there is also a risk of clustering ASVs from different species into the same OTU when using broad distance thresholds, these risks are of less concern than artificially splitting a genome into separate ASVs and OTUs. IMPORTANCE 16S rRNA gene sequencing has engendered significant interest in studying microbial communities. There has been tension between trying to classify 16S rRNA gene sequences to increasingly lower taxonomic levels and the reality that those levels were defined using more sequence and physiological information than is available from a fragment of the 16S rRNA gene. Furthermore, the naming of bacterial taxa reflects the biases of those who name them. One motivation for the recent push to adopt ASVs in place of OTUs in microbial community analyses is to allow researchers to perform their analyses at the finest possible level that reflects species-level taxonomy. The current research is significant because it quantifies the risk of artificially splitting bacterial genomes into separate clusters. Far from providing a better representation of bacterial taxonomy and biology, the ASV approach can lead to conflicting inferences about the ecology of different ASVs from the same genome.

Clearance of Clostridioides difficile Colonization Is Associated with Antibiotic-Specific Bacterial Changes.

The gut bacterial community prevents many pathogens from colonizing the intestine. Previous studies have associated specific bacteria with clearing Clostridioides difficile colonization across different community perturbations. However, those bacteria alone have been unable to clear C. difficile colonization. To elucidate the changes necessary to clear colonization, we compared differences in bacterial abundance between communities able and unable to clear C. difficile colonization. We treated mice with titrated doses of antibiotics prior to C. difficile challenge, resulting in no colonization, colonization and clearance, or persistent colonization. Previously, we observed that clindamycin-treated mice were susceptible to colonization but spontaneously cleared C. difficile Therefore, we investigated whether other antibiotics would show the same result. We found that reduced doses of cefoperazone and streptomycin permitted colonization and clearance of C. difficile Mice that cleared colonization had antibiotic-specific community changes and predicted interactions with C. difficile Clindamycin treatment led to a bloom in populations related to Enterobacteriaceae Clearance of C. difficile was concurrent with the reduction of those blooming populations and the restoration of community members related to the Porphyromonadaceae and Bacteroides Cefoperazone created a susceptible community characterized by drastic reductions in the community diversity and interactions and a sustained increase in the abundance of many facultative anaerobes. Lastly, clearance in streptomycin-treated mice was associated with the recovery of multiple members of the Porphyromonadaceae, with little overlap in the specific Porphyromonadaceae observed in the clindamycin treatment. Further elucidation of how C. difficile colonization is cleared from different gut bacterial communities will improve C. difficile infection treatments.IMPORTANCE The community of microorganisms, or microbiota, in our intestines prevents pathogens like C. difficile from colonizing and causing infection. However, antibiotics can disturb the gut microbiota, which allows C. difficile to colonize. C. difficile infections (CDI) are primarily treated with antibiotics, which frequently leads to recurrent infections because the microbiota has not yet returned to a resistant state. The recurrent infection cycle often ends when the fecal microbiota from a presumed resistant person is transplanted into the susceptible person. Although this treatment is highly effective, we do not understand the mechanism. We hope to improve the treatment of CDI through elucidating how the bacterial community eliminates CDI. We found that C. difficile colonized susceptible mice but was spontaneously eliminated in an antibiotic treatment-specific manner. These data indicate that each community had different requirements for clearing colonization. Understanding how different communities clear colonization will reveal targets to improve CDI treatments.

Protection from Lethal Clostridioides difficile Infection via Intraspecies Competition for Cogerminant.

Clostridioides difficile, a Gram-positive, spore-forming bacterium, is the primary cause of infectious nosocomial diarrhea. Antibiotics are a major risk factor for C. difficile infection (CDI), as they disrupt the gut microbial community, enabling increased germination of spores and growth of vegetative C. difficile To date, the only single-species bacterial preparation that has demonstrated efficacy in reducing recurrent CDI in humans is nontoxigenic C. difficile Using multiple infection models, we determined that precolonization with a less virulent strain is sufficient to protect from challenge with a lethal strain of C. difficile, surprisingly even in the absence of adaptive immunity. Additionally, we showed that protection is dependent on high levels of colonization by the less virulent strain and that it is mediated by exclusion of the invading strain. Our results suggest that reduction of amino acids, specifically glycine following colonization by the first strain of C. difficile, is sufficient to decrease germination of the second strain, thereby limiting colonization by the lethal strain.IMPORTANCE Antibiotic-associated colitis is often caused by infection with the bacterium Clostridioides difficile In this study, we found that reduction of the amino acid glycine by precolonization with a less virulent strain of C. difficile is sufficient to decrease germination of a second strain. This finding demonstrates that the axis of competition for nutrients can include multiple life stages. This work is important, as it is the first to identify a possible mechanism through which precolonization with C. difficile, a current clinical therapy, provides protection from reinfection. Furthermore, our work suggests that targeting nutrients utilized by all life stages could be an improved strategy for bacterial therapeutics that aim to restore colonization resistance in the gut.