Pathogen detection from (direct Nanopore) sequencing data using Galaxy - Foodborne Edition
Author(s) | Bérénice Batut Engy Nasr Paul Zierep |
Editor(s) | Hans-Rudolf Hotz Wolfgang Maier |
OverviewQuestions:Objectives:
What are the preprocessing steps to prepare ONT sequencing data for further analysis?
How to identify pathogens using sequencing data?
How to track the found pathogens through all your samples datasets?
Requirements:
Check quality reports generated by FastQC and NanoPlot for metagenomics Nanopore data
Preprocess the sequencing data to remove adapters, poor quality base content and host/contaminating reads
Perform taxonomy profiling indicating and visualizing up to species level in the samples
Identify pathogens based on the found virulence factor gene products via assembly, identify strains and indicate all antimicrobial resistance genes in samples
Identify pathogens via SNP calling and build the consensus gemone of the samples
Relate all samples’ pathogenic genes for tracking pathogens via phylogenetic trees and heatmaps
Time estimation: 4 hoursLevel: Introductory IntroductorySupporting Materials:Published: Jan 26, 2023Last modification: Sep 27, 2024License: Tutorial Content is licensed under Creative Commons Attribution 4.0 International License. The GTN Framework is licensed under MITpurl PURL: https://gxy.io/GTN:T00393rating Rating: 5.0 (1 recent ratings, 4 all time)version Revision: 11
Food contamination with pathogens is a major burden on our society. In the year 2019, foodborne pathogens caused 137 hospitalisations in Germany (BVL 2019). Globally, they affect an estimated 600 million people a year and impact socioeconomic development at different levels. These outbreaks are mainly due to Salmonella spp. followed by Campylobacter spp. and Noroviruses, as studied by the Food safety - World Health Organization (WHO).
During the investigation of a foodborne outbreak, a microbiological analysis of the potentially responsible food vehicle is performed in order to detect the responsible pathogens and identify the contamination source. By default, the European Regulation (EC) follows ISO standards to detect bacterial pathogens in food: pathogens are detected and identified by stepwise cultures on selective media and/or targeting specific genes with real-time PCRs. The current gold standard is Pulsed-field Gel Electrophoresis (PFGE) or Multiple-Locus Variable Number Tandem Repeat Analysis (MLVA) to characterize the detected strains. These techniques have some disadvantages.
Whole Genome Sequencing (WGS) has been proposed as an alternative. With just one sequencing run, we can:
- detect all genes
- run phylogenetic analysis to link cases
- get information on antimicrobial resistance genes, virulence, serotype, resistance to sanitizers, root cause, and other critical factors in one assay, including historical reference to pathogen emergence.
WGS is more than a surveillance tool and was recommended by the European Centre for Disease Prevention and Control (ECDC) and the European Food Safety Authority (EFSA) for surveillance and outbreak investigation. WGS still requires isolation of the targeted pathogen, which is a time-consuming process, the execution is not always straightforward, nor the success is guaranteed. Sequencing methods without prior isolation could solve this issue.
The evolution of sequencing techniques in the last decades has made the development of shotgun metagenomic sequencing possible, i.e. the direct sequencing of all DNA present in a sample. This approach gives an overview of the genomic composition of all cells in the sample, including the food source itself, the microbial community, and any possible pathogens and their complete genetic information without the need for prior isolation. Several studies have demonstrated the potential of shotgun metagenomics to identify and characterize pathogens and their functional characteristics (e.g. virulence genes) in naturally contaminated or purposefully spiked food samples.
The currently available studies used Illumina sequencing, generating short reads. Longer read lengths, generated by third-generation sequencing platforms such as Pacific Biosciences (PacBio) and Oxford Nanopore Technologies (ONT), make it easier and more practical to identify strains with fewer reads. MinION (from Oxford Nanopore) is a portable, real-time device for ONT sequencing. Several proof-of-principle studies have shown the utility of ONT long-read sequencing from metagenomic samples for pathogen identification (Ciuffreda et al. 2021).
Comment: Nanopore sequencingNanopore sequencing has several properties that make it well-suited for our purposes
- Long-read sequencing technology offers simplified and less ambiguous genome assembly
- Long-read sequencing gives the ability to span repetitive genomic regions
- Long-read sequencing makes it possible to identify large structural variations
When using Oxford Nanopore Technologies (ONT) sequencing, the change in electrical current is measured over the membrane of a flow cell. When nucleotides pass the pores in the flow cell the current change is translated (basecalled) to nucleotides by a basecaller. A schematic overview is given in the picture above.
When sequencing using a MinIT or MinION Mk1C, the basecalling software is present on the devices. With basecalling the electrical signals are translated to bases (A,T,G,C) with a quality score per base. The sequenced DNA strand will be basecalled and this will form one read. Multiple reads will be stored in a fastq file.
To identify and track foodborne pathogens using long-read metagenomic sequencing, different samples of potentially contaminated food (at different time points or different locations) are prepared, DNA is extracted and sequenced using MinION (ONT). The generated sequencing data then need to be processed using bioinformatics tools.
In this tutorial, we will be presenting a series of Galaxy workflows whose main goals are to:
- agnostically detect pathogens (What exactly is this pathogen and what virulence factors does it carry?) from data extracted directly (without prior cultivation) from a potentially contaminated sample (e.g. food like chicken, beef, etc.) and sequenced using Nanopore
- compare different samples to trace the possible source of contamination
To illustrate how to process such data, we will use datasets generated by Biolytix with the following approach:
Food samples, here chicken, are spiked with known pathogens, here:
- Salmonella enterica subsp. enterica in the sample named
Barcode 10 Spike 2
- Salmonella enterica subsp. houtenae in the sample named
Barcode 11 Spike 2b
DNA in the samples is extracted, analyzed with qPCR, and sequenced via Nanopore. We start the tutorial from raw data generated by Nanopore.
AgendaIn this tutorial, we will deal with:
Prepare Galaxy and data
Any analysis should get its own Galaxy history. So let’s start by creating a new one:
Hands-on: Data upload
Create a new history for this analysis
To create a new history simply click the new-history icon at the top of the history panel:
Rename the history
- Click on galaxy-pencil (Edit) next to the history name (which by default is “Unnamed history”)
- Type the new name
- Click on Save
- To cancel renaming, click the galaxy-undo “Cancel” button
If you do not have the galaxy-pencil (Edit) next to the history name (which can be the case if you are using an older version of Galaxy) do the following:
- Click on Unnamed history (or the current name of the history) (Click to rename history) at the top of your history panel
- Type the new name
- Press Enter
Before we can begin any Galaxy analysis, we need to upload the input data: FASTQ files with the sequenced samples.
Hands-on: Import datasets
Import the following samples via link from Zenodo or Galaxy shared data libraries:
https://zenodo.org/record/11222469/files/Barcode10_Spike2.fastq.gz https://zenodo.org/record/11222469/files/Barcode11_Spike2b.fastq.gz
- Copy the link location
Click galaxy-upload Upload Data at the top of the tool panel
- Select galaxy-wf-edit Paste/Fetch Data
Paste the link(s) into the text field
Press Start
- Close the window
As an alternative to uploading the data from a URL or your computer, the files may also have been made available from a shared data library:
- Go into Data (top panel) then Data libraries
- Navigate to the correct folder as indicated by your instructor.
- On most Galaxies tutorial data will be provided in a folder named GTN - Material –> Topic Name -> Tutorial Name.
- Select the desired files
- Click on Add to History galaxy-dropdown near the top and select as Datasets from the dropdown menu
In the pop-up window, choose
- “Select history”: the history you want to import the data to (or create a new one)
- Click on Import
Rename the files to
Barcode10
andBarcode11
respectively
- Click on the galaxy-pencil pencil icon for the dataset to edit its attributes
- In the central panel, change the Name field
- Click the Save button
Create a collection named
Samples
that includes both datasets (Barcode10
andBarcode11
)
- Click on galaxy-selector Select Items at the top of the history panel
- Check all the datasets in your history you would like to include
Click n of N selected and choose Build Dataset List
- Enter a name for your collection
- Click Create collection to build your collection
- Click on the checkmark icon at the top of your history again
In this tutorial, we can offer 2 versions:
- A short version, running prebuilt workflows
- A long version, going step-by-step
Hands-on: Choose Your Own TutorialThis is a "Choose Your Own Tutorial" section, where you can select between multiple paths. Click one of the buttons below to select how you want to follow the tutorial
Preprocessing
Before starting any analysis, it is always a good idea to assess the quality of your input data and to discard poor quality base content by trimming and filtering reads.
In this section we will run a Galaxy workflow that performs the following tasks with the following tools:
- Assess the reads quality before and after preprocessing it using FastQC, NanoPlot and MultiQC (Ewels et al. 2016)
- Trimming and filtering reads by length and quality using Porechop and Fastp (Chen et al. 2018)
- Remove main host sequences, in this training all chicken (Gallus gallus) sequences, using Minimap2
- Remove other possible hosts sequences e.g. human, cow, etc. using Kraken2 (Wood and Salzberg 2014) with the Kalamari database, and Krakentools: Extract Kraken Reads By ID to remove all the hosts sequences before moving on to the next section with only the non-host sequences.
We will run all these steps using a single workflow, then discuss each step and the results in more detail.
Hands-on: Pre-Processing
- Import the workflow into Galaxy
- Copy the URL (e.g. via right-click) of this workflow or download it to your computer.
- Import the workflow into Galaxy
- Click on Workflow on the top menu bar of Galaxy. You will see a list of all your workflows.
- Click on galaxy-upload Import at the top-right of the screen
- Provide your workflow
- Option 1: Paste the URL of the workflow into the box labelled “Archived Workflow URL”
- Option 2: Upload the workflow file in the box labelled “Archived Workflow File”
- Click the Import workflow button
Below is a short video demonstrating how to import a workflow from GitHub using this procedure:
- Run Workflow 1: Nanopore Preprocessing workflow using the following parameters
“Samples Profile”:
PacBio/Oxford Nanopore read to reference mapping
, which is the technique used for sequencing the samples.param-files “Collection of all samples”:
Samples
collection created from the imported Fastq.qz files
- Click on Workflow on the top menu bar of Galaxy. You will see a list of all your workflows.
- Click on the workflow-run (Run workflow) button next to your workflow
- Configure the workflow as needed
- Click the Run Workflow button at the top-right of the screen
- You may have to refresh your history to see the queued jobs
The workflow will take a little while to complete. Once tools have completed, the results will be available in your history for viewing. Note that only the most important outputs will be visible; intermediate files are hidden by default.
While you are waiting for the workflow to complete, please continue reading in the next section(s) where we will go into a bit more detail about what happens at each step of the workflow we launched and examine the results.
Quality Control and Preprocessing
During sequencing, errors are introduced, such as incorrect nucleotides being called. These are due to the technical limitations of each sequencing platform. Sequencing errors might bias the analysis and can lead to a misinterpretation of the data. Sequence quality control is therefore an essential first step in your analysis.
In this tutorial we use similar tools as described in the tutorial “Quality control”, but more specific to Nanopore data:
- Quality control with
- FastQC generates a web report that will aid you in assessing the quality of your data
- NanoPlot plotting tool for long read sequencing data and alignments
Hands-on: Initial quality assessment- FastQC ( Galaxy version 0.73+galaxy0) with the following parameters:
- param-files “Raw read data from your current history”:
Samples
collection created from the imported Fastq.qz files
- param-files “Raw read data from your current history”:
- NanoPlot ( Galaxy version 1.28.2+galaxy1) with the following parameters:
- “Select multifile mode”:
batch
- “Type of the file(s) to work on”:
fastq
- param-files “Data input files”:
Samples
collection created from the imported Fastq.qz files
- param-files “Data input files”:
- “Type of the file(s) to work on”:
CommentThe
NanoPlot
step, as it does not require the results of FastQC to run, can be launched even if FastQC is not ready - “Select multifile mode”:
- MultiQC ( Galaxy version 1.11+galaxy0) with the following parameters:
- In “Results”:
- param-repeat “Insert Results”
- “Which tool was used generate logs?”:
FastQC
- In “FastQC output”:
- param-repeat “Insert FastQC output”
- “Type of FastQC output?”:
Raw data
- param-files “FastQC output”: collection of
Raw data
outputs of FastQC tool
- “Type of FastQC output?”:
- param-repeat “Insert FastQC output”
- In “FastQC output”:
- “Which tool was used generate logs?”:
- param-repeat “Insert Results”
- In “Results”:
-
Read trimming and filtering with Porechop and Fastp (Chen et al. 2018)
Hands-on: Read trimming and filtering- Porechop ( Galaxy version 0.2.4) with the following parameters:
- param-files “Input FASTA/FASTQ”:
Samples
collection created from the imported Fastq.qz files - “Output format for the reads”:
fastq.gz
- param-files “Input FASTA/FASTQ”:
- fastp ( Galaxy version 0.20.1+galaxy0) with the following parameters:
- “Single-end or paired reads”:
Single-end
- param-files “Input 1”: output collection of Porechop tool
- In Output Options
- “Output JSON report”:
Yes
- “Output JSON report”:
CommentThis step can be launched even if Porechop is not done. It will be scheduled and wait until Porechop is done to start.
- “Single-end or paired reads”:
- Porechop ( Galaxy version 0.2.4) with the following parameters:
-
Quality recheck after read trimming and filtering with FastQC and Nanoplot and report aggregation with MultiQC
Hands-on: Final quality checks- FastQC ( Galaxy version 0.73+galaxy0) with the following parameters:
- param-files “Raw read data from your current history”: output collection of fastp tool
- NanoPlot ( Galaxy version 1.28.2+galaxy1) with the following parameters:
- “Select multifile mode”:
batch
- “Type of the file(s) to work on”:
fastq
- param-files “files”: output collection of fastp tool
- “Type of the file(s) to work on”:
- “Select multifile mode”:
- MultiQC ( Galaxy version 1.11+galaxy0) with the following parameters:
- In “Results”:
- param-repeat “Insert Results”
- “Which tool was used generate logs?”:
FastQC
- In “FastQC output”:
- param-repeat “Insert FastQC output”
- “Type of FastQC output?”:
Raw data
- param-files “FastQC output”: collection of
Raw data
output of FastQC tool done after fastp
- “Type of FastQC output?”:
- param-repeat “Insert FastQC output”
- In “FastQC output”:
- “Which tool was used generate logs?”:
- param-repeat “Insert Results”
- “Which tool was used generate logs?”:
fastp
- param-files “Output of fastp”:
JSON report
output of fastp tool
- param-files “Output of fastp”:
- “Which tool was used generate logs?”:
- param-repeat “Insert Results”
- In “Results”:
- FastQC ( Galaxy version 0.73+galaxy0) with the following parameters:
QuestionInspect the HTML two outputs of MultiQC for
Barcode10
before and after preprocessing taggedMultiQC_Before_Preprocessing
andMultiQC_After_Preprocessing
- How many sequences does
Barcode10
contain before and after trimming?- What is the quality score over the reads before and after trimming? And the mean score?
- What is the importance of FastQC?
- Before trimming the file has 114,986 sequences and After trimming the file has 91,434 sequences
- The “Per base sequence quality” is globally medium: the quality score stays above 20 over the entire length of reads after trimming, while quality below 20 could be seen before trimming specially at the beginning and the end of the reads.
Sequence quality of Barcode 10 and Barcode 11 before preprocessing:
Sequence quality of Barcode 10 and Barcode 11 after preprocessing:
- After checking what is wrong, e.g. before trimming, we should think about the errors reported by FastQC: they may come from the type of sequencing or what we sequenced (check the “Quality control” training: FastQC for more details). However, despite these challenges, we can already see sequences getting slightly better after the trimming and filtering, so now we can proceed with our analyses.
CommentFor more information about how to interpret the plots generated by FastQC and MultiQC, please see our dedicated “Quality control” Tutorial.
Host read filtering
Generally, we are not interested in the food (host) sequences, rather only those originating from the pathogen itself. It is an important to get rid of all host sequences and to only retain sequences that might include a pathogen, both in order to speed up further steps and to avoid host sequences compromising the analysis.
In this tutorial, we know the samples come from chicken meat spiked with Salmonella so we already know what will we get as the host and the main pathogen. If the host is not known, Kraken2 with Kalamari database can be used to detect it.
In this tutorial we use:
-
Map reads to chicken reference genome using Map with minimap2 and Chicken (Gallus gallus): galGal6 built in reference genome of chicken, and we move forward with the unmapped ones.
Hands-on: Read taxonomic classification for host filtering- Map with minimap2 ( Galaxy version 2.24+galaxy0) with the following parameters:
- “Will you select a reference genome from your history or use a built-in index?”:
Use a built-in genome index
- “Using reference genome”:
Chicken (Gallus gallus): galGal6
- “Using reference genome”:
- “Single or Paired-end reads”:
Single
- param-file “Select fastq dataset”:
out1
(output of fastp tool) - “Select a profile of preset options”:
PacBio/Oxford Nanopore read to reference mapping (-Hk19) (map-pb)
, which is the technique used for sequencing the samples.
- param-file “Select fastq dataset”:
- In “Alignment options”:
- “Customize spliced alignment mode?”:
No, use profile setting or leave turned off
- “Customize spliced alignment mode?”:
- “Will you select a reference genome from your history or use a built-in index?”:
- Split BAM by reads mapping status ( Galaxy version 2.5.2+galaxy2) with the following parameters:
- param-file “BAM dataset to split by mapped/unmapped”:
alignment_output
(output of Map with minimap2 tool)
- param-file “BAM dataset to split by mapped/unmapped”:
- Samtools fastx ( Galaxy version 1.15.1+galaxy2) with the following parameters:
- param-file “BAM or SAM file to convert”:
unmapped
(output of Split BAM by reads mapping status tool) - “Output format”:
compressed FASTQ
- “Write index read files”:
No
- param-file “BAM or SAM file to convert”:
- Map with minimap2 ( Galaxy version 2.24+galaxy0) with the following parameters:
-
Assign filted reads, after mapping (non chicken reads), to taxa using Kraken2 (Wood and Salzberg 2014) as a further contamination detection using the Kalamari database. The Kalamari database includes mitochondrial sequences of various known hosts including food hosts.
Hands-on: Read taxonomic classification for host filtering- Kraken2 ( Galaxy version 2.1.1+galaxy1) with the following parameters:
- “Single or paired reads”:
Single
- param-file “Input sequences”:
output
(output of Samtools fastx tool)
- param-file “Input sequences”:
- “Print scientific names instead of just taxids”:
Yes
- In “Create Report”:
- “Print a report with aggregrate counts/clade to file”:
Yes
- “Report counts for ALL taxa, even if counts are zero”:
Yes
- “Report minimizer data”:
Yes
- “Print a report with aggregrate counts/clade to file”:
- “Select a Kraken2 database”:
kalamari
- “Single or paired reads”:
QuestionFor the tutorial long version takers, run Samtools fastx on the
mapped
(output of Split BAM by reads mapping status tool), then inspect the output forBarcode10
. If you are a short version taker then inspect the output namedhost_sequences_fastq
.- How many chicken sequences were found?
- 53722
- Kraken2 ( Galaxy version 2.1.1+galaxy1) with the following parameters:
-
Filter host assigned reads based on Kraken2 assignments
- Manipulate Kraken2 classification to extract the sequence ids of all hosts sequences identified with Kraken2
- Filter the FASTQ files to get 1 ouput with the host-assigned sequences and 1 output without the host-assigned reads
Hands-on: Host read filtering- Krakentools: Extract Kraken Reads By ID ( Galaxy version 1.2+galaxy1) with the following parameters:
- “Single or paired reads?”:
Single
- param-file “FASTQ/A file”:
out1
(output of fastp tool)
- param-file “FASTQ/A file”:
- param-files “Results”:
Kraken2 with Kalamri database Results
outputs of Kraken2 tool - param-files “Report”:
Kraken2 with Kalamri database Report
outputs of Kraken2 tool -
“Taxonomix ID(s) to match”:
9031 9606 9913
We specify here the taxonomic ID of the hosts so we can filter reads assigned to these hosts. Kraken2 uses taxonomic IDs from NCBI, the IDs for a specific taxa can be found at ncbi. To be generic, we remove here:
- Human (
9606
) - Chicken (
9031
) - Beef (
9913
)
If the contaminated food comes from and may include other animals, you can change the value here.
- Human (
- “Invert output”:
Yes
- “Output as FASTQ”:
Yes
- “Include parents”:
Yes
- “Include children”:
Yes
- “Single or paired reads?”:
CommentWe will need the outputs from this section in the next one. If yours is still running or you get an error you can go on and upload it so you can start the next workflow, the next hands-on is optional.
Hands-on: Optional Data upload
Import the quality processed samples fastqsanger files via link from Zenodo or the Shared Data library:
https://zenodo.org/record/11222469/files/preprocessed_sample_barcode10_spike2.fastq.gz https://zenodo.org/record/11222469/files/preprocessed_sample_barcode11_spike2b.fastq.gz
Rename datasets to
Barcode10
andBarcode11
respectivelyCreate a collection named
collection of preprocessed samples
from the two imported datasets
Taxonomy Profiling
In this section we would like to identify the different organisms found in our samples by assigning taxonomy levels to the reads starting from the kingdom level down to the species level and visualize the result. It’s important to check what might be the species of a possible pathogen to be found, it gets us closer to the investigation as well as discovering possible multiple food infections if any existed.
Taxonomy is the method used to naming, defining (circumscribing) and classifying groups of biological organisms based on shared characteristics such as morphological characteristics, phylogenetic characteristics, DNA data, etc. It is founded on the concept that the similarities descend from a common evolutionary ancestor.
Defined groups of organisms are known as taxa. Taxa are given a taxonomic rank and are aggregated into super groups of higher rank to create a taxonomic hierarchy. The taxonomic hierarchy includes eight levels: Domain, Kingdom, Phylum, Class, Order, Family, Genus and Species.
The classification system begins with 3 domains that encompass all living and extinct forms of life
- The Bacteria and Archae are mostly microscopic, but quite widespread.
- Domain Eukarya contains more complex organisms
When new species are found, they are assigned into taxa in the taxonomic hierarchy. For example for the cat:
Level Classification Domain Eukaryota Kingdom Animalia Phylum Chordata Class Mammalia Order Carnivora Family Felidae Genus Felis Species F. catus From this classification, one can generate a tree of life, also known as a phylogenetic tree. It is a rooted tree that describes the relationship of all life on earth. At the root sits the “last universal common ancestor” and the three main branches (in taxonomy also called domains) are bacteria, archaea and eukaryotes. Most important for this is the idea that all life on earth is derived from a common ancestor and therefore when comparing two species, you will -sooner or later- find a common ancestor for all of them.
Let’s explore taxonomy in the Tree of Life, using Lifemap
In the previous section we ran Kraken2 along with the Kalamari database, which is also a kind of taxonomy profiling but the database used is designed to include all possible host sequences. In the following part, we run Kraken2 again; but this time with one of its built-in databases, Standard PlusPF, which can give us more insight into pathogen candidate species than Kalamari. You can test this yourself by comparing reports of both Kraken2 runs.
In the \(k\)-mer approach for taxonomy classification, we use a database containing DNA sequences of genomes whose taxonomy we already know. On a computer, the genome sequences are broken into short pieces of length \(k\) (called \(k\)-mers), usually 30bp.
Kraken examines the \(k\)-mers within the query sequence, searches for them in the database, looks for where these are placed within the taxonomy tree inside the database, makes the classification with the most probable position, then maps \(k\)-mers to the lowest common ancestor (LCA) of all genomes known to contain the given \(k\)-mer.
Kraken2 uses a compact hash table, a probabilistic data structure that allows for faster queries and lower memory requirements. It applies a spaced seed mask of s spaces to the minimizer and calculates a compact hash code, which is then used as a search query in its compact hash table; the lowest common ancestor (LCA) taxon associated with the compact hash code is then assigned to the k-mer.
You can find more information about the Kraken2 algorithm in the paper Improved metagenomic analysis with Kraken 2.
Hands-on: Taxonomy Profiling and visualisation
- Import the workflow into Galaxy
- Copy the URL (e.g. via right-click) of this workflow or download it to your computer.
- Import the workflow into Galaxy
- Run Workflow 2: Taxonomy Profiling and Visualization with Krona workflow using the following parameters:
- “Send results to a new history”:
No
- param-files “Collection of preprocessed samples”:
collection of preprocessed samples
collection, output from Krakentools: Extract Kraken Reads By ID tool from the preproceesing workflow- “Kraken database”:
Prebuilt Refseq indexes: PlusPF (Standard plus protozoa and fungi) (Version: 2022-06-07 - Downloaded: 2022-09-04T165121Z)
- Click on Workflow on the top menu bar of Galaxy. You will see a list of all your workflows.
- Click on the workflow-run (Run workflow) button next to your workflow
- Configure the workflow as needed
- Click the Run Workflow button at the top-right of the screen
- You may have to refresh your history to see the queued jobs
To assign reads to taxons, we use Kraken2 with Standard PlusPF database.
Hands-on: Taxonomy Profiling
- Kraken2 ( Galaxy version 2.1.1+galaxy1) with the following parameters:
- “Single or paired reads”:
Single
- param-files “Input sequences”: collection output from Krakentools: Extract Kraken Reads By ID tool from the preprocessing section
- In “Create Report”:
- “Print a report with aggregrate counts/clade to file”:
Yes
- “Select a Kraken2 database”:
Prebuilt Refseq indexes: PlusPF (Standard plus protozoa and fungi) (Version: 2022-06-07 - Downloaded: 2022-09-04T165121Z)
QuestionInspect the Kraken2 report for
Barcode10
- What is the most commonly found species?
- What is the second most commonly found species?
- How many sequences are classified and how many are unclassified?
- What are the differences between Kraken2 tool’s report with Kalamari database and Kraken2 tool’s report with Standard PlusPF database regarding the previous 3 questions?
- Genus level Salmonella with 9,950 sequences
- Genus level Escherichia with 1,949 sequences
- 33,941 sequences are classified and 3,738 are unclassified
- With Kalamari database the most found Genus is Escherichia with 13,943 sequences and the second most found Genus is Salmonella with 10,585 sequences. The number of classified sequences are 30,838 sequences and the unclassified sequences are 6,874. In conclusion, both databases are able to show the similar results of the most common identified species, but with different counts of identified sequences. As well as, the number of the classified sequences with Standard PlusPF database is higher than Kalamari database.
In order to view the taxonomy profiling produced by Kraken2 tool, there are a lot of tools to be used afterwards such as Krona pie chart, which we will be using in this tutorial. For later, you can also check out Pavian tool, as well as Phinch visualization, which is an interactive tool that contains multiple visualization plots, it is interactive alowing you to choose between different parameters, you can visualize each taxonomic level on its own, you can have the metadata of the samples represented along with the taxonomic visualization, download all plots for publications and a lot of other benefits.
Hands-on: Visualisation
- Krakentools: Convert kraken report file ( Galaxy version 1.2+galaxy1) with the following parameters:
- param-file “Kraken report file”:
report_output
(output of Kraken2 tool)- Krona pie chart ( Galaxy version 2.7.1+galaxy0) with the following parameters:
- “What is the type of your input data”:
Tabular
- param-file “Input file”:
output
(output of Krakentools: Convert kraken report file tool)
Now let’s explore the Krona pie chart output for Barcode11
Question
- What is the most commonly found species?
- What is the second most commonly found species?
CommentWhile these steps are running, you can move on to the next section Gene based pathogenic identification and run the steps there, as well. Both analyses can execute in parallel.
You may have noticed some sequences have been assigned to the Human Genome (Homosapians) species, when we run Kraken2 using the Standard PlusPF in this section. However, in the pre-processing section when we ran Kraken2 with Kalamari no Human Genomes were found. The lab (data producers) has confirmed that these sequences assigned to human by Standard PlusPF database are not human and there should be no human sequences in the samples as Kalamari database result’s confirmed. So these sequences were wrongly assigned to human by Standard PlusPF. That is due to resemblance between organisms and the limited species coverage of Kraken2 databases sometimes do happen that reads corresponding to higher organisms get mapped to humans. It was a very severe problem for the Standard PlusPF, because yeast genes were mis-assigned to human.
We decide to keep these sequences since we do not know what are they via the taxonomy profiling step, which could mean that they might be identified as pathogens in the coming steps, and if we delete them we are possibly losing important information and losing the main goal of the workflow to detect pathogens and track them.
Gene-based pathogen identification
With taxonomy profiling, we identified some bacterial species. But we want to be sure they are pathogenic, by looking for genes known to be linked to pathogenicity or to the pathogenecity character of the organim:
- Virulence Factor (VF): gene products, usually proteins, involved in pathogenicity. By identifiying them we can call a pathogen and its severity level
-
Antimicrobial Resistance genes (AMR).
These type of genes have three fundamental mechanisms of antimicrobial resistance that are enzymatic degradation of antibacterial drugs, alteration of bacterial proteins that are antimicrobial targets, and changes in membrane permeability to antibiotics, which will lead to not altering the target site and spread throughput the pathogenic bacteria decreasing the overall fitness of the host.
To look for these genes and determine the strain of the bacteria we are testing for pathogenicity we do:
- Genome assembly to get contigs, i.e. longer sequences, using metaflye (Kolmogorov et al. 2020) then assembly polishing using medaka consensus pipeline and visualizing the assembly graph using Bandage Image (Wick et al. 2015)
- Generate reports with AMR genes and VF using ABRicate
As outputs, we will get our FASTA and Tabular files to track genes and visualize our pathogenic identification.
Hands-on: Gene based Pathogenic Identification
- Import the workflow into Galaxy
- Copy the URL (e.g. via right-click) of this workflow or download it to your computer.
- Import the workflow into Galaxy
- Click on Workflow on the top menu bar of Galaxy. You will see a list of all your workflows.
- Click on galaxy-upload Import at the top-right of the screen
- Provide your workflow
- Option 1: Paste the URL of the workflow into the box labelled “Archived Workflow URL”
- Option 2: Upload the workflow file in the box labelled “Archived Workflow File”
- Click the Import workflow button
Below is a short video demonstrating how to import a workflow from GitHub using this procedure:
- Run Workflow 3: Gene-based Pathogen Identification workflow using the following parameters:
- param-file “Collection of preprocessed samples”:
collection of preprocessed samples
collection output from Krakentools: Extract Kraken Reads By ID tool from the preprocessing workflow
- Click on Workflow on the top menu bar of Galaxy. You will see a list of all your workflows.
- Click on the workflow-run (Run workflow) button next to your workflow
- Configure the workflow as needed
- Click the Run Workflow button at the top-right of the screen
- You may have to refresh your history to see the queued jobs
Assembly
To identify VF or AMR genes, it is better to assemble reads into longer seuqences or contigs, that can be then used to search databases for the presence of any pathogenic gene:
-
Assembly of long-read metagenomic data using metaflye or Flye.
Hands-on: Assembly with Flye- Build list with the following parameters:
- In “Dataset”:
- param-repeat “Insert Dataset”
- param-collection “Input Dataset”: collection output from Krakentools: Extract Kraken Reads By ID tool from the preprocessing section
- “Label to use”:
Index
- param-repeat “Insert Dataset”
- In “Dataset”:
- Flye ( Galaxy version 2.9+galaxy0) with the following parameters:
-
param-file “Input reads”: collection output from Build list tool
CommentWe need to run Flye individually on each sample otherwise Flye runs by default a co-assembly mode, i.e. it combines reads of both samples together before running the assembly.
- “Mode”:
Nanopore HQ (--nano-hq)
- “Perform metagenomic assembly”:
Yes
- “Reduced contig assembly coverage”:
Disable reduced coverage for initial disjointing assembly
-
- Build list with the following parameters:
-
For the visualization of the assembly graph output from Flye we have chosen Bandage Image.
Hands-on: Visualization of the assembly grap- Bandage Image ( Galaxy version 0.8.1+galaxy2) with the following parameters:
- param-files “Graphical Fragment Assembly”:
assembly_graph
Assembly graph outputs of Flye tool
- param-files “Graphical Fragment Assembly”:
- Bandage Image ( Galaxy version 0.8.1+galaxy2) with the following parameters:
-
Contig polishing using medaka to correct the long, error-prone Nanopore reads
Hands-on: Contig polishing- medaka consensus pipeline ( Galaxy version 1.7.2+galaxy0) with the following parameters:
- param-files “Select basecalls”: collection output from Krakentools: Extract Kraken Reads By ID tool from the preprocessing section
- param-files “Select assembly”:
consensus
collection output of Flye tool - “Select model”:
r941_min_hac_g507
- “Select output file(s)”:
select all
To keep information about the provenance of the contigs, we extract the sample names from the collection of preprocessed samples collection and add it to the contigs files.
Hands-on: Contig renaming to add sample names- FASTA-to-Tabular ( Galaxy version 1.1.1) with the following parameters:
- param-files “Convert these sequences”: collection output of medaka consensus pipeline tool
- Extract element identifiers ( Galaxy version 0.0.2) with the following parameters:
- param-files “Dataset collection”: collection output from Krakentools: Extract Kraken Reads By ID tool from the preprocessing section
- Split file ( Galaxy version 0.5.0) with the following parameters:
- param-files “Text file to split”: output from Extract element identifiers tool
- Parse parameter value with the following parameters:
- param-files “Input file containing parameter to parse out of”: output from Split file tool
- Compose text parameter value ( Galaxy version 0.1.1) with the following parameters:
- In “components”:
- param-repeat “Insert components”
- “Choose the type of parameter for this field”:
Text Parameter
- “Enter text that should be part of the computed value”: output from Parse parameter value tool
- “Choose the type of parameter for this field”:
- param-repeat “Insert components”
- “Choose the type of parameter for this field”:
Text Parameter
- “Enter text that should be part of the computed value”:
_$1
- “Enter text that should be part of the computed value”:
- “Choose the type of parameter for this field”:
- param-repeat “Insert components”
- In “components”:
- Replace ( Galaxy version 1.1.4) with the following parameters:
- param-file “File to process”: collection output of FASTA-to-Tabular tool
- In “Find and Replace”:
- param-repeat “Insert Find and Replace”
- “Find pattern”:
^(.+)$
- “Replace with”: output from Compose text parameter value tool
- “Find-Pattern is a regular expression”:
Yes
- “Replace all occurences of the pattern”:
Yes
- “Find and Replace text in”:
specific column
- “in column”:
Column: 1
- “in column”:
- “Find pattern”:
- param-repeat “Insert Find and Replace”
- Tabular-to-FASTA ( Galaxy version 1.1.1) with the following parameters:
- param-file “Tab-delimited file”:
outfile
(output of Replace tool) - “Title column(s)”:
c1
- “Sequence column”:
c2
- param-file “Tab-delimited file”:
- Rename the output collection
Contigs
- medaka consensus pipeline ( Galaxy version 1.7.2+galaxy0) with the following parameters:
QuestionInspect Flye and Medaka consensus pipeline output results for
Barcode10
- How many different contigs did you get after Flye, collection name: Flye Consensus Fasta?
- How many were left after Medaka consensus pipeline, collection name: Sample all contigs, and what does that mean?
- What is the result of your Bandage Image?
Antimicrobial Resistance Genes
Now, to search AMR genes among our samples’ contigs, we run ABRicate and choose the NCBI Bacterial Antimicrobial Resistance Gene Database (AMRFinderPlus) from the advanced options of the tool. The tool checks if there is an AMR found or not, if found then in which contig it is, its location on the contig, what the name of the exact product is, what substance it provides resistance against and a lot of other information regarding the found AMR.
Hands-on: Antimicrobial Resistance Genes Identification
- ABRicate ( Galaxy version 1.0.1) with the following parameters:
- param-files “Input file (Fasta, Genbank or EMBL file)”: collection output of medaka consensus pipeline tool FASTA files with contigs
- In “Advanced options”:
- “Database to use - default is ‘resfinder’“:
NCBI Bacterial Antimicrobial Resistance Reference Gene Database
- Rename ABRicate the output collection
amr_identified_by_ncbi
The outputs of ABRicate is a tabular file with different columns:
FILE
: The filename this hit came fromSEQUENCE
: The sequence in the filenameSTART
: Start coordinate in the sequenceEND
: End coordinateSTRAND
: AMR geneGENE
: AMR geneCOVERAGE
: What proportion of the gene is in our sequenceCOVERAGE_MA
: A visual represenationGAPS
: Was there any gaps in the alignment - possible pseudogene?%COVERAGE
: Proportion of gene covered%IDENTITY
: Proportion of exact nucleotide matchesDATABASE
: The database this sequence comes fromACCESSION
: The genomic source of the sequencePRODUCT
RESISTANCE
To prepare the ABRicatetool output tabulars of both samples for further analysis in the Pathogen Detection Samples Aggregation and Visualisation section, tabular manipulation tools such as Replacetool is used. We mainly use it to add the sample ID along with which contig at which exact location.
Hands-on: Antimicrobial Resistance Genes Identification
- Replace ( Galaxy version 1.1.4) with the following parameters:
- param-file “File to process”:
report
(output of ABRicate tool)- In “Find and Replace”:
- param-repeat “Insert Find and Replace”
- “Find pattern”:
#FILE
- “Replace with”:
SampleID
- “Replace all occurences of the pattern”:
Yes
- “Find and Replace text in”:
specific column
- “in column”:
c1
- param-repeat “Insert Find and Replace”
- “Find pattern”:
^(.+)$
- “Replace with”: output from Compose text parameter value tool
- “Find-Pattern is a regular expression”:
Yes
- “Replace all occurences of the pattern”:
Yes
- “Ignore first line”:
Yes
- “Find and Replace text in”:
specific column
- “in column”:
c2
- Rename the output collection
AMRs
QuestionInspect ABRicate output files from
Barcode10
andBarcode11
tags
- How many AMR genes found in
Barcode10
sample, what are they? Give more details about them.- How many AMR genes found in
Barcode11
sample, what are they? Give more details about them.
- 7 AMR genes were found:
- Tet(C), which resists TETRACYCLINE. It was found in contig 119 from the position 1635 till 2810, with 100% coverage, so 100% of gene is covered in this contig.
- Tet(34), which resists TETRACYCLINE. It was found in contig 135 from the position 69874 till 70223, with 74.41% coverage.
- aac(6’)_Yersi, which resists AMINOGLYCOSIDE. It was found in contig 156 from the position 37698 till 38000, with 69.68 % coverage.
- 2 genes with sulfonamide-resistant dihydropteroate synthase Sul1 products
- 2 genes with oxacillin-hydrolyzing class D beta-lactamase OXA-2 products
- 2 AMR genes were found by the database in
Barcode11
sample, Tet(34) and aac(6’)_Yersi.
Virulence Factor identification
In this step we return back to the main goal of the tutorial where we want to identify the pathogens: identify if the bacteria found in our samples are pathogenic bacteria or not. One of the ways to do that is to identify if the sequences include genes with a Virulence Facor or not, such that if the samples include gene(s) with a Virulence Factor then it for sure is a pathogen.
Comment: DefinitionsBacterial Pathogen: A bacterial pathogen is usually defined as any bacterium that has the capacity to cause disease. Its ability to cause disease is called pathogenicity.
Virulence: Virulence provides a quantitative measure of the pathogenicity or the likelihood of causing a disease.
Virulence Factors: Virulence factors refer to the properties (i.e., gene products) that enable a microorganism to establish itself on or within a host of a particular species and enhance its potential to cause disease. Virulence factors include bacterial toxins, cell surface proteins that mediate bacterial attachment, cell surface carbohydrates and proteins that protect a bacterium, and hydrolytic enzymes that may contribute to the pathogenicity of the bacterium.
To identifly VFs, we use again ABRicate but this time with the VFDB from the advanced options of the tool.
Hands-on: Virulence Factor identification
- ABRicate ( Galaxy version 1.0.1) with the following parameters:
- param-files “Input file (Fasta, Genbank or EMBL file)”: collection output of medaka consensus pipeline tool FASTA files with contigs
- In “Advanced options”:
- “Database to use - default is ‘resfinder’“:
VFDB
- Rename ABRicate the output collection
vfs_of_genes_identified_by_vfdb
QuestionInspect VFs of genes Identified by VFDB output file from
Barcode10
andBarcode11
- How many different VFs gene products were found in
Barcode10
sample?- How many different VFs gene products were found in
Barcode11
sample?
- 188
- 287
To prepare the ABRicatetool output tabulars of both samples for further analysis in the Pathogen Detection Samples Aggregation and Visualisation section, tabular manipulation tools such as Replacetool is used. We mainly use it to add the sample ID along with which contig at which exact location.
Hands-on: Replace Text
- Replace ( Galaxy version 1.1.4) with the following parameters:
- param-file “File to process”:
report
(output of ABRicate tool)- In “Find and Replace”:
- param-repeat “Insert Find and Replace”
- “Find pattern”:
#FILE
- “Replace with”:
SampleID
- “Replace all occurences of the pattern”:
Yes
- “Find and Replace text in”:
specific column
- “in column”:
c1
- param-repeat “Insert Find and Replace”
- “Find pattern”:
^(.+)$
- “Replace with”: output from Compose text parameter value tool
- “Find-Pattern is a regular expression”:
Yes
- “Replace all occurences of the pattern”:
Yes
- “Ignore first line”:
Yes
- “Find and Replace text in”:
specific column
- “in column”:
c2
- Rename the output collection
VFs
Allele-based pathogen identification
Now we would like to identify pathogens with a third approach based on variant and single nucleotide polymorphisms (SNPs) calling: comparison of reads to a targeted reference genome, and call the differences between sample reads and reference genomes to identify variants.
For example, if we want to check whether our samples include Campylobacter pathogenic strains or not, we will map our samples against the reference genome of the Campylobacter species. Variants in specific positions on the genome are queried to judge if these variations would indicate a pathogen or not.
This approach also allows identification of novel alleles and possible new variants of the pathogen.
Using this approach, we also build the consensus genome of each sample, so we can later build a phylogenetic tree of all samples’ full genomes and have an insight into events that occurred during the evolution of same or different species in the samples.
In this training, we are testing Salmonella enterica, with different strains of which our samples were spiked. So we will now upload to our history the reference genome of S. enterica we originally obtained from the National Center for Biotechnology Information (NCBI) database.
Hands-on: Data upload
Import a reference genome FASTA file via link from Zenodo or Galaxy shared data libraries
https://zenodo.org/record/11222469/files/Salmonella_Ref_genome.fna.gz
Hands-on: Allele based Pathogenic Identification
- Import the workflow into Galaxy
- Copy the URL (e.g. via right-click) of this workflow or download it to your computer.
- Import the workflow into Galaxy
- Click on Workflow on the top menu bar of Galaxy. You will see a list of all your workflows.
- Click on galaxy-upload Import at the top-right of the screen
- Provide your workflow
- Option 1: Paste the URL of the workflow into the box labelled “Archived Workflow URL”
- Option 2: Upload the workflow file in the box labelled “Archived Workflow File”
- Click the Import workflow button
Below is a short video demonstrating how to import a workflow from GitHub using this procedure:
- Run Workflow 4: Nanopore Allele-based Pathogen Identification workflow using the following parameters:
- “Send results to a new history”:
No
- param-files “Collection of preprocessed samples”:
collection of preprocessed samples
collection output from Krakentools: Extract Kraken Reads By ID tool from the preprocessing workflow“Samples Profile”:
Nothing selected
Samples profile is the technique used for sequencing the samples, it is an optional input, if you choose nothing, the tool will automatically detect it based on the input samples reads.
- param-file “Reference Genome of Tested Strain”:
Salmonella_Ref_genome.fna.gz
Variant Calling or SNP Calling
To identify variants, we
-
Map reads to the reference genome of the species of the pathogen we want to test our samples against using Minimap2 (Li 2017) as our datasets are from a Nanopore:
Hands-on: Mapping to reference genome- Map with minimap2 ( Galaxy version 2.24+galaxy0) with the following parameters:
- “Will you select a reference genome from your history or use a built-in index?”:
Use a genome from history and build index
- param-file “Use the following dataset as the reference sequence”:
Salmonella_Ref_genome.fna.gz
- param-file “Use the following dataset as the reference sequence”:
- “Single or Paired-end reads”:
Single
- param-files “Select fastq dataset”: collection output from Krakentools: Extract Kraken Reads By ID tool from the preprocessing section
- “Will you select a reference genome from your history or use a built-in index?”:
- Map with minimap2 ( Galaxy version 2.24+galaxy0) with the following parameters:
-
Identify variants and single nucleotide variants using Clair3 (Zheng et al. 2021), which is designed specifically for Nanopore datasets and giving better results than other variant calling tools, as well as being new and up-to-date.
CommentMedaka consensus tool and medaka variant tool can be also used instead of Clair3, they give similar results but they are much slower then Clair3 and offer fewer options.
Hands-on: Variant or SNP Calling- Clair3 ( Galaxy version 0.1.12+galaxy0) with the following parameters:
- param-files “BAM/CRAM file input”: collection output of Map with minimap2 tool
- “Reference genome source”:
History
- param-file “Reference genome”:
Salmonella_Ref_genome.fna.gz
- param-file “Reference genome”:
- “Clair3 model”:
Built-in
- “Built-in model”:
r941_prom_hac_g360+g422
- “Built-in model”:
- In “Advanced parameters”:
- “Call with the following ploidy model”:
haploid precise (--haploid_precise)
- “Call with the following ploidy model”:
- Clair3 ( Galaxy version 0.1.12+galaxy0) with the following parameters:
-
Left-align and normalize indels using bcftools norm (Li et al. 2009)
This step:
- checks REF alleles in the output match the reference;
- splits multiallelic sites into multiple rows;
- recovers multiallelics from multiple rows
Hands-on: Left-align and normalize indels- bcftools norm ( Galaxy version 1.9+galaxy1) with the following parameters:
- param-files “VCF/BCF Data”: collection output of Clair3 tool
- “Choose the source for the reference genome”:
Use a genome from the history
- param-file “Reference genome”:
Salmonella_Ref_genome.fna.gz
- param-file “Reference genome”:
- “output_type”:
uncompressed VCF
-
Filter variants to keep only the pass and good quality variants using SnpSift Filter (Cingolani et al. 2012)
CommentLoFreq filter can be also used instead, both tools performs equal and fast results.
Hands-on: Filter variants- SnpSift Filter ( Galaxy version 4.3+t.galaxy1) with the following parameters:
- param-files “Input variant list in VCF format”: collection output of bcftools norm tool
- “Type of filter expression”:
Simple expression
- “Filter criteria”:
(QUAL > 2)
- “Filter criteria”:
- “Filter mode”:
Retain selected variants, remove others
The output is a VCF file. VCF is the standard file format for storing variation data, with different columns:
#CHROM
: ChromosomePOS
: Co-ordinate - The start coordinate of the variant.ID
: IdentifierREF
: Reference allele - The reference allele is whatever is found in the reference genome. It is not necessarily the major allele.ALT
: Alternative allele - The alternative allele is the allele found in the sample you are studying.QUAL
: Score - Quality score out of 100.FILTER
: Pass/fail - If it passed quality filters.INFO
: Further information - Allows you to provide further information on the variants. Keys in the INFO field can be defined in header lines above thetable.FORMAT
: Information about the following columns - The GT in the FORMAT column tells us to expect genotypes in the following columns.Individual identifier (optional)
- The previous column told us to expect to see genotypes here. The genotype is in the form “0|1”, where 0 indicates the reference allele and 1 indicates the alternative allele, i.e it is heterozygous. The vertical pipe “|” indicates that the genotype is phased, and is used to indicate which chromosome the alleles are on. If this is a slash (/) rather than a vertical pipe, it means we don’t know which chromosome they are on.
- SnpSift Filter ( Galaxy version 4.3+t.galaxy1) with the following parameters:
-
Extract a tabular report with Chromosome, Position, Identifier, Reference allele, Alternative allele and Filter from the VCF files using SnpSift Extract Fields
Hands-on: Extract a tabular report- SnpSift Extract Fields ( Galaxy version 4.3+t.galaxy0) with the following parameters:
- param-files “Variant input file in VCF format”: collection output of SnpSift Filter
- “Fields to extract”:
CHROM POS ID REF ALT FILTER
- SnpSift Extract Fields ( Galaxy version 4.3+t.galaxy0) with the following parameters:
QuestionNow let’s inspect the outputs for
Barcode10
:
- How many variants were found by Clair3?
- How many variants were found after quality filtering?
- Before filtering: 2,812
- After filtering 2,642
Mapping Depth and Coverage
Mapping depth and coverage are essential metrics in variant calling because they ensure comprehensive analysis and accuracy in genomic studies. Mapping coverage indicates the percentage of the reference genome covered by sequencing reads, ensuring that the majority of the genome is analyzed to detect variants accurately. Mapping depth, on the other hand, refers to the number of times each base is sequenced, providing confidence in variant calls by distinguishing true variants from sequencing errors and enabling the detection of low-frequency variants. Both metrics are crucial for quality control, resource allocation, and reliable interpretation of genomic data, ensuring that important variants are not missed and reducing the risk of false positives or negatives.
For this step we run Samtools depth and Samtools coverage
Hands-on: Mapping Depth and Mapping Coverage
- Samtools depth ( Galaxy version 1.15.1+galaxy2) with the following parameters:
- param-file “BAM file(s)”:
alignment_output
(output of Map with minimap2 tool)- “Filter by regions”:
No
- Samtools coverage ( Galaxy version 1.15.1+galaxy2) with the following parameters:
- “Are you pooling bam files?”:
No
- param-file “BAM file”:
alignment_output
(output of Map with minimap2 tool)- “Histogram”:
No
QuestionInspect the Samtools coverage output for
Barcode10
- How well the sample reads covering the reference genome of Salmonella?
- 99.65%.
Consensus Genome Building
For further anaylsis we have included one more step in this section, where we build the full genome of our samples.
This consensus genome can be used later to compare and relate samples together based on their full genome. In cases such as SARS-CoV2, it is important to do so in order to discover new outbreaks. In this example of the training, it is not really important to draw a tree of the full genomes of the samples as Salmonella does not have such a speedy outbreak as SARS-CoV2 does. However, we decided to include it in the workflow for any further analysis of the users, if needed.
For this step we run bcftools consensus (Li et al. 2009).
Hands-on: Consensus Genome Building
- bcftools consensus ( Galaxy version 1.15.1+galaxy3) with the following parameters:
- param-files “VCF/BCF Data”: collection output of SnpSift Filter tool
- “Choose the source for the reference genome”:
Use a genome from the history
- param-file “Reference genome”:
Salmonella_Ref_genome.fna.gz
QuestionInspect the bcftools consensus output for
Barcode11
- How many sequences did we get for the sample? What are they?
- Why?
- We got 2 sequences: the complete genome and the complete plasmid genome.
- The tool uses the reference genome and the variants found to build the consensus genome of the sample, and the reference genome FASTA file we use includes two sequences a complete one and a plasmid complete one. So the tool constructed both sequences for us to choose from, based on our further analysis.
Pathogen Detection Samples Aggregation and Visualisation
CommentIf you did not get your Gene-based pathogen identification section output files needed yet or you got an error for some reason, you can go on and download them all or the ones missing from Zenodo so you can start this workflow, please don’t forget to create the collections for them as explained in the pervious hands-on.
Hands-on: Optional Data upload
Import all tabular and FASTA files needed for this section via link from Zenodo to the new created history:
https://zenodo.org/record/11222469/files/vfs_of_genes_identified_by_vfdb_barcode10.tabular https://zenodo.org/record/11222469/files/vfs_of_genes_identified_by_vfdb_barcode11.tabular https://zenodo.org/record/11222469/files/VFs_Barcode10.tabular https://zenodo.org/record/11222469/files/VFs_Barcode11.tabular https://zenodo.org/record/11222469/files/Contigs_Barcode10.fasta https://zenodo.org/record/11222469/files/Contigs_Barcode11.fasta
- Copy the link location
Click galaxy-upload Upload Data at the top of the tool panel
- Select galaxy-wf-edit Paste/Fetch Data
Paste the link(s) into the text field
Press Start
- Close the window
In this last section, we would like to show how to aggregate results and use the results to help tracking pathogenes among samples by:
- Drawing a presence-absence heatmap of the identified VF genes within all samples to visualize in which samples these genes can be found.
- Drawing a phylogenetic tree for each pathogenic gene detected, where we will relate the contigs of the samples together where this gene is found.
With these two types of visualizations we can have an overview of all samples and the genes, but also how samples are related to each other i.e. which common pathogenic genes they share. Given the time of the sampling and the location one can easily identify using these graphs, where and when the contamination has occurred among the different samples.
Hands-on: Organize imported dataFollow these steps only if you imported the datasets, but if your Gene-based Pathogen Identification part is already finished correctly then skip the following 3 steps.
Create a collection named
VFs
withVFs
files
- Click on galaxy-selector Select Items at the top of the history panel
- Check all the datasets in your history you would like to include
Click n of N selected and choose Build Dataset List
- Enter a name for your collection
- Click Create collection to build your collection
- Click on the checkmark icon at the top of your history again
Create a collection named
vfs_of_genes_identified_by_vfdb
withvfs_of_genes_identified_by_vfdb
filesCreate a collection named
Contigs
withContigs
files
CommentIf you did not get your Gene-based pathogen identification section output files needed yet or you got an error for some reason, you can go on and download them all or the ones missing from Zenodo so you can start this workflow, please don’t forget to create the collections for them as explained in the pervious hands-on. You also need to download and import more tabular files that are generated from the output of Preprocessing and Allele-based pathogen identification.
Hands-on: Optional Data upload
Import all tabular and FASTA files needed for this section via link from Zenodo to the new created history:
https://zenodo.org/record/11222469/files/removed_hosts_percentage_tabular.tabular https://zenodo.org/record/11222469/files/mapping_coverage_percentage_per_sample.tabular https://zenodo.org/record/11222469/files/mapping_mean_depth_per_sample.tabular https://zenodo.org/record/11222469/files/number_of_variants_per_sample.tabular https://zenodo.org/record/11222469/files/amr_identified_by_ncbi_barcode10.tabular https://zenodo.org/record/11222469/files/amr_identified_by_ncbi_barcode11.tabular https://zenodo.org/record/11222469/files/vfs_of_genes_identified_by_vfdb_barcode10.tabular https://zenodo.org/record/11222469/files/vfs_of_genes_identified_by_vfdb_barcode11.tabular https://zenodo.org/record/11222469/files/VFs_Barcode10.tabular https://zenodo.org/record/11222469/files/VFs_Barcode11.tabular https://zenodo.org/record/11222469/files/AMRs_Barcode10.tabular https://zenodo.org/record/11222469/files/AMRs_Barcode11.tabular https://zenodo.org/record/11222469/files/Contigs_Barcode10.fasta https://zenodo.org/record/11222469/files/Contigs_Barcode11.fasta
- Copy the link location
Click galaxy-upload Upload Data at the top of the tool panel
- Select galaxy-wf-edit Paste/Fetch Data
Paste the link(s) into the text field
Press Start
- Close the window
In this last section, we would like to show how to aggregate results and use the results to help tracking pathogenes among samples by:
- Drawing a presence-absence heatmap of the identified VF genes within all samples to visualize in which samples these genes can be found.
- Drawing a phylogenetic tree for each pathogenic gene detected, where we will relate the contigs of the samples together where this gene is found.
With the visualizations types in this workflow, e.g. Heatmaps, Phylogenetic trees and Barplots, we can have an overview of all samples and the genes, but also how samples are related to each other i.e. which common pathogenic genes they share. Given the time of the sampling and the location one can easily identify using these graphs, where and when the contamination has occurred among the different samples.
Hands-on: Organize imported dataFollow these steps only if you imported the datasets, but if your Gene-based Pathogen Identification part is already finished correctly then skip the following 5 steps.
Create a collection named
VFs
withVFs
files
- Click on galaxy-selector Select Items at the top of the history panel
- Check all the datasets in your history you would like to include
Click n of N selected and choose Build Dataset List
- Enter a name for your collection
- Click Create collection to build your collection
- Click on the checkmark icon at the top of your history again
Create a collection named
vfs_of_genes_identified_by_vfdb
withvfs_of_genes_identified_by_vfdb
filesCreate a collection named
AMRs
withAMRs
filesCreate a collection named
amr_identified_by_ncbi
withamr_identified_by_ncbi
filesCreate a collection named
Contigs
withContigs
files
Hands-on: All Samples Analysis
- Import the workflow into Galaxy
- Copy the URL (e.g. via right-click) of this workflow or download it to your computer.
- Import the workflow into Galaxy
- Click on Workflow on the top menu bar of Galaxy. You will see a list of all your workflows.
- Click on galaxy-upload Import at the top-right of the screen
- Provide your workflow
- Option 1: Paste the URL of the workflow into the box labelled “Archived Workflow URL”
- Option 2: Upload the workflow file in the box labelled “Archived Workflow File”
- Click the Import workflow button
Below is a short video demonstrating how to import a workflow from GitHub using this procedure:
- Run Workflow 5: Pathogen Detection Samples Aggregation and Visualisation workflow using the following parameters:
- “Send results to a new history”:
No
- param-collection “Contigs”: collection
Contigs
output from the Gene-based Pathogen Identification workflow- param-collection “VFs”: collection
VFs
output from the Gene-based Pathogen Identification workflow- param-collection “AMRs”: collection
AMRs
output from the Gene-based Pathogen Identification workflow- param-collection “vfs_of_genes_identified_by_vfdb”: collection
vfs_of_genes_identified_by_vfdb
output from the Gene-based Pathogen Identification workflow- param-collection “amr_identified_by_ncbi”: collection
amr_identified_by_ncbi
output from the Gene-based Pathogen Identification workflow- param-collection “removed_hosts_percentage_tabular”: tabular
removed_hosts_percentage_tabular
output from the Preprocessing workflow- param-collection “mapping_coverage_percentage_per_sample”: tabular
mapping_coverage_percentage_per_sample
output from the Allele-based Pathogen Identification workflow- param-collection “mapping_mean_depth_per_sample”: tabular
mapping_mean_depth_per_sample
output from the Allele-based Pathogen Identification workflow- param-collection “number_of_variants_per_sample”: tabular
number_of_variants_per_sample
output from the Allele-based Pathogen Identification workflow
- Click on Workflow on the top menu bar of Galaxy. You will see a list of all your workflows.
- Click on the workflow-run (Run workflow) button next to your workflow
- Configure the workflow as needed
- Click the Run Workflow button at the top-right of the screen
- You may have to refresh your history to see the queued jobs
Heatmap
A heatmap is one of the visualization techniques that can give you a complete overview of all the samples together and whether or not a certain value exists. In this tutorial, we use the heatmap to visualize all samples aside and check which common bacteria pathogen genes are found in samples and which is only found in one of them.
We use Heatmap w ggplot tool along with other tabular manipulating tools to prepare the tabular files.
-
Combine VFs accessions for samples into a table and get 0 or 1 for absence / presence
Hands-on: Heatmap- Remove beginning with the following parameters:
- param-collection “from”:
vfs_of_genes_identified_by_vfdb
collection output of ABRicate tool from the Gene-based Pathogen Identification section
- param-collection “from”:
- Group with the following parameters:
- param-file “Select data”:
out_file1
(output of Remove beginning tool) - “Group by column”:
c6
- In “Operation”:
- param-repeat “Insert Operation”
- “Type”:
Count
- “On column”:
c6
- “Type”:
- param-repeat “Insert Operation”
- param-file “Select data”:
- Filter empty datasets with the following parameters:
- param-file “Input Collection”:
out_file1
(output of Group tool)
- param-file “Input Collection”:
- Column join ( Galaxy version 0.0.3) with the following parameters:
- param-file “Tabular files”:
output
(output of Filter empty datasets tool) - “Fill character”:
0
- param-file “Tabular files”:
- Column Regex Find And Replace ( Galaxy version 1.0.3) with the following parameters:
- param-file “Select cells from”:
tabular_output
(output of Column join tool) - “using column”:
c1
- In “Check”:
- param-repeat “Insert Check”
- “Find Regex”:
#KEY
- “Replacement”:
key
- “Find Regex”:
- param-repeat “Insert Check”
- param-file “Select cells from”:
- Remove beginning with the following parameters:
-
Draw heatmap
Hands-on: Heatmap- Heatmap w ggplot ( Galaxy version 3.4.0+galaxy0) with the following parameters:
- param-file “Select table”:
out_file1
(output of Column Regex Find And Replace tool) - “Select input dataset options”:
Dataset with header and row names
- “Select column, for row names”:
c1
- “Sample names orientation”:
vertial
- “Select column, for row names”:
- “Plot title”:
Pathogeneic Genes Per Samples
- In “Advanced Options”:
- “Enable data clustering”:
Yes
- “Enable data clustering”:
- In “Output Options”:
- “Unit of output dimensions”:
Centimeters (cm)
- “width of output”:
70.0
- “height of output”:
70.0
- “dpi of output”:
1000.0
- “Additional output format”:
PDF
- “Unit of output dimensions”:
- param-file “Select table”:
- Heatmap w ggplot ( Galaxy version 3.4.0+galaxy0) with the following parameters:
QuestionNow let’s see how your heatmap PDF looks like, you can zoom-in and out in your Galaxy history.
- Mention three of the common bacterial pathogen genes found in both samples.
- How can the differences in the found VF bacteria pathogen genes between the two samples be interpreted?
- A lot of bacteria pathogen VF gene products identified by the VFDB are common in both samples, such as: rfaD, ssaN and fliQ
Both samples were spiked with the same pathogen species, S. enterica, but not the same strain:
Barcode10
sample is spiked with S. enterica subsp. enterica strainBarcode11
sample is spiked with S. enterica subsp. houtenae strain.This can be the main cause of the big similarities and the few differences of the bacteria pathogen VF gene products found between both of the two samples. Other factors such as the time and location of the sampling may cause other differences. By knowing the metadata of the samples inputted for the workflows in real life we can understand what actually happened. We can have samples with no pathogen found then we start detecting genes from the 7th or 8th sample, then we can identify where and when the pathogen entered the host, and stop the cause of that
Phylogenetic Tree building
Phylogenetic trees can be used to track the evolution of the pathogen between the samples. Therefore, the VFs are used as a marker gene for the pathogen, similar to 16S marker genes for species profiling. We use the VFs since we know they are associated to the pathogenicity of the sample. By observing the created trees one can identify groups of related pathogens. If additional meta data of the samples would be available one could further identify groups that are associated to specific traits such as increase pathogenicity or faster transmission. Consequently, the tree could be used for phylogenetic placement of unknwon samples.
For the phylogenetic trees, for each bacteria pathogen gene found in the samples we use ClustalW (Larkin et al. 2007) for Multiple Sequence Alignment (MSA) needed before constructing a phylogenetic tree, for the tree itself we use FASTTREE and Newick Display (Dress et al. 2008) to visualize it.
To get the sequence to align, we need to extract the sequences of the VFs in the contigs:
Hands-on: Extract the sequences of the VFs
- Collapse Collection ( Galaxy version 5.1.0) with the following parameters:
- param-collection “Collection of files to collapse into single dataset”:
Contigs
- “Prepend File name”:
Yes
- Collapse Collection ( Galaxy version 5.1.0) with the following parameters:
- param-collection “Collection of files to collapse into single dataset”:
VFs
- “Keep one header line”:
Yes
- “Prepend File name”:
Yes
- Split by group ( Galaxy version 0.6) with the following parameters:
- param-file “File to split”: output of 2nd Collapse Collection tool
- “on column”:
Column: 13
- “Include header in splits?”:
Yes
- Cut with the following parameters:
- “Cut columns”:
c2,c3,c4
- param-file “From”:
split_output
(output of Split by group tool)- Remove beginning with the following parameters:
- param-file “from”: output of Cut tool
- bedtools getfasta ( Galaxy version 2.30.0+galaxy1) with the following parameters:
- param-file “BED/bedGraph/GFF/VCF/EncodePeak file”:
out_file1
(output of Remove beginning tool)- “Choose the source for the FASTA file”:
History
- param-file “FASTA file”:
output
(output of 1st Collapse Collection tool)
We can now run multiple sequence alignment, build the trees for each VF and display them.
Hands-on: Phylogenetic Tree building
- ClustalW ( Galaxy version 2.1+galaxy1) with the following parameters:
- param-collection “FASTA file”: output of bedtools getfasta tool
- “Data type”:
DNA nucleotide sequences
- “Output alignment format”:
FASTA format
- “Output complete alignment (or specify part to output)”:
Complete alignment
- FASTTREE ( Galaxy version 2.1.10+galaxy1) with the following parameters:
- “Aligned sequences file (FASTA or Phylip format)”:
fasta
- param-collection “FASTA file”: output of ClustalW tool
- “Set starting tree(s)”:
No starting trees
- “Protein or nucleotide alignment”:
Nucleotide
- Newick Display ( Galaxy version 1.6+galaxy1) with the following parameters:
- param-file “Newick file”: output of FASTTREE tool
- “Branch support”:
Hide branch support
- “Branch length”:
Hide branch length
- “Image width”:
2000
QuestionNow let’s see how your trees for the bacteria pathogen gene with accession IDs: AAF37887 and NP_459543 look like. To access that go to the output of Newick
- In which samples and contigs is gene AAF37887 found?
- In which samples and contigs is gene NP_459543 found?
Conclusion
In this tutorial, we have tried the workflow designed to detect and track pathogens in our food and drinks. Through out the full workflow we used our Nanopore sequenced datasets from Biolytix and analyzed it, found the pathogens and tracked it. This approach can be summarized with the following scheme: