Bioinformatics
Introduction
What Question Does It Ask?
Bioinformatics analyses biological data such as DNA, RNA and protein sequences with algorithms and statistics. The course covers problems such as sequence alignment, genome assembly, gene expression analysis and protein structure prediction, using methods that cope with the size and noise of this data.
At a glance
biology, algorithms and statistics
DNA, protein sequences, expression data
alignment, structure, function prediction
biological validity
medium-high
huge sequence datasets
Introduction
A Short History
Watson and Crick, drawing also on Franklin's data, propose the double-helix structure of DNA.
Needleman and Wunsch publish a global sequence alignment algorithm based on dynamic programming.
Smith and Waterman publish the local sequence alignment algorithm.
BLAST is published: fast, heuristic similarity search in large databases.
The Human Genome Project is completed; sequencing costs begin to fall rapidly.
AlphaFold 2 predicts protein structure at CASP14 with accuracy close to experimental methods.
The Course
Core Concepts
Global and local alignment; scoring matrices.
GenBank, UniProt, PDB; similarity search.
Gene finding and protein family profiles.
Building a genome from short reads; de Bruijn graphs.
Measuring how active each gene is with RNA-seq.
Building the family tree of species from sequences.
Predicting 3D shape from the amino acid sequence.
Controlling the false discovery rate over thousands of genes.
The Course
A Typical Workflow
The Course
What Does the Course Cover?
- A molecular biology primer and biological databases
- Pairwise alignment: Needleman-Wunsch, Smith-Waterman
- Scoring matrices and similarity search with BLAST
- Multiple sequence alignment
- Hidden Markov models and gene finding
- Motif finding
- Genome assembly: de Bruijn graphs
- Read mapping and variant calling
- Phylogenetic trees
- Gene expression with RNA-seq; multiple testing
- Clustering and classifying gene expression
- Protein structure prediction and AlphaFold
Skills you will gain
A typical semester; the order and coverage vary between universities.
Try It
Align Two Gene Fragments
How similar are DNA fragments of the same gene in two species? The Needleman-Wunsch table finds the best alignment. Change the sequences and scores, then click a cell to see how it was computed.
Context
Prerequisites
Courses worth knowing before this one, and why they are needed.
| Course | Why it is needed |
|---|---|
| Machine Learning | gene expression classification, protein structure |
| Data Mining | sequence motifs, clustering |
| Algorithms | dynamic programming: the method behind sequence alignment |
| Data Structures | hash tables, trees and graphs: k-mer counting and genome assembly |
| Biology | the basics of DNA, RNA, proteins and gene expression |
Context
Are You Ready for This Course?
Ask yourself; for every "no", the right-hand column shows where to start.
| Ask yourself | If not, start with |
|---|---|
| Can you find the longest common subsequence of two strings by dynamic programming? | Dynamic programming from an algorithms course |
| Can you explain how information flows from DNA to RNA to protein? | High school biology or a short molecular biology primer |
| Can you count all substrings of length k in a text with a hash table? | Hash tables from a data structures course |
| Can you train a classifier and interpret the result of a clustering? | Machine Learning |
Context
Neighbouring Courses
Overlap
Overlapping Courses
| Relation | Course | Shared ground |
|---|---|---|
| application | This course applies the methods of Machine Learning | gene expression classification, protein structure |
| application | This course applies the methods of Data Mining | sequence motifs, clustering |
| shares methods | Shares methods with Probabilistic Graphical Models | hidden Markov models for sequence alignment |
Differences
Where It Differs (1/2)
| Criterion | Bioinformatics | Machine Learning | Data Mining |
|---|---|---|---|
| Core question | How are biological sequences and molecular data analyzed computationally? | How does a program generalize from examples? | How are hidden, useful patterns found in large piles of data? |
| Approach | biology, algorithms and statistics | statistical learning | discovery-driven analysis |
| Input | DNA, protein sequences, expression data | labeled or unlabeled examples | large tables or transaction data |
| Output | alignment, structure, function prediction | a model that makes predictions | rules, clusters, outliers |
| Success measure | biological validity | error on unseen data | interestingness, support, confidence |
| Math load | medium-high | high: linear algebra, probability, optimization | medium |
| Data needs | huge sequence datasets | moderate to large | large |
- Machine Learning: ML develops general-purpose learning methods; this course applies them to sequence and expression data together with biological knowledge.
- Data Mining: Data mining looks for patterns in any data; this course uses alignment and motif methods specific to DNA and protein sequences.
Differences
Where It Differs (2/2)
| Criterion | Bioinformatics | Graphical Models | Medical Imaging |
|---|---|---|---|
| Core question | How are biological sequences and molecular data analyzed computationally? | How do we model and query many interdependent, uncertain variables? | How do X-ray, CT and MRI images help diagnosis and treatment? |
| Approach | biology, algorithms and statistics | probability and graphs combined | image processing plus clinical knowledge |
| Input | DNA, protein sequences, expression data | variables, dependencies, data | CT, MRI, X-ray, ultrasound |
| Output | alignment, structure, function prediction | conditional probability, best explanation | segmentation, measurement, diagnostic suggestion |
| Success measure | biological validity | likelihood, inference accuracy | sensitivity, specificity, Dice |
| Math load | medium-high | high: probability | medium-high |
| Data needs | huge sequence datasets | moderate | little; labels are expensive |
- Graphical Models: Probabilistic graphical models are a general framework; this course uses hidden Markov models for gene finding and protein families.
- Medical Imaging: Medical image processing analyses images of organs and tissue; this course analyses sequence and expression data at the molecular level.
Practice
Applications
Choosing treatment by genetic variants.
Tracing spread through virus genomes.
Predicting target protein and molecule interactions.
Finding tumour-specific mutations.
Breeding productive and resilient crop varieties.
Building species relationships from sequences.
Practice
Risks and Ethics
A genome identifies a person and their relatives; identities have been recovered from genetic data thought anonymous.
Genomic databases come mostly from people of European ancestry; risk scores are less accurate for other ancestries.
When samples are processed on different days or machines, a technical difference can look like a biological finding.
Treating a variant of uncertain significance as a cause of disease can lead a patient to needless treatment or worry.
In depth: Explainable AI and AI Ethics.
Practice
Tools and Datasets
Tools and libraries
Well-known datasets
Practice
Common Misconceptions
| Common belief | In fact |
|---|---|
| One gene means one trait. | Most traits come from many genes and the environment together; few are set by a single gene. |
| Once a genome is sequenced, its function is known. | A sequence is only a string of letters; finding what genes do is a separate, hard analysis. |
| Bioinformatics is only for biologists. | The core of the field is algorithms, data structures and statistics; computer engineers are central. |
| When thousands of genes are tested, the significant ones are real. | Multiple testing inflates false positives; corrections such as the false discovery rate are needed. |
Next Steps
After This Course
Courses that build on or extend this one
Related careers
Next Steps
Further Reading
- Durbin, Eddy, Krogh and Mitchison, Biological Sequence Analysis, Cambridge University Press, 1998.
- Jones and Pevzner, An Introduction to Bioinformatics Algorithms, MIT Press, 2004.
- Compeau and Pevzner, Bioinformatics Algorithms: An Active Learning Approach, 3rd ed., Active Learning Publishers, 2018.
- Altschul et al., "Basic Local Alignment Search Tool", Journal of Molecular Biology 215(3), 1990.