Digital Signal Processing
Introduction
What Question Does It Ask?
Digital signal processing analyzes, filters and transforms audio, vibration, ECG or radio signals that have been sampled at regular intervals, using mathematical transforms. The course rests on exact mathematics, not learning; it is the common foundation of the audio, image and communications courses.
At a glance
mathematical transforms and filters
sampled signal
filtered signal, spectrum
signal-to-noise ratio, frequency response
high: complex numbers, Fourier
no learning; the signal suffices
Introduction
A Short History
In his book on heat, Fourier proposes writing functions as sums of sinusoids.
Shannon publishes sampling theory: a band-limited signal sampled fast enough is recovered exactly.
Cooley and Tukey publish the fast Fourier transform (FFT); computing spectra becomes practical.
Ahmed, Natarajan and Rao introduce the discrete cosine transform (DCT); JPEG and MP3 build on it.
Oppenheim and Schafer's Digital Signal Processing appears; the field becomes a standard course.
Texas Instruments' Speak & Spell brings single-chip digital speech synthesis into homes.
The Course
Core Concepts
Measuring a continuous signal at equal intervals to get a sequence of numbers.
Sample faster than twice the highest frequency.
With undersampling, a high frequency shows up as a low one.
Rounding amplitude to a finite number of levels; bit depth.
The response of a linear time-invariant system to its input.
A fast way to split a signal into frequency components.
Low-pass, high-pass and band-pass digital filters.
Poles and zeros of a filter; stability analysis.
The Course
A Typical Workflow
The Course
What Does the Course Cover?
- Discrete-time signals and systems
- Linear time-invariant systems and convolution
- Sampling, aliasing and reconstruction
- Discrete-time Fourier transform, frequency response
- The z-transform: poles, zeros and stability
- The discrete Fourier transform (DFT) and the FFT
- Windowing and spectral leakage
- FIR filter design: the window method
- IIR filter design: Butterworth, Chebyshev
- Sample-rate conversion: decimation, interpolation
- Short-time Fourier transform and spectrograms
- Quantization noise and fixed-point implementation
Skills you will gain
A typical semester; the order and coverage vary between universities.
Try It
Cleaning a Noisy Pulse
A chest-strap ECG samples at 200 Hz; 50 Hz mains hum and muscle noise have crept into the recording. Change the moving-average window length and watch the signal in both time and frequency.
Context
Prerequisites
Courses worth knowing before this one, and why they are needed.
| Course | Why it is needed |
|---|---|
| Calculus | integrals, series and complex numbers: the language of the Fourier transform |
| Differential Equations | behavior and stability of linear systems |
| Programming with C | to write real-time filters on embedded devices |
Context
Are You Ready for This Course?
Ask yourself; for every "no", the right-hand column shows where to start.
| Ask yourself | If not, start with |
|---|---|
| Can you write a complex number in polar form and explain Euler's formula? | Complex numbers and Euler's formula from calculus |
| Can you read the amplitude, frequency and phase of a sinusoid from its plot? | A quick review of trigonometry and sinusoid graphs |
| Can you evaluate a sum (Σ) and a simple integral? | Series and integrals from calculus |
| Can you generate an array in Python or MATLAB and plot it? | Intro programming, then a short NumPy and Matplotlib tutorial |
Context
Neighbouring Courses
Overlap
Overlapping Courses
| Relation | Course | Shared ground |
|---|---|---|
| builds on | Image Processing builds on this course | 2D signals, convolution, Fourier transform |
| builds on | Speech Recognition and Audio Processing builds on this course | spectrogram, MFCC, filters |
| shares methods | Shares methods with Time Series Analysis and Forecasting | frequency analysis, filtering |
| shares methods | Shares methods with Information Theory | compression, sampling, channels |
Differences
Where It Differs (1/2)
| Criterion | Signal Processing | Image Processing | Speech and Audio |
|---|---|---|---|
| Core question | How are sampled signals analyzed, filtered and transformed? | How is an image enhanced, transformed and divided into regions? | How are words, speakers and events extracted from a sound wave? |
| Approach | mathematical transforms and filters | pixel-level transformations | acoustic signal and language model |
| Input | sampled signal | image | audio waveform |
| Output | filtered signal, spectrum | processed image or regions | text, speaker, sound event |
| Success measure | signal-to-noise ratio, frequency response | visual quality, PSNR | word error rate (WER) |
| Math load | high: complex numbers, Fourier | medium: convolution, Fourier | medium-high |
| Data needs | no learning; the signal suffices | little; learning not required | many hours of recordings |
- Image Processing: Signal processing works with one-dimensional, time-dependent signals; image processing carries the same tools to a 2D pixel grid.
- Speech and Audio: Signal processing provides general tools; speech recognition combines them with language models and learning to output words.
Differences
Where It Differs (2/2)
| Criterion | Signal Processing | Time Series | Information Theory |
|---|---|---|---|
| Core question | How are sampled signals analyzed, filtered and transformed? | How do we find structure in measurements over time and forecast the future? | How is information measured, and how is it compressed and transmitted with the least loss? |
| Approach | mathematical transforms and filters | time-dependent statistical models | measuring information with probability |
| Input | sampled signal | timestamped measurements | source and channel model |
| Output | filtered signal, spectrum | forecast, trend, seasonality | bounds, codes, compression rate |
| Success measure | signal-to-noise ratio, frequency response | forecast error (MAE, RMSE) | bits, channel capacity |
| Math load | high: complex numbers, Fourier | medium-high | high: probability |
| Data needs | no learning; the signal suffices | long history | none |
- Time Series: Both look at time-dependent data; time series analysis needs forecasting and statistics, signal processing needs frequency and filters.
- Information Theory: Information theory gives the measure of information and the limits of compression; signal processing gives the algorithms that act on the signal.
Practice
Applications
Equalizers, noise suppression, MP3 compression.
Modems, Wi-Fi, 4G/5G modulation.
Filtering ECG and EEG, finding peaks.
Measuring range and speed from echoes.
Detecting machine faults from the spectrum.
Transforms in JPEG and video coding.
Practice
Risks and Ethics
Without a low-pass filter before sampling, high frequencies show up as fake low ones and cannot be undone.
A pole outside the unit circle makes the output blow up; coefficient rounding in fixed point can push it there.
An FFT taken without a suitable window shows frequency components that are not there and leads to wrong diagnoses.
The nonlinear phase of an IIR filter distorts waveforms such as ECG, which can affect a diagnosis.
In depth: Explainable AI and AI Ethics.
Practice
Tools and Datasets
Tools and libraries
Sample signals and datasets
Practice
Common Misconceptions
| Common belief | In fact |
|---|---|
| A higher sampling rate is always better. | Beyond the Nyquist limit you gain no information; only data and computation grow. |
| The FFT is a different transform from the Fourier transform. | The FFT is an algorithm that computes the discrete Fourier transform (DFT) fast; the result is the same. |
| A filter tells noise from signal and removes it. | A filter separates by frequency; if noise shares the signal's band, the filter cannot separate it. |
| Deep learning has made signal processing obsolete. | Audio and sensor models usually take a spectrogram or a filtered signal as input. |
Next Steps
After This Course
Courses that build on or extend this one
Related careers
Next Steps
Further Reading
- Oppenheim and Schafer, Discrete-Time Signal Processing, 3rd ed., Pearson, 2010.
- Proakis and Manolakis, Digital Signal Processing: Principles, Algorithms, and Applications, 4th ed., Pearson, 2007.
- Smith, The Scientist and Engineer's Guide to Digital Signal Processing, California Technical Publishing, 1997.
- Cooley and Tukey, "An Algorithm for the Machine Calculation of Complex Fourier Series", Mathematics of Computation 19(90), 1965.