Remote Sensing
Introduction
What Question Does It Ask?
Remote sensing extracts information about the Earth without touching it, by measuring reflected and emitted energy with sensors on satellites, aircraft or drones. An image is not just a color photo but multiband data, where each band carries a different physical measurement.
At a glance
physical sensing and image analysis
multispectral satellite imagery
land cover map, change
map accuracy, kappa
medium
plenty; labels limited
Introduction
A Short History
Nadar photographs Paris from a balloon: the first known aerial photograph.
The first weather satellite, TIROS-1, is launched; clouds are imaged routinely from space.
Landsat 1 is launched: the first civilian program to monitor the Earth in multiple bands.
Seasat becomes the first civilian satellite to collect synthetic aperture radar (SAR) images from space.
The US Geological Survey (USGS) opens the Landsat archive to everyone for free.
Sentinel-2A is launched; Copernicus open data starts an era of frequent, free imagery.
The Course
Core Concepts
Visible, infrared, thermal and microwave bands.
Optical sensors measure sunlight; radar sends its own signal.
Spatial, spectral, temporal and radiometric.
Water, plants and soil reflect differently in each band.
NDVI for vegetation, NDWI for water.
Atmospheric, terrain and geometric correction.
Labeling each pixel as forest, field, urban or water.
Comparing images from different dates.
The Course
A Typical Workflow
The Course
What Does the Course Cover?
- Electromagnetic radiation and surface interaction
- Sensors, platforms and types of resolution
- Radiometric and atmospheric correction
- Geometric correction, coordinate systems, projections
- Image enhancement and colour composites
- Spectral indices: NDVI, NDWI
- Supervised and unsupervised land-cover classification
- Accuracy assessment and ground truth
- Change detection and time-series analysis
- Thermal sensing and LiDAR
- Radar (SAR) imagery and interferometry
- Deep learning for satellite imagery
Skills you will gain
A typical semester; the order and coverage vary between universities.
Try It
Measuring Forest Loss from Space
Two satellite images of the same area, from two dates, have red and near-infrared (NIR) bands. Find vegetation with NDVI, slide the threshold and measure how many hectares of forest were lost; click a pixel to see its value.
Context
Prerequisites
Courses worth knowing before this one, and why they are needed.
| Course | Why it is needed |
|---|---|
| Image Processing | multispectral images, correction |
| Computer Vision | land cover classification, change detection |
| Physics | electromagnetic waves, reflection and absorption |
| Geographic information systems | coordinate systems, map projections and layers |
| Programming | large array and file operations in Python |
Context
Are You Ready for This Course?
Ask yourself; for every "no", the right-hand column shows where to start.
| Ask yourself | If not, start with |
|---|---|
| Can you explain the visible and infrared parts of the electromagnetic spectrum? | Electromagnetic waves from high-school physics |
| Can you explain latitude/longitude versus projected (metre) coordinates? | A short introductory GIS tutorial with QGIS |
| Can you apply a histogram and thresholding to an image? | Image Processing |
| Can you train a classifier and interpret its confusion matrix? | Machine Learning |
Context
Neighbouring Courses
Overlap
Overlapping Courses
| Relation | Course | Shared ground |
|---|---|---|
| application | This course applies the methods of Image Processing | multispectral images, correction |
| application | This course applies the methods of Computer Vision | land cover classification, change detection |
| shares methods | Shares methods with Time Series Analysis and Forecasting | multitemporal image series |
Differences
Where It Differs (1/2)
| Criterion | Remote Sensing | Image Processing | Computer Vision |
|---|---|---|---|
| Core question | What can satellite and aerial images tell us about the Earth? | How is an image enhanced, transformed and divided into regions? | How does a computer understand what is in an image or a video? |
| Approach | physical sensing and image analysis | pixel-level transformations | extracting meaning from images |
| Input | multispectral satellite imagery | image | image or video |
| Output | land cover map, change | processed image or regions | label, box, depth, 3D structure |
| Success measure | map accuracy, kappa | visual quality, PSNR | accuracy, mAP, IoU |
| Math load | medium | medium: convolution, Fourier | high: geometry, linear algebra |
| Data needs | plenty; labels limited | little; learning not required | many labeled images |
- Image Processing: Image processing provides the general methods; remote sensing applies them to multiband satellite images that carry physical measurements.
- Computer Vision: Vision recognizes objects in ordinary photos; remote sensing maps the Earth using spectral signatures and location.
Differences
Where It Differs (2/2)
| Criterion | Remote Sensing | Time Series | Medical Imaging |
|---|---|---|---|
| Core question | What can satellite and aerial images tell us about the Earth? | How do we find structure in measurements over time and forecast the future? | How do X-ray, CT and MRI images help diagnosis and treatment? |
| Approach | physical sensing and image analysis | time-dependent statistical models | image processing plus clinical knowledge |
| Input | multispectral satellite imagery | timestamped measurements | CT, MRI, X-ray, ultrasound |
| Output | land cover map, change | forecast, trend, seasonality | segmentation, measurement, diagnostic suggestion |
| Success measure | map accuracy, kappa | forecast error (MAE, RMSE) | sensitivity, specificity, Dice |
| Math load | medium | medium-high | medium-high |
| Data needs | plenty; labels limited | long history | little; labels are expensive |
- Time Series: Time series analysis provides the general methods; remote sensing tracks change in images of the same place over years.
- Medical Imaging: Both treat an image as a physical measurement; medical imaging measures the body, remote sensing the Earth.
Practice
Applications
Crop health, yield prediction, irrigation.
Burned areas, deforestation monitoring.
Damage maps after earthquakes and floods.
Construction and urban sprawl.
Monitoring glaciers, sea surface and drought.
Reconnaissance and target area analysis.
Practice
Risks and Ethics
High-resolution satellite and drone imagery can track people's homes, vehicles and movements without consent.
A classification map never checked in the field can mislead farming or disaster decisions despite high reported accuracy.
Unmasked clouds and shadows look like forest loss or flooding in change detection.
A model trained on European data fails silently in other climates and farming patterns; each region needs validation.
In depth: Explainable AI and AI Ethics.
Practice
Tools and Datasets
Tools and libraries
Well-known datasets
Practice
Common Misconceptions
| Common belief | In fact |
|---|---|
| A satellite image is an ordinary color photo. | It also has infrared, thermal and radar bands that the eye cannot see. |
| Higher spatial resolution is always better. | For wide areas and frequent revisits, medium resolution is often more suitable. |
| If there are clouds, the satellite sees nothing. | Optical sensors cannot; radar (SAR) sees through clouds and at night. |
| This is just an image processing course. | Sensor physics, the atmosphere, map projections and field validation are also part of it. |
Next Steps
After This Course
Courses that build on or extend this one
Related careers
Next Steps
Further Reading
- Lillesand, Kiefer and Chipman, Remote Sensing and Image Interpretation, 7th ed., Wiley, 2015.
- Jensen, Remote Sensing of the Environment: An Earth Resource Perspective, 2nd ed., Pearson, 2007.
- Campbell and Wynne, Introduction to Remote Sensing, 5th ed., Guilford Press, 2011.
- Richards, Remote Sensing Digital Image Analysis, 5th ed., Springer, 2013.