Hume’s Problem of Induction
Published:
Science depends on a simple expectation:
the future will, in relevant ways, resemble the past.
Water boiled yesterday.
It boils today.
We expect similar behavior tomorrow under similar conditions.
Electrons measured in one laboratory behave like electrons elsewhere.
Gravitational laws observed in our region are applied to distant galaxies.
Without this kind of generalization, science would collapse.
David Hume asked a devastating question:
What justifies that expectation?
The Structure of Induction
Inductive reasoning moves beyond observed evidence.
We have observed many instances of A followed by B.
We infer that future A-like cases will probably be followed by B.
But the conclusion contains information not logically guaranteed by the premises.
Past regularity does not deductively entail future regularity.
That gap is the problem.
The Sun Example
The sun has risen every day in recorded history.
Does that prove it will rise tomorrow?
No.
The past pattern strongly supports the expectation.
But no contradiction follows from imagining that tomorrow is different.
The conclusion is highly reasonable.
It is not deductively certain.
Hume asks why reason permits the leap.
Demonstrative Reasoning Cannot Justify Induction
Could induction be justified deductively?
No.
A deductive proof would need to show that nature must continue uniformly.
But it is logically possible to imagine a universe in which laws suddenly change.
No contradiction is involved.
So induction cannot be established as a necessary truth by pure logic.
Probable Reasoning Seems Circular
Perhaps we justify induction probabilistically.
Induction has worked well in the past.
Therefore it will probably continue to work.
But this argument itself uses induction.
We infer future reliability from past reliability.
The justification presupposes the very principle it is supposed to prove.
This is Hume’s circularity problem.
Uniformity of Nature
A common response says:
nature is uniform.
Similar causes produce similar effects.
But how do we know that?
Because nature has behaved uniformly in observed cases.
Again, the argument moves from past observations to future expectation.
Uniformity cannot simply be assumed as an independent empirical proof of induction.
Cause and Constant Conjunction
Hume’s skepticism extends to causation.
We observe one event followed by another.
Strike billiard ball A.
Ball B moves.
We come to expect the connection.
But do we perceive a necessary causal power?
Hume argues that experience gives us repeated conjunction, not a visible metaphysical necessity linking cause and effect.
Our expectation grows from habit.
Habit
For Hume, human beings naturally form expectations from repeated patterns.
After seeing A followed by B many times, the mind anticipates B when A appears again.
This habit is psychologically unavoidable.
It is practically indispensable.
But it is not the same as a deductive rational proof.
Nature trains expectation.
Reason does not fully justify it from first principles.
Does Hume Destroy Science?
No.
Hume does not show that induction is useless.
He shows that its justification is philosophically difficult.
Science can remain extraordinarily successful while lacking a non-circular proof that future regularities must resemble past ones.
This distinction matters.
A practice can be rationally indispensable without being deductively grounded.
Popper’s Response
Karl Popper attempted to avoid induction by emphasizing falsification.
Scientists do not prove universal theories from repeated observations.
They propose bold conjectures.
Then they try to refute them.
No number of white swans proves all swans are white.
One black swan can refute the universal claim.
This asymmetry is powerful.
But Popper does not eliminate every inductive element of science.
Why Falsification Still Needs Background Assumptions
Suppose an experiment contradicts a prediction.
Should we reject the main theory?
Maybe the instrument failed.
Maybe initial conditions were wrong.
Maybe an auxiliary hypothesis was false.
Deciding which component to revise depends partly on broader evidential judgment.
Science cannot operate as pure deductive falsification alone.
Repeated Success Still Matters
Even Popperian scientists trust theories that survive many tests more than theories that have never been tested.
Why?
Because past predictive success influences future confidence.
That looks inductive.
A philosophy that bans induction completely struggles to describe actual scientific reasoning.
Bayesian Response
Bayesian epistemology reframes induction as probabilistic updating.
Start with prior probabilities.
Observe evidence.
Update using Bayes’ theorem.
Repeated successful predictions increase posterior confidence.
This gives induction mathematical structure.
But it does not entirely escape Hume’s question.
Why trust the probabilistic model?
Why assume future data are generated by the same process?
Some regularity assumptions remain.
Reichenbach’s Pragmatic Response
Hans Reichenbach offered a pragmatic defense.
If any method can successfully learn stable frequencies in nature, induction is the method that will eventually converge toward them.
If nature contains no stable regularities, no method can succeed anyway.
So induction is justified not as logically guaranteed but as the best strategy available in a world where prediction is possible.
This is a practical rather than deductive solution.
Naturalized Epistemology
Another response treats human reasoning as part of nature.
We use induction because organisms evolved in environments containing enough regularity for learning to work.
Brains that ignored persistent patterns would perform badly.
This explains why inductive cognition exists.
But evolutionary success is not the same as philosophical justification.
It explains the origin of trust, not necessarily its logical foundation.
Inference to the Best Explanation
Some philosophers argue that the success of science itself is best explained by the idea that nature contains stable structures.
If laws were arbitrary from moment to moment, systematic prediction would be unlikely.
The continuing success of scientific inference supports realism about regularity.
But this argument is itself abductive.
It does not provide deductive certainty.
Goodman and the New Riddle of Induction
Nelson Goodman sharpened the problem.
Suppose every emerald observed before time T is green.
We infer future emeralds will be green.
Now define a strange predicate:
grue = green before T and blue after T.
All past emerald observations also support “all emeralds are grue.”
Why prefer green over grue?
The problem shows that induction depends on which categories and predicates we treat as natural.
Past evidence alone does not mechanically determine one generalization.
Projectible Predicates
Goodman’s puzzle introduces the idea of projectibility.
Some properties seem appropriate to generalize.
Green.
Mass.
Electric charge.
Others look artificially constructed.
Grue.
Why?
Possible answers appeal to:
- natural kinds,
- simplicity,
- entrenched concepts,
- causal structure,
- scientific theory.
Induction depends on representation as well as observation.
Machine Learning Faces the Same Problem
A machine-learning model trained on past data must generalize to new cases.
Why should it?
Because we assume training and test data share relevant structure.
If the data-generating process changes radically, generalization fails.
This is a modern version of Hume’s problem.
Machine learning does not escape induction.
It mechanizes it.
Distribution Shift
A model trained in one environment may fail in another.
Medical data from one hospital may not generalize.
Economic patterns can change.
Language usage evolves.
This is distribution shift.
It reminds us that inductive success depends on stability.
The future need not resemble the past in every respect.
Science Uses Conditional Induction
Scientific induction is rarely:
“the past was like this, so the future must be identical.”
It is more often:
“under sufficiently similar conditions and within this tested domain, we expect similar behavior.”
This is a weaker and more disciplined claim.
It acknowledges boundaries.
Laws and Induction
If laws of nature are real governing structures, perhaps induction is reliable because the same laws persist.
But how do we know laws persist?
Through repeated evidence.
Unless law persistence is metaphysically necessary, Hume’s challenge returns.
A law-based ontology may explain regularity without fully solving epistemic access to it.
The Problem Cannot Simply Be Ignored
Scientists rarely stop experiments to debate Hume.
They do not need to.
Science can function pragmatically.
But philosophy asks what makes the function rational.
Hume reveals that empirical knowledge rests on a bridge that cannot be built from deduction alone.
We trust regularity because it has worked, because alternatives are worse, because prediction succeeds, and because our entire epistemic practice depends on it.
None of these is a simple proof.
Fallibilism
The most realistic response may be fallibilist.
We do not claim induction guarantees truth.
We treat it as a corrigible strategy.
Expectations remain open to revision.
Evidence updates confidence.
When regularities fail, models change.
Science becomes not a path to certainty but a disciplined way of learning under uncertainty.
Hume’s Lasting Lesson
The problem of induction teaches humility.
Past success does not logically force future success.
Repeated evidence can justify confidence without creating certainty.
Scientific laws are trusted because they survive increasingly severe tests, not because philosophy has proved nature cannot change.
That is enough for powerful knowledge.
It is not absolute proof.
From Prediction to Explanation
Even if induction lets us expect patterns to continue, science wants more than reliable prediction.
We also ask why.
Why did the eclipse occur?
Why does a drug work?
Why did the universe expand?
Why do gases obey pressure relationships?
Prediction and explanation are not identical.
So the next question is:
What makes an explanation scientific?
