The justification of science appears at first glance to be the generalisation of experience. I heat melt x and see that it expands, I heat metal y and see that it expands, I heat metal z and see that it expands, and so on, such that it seems natural that I can claim that all metals expand when I heat them. Most scientists think that this is what a scientific argument is, and most would also think this is what we might mean by objectivity. There are, however, two questions we might ask of them. First of all, does the inductive method really produce knowledge, and secondly even if it did is this how science itself operates in its own history.
Let us take the first question first, because is the more traditional problem of induction, and has its canonical form in the argument of Hume. To understand his problem with induction we first of all need to understand his epistemology. For Hume, there are two kinds of propositions: relations of ideas, and matters of facts. In the first relation, the truth of our ideas is confined to our ideas alone. Thus if you understand the concept ‘bachelor’ you know that the idea ‘unmarried man’ in contained within it. When it comes to matters of fact, however, we have to go beyond our concepts to experience. They tell us something new about the world and not just the ideas that we already know. A matter of fact would be that Paris is the capital of France, or metals expand when heated. Of course when you know the idea then you know what is contained in it, but to get the idea you first of all have to get the knowledge.
They can be false relations of ideas as there can be false matters of fact. Thus if you think that a whale is a fish, then you have made an error about a relation of ideas (you don’t know that a whale is a mammal), and if you think that Plato died in 399 BC, then you have made an error at the level of facts (Ladyman 2002, p.32). Relations of ideas can be proved true by deduction since the negation is a contraction. Basically relations of ideas are tautologies, you cannot assert that Peter is not a bachelor at the same time as asserting that he isn’t married as well, since being unmarried and being a bachelor are one the same thing. On the other hand, matters of fact cannot be proved by deduction, but can only be derived from experience and their contradiction is not a fallacy. If I say that Everest is the tallest mountain on Earth, none of the terms have a logical relation to one another, so I could assume that there is taller mountain. I would have to experience the different tall mountains on Earth to know which one was tallest or not (Ladyman 2002, p.33). For this reason Hume was extremely sceptical about what one could claim to know deductively. All that one could claim are logical relations between concepts that we already know (whose origin anyway would be the senses). What we cannot claim is to produce new knowledge about the world simply through examining our concepts (as theology and metaphysics is wont to do in his opinion).
These distinctions seem very straight forward and at first glance appear to back up the inductivist view of science. The problem for Hume, however, is the idea that matters of fact could have the same necessary conclusions as relations of ideas, as the idea of expanding metals as a universal law implies. The key to this problem for Hume is whether I can assert that what happens in the past is a certain kind for what will happen in the future. I have experience the fact that the sun rises every morning. Does this give me the right to say that it will rise again tomorrow, when I haven’t actually experience this dawn yet. If it does rise then I will be certain, and in terms of the past, I know that it did rise, but now can I know that I will rise again tomorrow?
Induction for Hume is based upon causal arguments. Our only knowledge of cause and effect is through experience itself because there is no logical reason why any causal relation should hold or not hold. I know that matches cause fires, because I know that from experience, not because matches logically contain fire. Just as we can only infer future behaviour of the world from the actual experience of the world, then we can only understand the category of causality from experience. In other words without experience we would not have the concept of causality as a generality. If I always experience the dawn as the rising of the sun then I conjoin this events. If A always follows B, then I will say that A causes B. This because I believe that the future always follows the same path as the past. So that if A happens, then B will happen. Linked to conjunction is contiguity and precedence. Contiguity means that B follows A in time and space, and precedence is that the effect is always after the cause. (the flame is after the lighted match and not before). It is because of conjunction, contiguity, and precedence, that we feel that we have good reason to say that A cause B, or that the sun will rise tomorrow. Hume assertion that this can never be a necessary reason, as is suggested by generalisation of a universal law however compelling I feel this causality to be.
Take the example of billiard balls, which seems the most basic relation of causality. The ball X hits the ball Y and causes it to move. But what do we mean by that? Do we mean that the ball X makes the ball Y move or that it produces its movement? We think there is a necessary connection between the two events. X moving and Y moving. What we experience is conjunction, contiguity and precedence, what we do not experience is some mysterious ‘necessary connection’. What we see is ball X and ball Y, what we do not see is some other third thing (like an invisible connection, indeed what we do not see is causality). What does it add to our explanation of the events, even if we were to add this mysterious cause. Wouldn’t the ball X and the ball Y just move in exactly the same way?
The point for Hume is just because two events have always in the past be conjoined, does not mean that we can be universally certain that they will always do so. The conclusion of inductive argument could be false but that would never make it invalid (indeed it might make it more interesting, as if the sun did not rise the next day), but this is never the case with a deductive argument if the premises are true. What underpins are inductive generalisation is the belief that nature is well ordered spatially and temporally, that what happens many times will happen again in the same way. But that is just an assumption. Why must the future always be the same as the past and it certainly is not a contradiction if it were not.
Now of course we make these kind of inferences all the time, and Hume accepts that. I probably would not be able to live if I really though the sun would not rise tomorrow every time I went to bed. But this uniformity is a result of our psychology (perhaps it is an evolutionary trait) rather than reason or logic. We find regularity in nature because our habitual associations of events, and not because these events are necessarily connected.
There is no doubt that Hume’s problem is very profound and does make us look at induction more critically, but we might think that the idea that science itself is inductive in the simply way that inductivism implies is too simplistic. It is important to note that this is a very different critique from the methodological one. In the first case, we investigate the method of induction, and like Hume say that is flawed, or might even argue that Hume’s own account of induction is not a correct description of induction. Whereas in the historical account of science, we are arguing whether the description of method is actually how scientists themselves work. One is a description of the content of scientific knowledge, the other is a description of the activity scientists themselves. This is a completely different way of doing philosophy of science. For it does not first of all describe a method of doing science and then apply it to scientists, rather it examines what scientists do and from that derives the method. We shall see that this way of understanding science is going to be very important to Kuhn.
Why might we think that scientists do not use the inductive method in the way that induction has been described so far? Take the example of Newton’s Principia (Ladyman 2002, pp.55–6). Newton presents in this work the three laws of motion and the law of gravity. From these laws in explains natural phenomena like planetary motion. He says that he has inferred these laws through induction from observation. Now it is French philosopher of science Duhem that points out that there is a problem with Newton’s explanation. The data he is using is Kepler’s. His data proves that the planet will move in circles, whereas Newton’s in ellipses. This means that he could not have inferred gravity from Kepler’s data, rather he already the hypothesis of the law of gravity to interpret Kepler’s data. Again Newton’s first law state that bodies will maintain their state of motion unless acted upon by another body, but we have not observed a body that has not been acted upon, so this law could not be obtained through observation. Even Kepler’s theory could not have be derived from observation, because he took his data from Brahe, but could only organise it by already assuming that planets moved in circles, a hypothesis he didn’t receive from data, but from the mystical Pythagorean tradition.
So there are two reasons why we might be sceptical of the simple inductive explanation of science. One is methodological through the problem of induction (though we might come up with a better inductive method to solve this), and the other is historical, that science does not work in the way that theory of induction describes. I think the latter is the more serious issue than the former. For in the end science is what scientists do, and not what philosophers might idealise that they do.
Ladyman, J., 2002. Understanding Philosophy of Science, London; New York: Routledge.
 A group of philosophers from the 20th century called logical positivists also liked this distinction, and differentiated mathematical and logical truths, on the one hand, and science on the other. Anything that didn’t fit this schema was said to be nonsense or meaningless.
 This is what Ladyman does when he lists all the different ways in which we might counter Hume, the most telling being induction as the ‘best explanation’ (Ladyman 2002, pp.46–7).