The elegance in science is not always obvious, but it does play an important role. Here, Ian Glynn selects historical examples from a wide range of sciences to draw out the principle of elegance, highlighting the role of beauty and simplicity in science, and relating it to important philosophical issues related to inference to the best explanation.