Many synthetic biology applications rely on programming living cells using gene circuits - the assembly and wiring of genetic elements to control cellular behaviors. Extensive progress has been made in constructing gene circuits with diverse functions and applications. For many circuit functions, however, it remains challenging to ensure that the circuits operate in a predictable manner. Although the notion of predictability may appear intuitive, close inspection suggests that it is not always clear what constitutes predictability. We dissect this concept and how it can be confounded by the complexity of a circuit, the complexity of the context, and the interplay between the two. We discuss circuit engineering strategies, in both computation and experiment, that have been used to improve the predictability of gene circuits.