Along shore sediment transport that is driven by waves is generally assumed to smooth a coastline. This assumption is valid for small angles between the wave crest lines and the shore, as has been demonstrated in shoreline models. But when the angle between the waves and the shoreline is sufficiently large, small perturbations to a straight shoreline will grow. Here we use a numerical model to investigate the implications of this instability mechanism for large-scale morphology over long timescales. Our simulations show growth of coastline perturbations that interact with each other to produce large-scale features that resemble various kinds of natural landforms, including the capes and cuspate forelands observed along the Carolina coast of southeastern North America. Wind and wave data from this area support our hypothesis that such an instability mechanism could be responsible for the formation of shoreline features at spatial scales up to hundreds of kilometres and temporal scales up to millennia.