More than one artist goes by Pagan Babies 1. The short-lived dream pop band formed by Kat Bjelland and Courtney Love in 1985 in Portland, Oregon, United States 2. A Philadelphia punk band formed in 1986. Biographies are listed below: 1. Pagan Babies were a short-lived dream pop band formed in 1985 by Courtney Love and Kat Bjelland. Love and Bjelland had previously been in the San Francisco-based project Sugar Babydoll with L7 bassist Jennifer Finch, however, relocating back to Portland in late 1985, they formed the Pagan Babies with Janis Tanaka and Deirdre Schletter.