There are hundreds of different kinds of Passionflower and many of them have palatable fruit. P. edulis is the most commonly-cultivated, but not necessarily the tastiest. Almost all of them have fairly similar flowers.
John Vanderplank says that his favorite is P. antioquiensis, and that, generally, the Tacsonias are the best-flavored. They're not grown as much as P. edulis, in part because they are high-elevation Andean species that need "eternal spring-like" climates. Bermuda being north of the real tropics can probably grow some of them.
One of them is actually very widespread, but not cultivated much: P. mollissima. It has gone feral in many parts of the subtropics, and is extremely rampant (listed as a weed in many countries worldwide). But it has a delicious fruit, which is one of the ways its spreads: humans commonly collect the feral fruits, eat them, and spit the seeds out somewhere else. It is common along human foot-roads!
Those caterpillars might be Heleconoid butterflies, if you have those (and probably do). They love Passionflowers. Lepidotists often grow Passionflowers as larval food. Passionflowers are generally so rampant, it doesn't hurt them much to have a few caterpillars grazing on them.
