The pandemic hit abalone farmers fast and hard. Prices have dropped and backers appear to be losing their appetite for investing in the delicacy