For some alternatives, try out the Boulcott Lodge and the Wallaceville Motor Lodge. They are 30 kilometres and 30 kilometres respectively from the main center. Further alternatives are the B-K's Esplanade Motor Lodge, 30 kilometres away, and the Totara Lodge, 30 kilometres.
If you want to explore some nearby localities, consider Wallaceville and Wellington. Travel 30 kilometres to the north from Palliser Bay and you'll find Wallaceville. That said, Wellington is 35 kilometres to the west. Hotels and apartments in Wallaceville are the Hawks Inn Motel and Trentham Motel. The Ohtel and Boulcott Suites are some of the choices in Wellington.
Before you say "adios" to Wellington, ensure you catch some sport. Find Newtown Park to the west of Palliser Bay. The InterContinental Wellington and the QT Museum Wellington Apartments are both good options if you want to sleep nearby.