Are hotel reservations a must in February or can we wing it?

My fiancé and I are planning a trip to Barbados in February for 5 or 6 days. Is it recommended to book a hotel before we get there? Sometimes, some of our best trips were finding places to stay as we go. We will also being flying out to Dominica for 6 day.

We like to budget travel, prefer to stay places around $200 or less. As long as it is clean, we are good. We are pretty laid back. Just want to take in the scenery and relax.

Source