The Mayor of Penticton says short-term vacation rentals get unfairly characterized as the driving force behind the housing affordability crisis in the city.