Port Erin Commissioners have applied to have the Cosy Nook cafe building stripped of its protected status.
The building was placed on the buildings register just a few months ago, last April.
That means the site is now officially recognised as having historical significance and is legally protected from demolition.
The move was welcomed by heritage groups on the island and the government said it would preserve the site for future generations.
However, in a recent planning application town commissioners say the building was registered without a full inspection.
They claim the building is in a poor state and has no protection from an "increased risk of flooding".
LegCo to face questions in this morning's sitting
Passport prices to rise
House of Keys to sit for final time before election
Island cyclist to ride in Tour De France
Police appeal over promenade street brawl
Well-known farm in the west up for sale
Pet foodbank needs your help!
How much cash can government raise in 10 days, asks MHK