You can, until the map says otherwise, and in Poole the map says otherwise a lot. There are 270 listed buildings here and sixteen conservation areas. The published ground class for shrink-swell covers the entire area. Thousands of planning applications have gone in over the past two years, so this is plainly not a town where nobody builds anything. It is a town where the address decides the answer long before the architect does.
Of those 270 listed buildings, three are Grade One, 21 are Grade Two star and 246 are Grade Two. Listing applies to the whole building inside and out, not the pretty elevation facing the road, so a Grade Two terrace means listed building consent for the window frames, the internal layout and anything structural, on top of ordinary planning permission. Owners who assume the protection stops at the front door tend to discover otherwise partway through a kitchen.
The sixteen conservation areas are the constraint that catches far more people, because a conservation area covers ordinary unlisted houses too. Poole Park, Sandbanks, Canford Cliffs Village, Ashley Cross, The Avenue, Brunstead Road, Westbourne and the Town Centre Heritage area are among them, which is to say the constraint sits squarely on top of some of the most expensive streets in the town. Inside a designated area, permitted development rights are typically restricted and works that would be waved through elsewhere, including demolition and tree work, need consent first. The boundary is a line on a plan rather than a feeling about a street, and it does not follow the estate agent's description of the neighbourhood.
Ten scheduled monuments sit within the area as well. That is the strictest protection tier in the system and it matters mainly to land near one rather than to a suburban semi, but where it applies, consent comes from the national heritage body rather than the council.
None of this stops the town building. Planning applications across Poole ran to 7,528 between April 2024 and July 2026, with 3,139 of them in the last twelve months. People here extend, convert, reroof and rebuild constantly. The volume is the encouraging part of this answer: the system is busy, not closed.
The ground is worth a conversation with a structural engineer before it becomes a conversation with a builder. The British Geological Survey puts the whole of the area at shrink-swell class 3, which reflects clay soils that swell and contract with moisture. In practice that shapes foundation depth and, for anything near mature trees, the design of the footings. It is a design consideration rather than a reason to walk away, and it is why a shallow extension quote that sounds cheap usually is.
Two listed buildings in the area appear on Historic England's Heritage at Risk register. That flags a building in poor condition that may qualify for grant support and will certainly attract close attention to any works proposed. It is a fact about those specific buildings rather than a warning to anyone buying an ordinary house nearby.
The practical position is straightforward enough. Outside the designated areas, ordinary permitted development rules apply and a rear extension or loft conversion is a normal project. Inside them, or on any listed property, assume nothing is permitted until the council confirms it, and get that answer before exchange rather than after. The pre-application conversation costs a fraction of the design fees it can save.
Of everything Poole does, the freedom to alter your own home is what it does worst. Between the listings, the conservation areas and the monuments, a large share of the town's most expensive streets come with a consent process attached, and that is the single biggest thing to check before you buy here with plans in mind.