Newbury is the name of several places:
Canada
England
United States of America
also:
The place name was bestowed on Newbury in England late in the 11th century. When British colonists in North America carried the place name with them, they (unsurprisingly) abstained from following the common convention of prefixing New to the name of the newly founded settlement.
In addition, there are places named Newberry.