Bunker Hill Street Burying Ground. Between Polk and Elm Streets. Bunker Hill Monument in background. This cemetery was opened in 1803. The fiercely fought defence of the "Rail Fence" on June 17, 1775, occurred here and on a line to Monument Square, as indicated by a stone tablet.