The memorial on Rocky Hill stands as a tribute to the men and women from Goulburn and district who contributed to Australia's war effort in World War I between 1914 and 1918. The stone and concrete tower opened in 1925 and was funded by local subscription after W.J. Bartlett donated the land. Goulburn citizens and school children carried many of the stones used in the tower to the site.

Rocky Hill is also significant for the Aboriginal bora ring and ceremonial site that is now occupied by the car park.