A 13th Century manor house that was so overgrown its walls could not be seen was saved "despite all odds" by a community.