An environmental campaigner who has been working with the community on the issue of Ty Llwyd quarry has been threatened with legal action to stay away from the site.