Plaid Cymru councillors have hit out after the council approved the draft budget proposals.
The proposals includes a council tax rise of almost 7% and cuts of more than £8 million.
As part of the cuts, the Trehir household waste recycling centre near Llanbradach could be closed, saving £15,000.
However, Plaid Cymru group leader and Llanbradach ward councillor Colin Mann has criticised the plans.
Cllr Mann said: “This is so short-sighted. While health and safety issues may have been identified, the Labour-run authority should be tackling them, not closing a valuable resource.
“It seems absolutely crazy to shut the only civic amenity site in the Caerphilly Basin area, which is the most populated area of the county borough.
“This will mean people living in towns like Machen, Bedwas and Senghenydd having to travel 30 minutes or more to use the the site at Penallta in Hengoed. It will be a round trip of more than eight miles for some residents.”
Cllr Mann added: “The council is quick to talk about sustainability but the closure is likely to lead to higher levels of fly-tipping and increased costs for clearing the mess left by some irresponsible residents not prepared to travel so far to a site.
“This proposal should be rejected and the Trehir site remain open for the benefit of residents.”
Meanwhile, Cllr John Roberts, who represents the Aber Valley ward, accused the council of “picking on” smaller communities
He said: “From the proposals put forward for 2020-21, it seems the Labour administration is unfairly picking on the smaller places or villages and targeting them for cuts.
“They may think it is easier to find little pockets of money to help make up bigger cuts but it’s not fair.”
Cllr Roberts highlighted plans to decommission 26 CCTV cameras, withdraw £3,000 of match funding from the Senghenydd splash park and cuts to cleaning staff.
He also spoke of the proposals to cut school crossing patrols from 55 to 22 and to cut capital improvement projects in town and village centres by £8,000.
Labour group chair, Cllr Gez Kirby, said: “Caerphilly Council has suffered cuts to our budget of over £100 million over the last nine years.
“To set a balanced 2020/21 budget next February, we are likely to be forced to make a further £8 million savings.
“However, these are initial savings proposals. Our council will launch a public consultation on them in the next week, and we’d urge as many residents as possible to have their say.
“Councillors will also shortly have opportunity to review the proposals in special scrutiny committee meetings, and make comments.”
Cllr Kirby added: “We look forward with interest to Plaid Cymru’s alternative savings proposals, to address Cllr Mann’s and Cllr Roberts’ specific concerns.”