Senior councillors have backed new budget proposals they say will protect key services and clean up the county borough – while also including a council tax rise.