The controller shall have a general supervision and control of the fiscal affairs of the county and of the accounts and official acts of all officers or other persons who shall collect, receive or distribute the public moneys of the county, or who shall be charged with the management or custody thereof. He may at any time require from any of them, in writing, an account of all moneys or property which may have come into their control. He shall, immediately on the discovery of any default or delinquency, report the same to the commissioners and the court of common pleas of the county, and shall take immediate measures to secure the public moneys or property and remove the delinquent party, if in office and not removed by the commissioners.