Whenever the bonds or interest coupons issued under Sections 391 et seq. of this title, shall become due, they shall be, on presentation of coupon bonds, promptly paid by the proper disbursing officer, out of the money in his hands collected for that purpose; and he shall endorse upon the face of any bond or coupon paid by him, in red ink, the word “paid”, and the date of payment, and sign his name thereto, and at each settlement he shall turn over the bonds and coupons so paid and canceled, which shall be carefully preserved or destroyed. Provided however, the presentation of a registered bond shall not be required for payment of interest thereon when payment of interest is otherwise provided by the terms of the bond.