Any clerk, register or other officer having the custody of any record, maps or book, or of any paper or proceeding of any court of justice, filed or deposited in any public office, who is guilty of stealing, willfully destroying, mutilating, defacing, altering or falsifying or unlawfully removing or secreting such record, map, book, paper or proceeding, or who permits any other person so to do, shall be guilty of a felony punishable by imprisonment in the State Penitentiary not exceeding five (5) years, and in addition thereto, such person shall forfeit office.