All regulations shall be signed by the superintendent in duplicate and the duplicate originals shall be kept in two sets of loose-leaf books, of which one shall be kept in the offices of the Department of Financial Services in Albany and in the City of New York. These copies are not to be taken from the Department of Financial Services except under order of court. It shall be the duty of the department counsel, or of a deputy superintendent designated for that purpose, to see that all regulations are consecutively numbered, properly recorded and indexed by reference to subject matter and to the section or sections of the Insurance Law. The regulations and index shall be open to public inspection.