The keeper of each prison shall provide, at the expense of the county or state, as the case may be, for each prisoner under his charge, who may be able and desirous to read, a copy of the Bible, or New Testament, to be used by such prisoner during his confinement, and any minister of the Gospel, disposed to aid in reforming the prisoners, and instructing them in their moral and religious duties, shall have access to them at seasonable and proper times.