The holder of any renewable license or permit issued under the provisions of this Code¹ shall be entitled to thirty (30) days after the expiration date thereof in which to renew the same, without penalty; and if he fails to pay the renewal fee within such thirty-day period, he shall, unless otherwise provided in this Code, be required to pay the renewal fee plus a penalty fee in an amount as promulgated by the State Board of Health by rule. Such penalty fee shall not exceed the amount of the renewal fee. In the case of any renewal fee which shall exceed Ten Thousand Dollars ($10,000.00), the penalty fee shall be one and one-half percent (1.5%) per month of the outstanding balance of the renewal fee. The Board may promulgate rules which prohibit the renewal of a license or permit which has expired by more than ninety (90) days.