Notaries public must give bond with sureties, to be approved by the judge of probate of the county for which they are appointed, in the sum of $10,000.00, payable to the State of Alabama and conditioned to faithfully discharge the duties of such office so long as they may continue therein or discharge any of the duties thereof. Such bond must be executed, approved, filed and recorded in the office of the judge of probate before they enter on the duties of such office.