He shall, ex officio, on the application of the sheriff of his county or city, order execution to be issued for the recovery of all fines, penalties and forfeitures which shall be imposed by any court of record of this State, together with the costs accruing thereon.