In the first instance the county or counties operating an infirmary shall defray the actual per capita cost of treatment, care and maintenance. To the extent that a patient is a public charge, such county or counties shall be reimbursed for such expenditures, as determined from annual infirmary reports filed with the department under s. 46.18 (8), (9) and (10), by the county of residence.