Private Solutions to Public Problems