In a medium bowl, whisk together sugar, cornstarch, flour, orange zest, and salt. Whisk in egg yolks until well combined. (Mixture will be very thick.) Gradually add half of warm milk to sugar mixture, whisking constantly. Add sugar mixture to remaining warm milk in pan. Bring to a boil over medium heat, whisking constantly. Cook, whisking constantly, until thickened and mixture no longer tastes starchy, 3 to 4 minutes. Remove from heat.