How to install this Site Extension?

Simply go to the new Azure Portal or the scm site of your Azure Web Apps.