Automation improvements

[crummel]

Situation

There are currently many manual steps in and around our build and release process for servicing. These cause problems because they can be easily forgotten, they may not be done consistently between servicing events, and they make servicing take longer.

Objective

Improve servicing ease and turn-around times by automating work that is currently done manually. Prioritize work that is easier to automate and takes the most effort manually.

Execution

Identify opportunities for automating manual servicing work, estimate and prioritize them. All these improvements should be small and independent so improvements can be made gradually whenever we have time. Ideally we will make at least one improvement per servicing cycle that we can then try out in that cycle.

[ghost]

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

[MichaelSimons]

[Triage] It would be beneficial to identify which issues would still exist with ArPow. Additionally we would like to identify phases w/the idea being the top phase would be the items we would like to tackle first. Once the phases are identified, they should be reviewed by the triage team.

[crummel]

Based on value/effort ratio, "shovel-readiness", and usefulness after ArPow I recommend these for the first pass:

• Automatically verify that XML/Intellisense docs are included in SDK output #2127 (already has a PR)
• Fix Maestro++ subscriptions #2124
• smoke-test.sh --targetRid argument isn't read in time #2081
• Use source modification to remove internal feeds from nuget.config, not patches #1594
• Include runtime and sdk version as a build output of source-build #600

And these for later implementation:

• Enable uploading shipping artifacts to Azure Storage #2128
• Automatically verify output versions of SDK and runtimes (including ASP.NET) against expected versions #2125
• Automatically trim down smoke-testNuGet.Config for tarball, instead of having extra copy at support/tarball/smoke-testNuGet.Config #1669
• Add verification of output version to source-build testing #1610
• Improve official build tarball file name #747

And the rest for later re-evaluation.

[MichaelSimons]

[Triage] The decision is that we will commit to fixing one issue per servicing cycle. @crummel, please add to project board and assign milestones.

[MichaelSimons]

[Triage] This is superseded by #3065