Add verification of output version to source-build testing

[crummel]

We know the version numbers we should have and can check them as an early warning to make sure we're including the correct:

• ASP.NET version
• Runtime version
• SDK version

[omajid]

I can take a shot at this.

Would you want this check to just print out the numbers at the end of a build? Or also compare it with, say, https://dotnetcli.blob.core.windows.net/dotnet/release-metadata/3.1/releases.json ?

[dseefeld]

Printing it during smoke-test would be a good first start. Also, checking against release.json could be useful to see if it is correct or if it is an old release listed there. Since we'll be comparing agains n-1 builds for other test, we could check to make sure it's past that version, too.

[omajid]

Printing it during smoke-test would be a good first start.

Running the smoke tests today, I see:

$ ./smoke-test.sh --targetRid fedora.34-x64                                                                     
RID to test: fedora.34-x64                                                                                                                                    
SDK under test is:                                                                                                                                            
.NET SDK (reflecting any global.json):                                                                                                                        
 Version:   5.0.202                                                                                                                                           
 Commit:    db7cc87d51                                                                                                                                        
                                                                                                                                                              
Runtime Environment:                                                                                                                                          
 OS Name:     fedora                                                                                                                                          
 OS Version:  34                                                                                                                                              
 OS Platform: Linux                                                                                                                                           
 RID:         fedora.34-x64                                                                                                                                   
 Base Path:   /home/omajid/devel/dotnet/source-build/testing-smoke/builtCli/sdk/5.0.202/                                                                      
                                                                                                                                                              
Host (useful for support):                                                                                                                                    
  Version: 5.0.5                                                                                                                                              
  Commit:  561d6ea60d                                                                                                                                         
                                                                                                                                                              
.NET SDKs installed:                                                                                                                                          
  5.0.202 [/home/omajid/devel/dotnet/source-build/testing-smoke/builtCli/sdk]                                                                                 
                                                                                                                                                              
.NET runtimes installed:                                                                                                                                      
  Microsoft.AspNetCore.App 5.0.5 [/home/omajid/devel/dotnet/source-build/testing-smoke/builtCli/shared/Microsoft.AspNetCore.App]                              
  Microsoft.NETCore.App 5.0.5 [/home/omajid/devel/dotnet/source-build/testing-smoke/builtCli/shared/Microsoft.NETCore.App]                                    
                                                                                                                                                              
To install additional .NET runtimes or SDKs:                                                                                                                  
  https://aka.ms/dotnet-download                                                                                                                              
/home/omajid/devel/dotnet/source-build/testing-smoke/NuGet.Config Contents:                                                                                   
<?xml version="1.0" encoding="utf-8"?>                                                                                                                        
<configuration>                                                                                                                                               
  <packageSources>          
,,,

So I think the first part is already done?

The things left are mostly comparing against older builds:

Also, checking against release.json could be useful to see if it is correct or if it is an old release listed there.

This only makes sense before a public release, right? If I build the latest source-build 5.0 contents (commit 561d6ea) today, should things fail?

Since we'll be comparing against n-1 builds for other test, we could check to make sure it's past that version, too.

What do you expect this workflow to look like? .dotnet/dotnet (or the SDK used with --with-sdk) should be one version lower? Doing a quick sanity check, this doesn't appear to be a safe assumption. Compare the built SDK (see output of smoke tests above) with:

 $ .dotnet/dotnet --info
.NET SDK (reflecting any global.json):
 Version:   5.0.104
 Commit:    ca6b6acadb

Runtime Environment:
 OS Name:     fedora
 OS Version:  34
 OS Platform: Linux
 RID:         fedora.34-x64
 Base Path:   /home/omajid/devel/dotnet/source-build/.dotnet/sdk/5.0.104/

Host (useful for support):
  Version: 5.0.5
  Commit:  561d6ea60d

.NET SDKs installed:
  5.0.104 [/home/omajid/devel/dotnet/source-build/.dotnet/sdk]

.NET runtimes installed:
  Microsoft.AspNetCore.App 5.0.4 [/home/omajid/devel/dotnet/source-build/.dotnet/shared/Microsoft.AspNetCore.App]
  Microsoft.NETCore.App 3.1.1 [/home/omajid/devel/dotnet/source-build/.dotnet/shared/Microsoft.NETCore.App]
  Microsoft.NETCore.App 5.0.4 [/home/omajid/devel/dotnet/source-build/.dotnet/shared/Microsoft.NETCore.App]
  Microsoft.NETCore.App 5.0.5 [/home/omajid/devel/dotnet/source-build/.dotnet/shared/Microsoft.NETCore.App]

To install additional .NET runtimes or SDKs:
  https://aka.ms/dotnet-download

The host version is the same, SDK is a lower feature band, and runtime is the same (and there's an older runtime too).