[devops] Improve GitHub comment when the build fails. #20584

rolfbjarne · 2024-05-08T13:37:41Z

Currently we get a message saying all the tests failed catastrophically.

Example: #20434 (comment)

This is both confusing and scary, so change the comment to say that the build
failed instead.

Currently we get a message saying all the tests failed catastrophically. Example: xamarin#20434 (comment) This is both confusing and scary, so change the comment to say that the build failed instead.

vs-mobiletools-engineering-service2 · 2024-05-08T16:45:12Z

🔥 [CI Build] Test results 🔥

Test results

❌ Tests failed on VSTS: test results

1 tests crashed, 49 tests failed, 117 tests passed.

Failures

❌ framework tests

2 tests failed, 6 tests passed.

framework-test/tvOS - simulator/Debug: BuildFailure (Harness exception for 'framework-test': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/framework-test/iOS/generated-projects/tvos/framework-test-ios-tvos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
framework-test/watchOS 32-bits - simulator/Debug: BuildFailure (Harness exception for 'framework-test': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/framework-test/iOS/generated-projects/watchos/framework-test-ios-watchos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)

Html Report (VSDrops) Download

❌ fsharp tests

2 tests failed, 5 tests passed.

fsharp/tvOS - simulator/Debug: BuildFailure (Harness exception for 'fsharp': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/fsharp/generated-projects/tvos/fsharp-tvos.fsproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
fsharp/watchOS 32-bits - simulator/Debug: BuildFailure (Harness exception for 'fsharp': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/fsharp/generated-projects/watchos/fsharp-watchos.fsproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)

Html Report (VSDrops) Download

❌ interdependent-binding-projects tests

5 tests failed, 2 tests passed.

interdependent-binding-projects/iOS Unified 64-bits - simulator/Debug [dotnet]: Crashed
interdependent-binding-projects/iOS Unified 64-bits - simulator/Debug: Crashed
interdependent-binding-projects/tvOS - simulator/Debug [dotnet]: Crashed
interdependent-binding-projects/tvOS - simulator/Debug: BuildFailure (Harness exception for 'interdependent-binding-projects': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/interdependent-binding-projects/generated-projects/tvos/interdependent-binding-projects-tvos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
interdependent-binding-projects/watchOS 32-bits - simulator/Debug: BuildFailure (Harness exception for 'interdependent-binding-projects': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/interdependent-binding-projects/generated-projects/watchos/interdependent-binding-projects-watchos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)

Html Report (VSDrops) Download

❌ introspection tests

4 tests failed, 4 tests passed.

introspection/iOS Unified 64-bits - simulator/Debug: BuildFailure
introspection/tvOS - simulator/Debug [dotnet]: Crashed
introspection/tvOS - simulator/Debug: BuildFailure (Harness exception for 'introspection': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/2/s/xamarin-macios/tests/introspection/iOS/generated-projects/tvos/introspection-ios-tvos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/2/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/2/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
introspection/watchOS 32-bits - simulator/Debug: BuildFailure (Harness exception for 'introspection': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/2/s/xamarin-macios/tests/introspection/iOS/generated-projects/watchos/introspection-ios-watchos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/2/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/2/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)

Html Report (VSDrops) Download

❌ linker tests

12 tests failed, 53 tests passed.

dont link/tvOS - simulator/Debug: BuildFailure (Harness exception for 'dont link': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/linker/ios/dont link/generated-projects/tvos/dont link-tvos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
dont link/tvOS - simulator/Release: BuildFailure (Harness exception for 'dont link': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/linker/ios/dont link/generated-projects/tvos/dont link-tvos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
dont link/watchOS 32-bits - simulator/Debug: BuildFailure (Harness exception for 'dont link': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/linker/ios/dont link/generated-projects/watchos/dont link-watchos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
dont link/watchOS 32-bits - simulator/Release: BuildFailure (Harness exception for 'dont link': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/linker/ios/dont link/generated-projects/watchos/dont link-watchos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
link all/tvOS - simulator/Debug: BuildFailure (Harness exception for 'link all': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/linker/ios/link all/generated-projects/tvos/link all-tvos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
link all/tvOS - simulator/Release: BuildFailure (Harness exception for 'link all': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/linker/ios/link all/generated-projects/tvos/link all-tvos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
link all/watchOS 32-bits - simulator/Debug: BuildFailure (Harness exception for 'link all': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/linker/ios/link all/generated-projects/watchos/link all-watchos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
link all/watchOS 32-bits - simulator/Release: BuildFailure (Harness exception for 'link all': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/linker/ios/link all/generated-projects/watchos/link all-watchos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
link sdk/tvOS - simulator/Debug: BuildFailure (Harness exception for 'link sdk': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/linker/ios/link sdk/generated-projects/tvos/link sdk-tvos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable1 unixCreateMode) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access) at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensions.LoadWithoutNetworkAccess(XmlDocument doc, String filename) at Xharness.TestProject.CreateCopyAsync(ILog log, IProcessManager processManager, ITestTask test, String rootDirectory, Dictionary2 allProjectReferences) in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/TestProject.cs:line 98
at Xharness.Jenkins.TestTasks.TestTasks.RunInternalAsync() in /Users/builder/azdo/_work/1/s/xamarin-macios/tests/xharness/Jenkins/TestTasks/TestTask.cs:line 260)
link sdk/tvOS - simulator/Release: BuildFailure (Harness exception for 'link sdk': System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/builder/azdo/_work/1/s/xamarin-macios/tests/linker/ios/link sdk/generated-projects/tvos/link sdk-tvos.csproj'.
at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String path, OpenFlags flags, Int32 mode, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func4 createOpenException)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access)
at Microsoft.DotNet.XHarness.iOS.Shared.Utilities.PListExtensi\n\nThe message from CI is too large for the GitHub comments. You can find the full results here.

This reverts commit 1f37fcd.

vs-mobiletools-engineering-service2 · 2024-05-09T13:58:10Z

📚 [PR Build] Artifacts 📚

Packages generated

View packages

Pipeline on Agent
Hash: [PR build]

vs-mobiletools-engineering-service2 · 2024-05-09T14:00:01Z

💻 [PR Build] Tests on macOS X64 - Mac Sonoma (14) passed 💻

✅ All tests on macOS X64 - Mac Sonoma (14) passed.

Pipeline on Agent
Hash: [PR build]

vs-mobiletools-engineering-service2 · 2024-05-09T14:03:07Z

💻 [PR Build] Tests on macOS M1 - Mac Monterey (12) passed 💻

✅ All tests on macOS M1 - Mac Monterey (12) passed.

Pipeline on Agent
Hash: [PR build]

vs-mobiletools-engineering-service2 · 2024-05-09T14:03:16Z

💻 [PR Build] Tests on macOS M1 - Mac Ventura (13) passed 💻

✅ All tests on macOS M1 - Mac Ventura (13) passed.

Pipeline on Agent
Hash: [PR build]

vs-mobiletools-engineering-service2 · 2024-05-09T14:05:30Z

💻 [PR Build] Tests on macOS M1 - Mac Big Sur (11) passed 💻

✅ All tests on macOS M1 - Mac Big Sur (11) passed.

Pipeline on Agent
Hash: [PR build]

vs-mobiletools-engineering-service2 · 2024-05-09T14:26:06Z

❌ [CI Build] Windows Integration Tests failed ❌

❌ Failed ❌

Pipeline on Agent
Hash: 83f744d0f1d53fc4ce674c17b367b524574584b8 [PR build]

vs-mobiletools-engineering-service2 · 2024-05-09T14:40:39Z

✅ API diff for current PR / commit

Legacy Xamarin (No breaking changes)

~~iOS~~ (no change detected)
~~tvOS~~ (no change detected)
~~watchOS~~ (no change detected)
~~macOS~~ (no change detected)

NET (empty diffs)

~~iOS~~: (empty diff detected)
~~tvOS~~: (empty diff detected)
~~MacCatalyst~~: (empty diff detected)
~~macOS~~: (empty diff detected)

✅ API diff vs stable

Legacy Xamarin (No breaking changes)

iOS: vsdrops gist (No breaking changes)
tvOS: vsdrops gist (No breaking changes)
watchOS: vsdrops gist (No breaking changes)
macOS: vsdrops gist (No breaking changes)

.NET (No breaking changes)

iOS: vsdrops gist (No breaking changes)
tvOS: vsdrops gist (No breaking changes)
MacCatalyst: vsdrops gist (No breaking changes)
macOS: vsdrops gist (No breaking changes)
Microsoft.iOS vs Microsoft.MacCatalyst: vsdrops gist

Legacy Xamarin (stable) vs .NET

iOS: vsdrops gist
tvOS: vsdrops gist
macOS: vsdrops gist

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: 83f744d0f1d53fc4ce674c17b367b524574584b8 [PR build]

vs-mobiletools-engineering-service2 · 2024-05-09T15:49:12Z

🚀 [CI Build] Test results 🚀

Test results

✅ All tests passed on VSTS: test results.

🎉 All 170 tests passed 🎉

Tests counts

✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 8 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 7 tests passed. Html Report (VSDrops) Download
✅ generator: All 2 tests passed. Html Report (VSDrops) Download
✅ install-source: All 1 tests passed. Html Report (VSDrops) Download
✅ interdependent-binding-projects: All 7 tests passed. Html Report (VSDrops) Download
✅ introspection: All 8 tests passed. Html Report (VSDrops) Download
✅ linker: All 65 tests passed. Html Report (VSDrops) Download
✅ mac-binding-project: All 1 tests passed. Html Report (VSDrops) Download
✅ mmp: All 2 tests passed. Html Report (VSDrops) Download
✅ mononative: All 6 tests passed. Html Report (VSDrops) Download
✅ monotouch (iOS): All 11 tests passed. Html Report (VSDrops) Download
✅ monotouch (MacCatalyst): All 7 tests passed. Html Report (VSDrops) Download
✅ monotouch (macOS): All 8 tests passed. Html Report (VSDrops) Download
✅ monotouch (tvOS): All 11 tests passed. Html Report (VSDrops) Download
✅ monotouch (watchOS): All 4 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ mtouch: All 1 tests passed. Html Report (VSDrops) Download
✅ xammac: All 3 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 8 tests passed. Html Report (VSDrops) Download
✅ xtro: All 2 tests passed. Html Report (VSDrops) Download

Pipeline on Agent
Hash: [PR build]

[devops] Improve GitHub comment when the build fails.

d9b2b22

Currently we get a message saying all the tests failed catastrophically. Example: xamarin#20434 (comment) This is both confusing and scary, so change the comment to say that the build failed instead.

This comment has been minimized.

Sign in to view

mandel-macaque approved these changes May 8, 2024

View reviewed changes

This comment has been minimized.

Sign in to view

Merge branch 'main' into devops-improve-build-failure-message

6fab700

This comment has been minimized.

Sign in to view

haritha-mohan approved these changes May 9, 2024

View reviewed changes

This comment has been minimized.

Sign in to view

Break the build to verify desired behavior.

1f37fcd

This comment has been minimized.

Sign in to view

Revert "Break the build to verify desired behavior."

83f744d

This reverts commit 1f37fcd.

dalexsoto approved these changes May 9, 2024

View reviewed changes

mandel-macaque merged commit 35bcda3 into xamarin:main May 13, 2024
62 of 64 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[devops] Improve GitHub comment when the build fails. #20584

[devops] Improve GitHub comment when the build fails. #20584

rolfbjarne commented May 8, 2024

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

vs-mobiletools-engineering-service2 commented May 8, 2024

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

vs-mobiletools-engineering-service2 commented May 9, 2024

vs-mobiletools-engineering-service2 commented May 9, 2024

vs-mobiletools-engineering-service2 commented May 9, 2024

vs-mobiletools-engineering-service2 commented May 9, 2024

vs-mobiletools-engineering-service2 commented May 9, 2024

vs-mobiletools-engineering-service2 commented May 9, 2024

vs-mobiletools-engineering-service2 commented May 9, 2024

vs-mobiletools-engineering-service2 commented May 9, 2024

[devops] Improve GitHub comment when the build fails. #20584

[devops] Improve GitHub comment when the build fails. #20584

Conversation

rolfbjarne commented May 8, 2024

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

vs-mobiletools-engineering-service2 commented May 8, 2024

🔥 [CI Build] Test results 🔥

Test results

Failures

❌ framework tests

❌ fsharp tests

❌ interdependent-binding-projects tests

❌ introspection tests

❌ linker tests

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

vs-mobiletools-engineering-service2 commented May 9, 2024

📚 [PR Build] Artifacts 📚

Packages generated

vs-mobiletools-engineering-service2 commented May 9, 2024

💻 [PR Build] Tests on macOS X64 - Mac Sonoma (14) passed 💻

vs-mobiletools-engineering-service2 commented May 9, 2024

💻 [PR Build] Tests on macOS M1 - Mac Monterey (12) passed 💻

vs-mobiletools-engineering-service2 commented May 9, 2024

💻 [PR Build] Tests on macOS M1 - Mac Ventura (13) passed 💻

vs-mobiletools-engineering-service2 commented May 9, 2024

💻 [PR Build] Tests on macOS M1 - Mac Big Sur (11) passed 💻

vs-mobiletools-engineering-service2 commented May 9, 2024

❌ [CI Build] Windows Integration Tests failed ❌

vs-mobiletools-engineering-service2 commented May 9, 2024

✅ API diff for current PR / commit

✅ API diff vs stable

ℹ️ Generator diff

vs-mobiletools-engineering-service2 commented May 9, 2024

🚀 [CI Build] Test results 🚀

Test results

Tests counts