[bug] False positive successes on erroring CI (1.21-dev)

[patricklodder]

Bug Report

Current behavior:

On the cirrus CI, we have false positives, example:

• pip isn't found on the bionic CI, making it so that ltc-scrypt isn't installed: https://cirrus-ci.com/task/6727978193780736?logs=ci#L1573
• when running functional tests, the runner errors out because ltc-scrypt isn't installed: https://cirrus-ci.com/task/6727978193780736?logs=ci#L4841-L4864
• the job succeeds https://cirrus-ci.com/task/6727978193780736

Expected behavior

The CI job fails after encountering fatal errors in both dependency installation, and functional tests.

[JulsKawa]

@patricklodder Hello, this should be closed no ?

[patricklodder]

To my knowledge only the dependency scope was fixed, not the functional test false positives.