Fix timeouts related to metalearnings tests

[eddiebergman]

[eddiebergman]

See these tests for an example where it failed a lot:
https://github.com/automl/auto-sklearn/runs/6816612356?check_suite_focus=true