Skip to content

[Question] Rebuilding Auto Sklearn pipelines with the parameter dictionary returned by .cv_results_ #1663

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Muhammad-Hassan1000 opened this issue Apr 19, 2023 · 0 comments

Comments

@Muhammad-Hassan1000
Copy link

Muhammad-Hassan1000 commented Apr 19, 2023

Is there a way to rebuild an auto sklearn pipeline after I have imported the params dictionary from the .cv_results into a csv file?

My objective is to get the feature importance of every pipeline auto-sklearn tries. I know some models do not support feature importance so I have used permutation importance for them instead. I did get feature importance for the best pipeline ranked first in the leaderboard but I want to get the importance for every combination of hyperparameter it tries.

What I currently have is this csv file.

image

So, I'm looking for a method to rebuild the pipeline using these dictionaries.

I'd like to mention one more thing. Is there a direct way while training the AutoSklearnClassifier to access all the pipelines it tried with every hyperparameter combination to achieve my goal? I have looked into the documentation but I have failed to find anything accurate that would help me in this task. The documentation here lists a function .show_models() but the models it shows does not match the models shown in the .leaderboard().

Am I missing some working of auto-sklearn?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant