✨ Updated v1 CLI ✨

[phil-scale]

Summary

✨ New and improved ✨ CLI that uses a config file to store common info, like your API key and gateway endpoint

Usage guide and testing

❯ scale-launch bundles list
? Your Scale API Key? 615cc6e424ecf90020baffdd
? Is your installation of Launch self-hosted? Yes
? Your Gateway Endpoint? REDACTED
Bundles
┏━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━┓
┃ Bundle Id                ┃ Bundle name    ┃ Location                                                                                                         ┃ Packaging type ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━┩
│ bun_ce4n1trog16g03e8re00 │ test-returns-2 │ s3://scale-ml-hosted-model-inference/model_bundles/62bc820451dbea002b1c5421/83370af2-6b57-4aa6-9669-2cddcb88959b │ cloudpickle    │
│ bun_ce4n0pk5tn1g03vq7j70 │ test-returns-1 │ s3://scale-ml-hosted-model-inference/model_bundles/615cc6e424ecf90020baffdd/e922bef6-6bdf-480b-90c7-66ec46c8ad05 │ cloudpickle    │
└──────────────────────────┴────────────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴────────────────┘
❯ scale-launch bundles get test-returns-2
bundle_id: bun_ce4n1trog16g03e8re00
bundle_name: test-returns-2
location: s3://scale-ml-hosted-model-inference/model_bundles/62bc820451dbea002b1c5421/83370af2-6b57-4aa6-9669-2cddcb88959b
packaging_type: cloudpickle
env_params: {'framework_type': 'pytorch', 'pytorch_image_tag': '1.7.1-cuda11.0-cudnn8-runtime', 'tensorflow_version': None, 'ecr_repo': None, 'image_tag': None}
requirements: []
app_config: {}
metadata:
load_predict_fn:
def returns_returns_2(x):
    def returns_2(y):
        return 2

    return returns_2

❯ scale-launch endpoints list
Endpoints
┏━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━┳━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━┓
┃ Endpoint name ┃ Bundle name    ┃ Status ┃ Endpoint type ┃ Min Workers ┃ Max Workers ┃ Available Workers ┃ Unavailable Workers ┃ Metadata ┃
┡━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━╇━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━┩
│ test-endpoint │ test-returns-1 │ READY  │ async         │ 0           │ 1           │ 0                 │ 0                   │ {}       │
└───────────────┴────────────────┴────────┴───────────────┴─────────────┴─────────────┴───────────────────┴─────────────────────┴──────────┘

Shortcut Ticket

[sc-707008]

[shortcut-integration]

This pull request has been linked to Shortcut Story #707008: Improve V1 CLI usability.

[seanshi-scale]

lgtm! random qs about usability (probably in a separate pr but whatever):

• do we want to also show endpoint_id inside the endpoints list table? (for consistency with bundle + it might be easier to go to kubectl get deployment this way)
• I guess we probably want an endpoint get that gives details heh
• should we show bundle id as well in endpoint get? since the bundle used might be a previous version of the bundle (although maybe this would require us to get bundles by id to be useful)

[phil-scale]

lgtm! random qs about usability (probably in a separate pr but whatever):

• do we want to also show endpoint_id inside the endpoints list table? (for consistency with bundle + it might be easier to go to kubectl get deployment this way)
• I guess we probably want an endpoint get that gives details heh
• should we show bundle id as well in endpoint get? since the bundle used might be a previous version of the bundle (although maybe this would require us to get bundles by id to be useful)

Ok I'll do the first two in this PR. I actually realized that adding bundle ID in endpoint get isn't possible because it's not even in the client ModelEndpoint object. Will add that in a follow-up.

[syandroo]

🤩