Skip to content

Commit f5ab5df

Browse files
committed
Fixes for pypi release, use deepspeed-mii name
1 parent da98df0 commit f5ab5df

File tree

3 files changed

+24
-16
lines changed

3 files changed

+24
-16
lines changed

README.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -92,6 +92,7 @@ As an example here is a deployment of the [bigscience/bloom-560m](https://huggin
9292

9393
**Deployment**
9494
```python
95+
import mii
9596
mii_configs = {"tensor_parallel": 1, "dtype": "fp16"}
9697
mii.deploy(task="text-generation",
9798
model="bigscience/bloom-560m",
@@ -103,6 +104,7 @@ This will deploy the model onto a single GPU and start the GRPC server that can
103104

104105
**Query**
105106
```python
107+
import mii
106108
generator = mii.mii_query_handle("bloom560m_deployment")
107109
result = generator.query({"query": ["DeepSpeed is", "Seattle is"]}, do_sample=True, max_new_tokens=30)
108110
print(result)
@@ -112,6 +114,7 @@ The only required key is `"query"`, all other items outside the dictionary will
112114

113115
**Shutdown Deployment**
114116
```python
117+
import mii
115118
mii.terminate("bloom560m_deployment")
116119
```
117120

@@ -139,6 +142,7 @@ To use MII on AML resources, you must have the Azure-CLI installed with an activ
139142

140143
**Deployment**
141144
```python
145+
import mii
142146
mii_configs = {"tensor_parallel": 1, "dtype": "fp16"}
143147
mii.deploy(task="text-generation",
144148
model="bigscience/bloom-560m",

setup.py

Lines changed: 19 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -63,18 +63,22 @@ def command_exists(cmd):
6363
# None of the above, probably installing from source
6464
version_str += f'+{git_hash}'
6565

66-
setup(
67-
name='mii',
68-
version=version_str,
69-
description='deepspeed mii',
70-
install_requires=install_requires,
71-
#scripts=[],
72-
extras_require=extras_require,
73-
packages=find_packages(),
74-
classifiers=[
75-
'Programming Language :: Python :: 3.6',
76-
'Programming Language :: Python :: 3.7',
77-
'Programming Language :: Python :: 3.8',
78-
'Programming Language :: Python :: 3.9'
79-
'Programming Language :: Python :: 3.10'
80-
])
66+
setup(name="deepspeed-mii",
67+
version=version_str,
68+
description='deepspeed mii',
69+
author='DeepSpeed Team',
70+
author_email='[email protected]',
71+
url='http://deepspeed.ai',
72+
project_urls={
73+
'Documentation': 'https://github.com/microsoft/DeepSpeed-MII',
74+
'Source': 'https://github.com/microsoft/DeepSpeed-MII',
75+
},
76+
install_requires=install_requires,
77+
extras_require=extras_require,
78+
packages=find_packages(),
79+
classifiers=[
80+
'Programming Language :: Python :: 3.7',
81+
'Programming Language :: Python :: 3.8',
82+
'Programming Language :: Python :: 3.9',
83+
'Programming Language :: Python :: 3.10'
84+
])

version.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
0.1.0
1+
0.0.2

0 commit comments

Comments
 (0)