Skip to content

Added blog post "High performance Llama 2..." #1462

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Oct 4, 2023
Merged

Added blog post "High performance Llama 2..." #1462

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
9390a39
Added blog post "High performance Llama 2..."
cjyabraham Sep 30, 2023
6ac9900
fix dollar sign
cjyabraham Sep 30, 2023
33ce8aa
fix quote
cjyabraham Sep 30, 2023
b9b70d1
Merge branch 'site' into 9-29-2
cjyabraham Oct 3, 2023
11b63a3
Update publish date
cjyabraham Oct 3, 2023
7e652cf
Updates with requested changes
cjyabraham Oct 3, 2023
4280e0f
fix code block formatting
cjyabraham Oct 4, 2023
68a023d
fix code block
cjyabraham Oct 4, 2023
8011fc6
Update publish date
cjyabraham Oct 4, 2023
f871826
Adjust margin on code blocks
cjyabraham Oct 4, 2023
f15e82c
indent para
cjyabraham Oct 4, 2023
6fdc6f8
indent para
cjyabraham Oct 4, 2023
38e770d
Update publish date
cjyabraham Oct 4, 2023
a187910
Merge branch 'site' into 9-29-2
cjyabraham Oct 4, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
314 changes: 314 additions & 0 deletions _posts/2023-10-04-high-performance-llama.md
View file
Open in desktop

Large diffs are not rendered by default.

Binary file added assets/images/high-performance-llama/cost_vs_output_token_length_7b_13b.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/images/high-performance-llama/cost_vs_output_token_length_xl_48xl.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/images/high-performance-llama/latency_vs_input_token_length.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/images/high-performance-llama/latency_vs_output_token_length.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/images/high-performance-llama/latency_vs_tp.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/images/high-performance-llama/software_stack_inf2.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/images/high-performance-llama/throughput_vs_output_token_length.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.