Skip to content

lite & rce #603

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Mar 16, 2021
Merged

lite & rce #603

merged 9 commits into from
Mar 16, 2021

Conversation

DvirDukhan
Copy link
Collaborator

This PR allows a new variant for Redis AI - Lite
This variant will not broadcast models/scripts in the enterprise cluster and will allow:
resharding
Rof
Replica of

This PR also introduce the RCE variant which is based on the lite, with only ONNX backend

@codecov
Copy link

codecov bot commented Feb 10, 2021

Codecov Report

Merging #603 (43b0fb2) into master (353c7c2) will decrease coverage by 0.03%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #603      +/-   ##
==========================================
- Coverage   78.28%   78.25%   -0.04%     
==========================================
  Files          41       41              
  Lines        6535     6535              
==========================================
- Hits         5116     5114       -2     
- Misses       1419     1421       +2     
Impacted Files Coverage Δ
src/backends/tensorflow.c 70.50% <0.00%> (-0.57%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 353c7c2...43b0fb2. Read the comment docs.

@DvirDukhan DvirDukhan linked an issue Feb 10, 2021 that may be closed by this pull request
opt/pack.sh Outdated
if [[ -z $VARIANT ]]; then
local rampfile=ramp.yml
else
local rampfile=ramp$VARIANT.yml
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

local rampfile=ramp-${VARIANT}.yml

opt/Makefile Outdated
@@ -219,9 +219,13 @@ pack: $(INSTALLED_TARGET)
$(SHOW)find $(INSTALL_DIR) -name "*.so" -exec chmod +x {} \;
$(SHOW)mkdir -p $(ROOT)/bin/artifacts
ifneq ($(PACK_DEPS),0)
$(SHOW)DEVICE=$(DEVICE) BINDIR=$(ROOT)/bin/artifacts INSTALL_DIR=$(INSTALL_DIR) BRANCH=$(BRANCH) RAMP=1 DEPS=1 ./pack.sh
$(SHOW)DEVICE=$(DEVICE) BINDIR=$(ROOT)/bin/artifacts INSTALL_DIR=$(INSTALL_DIR) BRANCH=$(BRANCH) RAMP=0 DEPS=1 ./pack.sh
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why RAMP=0 here?
Also, we can avoid the large ifneq ($(PACK_DEPS),0) and just arrange DEPS=$(PACK_DEPS) with the following:

ifneq ($(PACK_DEPS),0)
override PACK_DEPS:=1
endif

opt/pack.sh Outdated
if [[ -z $VARIANT ]]; then
local rampfile=ramp.yml
else
local rampfile=ramp${VARIANT}.yml
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

local rampfile=ramp-${VARIANT}.yml
(added hyphen)

opt/Makefile Outdated
Comment on lines 218 to 228
pack: $(INSTALLED_TARGET)
$(SHOW)find $(INSTALL_DIR) -name "*.so" -exec chmod +x {} \;
$(SHOW)mkdir -p $(ROOT)/bin/artifacts

ifneq ($(PACK_DEPS),0)
$(SHOW)DEVICE=$(DEVICE) BINDIR=$(ROOT)/bin/artifacts INSTALL_DIR=$(INSTALL_DIR) BRANCH=$(BRANCH) RAMP=1 DEPS=1 ./pack.sh
else
$(SHOW)DEVICE=$(DEVICE) BINDIR=$(ROOT)/bin/artifacts INSTALL_DIR=$(INSTALL_DIR) BRANCH=$(BRANCH) RAMP=1 DEPS=0 ./pack.sh
override PACK_DEPS:=1
endif
DEPS=$(PACK_DEPS)
$(SHOW)DEVICE=$(DEVICE) BINDIR=$(ROOT)/bin/artifacts INSTALL_DIR=$(INSTALL_DIR) BRANCH=$(BRANCH) RAMP=1 ./pack.sh
$(SHOW)DEVICE=$(DEVICE) BINDIR=$(ROOT)/bin/artifacts INSTALL_DIR=$(INSTALL_DIR) BRANCH=$(BRANCH) RAMP=1 VARIANT=lite ./pack.sh
$(SHOW)DEVICE=$(DEVICE) BINDIR=$(ROOT)/bin/artifacts INSTALL_DIR=$(INSTALL_DIR) BRANCH=$(BRANCH) RAMP=1 VARIANT=rce ./pack.sh
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ifneq ($(PACK_DEPS),0)
override PACK_DEPS:=1
endif

pack: $(INSTALLED_TARGET)
	$(SHOW)find $(INSTALL_DIR) -name "*.so" -exec chmod +x {} \;
	$(SHOW)mkdir -p $(ROOT)/bin/artifacts
	$(SHOW)DEVICE=$(DEVICE) BINDIR=$(ROOT)/bin/artifacts INSTALL_DIR=$(INSTALL_DIR) BRANCH=$(BRANCH) DEPS=$(PACK_DEPS) ./pack.sh
	$(SHOW)DEVICE=$(DEVICE) BINDIR=$(ROOT)/bin/artifacts INSTALL_DIR=$(INSTALL_DIR) BRANCH=$(BRANCH) DEPS=$(PACK_DEPS) VARIANT=lite ./pack.sh
	$(SHOW)DEVICE=$(DEVICE) BINDIR=$(ROOT)/bin/artifacts INSTALL_DIR=$(INSTALL_DIR) BRANCH=$(BRANCH) DEPS=$(PACK_DEPS) VARIANT=rce  ./pack.sh

@DvirDukhan DvirDukhan merged commit f1a0530 into master Mar 16, 2021
@DvirDukhan DvirDukhan deleted the lite branch March 16, 2021 07:59
alonre24 pushed a commit that referenced this pull request Mar 16, 2021
@chayim chayim mentioned this pull request Jul 22, 2021
@chayim chayim mentioned this pull request Nov 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add Lite variant ramp file
3 participants