Skip to content

User belongs to all controls in experiment #11943

Closed
@DonJayamanne

Description

@DonJayamanne

Here's my output from Python output panel:

User belongs to experiment group 'ShowPlayIcon - start'
User belongs to experiment group 'ShowExtensionSurveyPrompt - control'
User belongs to experiment group 'DebugAdapterFactory - experiment'
User belongs to experiment group 'PtvsdWheels37 - experiment'
User belongs to experiment group 'LS - control'
User belongs to experiment group 'UseTerminalToGetActivatedEnvVars - control'
User belongs to experiment group 'WebHostNotebook - control'
User belongs to experiment group 'LocalZMQKernel - experiment'
User belongs to experiment group 'LocalZMQKernel - control'
User belongs to experiment group 'NativeNotebook - experiment'
User belongs to experiment group 'NativeNotebook - control'
User belongs to experiment group 'CollectLSRequestTiming - control'
User belongs to experiment group 'CollectNodeLSRequestTiming - experiment'
User belongs to experiment group 'EnableIPyWidgets - experiment'
User belongs to experiment group 'RunByLine - control'

As you can see I belong to the experiment and control group for two experiments LocalZMQKernel & NativeNotebook.

Here's my settings.json file

	"python.experiments.optInto": [
		"LocalZMQKernel - experiment",
		"NativeNotebook - experiment"
	],

I think we need to first check the opted in exepriments & then process the other list, and track the user experiments based on the experiment salt. This way they cannot belong to both control and experiment.
Also, we need to ensure opt in experiment takes precedence.

Metadata

Metadata

Assignees

Labels

bugIssue identified by VS Code Team member as probable bug

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions