Skip to content
This repository was archived by the owner on Sep 30, 2024. It is now read-only.

write script to combine multiple LSIF dumps of the same repo locally before upload #17960

Closed
garobrik opened this issue Feb 3, 2021 · 1 comment · Fixed by sourcegraph/lsif-test#24
Assignees
Labels
team/graph Graph Team (previously Code Intel/Language Tools/Language Platform)

Comments

@garobrik
Copy link
Contributor

garobrik commented Feb 3, 2021

Users with distributed build systems want to run indexers on subsets of their repos on multiple machines, and then combine the resulting LSIF dumps. This could be something we do on the backend, but this issue is for a stopgap (or maybe ultimately simpler solution): write a script to combine them locally.

Some considerations:

  • We will need to unique-ify IDs between dumps
  • Dumps might have different project roots
  • We should be able to lean on backend canonicalization somewhat but not sure how much
@garobrik garobrik added the team/graph Graph Team (previously Code Intel/Language Tools/Language Platform) label Feb 3, 2021
@garobrik garobrik added this to the Code Intelligence Sprint 5 milestone Feb 3, 2021
@garobrik garobrik self-assigned this Feb 3, 2021
@github-actions
Copy link
Contributor

github-actions bot commented Feb 3, 2021

Heads up @macraig - the "team/code-intelligence" label was applied to this issue.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
team/graph Graph Team (previously Code Intel/Language Tools/Language Platform)
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant