[1.0 Requirement] Heuristic caching #192
Description
Need to implement the caching system that will decide to either reuse kernels provided by the magic scheduler, or ask it to generate a new one. We need to carefully think through this system and its interactions with the manager, magic scheduler, and the graph caching system.