[SR] Make fused_sigrid_transforms work on graph outputs (#71507)

Summary:
Pull Request resolved: #71507

We previously disabled `FuseListUnpack` if the fused outputs of the op would alias the graph outputs. The concern was that some ops were assuming that `p_node->Output(0).isTensor()` implies `p_node->Output(i).isTensor()` for all `i > 0`. This condition can be violated if there exists both managed and unmanaged tensors in the output list.

Instead of adding this special case and missing out on some fusions, we should implement fused ops correctly.

Reviewed By: d1jang

Differential Revision: D33669034

fbshipit-source-id: 8b291b5fe610ffbe47b88a5a018daa63cb5665b0
(cherry picked from commit c6cba23)

Author: Mike Iovine

torch/csrc/jit/runtime/static/passes.cpp

@@ -746,8 +746,6 @@ void FuseListUnpack(std::shared_ptr<torch::jit::Graph>& graph) {
   AliasDb alias_db(
       graph,
       /*isFrozen=*/false);
-  const std::vector<Value*> graph_outputs(
-      graph->outputs().begin(), graph->outputs().end());
   auto nodes = graph->nodes();
   std::vector<Node*> to_remove;
   for (auto* node : nodes) {
@@ -771,22 +769,6 @@ void FuseListUnpack(std::shared_ptr<torch::jit::Graph>& graph) {
       continue;
     }
 
-    const bool checks_all_outputs =
-        node->kind() == fromQualString("fb::equally_split") ||
-        node->kind() == fromQualString("fb::gather_ranges_to_dense") ||
-        node->kind() == fromQualString("fb::gather_ranges_to_dense_v2");
-
-    if (!checks_all_outputs) {
-      // If any output of the ListUnpack node is unmanaged, disable fusion
-      // since the fused op assumes all outputs are either managed or not.
-      // Ops excluded here check all outputs.
-      const std::vector<Value*> list_unpack_outputs_vec(
-          list_unpack_outputs.begin(), list_unpack_outputs.end());
-      if (alias_db.mayContainAlias(list_unpack_outputs_vec, graph_outputs)) {
-        continue;
-      }
-    }
-
     const auto& new_sym = unfused_to_fused_it->second;
     auto* new_node = graph->create(new_sym, 0);