Skip to content

Commit b0115e5

Browse files
Apply suggestions from code review
Co-authored-by: Hyukjin Kwon <[email protected]>
1 parent 19183a0 commit b0115e5

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

python/docs/source/user_guide/arrow_pandas.rst

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -413,8 +413,8 @@ be read on the Arrow 0.15.0 release `blog <https://arrow.apache.org/blog/2019/10
413413
Setting Arrow ``self_destruct`` for memory savings
414414
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
415415

416-
Since Spark 3.2, the Spark configuration ``spark.sql.execution.arrow.pyspark.selfDestruct.enabled`` can be used to enable PyArrow's ``self_destruct`` feature, which can save memory when creating a Pandas dataframe via ``toPandas`` by freeing Arrow-allocated memory while building the Pandas dataframe.
417-
This option is experimental, and some operations may fail on the resulting Pandas dataframe due to immutable backing arrays.
416+
Since Spark 3.2, the Spark configuration ``spark.sql.execution.arrow.pyspark.selfDestruct.enabled`` can be used to enable PyArrow's ``self_destruct`` feature, which can save memory when creating a Pandas DataFrame via ``toPandas`` by freeing Arrow-allocated memory while building the Pandas DataFrame.
417+
This option is experimental, and some operations may fail on the resulting Pandas DataFrame due to immutable backing arrays.
418418
Typically, you would see the error ``ValueError: buffer source array is read-only``.
419419
Newer versions of Pandas may fix these errors by improving support for such cases.
420420
You can work around this error by copying the column(s) beforehand.

0 commit comments

Comments
 (0)