-
Notifications
You must be signed in to change notification settings - Fork 28.8k
Pull requests: apache/spark
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[SPARK-53720][SQL] Simplify extracting Table from DataSourceV2Relation
SQL
STRUCTURED STREAMING
#52460
opened Sep 25, 2025 by
aokolnychyi
Loading…
[SPARK-53570][SQL][PYTHON][CONNECT] Enhance type checking in
_to_col function
CONNECT
PYTHON
SQL
#52459
opened Sep 25, 2025 by
Yicong-Huang
Loading…
[SPARK-53716][PYTHON][DOCS] Document vectorized UDF with
@udf
PYTHON
SQL
#52454
opened Sep 25, 2025 by
zhengruifeng
Loading…
[DRAFT][SPARK-51519][SQL] MERGE INTO/UPDATE/DELETE support join hint
SQL
#52453
opened Sep 25, 2025 by
beliefer
Loading…
[SPARK-53715][SQL] Refactor getWritePrivileges for MergeIntoTable
SQL
#52451
opened Sep 25, 2025 by
beliefer
Loading…
[WIP][SPARK-53707] Improve attribute metadata handling.
SQL
#52449
opened Sep 25, 2025 by
ksbeyer
Loading…
Test buf plugin v29.5
CONNECT
PYTHON
SQL
STRUCTURED STREAMING
#52448
opened Sep 25, 2025 by
LuciferYang
•
Draft
[SPARK-53690][SS] Fix exponential formatting of avgOffsetsBehindLatest in Kafka sources object in progress json
SQL
STRUCTURED STREAMING
#52445
opened Sep 25, 2025 by
jayantdb
Loading…
[SPARK-46679][SQL] Fix for SparkUnsupportedOperationException Not found an encoder of the type T, when using Parameterized class
SQL
#52444
opened Sep 25, 2025 by
szehon-ho
Loading…
[SPARK-53406][SQL] Avoid unnecessary shuffle join in direct passthrough shuffle id
SQL
#52443
opened Sep 25, 2025 by
shujingyang-db
Loading…
[SPARK-49547][SQL][PYTHON] Add iterator of
RecordBatch API to applyInArrow
CONNECT
CORE
PYTHON
SQL
#52440
opened Sep 24, 2025 by
Kimahriman
Loading…
[SPARK-53696][PYTHON]Default to
bytes for BinaryType in PySpark UDF
AVRO
CORE
DOCS
PYTHON
SQL
#52438
opened Sep 24, 2025 by
xianzhe-databricks
Loading…
[SPARK-53691][PS][INFRA][TESTS] Further reorganize tests for Pandas API
BUILD
INFRA
#52433
opened Sep 24, 2025 by
zhengruifeng
Loading…
[SPARK-53687][SQL][SS][SDP] Introduce WATERMARK clause in SQL statement
DOCS
SQL
STRUCTURED STREAMING
#52428
opened Sep 24, 2025 by
HeartSaVioR
Loading…
[SPARK-53686][SQL] DESC column should print out default value
SQL
#52427
opened Sep 24, 2025 by
shujingyang-db
Loading…
[SPARK-53676][PYTHON] Extend to support column name
CONNECT
PYTHON
SQL
#52420
opened Sep 23, 2025 by
malthe
Loading…
[SPARK-53666][DOCS] Add script to generate llms.txt file for Spark main website
BUILD
INFRA
#52412
opened Sep 22, 2025 by
allisonwang-db
•
Draft
[DO-NOT-MERGE][DRAFT] Test workflow for python 3.11 and spark connect 3.5
CONNECT
INFRA
PYTHON
STRUCTURED STREAMING
#52408
opened Sep 22, 2025 by
shujingyang-db
•
Draft
[SPARK-53659][SQL] Infer Variant shredding schema when writing to Parquet
SQL
#52406
opened Sep 22, 2025 by
cashmand
Loading…
[SPARK-53658][CONNECT] Accept literal data_type field in ExecutePlanResponse
CONNECT
PYTHON
SQL
#52405
opened Sep 22, 2025 by
heyihong
Loading…
[SPARK-53656][SS] Refactor MemoryStream to use SparkSession instead of SQLContext
SQL
STRUCTURED STREAMING
#52402
opened Sep 22, 2025 by
ganeshashree
Loading…
[SPARK-53665][DOCS] Fix minor grammar/typos in sql-programming-guide.md
DOCS
#52396
opened Sep 19, 2025 by
Username46786
Loading…
[SPARK-53638][SS][PYTHON] Limit the byte size of arrow batch for TWS to avoid OOM
CORE
PYTHON
SQL
STRUCTURED STREAMING
#52391
opened Sep 18, 2025 by
zeruibao
Loading…
Previous Next
ProTip!
What’s not been updated in a month: updated:<2025-08-25.