All pull requests

Pull requests

• [SPARK-60110][UI] Skip event log compaction when replay skips lines over the line-length limit

  #59328·viirya opened Oct 9, 2026Member·

  ·

• [SPARK-60109][UI] Apply the replay line-length limit and UTF-8-safe line alignment to the History Server end-event reparse

  #59327·viirya opened Oct 9, 2026Member·

  ·

• [SPARK-60009][PYTHON] Honor Arrow-backed pandas conversion types and safety

  #59326·luc-pimentel opened Oct 9, 2026·

  ·

• [SPARK-60108][SQL] Length-check JSON CHAR/VARCHAR map keys without pad or trim

  #59325·srielau opened Oct 9, 2026Contributor·

  ·

• [SPARK-60107][SQL] Trim the storage-filter comments and conf docs

  #59324·peter-toth opened Oct 9, 2026Contributor·

  ·
  1

• [SPARK-59971][SQL] Apply requireAllClusterKeysForCoPartition to the one-side shuffle of a storage-partitioned join

  #59323·peter-toth opened Oct 9, 2026Contributor·

  ·

• [SPARK-60040][SQL] Carry the AS-OF join direction to SortMergeAsOfJoinExec

  #59322·LukaZdravic opened Oct 9, 2026Contributor·

  ·
  6

• [SPARK-60106][SQL] Require symmetric filter propagation when both plans filter different join children

  #59321·peter-toth opened Oct 9, 2026Contributor·

  ·

• [SPARK-60105][SQL] Memoize the retained session-config overlay for view and SQL function body confs

  #59320·sebastianhillig-db opened Oct 9, 2026Contributor·

  ·
  3

• [SPARK-60104][BUILD][TESTS] Switch Snowflake JDBC Driver from fat to thin

  #59319·pan3793 opened Oct 9, 2026Member·

  ·

• [WIP] Psd preflight clean rejection

  #59318·jerrypeng opened Oct 9, 2026Contributor·

  ·

• [SPARK-59234][SQL] Fail fast when a distributed key holds more splits than its expected count

  #59317·naveenp2708 opened Oct 9, 2026Contributor·

  ·

• [SPARK-60103][SQL] Apply XML CHAR/VARCHAR assignment after STRING parse

  #59316·srielau opened Oct 9, 2026Contributor·

  ·

• [SPARK-60102][SQL] Skip CSV filter pushdown for CHAR columns

  #59315·srielau opened Oct 9, 2026Contributor·

  ·

• [WIP][CONNECT][PYTHON] Honor uncapped retry backoff in Python client

  #59314·akashmalbari opened Oct 9, 2026·

  ·

• [SPARK-60101][SQL] Support native data sources implemented in Rust or C++

  #59313·HyukjinKwon opened Oct 9, 2026Member·

  ·
  6

• [SPARK-60100][PYTHON] Migrate grouped and cogrouped map pandas UDF eval types to pandas eval type handlers

  #59312·Yicong-Huang opened Oct 9, 2026Contributor·

  ·

• [SPARK-60097][SDP] SCD1 Ignore-null support; Define version map construction

  #59311·AnishMahto opened Oct 8, 2026Contributor·

  ·

• [SPARK-60096][CONNECT][SQL] Raise a user-facing error instead of INTERNAL_ERROR for an unresolved DataFrame subquery plan id

  #59310·sadikovi opened Oct 8, 2026·

  ·

• [SPARK-60044][SQL] Freeze the k-way merge ordering of GroupPartitionsExec when the merge is planned

  #59306·peter-toth opened Oct 8, 2026Contributor·

  ·

• [SPARK-60092][SQL] Add FileType Catalyst data type with FILE EXTERNAL DDL and JSON schema support

  #59305·dejankrak-db opened Oct 8, 2026Contributor·

  ·
  1

• [SPARK-59995][SQL][4.2] Drop sort orders that hold a partition transform from a V2 scan's output ordering

  #59304·peter-toth opened Oct 8, 2026Contributor·

  ·

• [SPARK-59995][SQL][4.3] Drop sort orders that hold a partition transform from a V2 scan's output ordering

  #59303·peter-toth opened Oct 8, 2026Contributor·

  ·

• [SPARK-60090][SQL][HIVE] Apply CHAR/VARCHAR assignment after TRANSFORM via Project

  #59302·srielau opened Oct 8, 2026Contributor·

  ·
  29

• [SPARK-60001][SQL] Allow outer references for ASOF JOIN in correlated subqueries

  #59301·LukaZdravic opened Oct 8, 2026Contributor·

  ·
  1