[spark] Format table scan support runtime filtering

[Zouxxyy]

Purpose

Introduce PaimonSupportsRuntimeFiltering for runtime filtering pushdown to distinguish between different Spark versions and support both PaimonScan and FormatTableScan.

// Spark3.4+
trait PaimonSupportsRuntimeFiltering extends BaseScan with SupportsRuntimeV2Filtering

// Spark3.2 and Spark3.3
trait PaimonSupportsRuntimeFiltering extends BaseScan with SupportsRuntimeFiltering

// Paimon table
class PaimonScan extends PaimonBaseScan with PaimonSupportsRuntimeFiltering

// Format table
class PaimonFormatTableScan extends BaseScan with PaimonSupportsRuntimeFiltering

Tests

API and Format

Documentation

[JingsongLi]

+1