feat: Make online_write_batch_size configurable in MaterializationConfig by cutoutsy · Pull Request #6268 · feast-dev/feast

What this PR does / why we need it:

Add a configurable online_write_batch_size option to MaterializationConfig for controlling batch size during online store writes.

Changes:

• Add online_write_batch_size: Optional[int] = None to MaterializationConfig
• When None (default): write all rows in a single batch (backward compatible)
• When set to a positive integer: write rows in batches of that size

Usage in feature_store.yaml:

materialization:
  online_write_batch_size: 10000

This allows users to control memory usage during materialization for large datasets.

Which issue(s) this PR fixes:

Fixes #6160