fix: Redundant feature materialization and premature incremental materialization timestamp updates by james-crabtree-sp · Pull Request #3789 · feast-dev/feast

…rialization timestamp updates (feast-dev#3789)

* SAASMLOPS-767 wait for jobs to complete

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>

* SAASMLOPS-805 Stopgap change to fix duplicate materialization of data

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>

* SAASMLOPS-805 save BYTEWAX_REPLICAS=1

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>

* SAASMLOPS-809 fix bytewax workers so they only process a single file (feast-dev#6)

* SAASMLOPS-809 fix bytewax workers so they only process a single file

* SAASMLOPS-809 fix newlines

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>

* SAASMLOPS-833 add configurable job timeout (feast-dev#7)

* SAASMLOPS-833 add configurable job timeout

* SAASMLOPS-833 fix whitespace

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>

* develop Run large materializations in batches of pods

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>

* master Set job_batch_size at least equal to max_parallelism

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>

* master clarity max_parallelism description

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>

* master resolve bug that causes materialization to continue after job error

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>

* master resolve bug causing pod logs to not be printed

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>

---------

Signed-off-by: James Crabtree <james.crabtree@sailpoint.com>
Signed-off-by: Attila Toth <hello@attilatoth.dev>