feat: Implement Databricks Unity Catalog offline store integration by falloficaruss · Pull Request #6515 · feast-dev/feast
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Initialize Databricks sessions during source validation
When users run feast apply or feast plan with source validation enabled, this subclass still inherits OfflineStore.validate_data_source and get_table_column_names_and_types_from_data_source, so validation goes through SparkSource.validate() and starts a plain Spark session via get_spark_session_or_start_new_with_repoconfig instead of this Databricks helper. In a local Databricks Connect setup with no active Databricks session, UC tables are validated against a local/non-UC Spark session and fail before any of the wrapped retrieval methods run; override these validation/schema methods to initialize the Databricks session too.
Useful? React with 👍 / 👎.