15 posts tagged with "arrow"

53 releases since Spice 1.0-stable, Spice.ai OSS has reached the 2.0-stable milestone! 🎉

Spice v2.0.0 is the next major release of Spice and a major milestone in the project's development, advancing Spice from a single-node engine into a distributed data and query platform built for enterprise AI agents. These agents need low-latency, governed access to data spread across many production systems, and because they generate their own queries autonomously, that access has to be sandboxed, observable, and able to absorb occasional heavy analytical queries without overwhelming the underlying systems. The release is headlined by multi-node distributed query, now generally available — multi-active, highly-available, and object-store-native, built on Apache Ballista — distributing both query execution and ingestion across executors with data-local routing and per-executor statistics for distributed join planning. Alongside it, the Spice Cayenne data accelerator is generally available, built on the Vortex compressed columnar format, with a high-throughput CDC write path, MERGE INTO, SQL-defined partitioning, inline writes, a dedicated compaction runtime, and write-path statistics for distributed join sizing. The engine also moves to DataFusion v52 with sort pushdown, a rewritten merge join, and dynamic filters, and the Spice CLI is rewritten in Rust as a single self-contained binary.

v2.0 also expands real-time and write-path capabilities across the platform: native CDC from MongoDB Change Streams and PostgreSQL WAL logical replication, durable Kafka CDC offsets, DML write-back for PostgreSQL, Snowflake, DynamoDB, Arrow, and DuckLake, DDL and MERGE INTO for Iceberg catalogs, mutual TLS across server endpoints and outbound connectors, HashiCorp Vault and Azure Key Vault secret stores, user-defined functions, hybrid search with Elasticsearch and DuckDB HNSW vector indexes, provider-aware LLM prompt caching, and the Responses API across all model providers.

Highlights in v2.0.0 include:​

• Spice Cayenne (GA) — generally available on the Vortex compressed columnar format, with WAL-staged writes, inline low-latency writes, fast-path CDC deletes, merge-on-read position deletes, composite & SQL-defined partitioning, MERGE INTO, dedicated compaction runtime, and join-sizing statistics maintained on the write path
• Multi-Active HA Distributed Query (GA) — multi-node distributed query built on Apache Ballista, with object-store-native clustering, dynamic cluster sizing, distributed ingestion, data-local query routing, per-executor table statistics for distributed join planning, and async queries via /v1/queries
• Mutual TLS (mTLS) — public mTLS for HTTP and Flight, TLS cert hot-reload, and mTLS client certificates for FlightSQL and Spice.ai connectors
• Enterprise Authentication & Authorization — OIDC bearer-token verification and Cedar-based authorization policy with per-principal row- and column-level filtering
• New Secret Stores — HashiCorp Vault and Azure Key Vault
• CDC Sources — native MongoDB Change Streams, PostgreSQL WAL logical replication, and durable Kafka CDC offsets — no Debezium or Kafka middleware required
• DML & DDL — INSERT/UPDATE/DELETE write-back for PostgreSQL, Snowflake, DynamoDB, and Arrow; CREATE TABLE/DROP TABLE and MERGE INTO for Iceberg catalogs
• User-Defined Functions — SQL UDFs in spicepods, remote UDFs over HTTP, and optional geospatial ST_* UDFs
• On-Demand Dataset Loading & Unified Query Cancellation — faster startup and end-to-end cancellation across HTTP, Flight, FlightSQL, and MCP
• Dynamic HTTP Connector — OAuth2 refresh tokens, pagination, dynamic headers, subquery-driven parameters, and rate-control state persisted across restarts
• Storage-Profile Accelerator Tuning & refresh_mode: snapshot — storage-aware acceleration defaults and point-in-time snapshot acceleration
• Search & Vectors — Elasticsearch data connector with native hybrid search, DuckDB HNSW vector engine with a statically linked VSS extension, multi-vector MaxSim embeddings, and a rerank() UDTF
• AI & LLM — provider-aware prompt caching, Responses API across all providers, MCP Streamable HTTP transport, and a searchable LLM tool registry
• New Data Connectors — Elasticsearch (Alpha), GCS (Alpha), Azure Cosmos DB (Alpha), Git (RC), ADBC, DuckLake (Beta), and catalog connectors for PostgreSQL, MySQL, MSSQL, and Snowflake
• Rust CLI — single-binary spice CLI with spice query async REPL, shell completions, and --output=json
• Dependency upgrades including DataFusion v52.5, DuckDB v1.5.3, Arrow v57.2, iceberg-rust v0.9.1, Turso v0.6.1, and Vortex v0.69

Spice v2.0 includes several breaking changes. Review the breaking changes section before upgrading.

Distribution Changes​

AI/ML support including local LLM/ML model and hosted LLM inference is now included in the default Spice build and image. The separate models build variant has been removed.

With models now included by default, the data-only distribution (without AI/ML support) is only published in nightly builds. Official production-ready data-only distributions are available exclusively through Spice Cloud and the Enterprise release.

A new Network Attached Storage (NAS) distribution with built-in SMB and NFS data connector support is also available in nightly builds and with Spice.ai Enterprise.

Native Windows builds are no longer provided; use WSL for local development. For more details, see the Distributions documentation.

What's New in v2.0.0​

Spice Cayenne Reaches General Availability​

The Spice Cayenne data accelerator is generally available in v2.0, with a major focus across the release candidates on write-path throughput, correctness, and distributed operation.

Write path & ingest:

• Staged Append Writes: WAL-based staged append writes prevent partial writes and data loss on stream errors — batches commit atomically.
• Inline Writes: Small writes are serialized as Arrow IPC and committed directly into the Cayenne metastore, bypassing the staged Vortex write path for low-latency ingest. Inline upserts atomically rewrite existing inline rows, inline data stays query-visible via an in-memory union scan, and rows are checkpointed to Vortex when thresholds are reached. Inline writes now also proceed with pending deletions in flight, and inline flush caps scale with available memory and storage class.
• Fast-Path CDC Deletes: DELETE statements whose filters identify primary keys directly — including composite keys expressed as (k1, k2) IN ((...), (...)) — skip the table scan entirely.
• Merge-On-Read Position Deletes: Primary-key upsert tables use position deletes with memory-pool accounting, avoiding full-table rewrites on update-heavy workloads.
• Resident Upsert Keysets: CDC upsert primary-key keysets stay resident between batches, avoiding per-batch full-table rebuilds.
• CDC Sub-Batch Efficiency: Interleaved upsert/delete workloads produce fewer sub-batch splits, with last-write-wins deduplication applied within batches.
• Dedicated Compaction Runtime: Background compaction runs on a dedicated thread pool with CDC pipelining and protected snapshots, isolating compaction work from query and ingest paths.

Query & planning:

• Join Filter Propagation: Filters propagate across equi-join keys, with range fallback for large join filters and IN-list rewrites.
• Write-Path Join-Sizing Statistics: Cayenne maintains live row counts and HyperLogLog-based distinct-value estimates on the write path, so distributed JoinSelection can correctly size joins without rescans.
• Scan-Result Cache: A new scan-result cache accelerates hot reads, with parallel Vortex partition writes and lock-free deletion caches with bloom-prefiltered probes.

SQL & catalog:

• MERGE INTO: Upsert-style MERGE INTO for Cayenne catalog tables, distributed across executors in cluster mode.
• PARTITION BY in SQL: Define partitioning directly in CREATE TABLE ... PARTITION BY (...); metadata is persisted in the catalog and survives restarts.
• Composite Partitioning: partition_by: [col1, col2] with hierarchical path-like keys.
• File-Based Retention Deletes: Time-based retention uses file-level deletes for both position-based and primary-key tables.

Correctness: Synchronized partition commits, correct NULL-sentinel handling for nullable partition expressions, tombstoned inline-checkpointed rows on upsert (preventing duplicate primary keys), and live reads through expired protected snapshots.

Multi-Active HA Distributed Query (GA)​

Spice.ai Enterprise feature. See High Availability.

Distributed Query is generally available. Built on Apache Ballista, it distributes query execution across multiple active executor nodes with no single point of failure, reading directly from object storage rather than relying on a central cluster.

Distributed query supports two execution modes:

• Synchronous: Queries for accelerated datasets are distributed across executors and results stream back in real-time — best for interactive, latency-sensitive queries.
• Asynchronous: Queries submitted via the HTTP /v1/queries API materialize results to object storage for later retrieval — best for long-running analytical and batch workloads.

Key capabilities:

• Dynamic Cluster Sizing: The planner adjusts parallelism to the number of active executors as nodes join or leave.
• Distributed Ingestion: Ingestion for partitioned accelerated tables is distributed across executors, with partition-aware write-through splitting scheduler-side Flight DoPut writes to the responsible executors.
• Data-Local Query Routing: Cayenne catalog queries route to the executors holding the relevant partitions.
• Per-Executor Table Statistics: Executors report table statistics — including NDV-aware estimates — so distributed JoinSelection can size joins correctly, fixing out-of-memory conditions on large semi-joins.
• Readiness & Failure Detection: /v1/ready gates on a configurable executor quorum for safe rolling deployments; scheduler readiness additionally waits for executor partition loads; executor heartbeat timeout reduced from 180s to 30s.
• Distributed DML & DDL: UPDATE/DELETE forwarding to all executors, executor DDL sync for late joiners, and distributed MERGE INTO.
• Cluster Observability: New cluster metrics (including scheduler_active_executors_count), distributed runtime.task_history replication, and a Grafana dashboard.
• Ballista S3 Shuffle: Async queries with runtime.params.shuffle_location: s3://... complete reliably with executor-environment-derived S3 clients.

Security: Mutual TLS, Secret Stores, and Hardening​

Several capabilities in this section are Spice.ai Enterprise features. See Enterprise Security.

Mutual TLS across the platform:

• Public mTLS for HTTP and Flight: client_auth_mode: request (optional, for migration windows) or required (strict) client-certificate verification.
• TLS Cert Hot-Reload: The runtime reloads TLS certificates on SIGHUP for zero-downtime rotation.
• Outbound mTLS Client Certificates: FlightSQL and Spice.ai data connectors present client certificates to upstream services; the spice sql REPL supports mTLS client auth.

runtime:
  tls:
    enabled: true
    certificate_file: /etc/spice/tls/server.crt
    key_file: /etc/spice/tls/server.key
    client_auth_mode: required
    client_auth_ca_file: /etc/spice/tls/client-ca.crt

Authentication & Authorization (Spice.ai Enterprise):

• OIDC Authentication: Validate OIDC bearer tokens (JWTs) issued by enterprise identity providers — Microsoft Entra ID, Okta, Auth0, AWS Cognito, and Google — for secure access to runtime endpoints, standalone or combined with API keys.
• Principal-Based Policy Enforcement: Fine-grained, Cedar-based authorization policy configured under runtime.authorization governs allow/deny access across datasets, models, tools, and endpoints. Combined with identity SQL functions (current_principal(), current_principal_email(), current_principal_groups()), policies enforce per-principal row-level filtering and column masking.

New Secret Stores: HashiCorp Vault (KV v1/v2; token, approle, kubernetes, and jwt auth with automatic lease renewal) and Azure Key Vault (service principal, managed identity, workload identity, Azure CLI, or auto-detect; sovereign cloud support).

Hardening:

• Read-only API Key Enforcement on the Flight DoGet path and async query endpoints.
• Per-Principal Cache Namespacing: SQL, search, and caching-accelerator caches are namespaced per authenticated principal so cached results never cross identity boundaries.
• API Key Timing Leak & Remote-UDF SSRF: Closed a timing-based position-disclosure leak in API key comparison and blocked SSRF via remote UDF endpoints.
• Snowflake Function Deny-List: A function deny-list is enforced in Snowflake federation pushdown, and Snowflake account identifiers and auth configuration are validated at startup.
• MCP allowed_hosts: MCP servers can be restricted to an explicit allowlist of upstream hosts.

Change Data Capture (CDC) Sources​

See Change Data Capture (CDC) for an overview of CDC in Spice.

• MongoDB Change Streams: MongoDB datasets with refresh_mode: changes stream changes natively into any local accelerator — no Debezium or Kafka required.
• PostgreSQL Native Replication (WAL): PostgreSQL datasets stream INSERT/UPDATE/DELETE directly from logical replication using pgoutput decoding, with automatic per-replica slot management, an initial REPEATABLE READ bootstrap snapshot, and durable LSN acknowledgement.
• Kafka CDC Offset Persistence: Kafka CDC offsets persist in sidecar tables for durable, resumable streams across restarts and failovers.
• Pipelined CDC Ingestion: Source reads overlap with batch apply, with envelope coalescing and improved nullability propagation.
• Debezium Schema Evolution: Schema changes in Debezium-sourced datasets no longer break dataset initialization on reload.

datasets:
  - from: postgres:my_table
    name: my_table
    params:
      pg_host: localhost
      pg_db: mydb
    acceleration:
      enabled: true
      engine: duckdb
      refresh_mode: changes

DML, DDL, and Write-Back​

Spice v2.0 turns more connectors and catalogs into full read/write tables:

• PostgreSQL DML: INSERT, UPDATE, and DELETE write-back on PostgreSQL datasets, with foreign-key metadata exposed via the PostgreSQL catalog connector.
• Snowflake DML: INSERT, UPDATE, and DELETE write-back on Snowflake datasets.
• DynamoDB DML: INSERT, UPDATE, and DELETE for DynamoDB, complementing read and CDC streaming.
• Arrow Primary Key Upserts: Native update-or-insert semantics for in-memory Arrow-accelerated tables.
• DDL for Iceberg: CREATE TABLE and DROP TABLE via FlightSQL and /v1/sql for Iceberg, with catalog.access: read_write_create.
• DuckLake INSERT: DuckLake catalog tables with read_write access support INSERT.

SQL & User-Defined Functions​

See the SQL Reference for the full SQL surface area.

• User-Defined Functions: Define reusable SQL UDFs as first-class spicepod components, or invoke remote functions over HTTP (Spice.ai Enterprise), plus table user functions.
• Spatial SQL UDFs: Optional geospatial ST_* UDFs for geometry workloads.
• JSON UDTFs: flatten_json, json_tree, and flatten_json_properties table-valued functions for JSON transformation and schema decomposition (with options such as expand_maps). See JSON Functions and Operators.
• PostgreSQL Metadata UDFs: Dataset and column descriptions are exposed via PostgreSQL-compatible UDFs (obj_description, col_description), so BI tools and psql surface Spice metadata.
• FlightSQL Substrait Plans: CommandStatementSubstraitPlan support for clients submitting Substrait-encoded plans.
• SQL REPL Expanded View: Toggle \x for a vertical key-value layout on wide result sets.
• Prepared statement, federation, and unparsing fixes across the engine, including keeping correlated subqueries out of JOIN ON conditions for Spice Cloud federation and correct EXISTS/NOT EXISTS subquery handling in the federation analyzer.

Runtime Features​

• On-Demand Dataset Loading: Datasets can be deferred — registered with a declared schema at startup (columns[].type, columns[].nullable) and fully resolved on first reference, reducing startup time and memory for large spicepods.
• Unified Query Cancellation: HTTP, Flight, FlightSQL, MCP, and internal execution paths honour a unified cancellation signal — disconnects, REPL Ctrl-C, and cancelled HTTP requests cancel the query end-to-end.
• Storage-Profile Accelerator Tuning: acceleration.storage_profile (auto, local_ssd, ebs, tmpfs) applies storage-aware defaults across DuckDB, SQLite, Turso, and Cayenne file-mode accelerators; auto detects the backing storage.
• refresh_mode: snapshot (Spice.ai Enterprise): Point-in-time snapshot acceleration with SQLite/Turso WAL flushing and Cayenne metastore slice integration, now reporting accurate readiness when no snapshot exists yet.
• Structured Component Errors: /v1/datasets?status=true and /v1/models?status=true return structured error objects (category, type, code) and human-readable error_message fields; the CLI shows an ERROR column.
• Actionable Config Errors: Parameter typos, missing secret references, and unknown engine names produce specific, actionable errors with suggestions.

Spicepod v2​

Spicepods now support version: v2, the default for spice init, while v1 spicepods continue to work with automatic migration of deprecated fields.

New v2 fields include runtime.ready_state, runtime.query.spill_compression, runtime.caching.sql_results.stale_while_revalidate_ttl, runtime.caching.sql_results.encoding, scheduler partition-assignment configuration, and catalog.access: read_write_create.

Data Connectors & Catalogs​

New connectors:

• Elasticsearch (Alpha, Spice.ai Enterprise): Query Elasticsearch indexes as SQL tables with native hybrid search — vector_search() kNN, text_search() BM25, and rrf() fusion — plus Elasticsearch as a backing vector engine, direct FTS engine configuration, and index lifecycle controls.
• GCS (Alpha): Federated queries against Google Cloud Storage, with Iceberg table support.
• Azure Cosmos DB (Alpha): Read-only NoSQL / Core SQL API connector with cross-partition scans and schema inference.
• Git (RC): HTTPS/SSH auth, Git LFS support, and per-repo connection resilience.
• ADBC: Data connector and catalog with full query federation, BigQuery support, and schema/table discovery.
• DuckLake (Beta): Lakehouse-style data management with DuckDB as the metadata catalog and object storage for data — ACID transactions, time travel, and schema evolution on Parquet.
• Self-Hosted Spice Connector: Connect Spice to another self-hosted Spice runtime as a federated source.

New catalog connectors for PostgreSQL, MySQL, MSSQL, and Snowflake, using native metadata catalogs for schema and table discovery. Unity Catalog compatibility extends to OSS Unity Catalog deployments, and DDL-defined catalogs can expose and query views.

HTTP connector: OAuth2 refresh-token authentication, query-parameter and no-limit pagination, dynamic request headers parameterised from query predicates, subquery-driven request parameters for fan-out queries, response metadata as queryable columns, map-to-array conversion, shared and persistent rate-control state across restarts and replicas, no caching of transient 429/5xx errors, and a correctly populated fetched_at column.

JSON ingestion: Single-object documents, JSONL, BOM-prefixed input, Socrata SODA responses, format auto-detection, and RFC 6901 json_pointer extraction of nested payloads.

Databricks: Resilience controls, Unity Catalog-aware permission prechecks with structured advisory errors, Classic SQL Warehouse foreign-table compatibility, connect_timeout/client_timeout parameters, a Databricks SQL dialect for federation, and Delta Lake column mapping (Name and Id modes).

Other connector improvements: MongoDB SRV support; MySQL mysql_zero_date_behavior; Snowflake OBJECT, MAP, GEOGRAPHY, GEOMETRY, VECTOR, and TIMESTAMP_LTZ types plus key-pair auth; ClickHouse Date32; S3 s3_url_style for path-style addressing and faster Parquet reads; GraphQL custom auth headers; Oracle and MSSQL sort/limit pushdown; GitHub GraphQL resilience; and improved Kafka reliability.

AI & LLM​

• Provider-Aware Prompt Caching: LLM calls automatically use provider-side prompt caching (e.g., Anthropic, OpenAI) for system prompts and tool descriptions, reducing latency and cost.
• Responses API Across All Providers: The Responses API works with every configured model provider, including streaming response.output_text.delta events and Authorization: Bearer header support.
• Multi-Vector Embeddings with MaxSim: List-of-string columns produce one embedding per element with MaxSim/mean/sum scoring for ColBERT-style late-interaction retrieval, plus a _match column identifying the best-matching element.
• rerank() UDTF: Reorder results from vector_search, text_search, or rrf using any registered chat model as a reranker, with automatic query propagation and pushdown support.
• Searchable LLM Tool Registry: Agents discover tools via semantic search instead of enumerating every tool in the system prompt.
• MCP Improvements: Streamable HTTP transport (/v1/mcp) on rmcp v1.5.0, native auth for streamable HTTP tools (mcp_auth_token, mcp_headers), external MCP server tool calls traced in task history, and configurable allowed_hosts.
• Per-Model Rate-Limited AI UDF Execution for controlling concurrent AI function invocations.

Search & Vectors​

• DuckDB Vector Engine: vector_engine: duckdb uses DuckDB's HNSW index for fast approximate nearest-neighbor search without an external vector store. In v2.0.0, the DuckDB VSS extension is statically linked into the bundled DuckDB, so HNSW vector search works out-of-the-box on clean machines with no extension download. HNSW indexes are preserved across data refresh, and cosine_distance pushes down via array_cosine_distance.
• Hybrid Search: Combine kNN vector search and BM25 full-text search with reciprocal rank fusion (rrf()), backed by Tantivy, Elasticsearch, or DuckDB.
• Full-Text Search Performance: Significantly faster Tantivy ingestion with rollback-on-error, and search metadata is correctly preserved on indexing and in Vortex physical schema calculation.
• Embedding Validation: row_id columns are validated during dataset initialization.

Caching​

Improvements across Caching:

• Stale-While-Revalidate: runtime.caching.sql_results.stale_while_revalidate_ttl serves stale results while revalidating in the background.
• Cache Encoding: Optional compression (e.g., zstd) for SQL results cache entries.
• Retention Policies for cached query results, and improved CDC-driven cache invalidation (including view plan invalidation on updates).
• Idle Cache Maintenance: Periodic maintenance drains invalidation predicates on idle caches, fixing unbounded memory growth in rarely-read caches.

Performance & Query Engine​

Apache DataFusion is upgraded to v52.5 over the course of the release cycle, bringing:

• Sort Pushdown to Scans: ~30x faster top-K queries on pre-sorted data; Parquet scans reverse row-group order for DESC on ASC-sorted files.
• Rewritten Sort-Merge Join: Up to three orders of magnitude faster in pathological cases (e.g., TPC-H Q21: minutes → milliseconds).
• Dynamic Filters: MIN/MAX aggregates and hash-join build sides prune files, row groups, and rows during execution.
• Faster CASE Expressions, statistics caching, and prefix-aware list-files caching for faster planning.
• TableProvider DELETE/UPDATE hooks and the RelationPlanner API for extensible SQL planning.
• Strict Overflow Handling: try_cast_to errors on overflow instead of silently producing NULLs.

Additional engine work: default query memory limit raised from 70% to 90% with GreedyMemoryPool, partial aggregation optimization for FlightSQLExec, improved partitioned query planning, and metastore transaction support to prevent concurrent conflicts.

Rust CLI​

The Spice CLI is completely rewritten from Go to Rust — a single spice binary built from the same codebase as spiced, with full feature parity across 27+ commands.

• spice query: Interactive REPL for async queries with multi-line SQL, progress indication, and cancellation.
• spice dataset configure: Non-interactive flag-based configuration (--from, --description, --param KEY=VALUE, --set) alongside interactive prompts.
• spice completions: Shell completion script generation.
• --output=json: Machine-readable output for scripting; spice login --output adds env, json, and keychain modes.
• spice init writes a yaml-language-server schema directive for IDE completions.

Observability​

• OpenTelemetry: Exporter fixes, authenticated metrics export, configurable metric name prefix (runtime.telemetry.metric_prefix), delta temporality by default, and OTLP resource attributes via runtime.telemetry.properties.
• Query Metrics: The query_executions metric gains a datasets dimension for per-dataset query attribution.
• Ingestion Metrics: rows_written, bytes_written, and dataset_acceleration_size_bytes for acceleration refresh and Flight DoPut/ADBC ingestion, and EXPLAIN ANALYZE metrics in FlightSQLExec.
• Task History: Distributed task history in cluster mode and tracing for external MCP server tool calls.

Notable Bug Fixes​

• localpod synchronization: localpod child datasets correctly track parent refreshes when the parent uses the in-memory Arrow accelerator.
• Spice Cloud federation: Correlated subqueries are kept out of JOIN ON conditions, fixing rejected federated queries.
• refresh_mode: snapshot: No longer reports Ready with empty data when no snapshot exists.
• Search metadata: Field and schema metadata preserved on search indexing and in Vortex physical schema calculation.
• HTTP connector: fetched_at column is correctly populated.
• Connector correctness: DynamoDB Streams transient-error retries and typed-NULL DML handling; ScyllaDB physical filter pushdown disabled to fix incorrect results; MSSQL TOP N pushdown; DuckDB DELETE/UPDATE on full and caching refresh modes; Turso checked arithmetic for timestamp conversions; ODBC queries no longer silently return 0 rows on failure; Flight GetFlightInfo/DoGet schema parity.

Dependency Updates​

Contributors​

• @cluster2600
• @ewgenius
• @Jeadie
• @krinart
• @lukekim
• @peasee
• @penberg
• @phillipleblanc
• @sgrebnov

Breaking Changes​

• Models included by default: The separate models build variant has been removed. Local LLM inference is always included in the default build and image.

• Windows native builds removed: Use WSL for local development.

• Spicepod version defaults to v2: spice init creates version: v2 spicepods. v1 remains supported with auto-migration; v1beta1 is no longer accepted.

• Flattened runtime.scheduler configuration: The nested runtime.scheduler.partition_management block is flattened and renamed:

  # Before
  runtime:
    scheduler:
      partition_management:
        interval: 30s
        max_assignments_per_cycle: 16
        discovery_timeout: 10s
  
  # After
  runtime:
    scheduler:
      partition_assignment_interval: 30s
      max_assignments_per_interval: 16
      partition_discovery_timeout: 10s
  

• S3 metadata columns renamed: location, last_modified, size → _location, _last_modified, _size.

• Default query memory limit changed: Increased from 70% to 90%.

• Metric renames: accelerated_refresh metrics renamed to acceleration_refresh; last_refresh_time gauge renamed to include the milliseconds unit.

• DuckDB parameter rename: partitioned_write_flush_threshold → partitioned_write_flush_threshold_rows.

• /v1/search API: Always returns an array in matches, even for single results.

• /v1/evals API removed.

• Perplexity model provider removed.

• x.ai model endpoint: x.ai models exclusively use the /v1/responses endpoint.

Upgrade Guide from v1.x​

Most v1 spicepods continue to work on v2.0 — v1 remains supported and deprecated fields auto-migrate at load time — so many deployments can upgrade by updating the binary or image alone. The steps below cover the breaking changes that may require manual action. Review each before upgrading a production deployment.

1. Build, image, and platform changes​

• Models are now included by default. The separate models build variant (and the corresponding -models image tags) has been removed; local LLM inference is always included in the default build and image. If your deployment pinned a models build or -models-tagged image, switch to the default build/image.
• Native Windows builds are removed. Use WSL for local Windows development.

2. Adopt Spicepod v2 (recommended)​

spice init now creates version: v2 spicepods. v1 spicepods remain supported with automatic migration, but v1beta1 is no longer accepted. To move to v2, set version: v2 and update the following fields — each auto-migrates from v1, but updating now clears the deprecation:

3. Update changed configuration​

• DuckDB parameter rename: partitioned_write_flush_threshold → partitioned_write_flush_threshold_rows.
• Default query memory limit raised from 70% to 90%. If you relied on the previous default to leave headroom for other processes on the host, set it explicitly via runtime.query.memory_limit.

4. Update queries and API clients​

• S3 metadata columns renamed: location, last_modified, size → _location, _last_modified, _size. Update any queries that reference these columns.
• /v1/search always returns an array in matches, even for a single result. Update clients that assumed a scalar value.
• /v1/evals API removed. Remove integrations that depend on it.

5. Update model providers​

• Perplexity model provider removed. Re-point affected models to another provider.
• x.ai models use the /v1/responses endpoint exclusively. Ensure x.ai integrations target the Responses API.

6. Update observability​

• Metric renames: accelerated_refresh → acceleration_refresh, and the last_refresh_time gauge is renamed to include the milliseconds unit. Update dashboards and alerts that reference these metric names.

After updating, restart the runtime and verify datasets and models report ready via /v1/datasets?status=true and /v1/models?status=true (the CLI shows a Ready/ERROR column).

Cookbook Updates​

New Spice Cookbook recipes added during the v2.0 release cycle:

• Async Queries: Submit long-running queries asynchronously and retrieve results later.
• DuckLake Catalog: Lakehouse-style data management with ACID transactions and time travel.
• Distributed Query: Run Spice in multi-active distributed cluster mode.
• mTLS: Mutual TLS for HTTP and Flight endpoints.
• Elasticsearch Connector: Query Elasticsearch indexes as SQL tables.
• MCP Server: Use Spice as an MCP server over Streamable HTTP.
• Snowflake DML: Write-back to Snowflake with INSERT/UPDATE/DELETE.
• PostgreSQL, MySQL, and MSSQL Catalogs: Schema and table discovery for external databases.
• Full-Text Search: BM25 full-text search over accelerated datasets.

The Spice Cookbook includes more than 100 recipes to help you get started with Spice quickly and easily.

Upgrading​

To upgrade to v2.0.0, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.0.0 image:

docker pull spiceai/spiceai:2.0.0

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.0.0

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed​

Changelog​

• Add TPC-DS integration tests with S3 source and PostgreSQL acceleration by @phillipleblanc in #9006
• fix(tests): fix flaky/slow/failing unit tests by @phillipleblanc in #9009
• fix: Update benchmark snapshots for DF51 upgrade by @app/github-actions in #9008
• fix: add feature gate to rrf TEST_EMBEDDING_MODEL by @phillipleblanc in #9017
• fix: features check by @phillipleblanc in #9014
• fix: Enable Cayenne acceleration snapshots by @lukekim in #9020
• URL table support by @lukekim in #9018
• ScyllaDB key filter by @lukekim in #8997
• fix: Schema mismatch when using column projection with HTTP caching by @phillipleblanc in #9021
• Add more tests for HTTP caching with columns selection by @sgrebnov in #9025
• HTTP cache snapshots: default to time_interval and fix snapshots_creation_policy: on_change by @sgrebnov in #9026
• Fix duplicate snapshot creation on startup by @sgrebnov in #9029
• Add ScyllaDB and SMB to the README table by @krinart in #9034
• Remove waiting for runtime to be ready before creating snapshot by @krinart in #9033
• Fix snapshot on_change policy to skip when no writes occurred by @sgrebnov in #9028
• Release notes for release release/1.11.0-rc.2 by @krinart in #9016
• ci: use arduino/setup-protoc for official protobuf compiler by @phillipleblanc in #9036
• ci: install unzip on aarch64 runner for arduino/setup-protoc by @phillipleblanc in #9038
• fix: don't fail release if upload to minio fails by @phillipleblanc in #9039
• Add missing protoc step to setup-cc action by @krinart in #9041
• fix: Update Search integration test snapshots by @app/github-actions in #9013
• Fix formula_1 and codebase_community in bird-bench by @Jeadie in #9000
• Cayenne S3 Express One Zone improvements by @lukekim in #9015
• Add zlib1g-dev to CI by @lukekim in #9052
• Improve validation and logging for hash indexes by @lukekim in #9047
• Upgrade Vortex with CASE-WHEN by @lukekim in #9051
• x.ai models now exclusively use /v1/responses endpoint by @lukekim in #9400
• Improvements for snapshot schema comparison by @krinart in #9401
• v2.0 breaking changes by @lukekim in #9233
• Create PartitionManagementTask for scheduler to update accelerated table partition assignments by @Jeadie in #9378
• refactor(Cayenne): route all write orchestration through CayenneDataSink by @sgrebnov in #9402
• Refactor benchmark to use QueryExecutor trait by @Jeadie in #9418
• feat: Add spidapter build and release workflow by @peasee in #9427
• Testoperator: add support for api-key when connecting to external spice instance by @sgrebnov in #9421
• Initial implementation of Ducklake catalog & data connectors by @lukekim in #9083
• Require aws_lc_rs since jsonwebtoken upgrade by @Jeadie in #9426
• feat: Add spidapter tool by @peasee in #9425
• Add release notes for 1.11.2 patch release by @sgrebnov in #9430
• feat(spidapter): integrate system-adapter-protocol with SCP provisioning by @phillipleblanc in #9434
• Add DuckLake TPCH E2E workflow and federated Spicepod configuration by @lukekim in #9431
• fix(spidapter): use Flight handshake auth instead of x-api-key header by @phillipleblanc in #9435
• [spidapter] Keep only what sparks joy by @Jeadie in #9439
• Refactor binary operator balancing by @Jeadie in #9424
• feat: Add Iceberg DDL support (CREATE TABLE / DROP TABLE) for default catalog override by @phillipleblanc in #9440
• Fix Flight SQL schema consistency: expand view types and verify field names by @sgrebnov in #9438
• Update spidapter for new system-adapter-protocol by @sgrebnov in #9442
• docs: fix typos and syntax errors in style guide and error handling docs by @cluster2600 in #9445
• Add acceleration refresh ingestion metrics (rows_written, bytes_written) by @phillipleblanc in #9461
• Refactor(Cayenne): Replace CatalogError and string based errors with Snafu errors by @sgrebnov in #9403
• Replace deprecated claude-3-5-haiku-latest with claude-haiku-4-5 by @Jeadie in #9492
• Fix #9481: Preserve schema in results cache for empty query results by @phillipleblanc in #9485
• Fix partition by serializing by @Jeadie in #9474
• query: reconcile execution stream nullability with logical plan schema by @phillipleblanc in #9486
• initial spice-cloud-client crate and spice cloud metrics --app <app-name>. by @Jeadie in #9480
• feat: Return dataset error message in datasets API by @peasee in #9487
• Spicebench by @lukekim in #9447
• build(deps): consolidate dependabot dependency updates by @phillipleblanc in #9504
• fix(cluster): route non-partitioned accelerated tables in distributed mode by @phillipleblanc in #9508
• Enable core scalar UDFs in refresh SQL by @sgrebnov in #9502
• Fix metrics in Spidapter again by @Jeadie in #9497
• fix(cluster): tolerate Completed->status propagation race in distributed query handle by @phillipleblanc in #9510
• feat: Support distributed ingestion in cayenne catalog by @peasee in #9506
• Fix Cayenne duplicate primary keys after DELETE + UPSERT CDC sequences by @krinart in #9494
• fix(cluster): rewrite table scans inside subqueries for distributed execution by @phillipleblanc in #9518
• fix: Set catalog mode to readwritecreate in spidapter by @peasee in #9519
• Upgrade AWS SDK crates & set APN user-agent in AWS SDK credential bridge by @lukekim in #8328
• feat(runtime): add runtime ready_state on_registration semantics by @lukekim in #9522
• fix: Add spidapter post-setup retries by @peasee in #9526
• Make partition discovery more robust and make initialization non-blocking by @sgrebnov in #9499
• Make lint-rust-fix support targeted packages and features by @Jeadie in #9511
• Handle new Cloud SCP API by @Jeadie in #9532
• Refactor and simplify streaming benchmarks by @krinart in #9405
• fix: ensure spidapter only increments attempts on failures by @peasee in #9534
• feat: Support specifying app resources in spidapter by @peasee in #9536
• test(runtime): Spice Cayenne DDL integration test by @lukekim in #9535
• fix: Handle schema evolution mismatch errors during data refresh by @lukekim in #9527
• fix: resolve clippy lint warnings by @phillipleblanc in #9547
• pr-builds --tag <TAG> for build_and_release.yml by @Jeadie in #9507
• Add --output flag to spice login with env/json/keychain modes by @Jeadie in #9541
• Don't use 'PartitionedTableScanRewrite' in async distributed query by @Jeadie in #9548
• feat(spidapter): add local backend mode with single executor by @phillipleblanc in #9531
• support chat template in HF by @Jeadie in #9543
• fix(cayenne): stream PK retention deletes and run OOM regression in CI by @phillipleblanc in #9533
• cayenne: Staged append writes to prevent partial writes and data loss on stream error by @sgrebnov in #9491
• AcceleratedTable::scan use FederatedTable::scan when ClusterRole::Scheduler by @Jeadie in #9550
• Upgrade to delta-kernel-rs v0.18.2 by @lukekim in #9528
• Run cayenne tests as part of PR CI by @sgrebnov in #9554
• Upgrade to DataFusion v52.2.0 by @lukekim in #9419
• Remove Snapshot Compaction + Add snapshot existence check by @krinart in #9523
• Update dependencies by @lukekim in #9566
• fix: Update benchmark snapshots by @app/github-actions in #9565
• fix: Compare Cayenne table configuration on startup by @peasee in #9529
• Make Refresh::refresh_sql more robust to alterations over time. by @Jeadie in #9549
• fix: Update datafusion-table-providers dependency to latest revision by @lukekim in #9574
• Unset AWS_ENDPOINT_URL when empty by @krinart in #9575
• fix: allow BytesProcessedExec repartitioning for unordered input by @lukekim in #9540
• Sanitize DataFusion errors by @lukekim in #9530
• Add conditional logging for partition assignments by @Jeadie in #9577
• use 'properly early exit on SIGTERM' by @Jeadie in #9573
• Update datafusion to 52.2.0 by @phillipleblanc in #9582
• Ensure we query one and only one partition per request by @Jeadie in #9416
• feat: Add support for Spicepod version v2 by @lukekim in #9583
• [SpiceDQ] Improve error messages; Avoid race condition on allocate_initial_partitions. by @Jeadie in #9579
• Update ballista dependencies to latest 52.0.0 revision by @lukekim in #9581
• Fix Databricks spark_connect mode always disabled by @phillipleblanc in #9586
• Support partitioning in Arrow accelerator by @Jeadie in #9571
• Fix spice query CLI response deserialization by @phillipleblanc in #9588
• fix: Update benchmark snapshots by @app/github-actions in #9584
• fix: Share RuntimeEnv across Cayenne read/write/delete paths for targeted list_files_cache invalidation by @sgrebnov in #9589
• feat: Add file:// state_location support for async queries scheduler by @phillipleblanc in #9590
• Update endgame links by @krinart in #9598
• ci: fix E2E CLI upgrade test to use latest release for spiced download by @phillipleblanc in #9613
• fix(DF): Lazily initialize BatchCoalescer in RepartitionExec to avoid schema type mismatch by @sgrebnov in #9623
• feat: Implement catalog connectors for various databases by @lukekim in #9509
• Refactor and clean up code across multiple crates by @lukekim in #9620
• fix: Improve error handling for distributed mode and state_location configuration by @lukekim in #9611
• Properly install postgres in install-postgres action by @krinart in #9629
• fix: Use Python venv for schema validation in CI by @phillipleblanc in #9637
• Update spicepod.schema.json by @app/github-actions in #9640
• Update testoperator dispatch to use release/2.0 branch by @phillipleblanc in #9641
• fix: Align CUDA asset names in Dockerfile and install tests with build output by @phillipleblanc in #9639
• Fix expect test scripts in E2E Installation AI test by @sgrebnov in #9643
• testoperator for partitioned arrow accelerator by @Jeadie in #9635
• Remove default 1s refresh_check_interval from spidapter for hive datasets by @phillipleblanc in #9645
• Fix scheduler panic and cancel race condition by @phillipleblanc in #9644
• Align Spice.ai connector parameter names across catalog/data connectors by @lukekim in #9632
• docs: update distribution details and add NAS support in release notes by @lukekim in #9650
• Enable postgres-accel in CI builds for benchmarks by @sgrebnov in #9649
• perf: Cache Turso metastore connection across operations by @penberg in #9646
• Add 'scheduler_state_location' to spidapter by @Jeadie in #9655
• Implement Cayenne S3 Express multi-zone live test with data validation by @lukekim in #9631
• chore(spidapter): bump default memory limit from 8Gi to 32Gi by @phillipleblanc in #9661
• perf: Use prepare_cached() in Turso and SQLite metastore backends by @penberg in #9662
• Improve CDC cache invalidation by @krinart in #9651
• Refactor Cayenne IDs to use UUIDv7 strings by @lukekim in #9667
• fix: add liveness check for dead executors in partition routing by @Jeadie in #9657
• fix(s3): Fix metadata column schema mismatches in projected queries by @sgrebnov in #9664
• s3_metadata_columns tests: include test for location outside table prefix by @sgrebnov in #9676
• docs: Update DuckDB, GCS, Git connector and Cayenne documentation by @lukekim in #9671
• Add s3_url_style support for S3 connector URL addressing by @phillipleblanc in #9642
• Consolidate E2E workflows and require WSL for Windows runtime by @lukekim in #9660
• Upgrade to Rust v1.93.1 by @lukekim in #9669
• Security fixes and improvements by @lukekim in #9666
• feat(flight): add DoPut rows/bytes written metrics for DoPut ETL ingestion tracking by @phillipleblanc in #9663
• Skip caching http error response + add response_headers by @krinart in #9670
• refactor: Remove v1/evals functionality by @Jeadie in #9420
• Make a test harness for Distributed Spice integration tests by @Jeadie in #9615
• Enable on_zero_results: use_source for views by @krinart in #9699
• fix(spidapter): Lower memory limit, passthrough AWS secrets, override flight URL by @peasee in #9704
• Show an error on a shared acceleration file with snapshots enabled by @krinart in #9698
• Fixes for anthropic by @Jeadie in #9707
• Use max_partitions_per_executor in allocate_initial_partitions by @Jeadie in #9659
• [SpiceDQ] Accelerations must have partition key by @Jeadie in #9711
• Upgrade to Turso v0.5 by @lukekim in #9628
• feat: Rename metadata columns to _location, _last_modified, _size by @phillipleblanc in #9712
• fix: bump datafusion-ballista to fix BatchCoalescer schema mismatch panic by @phillipleblanc in #9716
• fix: Ensure Cayenne respects target file size by @peasee in #9730
• refactor: Make DDL preprocessing generic from Iceberg DDL processing by @peasee in #9731
• [SpiceDQ] Distribute query of Cayenne Catalog to executors with data by @Jeadie in #9727
• Properly set primary_keys/on_conflict for Cayenne tables by @krinart in #9739
• Add executor resource and replica support to cloud app config by @ewgenius in #9734
• feat: Support PARTITION BY in Cayenne Catalog table creation by @peasee in #9741
• Update datafusion and related packages to version 52.3.0 by @lukekim in #9708
• Route FlightSQL statement updates through QueryBuilder by @phillipleblanc in #9754
• JSON file format improvements by @lukekim in #9743
• [SpiceDQ] Partition Cayenne catalogs writes through to executors by @Jeadie in #9737
• Update to DF v52.3.0 versions of datafusion & datafusion-tableproviders by @lukekim in #9756
• Make S3 metadata column handling more robust by @sgrebnov in #9762
• Fetch API keys from dedicated endpoint instead of apps response by @phillipleblanc in #9767
• Update arrow-rs, datafusion-federation, and datafusion-table-providers dependencies by @phillipleblanc in #9769
• Chunk metastore batch inserts to respect SQLite parameter limits by @phillipleblanc in #9770
• Improve JSON SODA support by @lukekim in #9795
• Add ADBC Data Connector by @lukekim in #9723
• docs: Release Cayenne as RC by @peasee in #9766
• cli[feat]: cloud mode to use region-specific endpoints by @lukekim in #9803
• Include updated JSON formats in HTTPS connector by @lukekim in #9800
• Flight DoPut: Partition-aware write-through forwarding by @Jeadie in #9759
• Pass through authentication to ADBC connector by @lukekim in #9801
• Move scheduler_state_location from adapter metadata to env var by @phillipleblanc in #9802
• Fix Cayenne DoPut upsert returning stale data after 3+ writes by @phillipleblanc in #9806
• Fix JSON column projection producing schema mismatch by @sgrebnov in #9811
• Fix http connector by @krinart in #9818
• Fix ADBC Connector build and test by @lukekim in #9813
• Support update & delete DML for distributed cayenne catalog by @Jeadie in #9805
• Set allow_http param when S3 endpoint uses http scheme by @phillipleblanc in #9834
• fix: Cayenne Catalog DDL requires a connected executor in distributed mode by @Jeadie in #9838
• fix: Add conditional put support for file:// scheduler state location by @Jeadie in #9842
• fix: Require the DDL primary key contain the partition key by @Jeadie in #9844
• fix: Databricks SQL Warehouse schema retrieval with INLINE disposition and async retry by @lukekim in #9846
• Filter pushdown improvements for SqlTable by @lukekim in #9852
• feat: add iam_role_source parameter for AWS credential configuration by @lukekim in #9854
• Fix ODBC queries silently returning 0 rows on query failure by @lukekim in #9864
• feat(adbc): Add ADBC catalog connector with schema/table discovery by @lukekim in #9865
• Make Turso SQL unparsing more robust and fix date comparisons by @lukekim in #9871
• Fix Flight/FlightSQL filter precedence and mutable query consistency by @lukekim in #9876
• Partial Aggregation optimisation for FlightSQLExec by @lukekim in #9882
• fix: v1/responses API preserves client instructions when system_prompt is set by @Jeadie in #9884
• feat: emit scheduler_active_executors_count and use it in spidapter by @Jeadie in #9885
• feat: Add custom auth header support for GraphQL connector by @krinart in #9899
• Add --endpoint flag to spice run with scheme-based routing by @lukekim in #9903
• When executor connects, send DDL for existing tables by @Jeadie in #9904
• fix: Improve ADBC driver shutdown handling and error classification by @lukekim in #9905
• fix: require all executors to succeed for distributed DML (DELETE/UPDATE) forwarding by @Jeadie in #9908
• fix(cayenne catalog): fix catalog refresh race condition causing duplicate primary keys by @Jeadie in #9909
• Remove Perplexity support by @Jeadie in #9910
• Fix refresh_sql support for debezium constraints by @krinart in #9912
• Implement DML for DynamoDBTableProvider by @lukekim in #9915
• chore: Update iceberg-rust fork to v0.9 by @lukekim in #9917
• Run physical optimizer on FallbackOnZeroResultsScanExec fallback plan by @sgrebnov in #9927
• Improve Databricks error message when dataset has no columns by @sgrebnov in #9928
• Delta Lake: fix data skipping for >= timestamp predicates by @sgrebnov in #9932
• fix: Ensure distributed Cayenne DML inserts are forwarded to executors by @Jeadie in #9948
• Add full query federation support for ADBC data connector by @lukekim in #9953
• Make time_format deserialization case-insensitive by @claudespice in #9955
• Hash ADBC join-pushdown context to prevent credential leaks in EXPLAIN plans by @lukekim in #9956
• fix: Normalize Arrow Dictionary types for DuckDB and SQLite acceleration by @sgrebnov in #9959
• ADBC BigQuery: Improve BigQuery dialect date/time and interval SQL generation by @lukekim in #9967
• Make BigQueryDialect more robust and add BigQuery TPC-H benchmark support by @lukekim in #9969
• fix: Show proper unauthorized error instead of misleading runtime unavailable by @lukekim in #9972
• fix: Enforce target_chunk_size as hard maximum in chunking by @lukekim in #9973
• Add caching retention by @krinart in #9984
• fix: improve Databricks schema error detection and messages by @lukekim in #9987
• fix: Set default S3 region for opendal operator and fix cayenne nextest by @phillipleblanc in #9995
• fix(PostgreSQL): fix schema discovery for PostgreSQL partitioned tables by @sgrebnov in #9997
• fix: Defer cache size check until after encoding for compressed results by @krinart in #10001
• fix: Rewrite numeric BETWEEN to CAST(AS REAL) for Turso by @lukekim in #10003
• fix: Handle integer time columns in append refresh for all accelerators by @sgrebnov in #10004
• fix: preserve s3a:// scheme when building OpenDalStorageFactory with custom endpoint by @phillipleblanc in #10006
• Fix ISO8601 time_format with Vortex/Cayenne append refresh by @sgrebnov in #10009
• fix: Address data correctness bugs found in audit by @sgrebnov in #10015
• fix(federation): fix SQL unparsing for Inexact filter pushdown with alias by @lukekim in #10017
• Improve GitHub connector ref handling and resilience by @lukekim in #10023
• feat: Add spice completions command for shell completion generation by @lukekim in #10024
• fix: Fix data correctness bugs in DynamoDB decimal conversion and GraphQL pagination by @sgrebnov in #10054
• Implement RefreshDataset for distributed control stream by @Jeadie in #10055
• perf: Improve S3 parquet read performance by @sgrebnov in #10064
• fix: Prevent write-through stalls and preserve PartitionTableProvider during catalog refresh by @Jeadie in #10066
• feat: spice completions auto-detects shell directory and writes file by @lukekim in #10068
• fix: Bug in DynamoDB, GraphQL, and ISO8601 refresh data handling by @sgrebnov in #10063
• fix partial aggregation deduplication on string checking by @lukekim in #10078
• fix: add MetastoreTransaction support to prevent concurrent transaction conflicts by @phillipleblanc in #10080
• fix: Use GreedyMemoryPool, add spidapter query memory limit arg by @phillipleblanc in #10082
• feat: Add metrics for EXPLAIN ANALYZE in FlightSQLExec by @lukekim in #10084
• Use strict cast in try_cast_to to error on overflow instead of silent NULL by @sgrebnov in #10104
• feat: Implement MERGE INTO for Cayenne catalog tables by @peasee in #10105
• feat: Add distributed MERGE INTO support for Cayenne catalog tables by @peasee in #10106
• Improve JSON format auto-detection for single multi-line objects by @lukekim in #10107
• Add mode: file_update acceleration mode by @krinart in #10108
• Coerce unsupported Arrow types to Iceberg v2 equivalents in REST catalog API by @peasee in #10109
• fix: Update default query memory limit to 90% from 70% by @phillipleblanc in #10112
• feat: Add mTLS client auth support to spice sql REPL by @lukekim in #10113
• fix(datafusion-federation): report error on overflow instead of silent NULL by @sgrebnov in #10124
• fix: Prevent data loss in MERGE when source has duplicate keys by @peasee in #10126
• feat: Add ClickHouse Date32 type support by @sgrebnov in #10132
• Add Delta Lake column mapping support (Name/Id modes) by @sgrebnov in #10134
• fix: Restore Turso numeric BETWEEN rewrite lost in DML revert by @lukekim in #10139
• fix: Enable arm64 Linux builds with fp16 and lld workarounds by @lukekim in #10142
• fix: remove double trailing slash in Unity Catalog storage locations by @sgrebnov in #10147
• fix: Improve GitHub GraphQL client resilience and performance by @lukekim in #10151
• Enable reqwest compression and optimize HTTP client settings by @lukekim in #10154
• fix: executor startup failures by @Jeadie in #10155
• feat: Distributed runtime.task_history support by @Jeadie in #10156
• fix: Preserve timestamp timezone in DDL forwarding to executors by @peasee in #10159
• feat: Per-model rate-limited concurrent AI UDF execution by @Jeadie in #10160
• fix(Turso): Reject subquery/outer-ref filter pushdown in Turso provider by @lukekim in #10174
• Fix linux/macos spice upgrade by @phillipleblanc in #10194
• Improve CREATE TABLE LIKE error messages, success output, EXPLAIN, and validation by @peasee in #10203
• fix: chunk MERGE delete filters and update Vortex for stack-safe IN-lists by @peasee in #10207
• Propagate runtime.params.parquet_page_index to Delta Lake connector by @sgrebnov in #10209
• Properly mark dataset as Ready on Scheduler by @Jeadie in #10215
• fix: handle Utf8View/LargeUtf8 in GitHub connector ref filters by @lukekim in #10217
• fix(databricks): Fix schema introspection and timestamp overflow by @lukekim in #10226
• fix(databricks): Fix schema introspection failures for non-Unity-Catalog environments by @lukekim in #10227
• feat: Add pagination support to HTTP data connector by @lukekim in #10228
• feat(databricks): DESCRIBE TABLE fallback and source-native type parsing for Lakehouse Federation by @lukekim in #10229
• fix(databricks): harden HTTP retries, compression, and token refresh by @lukekim in #10232
• feat[helm chart]: Add support for ServiceAccount annotations and AWS IRSA example by @peasee in #9833
• fix: Log warning and fall back gracefully on Cayenne config change by @krinart in #9092
• fix: Handle engine mismatch gracefully in snapshot fallback loop by @krinart in #9187
• fix: Full Text Search schema mismatch with ADBC connector by @lukekim in #10235
• docs: Update v2.0.0-rc.2 release notes with latest changes by @lukekim in #10238
• Fix append refresh dedup failure when refresh_sql selects column subset by @sgrebnov in #10225
• Revert "Properly mark dataset as Ready on Scheduler (#10215)" by @sgrebnov in #10242
• Fix failing merge conflicts for benchmarks by @krinart in #10247
• fix(github): fetch commits for dynamic and slash refs by @lukekim in #10233
• Upgrade DataFusion to v52.5.0-rc1 by @lukekim in #10249
• Merge develop to trunk (2026-04-09) by @claudespice in #10248
• fix: Validate embedding row_id columns during dataset init (fixes #8226) by @claudespice in #10208
• fix: Update tpch benchmark snapshots for federated/glue[csv].yaml by @app/github-actions in #10244
• feat(databricks): add resilience controls, UC awareness, and task history instrumentation by @lukekim in #10246
• fix: Make PartitionManager resilient to bare vs fully qualified table references by @sgrebnov in #10257
• fix: Update tpch benchmark snapshots for accelerated/s3[parquet]-cayenne[file].yaml by @app/github-actions in #10256
• Merge develop to trunk (2026-04-10) by @claudespice in #10251
• Improve Snowflake/ADBC dataset registration performance and observability by @lukekim in #10266
• Fixes for kafka connector by @krinart in #10263
• fix(runtime): gate otel code tags, suppress aws sdk noise, and unblock connector init by @lukekim in #10260
• fix(runtime): avoid regionless AWS SDK loads by @lukekim in #10271
• Add versioned release install workflow coverage by @lukekim in #10276
• fix(runtime): handle HTTP JSON unions and spicepod reloads by @lukekim in #10277
• Databricks UC permission prechecks: explicit denial as permanent error, ambiguous cases advisory by @lukekim in #10274
• Revert component status changes re-introduced by develop merge (#10248) by @sgrebnov in #10293
• Fix broken CI workflows by @ewgenius in #10294
• Group dependabot updates by ecosystem by @lukekim in #10296
• fix(tests): Replace flaky S3 Vectors snapshot tests with structural validation by @lukekim in #10301
• Update test_github_workflows snapshot by @lukekim in #10304
• fix(ci): fix Bedrock runner mismatch and snapshot auto-merge failure by @ewgenius in #10306
• feat(http): Add map-to-array conversion and query-parameter pagination by @lukekim in #10295
• New crate: datafusion-ddl by @Jeadie in #10205
• Make Databricks UC permission checks advisory with structured error reporting by @lukekim in #10283
• build(deps): bump the github-actions-dependencies group with 4 updates by @app/dependabot in #10298
• fix: Clear cached plans on view updates by @peasee in #10312
• build(deps): bump the aws-sdk group with 7 updates by @app/dependabot in #10299
• Code out of runtime. by @Jeadie in #10178
• fix: Respect function registry denies for accelerated table filter pushdown by @peasee in #10311
• fix: Don't block heartbeat when all slots acquired by @peasee in #10322
• fix: strip only outer parens in get_table_partition_expr_from_ctx by @Jeadie in #10323
• Upgrade datafusion-table-providers with MongoDB SRV support by @lukekim in #10317
• fix: Avoid pushing down bucketing partition expressions into executors by @peasee in #10324
• Upgrade datafusion-table-providers to d1b911a5 and bump adbc to 0.23 by @lukekim in #10329
• fix: Update Search integration test snapshots by @app/github-actions in #10308
• Handle foreign table + Classic sql warehouse combination gracefully by @krinart in #10318
• New crate datafusion-flightsql by @Jeadie in #10201
• Set tantivy=warn unless very verbose logging by @Jeadie in #10338
• Remove image registry and image name options from spidapter by @ewgenius in #10241
• build(deps): bump sysinfo from 0.37.2 to 0.38.4 by @app/dependabot in #10291
• build(deps): bump futures from 0.3.31 to 0.3.32 by @app/dependabot in #10289
• New crate 'datafusion-dml' by @Jeadie in #10334
• Jeadie/26 04 16/spice sql by @Jeadie in #10343
• Add Teraswitch/Pittsburgh apt mirrors + retry config for CI runners by @lukekim in #10349
• Implement sort pushdown and fix pushdown gaps across providers by @lukekim in #10337
• Merge develop to trunk (2026-04-16) by @claudespice in #10345
• Update candle and mistral.rs lock-step pins by @lukekim in #10278
• docs: fix status badges in README by @lukekim in #10350
• Migrate secrets to vars by @krinart in #10354
• Add limit pushdown and improve sort pushdown for Oracle and MSSQL by @sgrebnov in #10351
• Fix ubuntu mirror configuration by @ewgenius in #10359
• fix: Increase throughput test default ready_wait from 30s to 300s (fixes #8207) by @claudespice in #10344
• Add auth headers support to OTEL metrics exporter by @lukekim in #10347
• fix(github): shrink GraphQL page size on gateway errors; lower comment defaults by @lukekim in #10355
• Relax apt mirror substitution failure to warning in CI action by @ewgenius in #10361
• feat(http): Add OAuth2 refresh-token auth to HTTP connector by @lukekim in #10348
• Upgrade Rust toolchain to 1.94.1 by @lukekim in #10353
• Handle order by and sort in PartitionedTableScanRewrite by @Jeadie in #9656
• Fix OTEL Exporter by @krinart in #10363
• Pin spiceai candle / TEI forks to merged revs; drop local [patch] overrides by @lukekim in #10362
• Integrate spiceio and makefile_targets into pr.yml by @lukekim in #10357
• ci: skip artifact compression for test binaries/archives by @lukekim in #10381
• chore(deps): bump spiceai/candle, spiceai/mistral.rs, aws-lc-rs, tantivy, rand by @lukekim in #10379
• Bump datafusion-table-providers (#10375) by @lukekim in #10384
• fix: Update Search integration test snapshots by @app/github-actions in #10376
• v2.0.0-rc.3 preparation by @ewgenius in #10382
• fix(spicepod): JSON schema accepts string or {name: expr} for partition_by by @lukekim in #10352
• fix: Use ROUND for Turso decimal BETWEEN comparisons (fixes #9872) by @claudespice in #10360
• Revert "v2.0.0-rc.3 preparation" from trunk by @ewgenius in #10386
• Add on_schema_resolved dataset ready state by @lukekim in #10368
• feat: Add Elasticsearch data connector with hybrid search support by @lukekim in #10258
• ci: bump test archive upload compression-level to 1 by @lukekim in #10388
• feat(git-connector): promote Git connector to RC status by @lukekim in #10385
• feat(postgres): stream WAL directly to Spice accelerators by @lukekim in #10364
• Add schema decomposition to the HTTP connector by @lukekim in #10393
• fix(cayenne): Skip catalog refresh state reload for existing providers by @sgrebnov in #10396
• Make cayenne-flightsql tool by @Jeadie in #10356
• build(deps): bump the github-actions-dependencies group with 2 updates by @app/dependabot in #10398
• Update openapi.json by @app/github-actions in #10272
• Merge develop to trunk — 2026-04-19 by @claudespice in #10407
• feat(otel): default OTLP push exporter to delta temporality by @phillipleblanc in #10412
• fix: Restore analyzer rule ordering to run federation before type coercion by @sgrebnov in #10415
• fix: Map Utf8/LargeUtf8 to STRING in Databricks/Spark SQL dialects by @sgrebnov in #10420
• feat(otel): add metric name prefix at runtime.telemetry.metric_prefix by @phillipleblanc in #10418
• fix: Map LargeUtf8 to VARCHAR in Athena ODBC dialect by @sgrebnov in #10419
• feat(cluster): connector-driven object store registration on executors by @phillipleblanc in #10414
• build(deps): bump ubuntu from 22.04 to 24.04 in the docker-dependencies group by @app/dependabot in #10397
• fix: Update benchmark snapshots Apr 20 by @app/github-actions in #10417
• feat(otel): apply runtime.telemetry.properties as resource attributes on exported metrics by @phillipleblanc in #10416
• Publish RC releases to DockerHub; upgrade runners to ubuntu-24.04 by @lukekim in #10428
• feat: Add Azure Cosmos DB (NoSQL) data connector (RC) by @lukekim in #10392
• feat(datafusion): flatten_json_properties + json_tree UDTFs by @lukekim in #10406
• Harden /v1/tools and /v1/nsql against unauthenticated / LLM-driven SQL by @lukekim in #10365
• feat(embeddings): multi-vector embeddings with MaxSim + late-interaction by @lukekim in #10408
• Update GH runners for CUDA builds by @ewgenius in #10432
• fix(delta_lake): register object stores on cluster executors by @phillipleblanc in #10436
• DF-native DML by @krinart in #10327
• ci: run Build and Test on spiceai-macos; split install jobs by profile by @lukekim in #10434
• Improve search UDTFs: text_search, vector_search, rrf by @lukekim in #10387
• fix(model2vec): Improve robustness of model loading for sentence-transformers layouts by @sgrebnov in #10444
• Merge develop to trunk — 2026-04-21 by @claudespice in #10448
• Enable filter pushdown for vector_search UDTF by @sgrebnov in #10447
• Support Snowflake OBJECT, MAP, GEOGRAPHY, GEOMETRY, VECTOR, TIMESTAMP_LTZ types by @lukekim in #10451
• Fix Databricks tests by @krinart in #10449
• fix(cluster): forward register_object_stores through connector wrappers by @phillipleblanc in #10460
• Fixes for vector-search by @krinart in #10455
• Add expand_maps option and flatten_json UDTF by @lukekim in #10452
• fix: Update Search integration test snapshots by @app/github-actions in #10458
• Fix physical codec decode ambiguity for empty protobuf messages by @sgrebnov in #10466
• chore(logging): demote s3_single_file_cached skip refresh log to debug by @phillipleblanc in #10467
• Enable filter pushdown for rrf UDTF by @sgrebnov in #10465
• feat(cluster): consolidate distributed state into cluster.json by @phillipleblanc in #10463
• feat(cayenne): Add column statistics and data inlining by @lukekim in #10314
• docs(copilot): flag missing wrapper delegation when adding default trait methods by @phillipleblanc in #10461
• Wire Elasticsearch vector engine write path through acceleration by @lukekim in #10453
• Add helm lint CI by @ewgenius in #10468
• Fix Azure and GCS acceleration snapshot object store credential handling by @phillipleblanc in #10486
• Update spicepod.schema.json by @app/github-actions in #10485
• fix(secrets): harden AWS Secrets Manager secret store by @lukekim in #10478
• Update datafusion-ballista crate by @sgrebnov in #10488
• feat(secrets): add ParameterSpec and more params for AWS secrets manager by @phillipleblanc in #10487
• Add rerank UDTF for hybrid search with query auto-propagation by @lukekim in #10469
• Fix flatten_json_properties by @krinart in #10475
• fix: preserve field and schema metadata in expand_views_schema by @claudespice in #10494
• Upgrade rmcp to upstream 1.5.0; switch MCP server to Streamable HTTP by @lukekim in #10491
• fix: handle Snowflake TIMESTAMP_LTZ wire format and prevent nanosecond overflow by @claudespice in #10493
• Lint parity in Makefile by @krinart in #10492
• Add connect_timeout/client_timeout params to Databricks sql_warehouse mode by @lukekim in #10495
• fix(tracing): suppress opentelemetry INFO logs at all verbosity levels by @lukekim in #10497
• DynamoDB DML by @krinart in #10470
• feat(cayenne): native vector search via SIMD similarity UDFs by @lukekim in #10456
• fix(cli): suppress banner for all JSON-producing cloud subcommands (fixes #10498) by @claudespice in #10510
• fix(deps): bump openssl to 0.10.78 by @phillipleblanc in #10509
• fix(s3): quiet AWS SDK credential probe when no region is configured by @phillipleblanc in #10506
• fix(cdc): emit ready signal on caught-up Kafka/Debezium streams (#5201) by @phillipleblanc in #10504
• runtime-cluster crate + Run partition discovery before forwarding refresh to executors by @krinart in #10490
• Update lint-rust target to use --keep-going by @Jeadie in #10508
• Add TPC-H SF100 s3[parquet]-duckdb[file] benchmark spicepod by @lukekim in #10524
• Remove dev-profile install steps from pr.yml by @Jeadie in #10507
• fix: add missing NULL check on Timestamp path in append refresh by @claudespice in #10518
• fix: return error on Decimal128/256 overflow instead of silently dropping scale by @claudespice in #10519
• fix: delegate update and delete_from in IndexedTableProvider and EmbeddingTable by @claudespice in #10520
• feat(devx): make config errors, CLI, and REPL lead users to success by @lukekim in #10489
• fix(rerank): defer execution to RerankExec, enable filters and projection pushdown by @sgrebnov in #10514
• fix(llms): support Gemma models with missing attention_bias config field by @lukekim in #10523
• Fix vector_search silently ignoring named limit/column/include_score args by @sgrebnov in #10527
• fix: split unsupported filters locally in scan() for UseSource mode by @ewgenius in #10528
• feat(secrets): add Azure Key Vault secret store by @lukekim in #10496
• Bump mistralrs by @krinart in #10532
• Fix benchmark configurations and CI build issues by @sgrebnov in #10535
• Fix catalog query overrides for MySQL and MSSQL benchmarks by @sgrebnov in #10543
• For Cayenne, preserve matched columns for MERGE ... ON <cols> by @Jeadie in #10340
• build(deps): bump the aws-sdk group across 1 directory with 5 updates by @app/dependabot in #10538
• docs: update AI agent instructions (git workflow + Rust 1.94) by @lukekim in #10544
• fix: Update tpch benchmark snapshots by @app/github-actions in #10529
• fix: Update tpch benchmark snapshots for accelerated/s3[parquet]-duckdb[file].yaml by @app/github-actions in #10525
• Extract runtime-datafusion from runtime by @krinart in #10545
• Use generic DML extension planner for Cayenne by @Jeadie in #10437
• fix: Update Search integration test snapshots by @app/github-actions in #10552
• Fix security and correctness audit issues by @lukekim in #10526
• fix(MySQL): revert MySQL result column reorder to fix federated query failures by @sgrebnov in #10557
• Fix protoc installation by @krinart in #10566
• fix: Disable Ballista dynamic filters on HashJoinExec by @peasee in #10548
• Support views on DDL catalogs by @Jeadie in #10554
• Update datafusion by @Jeadie in #10422
• Improve full-text search indexing performance by @sgrebnov in #10464
• feat(mysql): add mysql_zero_date_behavior parameter (null|error) by @phillipleblanc in #10573
• fix(snowflake): declare private_key in connector PARAMETERS (fixes #10517) by @claudespice in #10559
• Honour CARGO_TARGET_DIR in Makefiles by @Jeadie in #10569
• Enable cosine_distance pushdown to DuckDB accelerator via array_cosine_distance by @sgrebnov in #10564
• fix: Update test snapshots by @app/github-actions in #10570
• fix: Update tpch benchmark snapshots by @app/github-actions in #10560
• feat(snapshots): make snapshots an optional feature by @phillipleblanc in #10574
• Enforce read-only API key restrictions on Flight DoGet and async query paths by @Jeadie in #10551
• Improved security posture on Github workflows by @Jeadie in #10556
• fix: Update datafusion-table-providers to improve SqlTable filter pushdown by @sgrebnov in #10595
• feat(secrets): add HashiCorp Vault secret store by @phillipleblanc in #10561
• fix: delegate update() in UpsertDedupTableProvider to inner provider by @claudespice in #10593
• Add DuckDB vector engine support by @lukekim in #10562
• Sharepoint - add object-store listing connector with expanded auth and write support by @lukekim in #10473
• fix: Install protoc from source by @peasee in #10597
• Enable DML support for PostgreSQL data connector by @phillipleblanc in #10446
• feat(postgres): support inline PEM sslrootcert by @claudespice in #10578
• Add foreign key metadata discovery to PostgreSQL Catalog by @sgrebnov in #10849
• Add Snowflake DML support by @lukekim in #10747
• Add MongoDB Change Streams support by @lukekim in #10813
• Add user-defined functions by @lukekim in #10571
• Add table user functions and gate HTTP servers by @lukekim in #10675
• feat: add on-demand dataset loading by @phillipleblanc in #10629
• feat(runtime): declared-schema deferred datasets by @phillipleblanc in #10669
• feat(spicepod, runtime): add columns[].type / nullable + lenient type parser by @phillipleblanc in #10661
• Replace external smb crate with internal SMB 3.1.1 client by @phillipleblanc in #10516
• Add unified query cancellation across all paths by @lukekim in #10390
• Add dynamic HTTP request headers by @lukekim in #10604
• feat(http): Support dynamic HTTP connector request params from subqueries by @lukekim in #10636
• feat(http): pass through HTTP metadata columns with JSON schema decomposition by @lukekim in #10679
• Add nolimit HTTP pagination max pages by @lukekim in #10673
• Add shared HTTP rate control for connectors by @lukekim in #10648
• Use origin label instead of name for HTTP rate control metrics by @lukekim in #10689
• fix(http): reject OR across different HTTP filter columns by @lukekim in #10625
• Add provider-aware LLM prompt caching by @lukekim in #10645
• Add searchable registry mode for LLM tools by @lukekim in #10647
• feat: refresh_mode: snapshot + SQLite/Turso WAL flush + Cayenne metastore slice by @phillipleblanc in #10651
• feat: per-principal cache namespacing for SQL/search/caching-accelerator by @lukekim in #10702
• Add self-hosted Spice connector support by @phillipleblanc in #10546
• Add Delta Lake Azure tenant parameter by @phillipleblanc in #10671
• Support OAuth2 client credentials in 'spice cloud login' by @ewgenius in #10586
• Add configurable allowed_hosts for MCP by @lukekim in #10638
• fix: make Helm chart probes configurable by @peasee in #10696
• Strip high-cardinality datasets dim from anonymous telemetry by @lukekim in #10711
• feat(elasticsearch): direct FTS engine config + index lifecycle and ingestion controls by @lukekim in #10672
• Add DuckDB HNSW vector index support for accelerated views by @sgrebnov in #10695
• Rewrite DuckDB vector search SQL to activate HNSW_INDEX_SCAN by @sgrebnov in #10674
• Fix DuckDB HNSW vector indexes lost after data refresh by @sgrebnov in #10668
• Fix DuckDB DELETE/UPDATE on full and caching refresh mode datasets by @phillipleblanc in #10632
• Fix DuckLake connector: downcast, module registration, schema discovery, and S3 credentials by @sgrebnov in #10650
• Fix federation pushing denied functions inside subqueries to remote engines by @phillipleblanc in #10692
• fix(caching): honour refresh_on_startup: always in caching mode by @phillipleblanc in #10594
• fix(iceberg): rebuild storage factory when Hadoop catalog scheme is inferred by @sgrebnov in #10601
• Pipeline CDC ingestion: overlap source reads with batch apply by @lukekim in #10676
• fix: add NULL check to CDC primary key extraction by @lukekim in #10684
• Properly handle nullability during CDC processing by @krinart in #10803
• Flatten scheduler config and rename partition management → partition assignment by @lukekim in #10450
• Improve NSQL UX and harden internal LLM tools by @lukekim in #10715
• Support Responses API across model providers by @lukekim in #10724
• Update xAI default model and handle Grok model retirements by @Jeadie in #10723
• Improve cli table layout by @krinart in #10725
• TLS cert hot-reload (mTLS plan M1) by @phillipleblanc in #10727
• Fix DuckLake catalog include filter being ignored by @phillipleblanc in #10738
• Promote DuckLake Catalog and Data Connector to Beta quality by @sgrebnov in #10743
• feat(ducklake): Support INSERT on catalog tables with read_write access by @sgrebnov in #10744
• perf(cdc): coalesce envelopes and overlap commits in apply pipeline by @lukekim in #10745
• feat: Allow full version tags in spicepod version by @peasee in #10748
• Add Arrow primary key upserts by @lukekim in #10749
• fix(snapshot): keep refresh_mode snapshot read-only by @phillipleblanc in #10752
• feat(tls): public mTLS for HTTP and Flight (channel + identity modes) by @phillipleblanc in #10753
• perf(cayenne): lock-free deletion caches with bloom-prefiltered probe by @lukekim in #10756
• fix(security): close API key timing-position leak and remote-UDF SSRF by @lukekim in #10757
• Fix 'wait_until_dependent_tables_are_ready' for catalogs by @phillipleblanc in #10758
• Fixes for views and resolved tables on 'spice refresh' CLI by @phillipleblanc in #10759
• Implement FlightSQL CommandStatementSubstraitPlan support by @lukekim in #10761
• feat(connectors): mTLS client cert support for flightsql and spiceai connectors by @phillipleblanc in #10764
• Allow arbitrary filenames when specifying spicepod path + kind validation by @krinart in #10777
• fix: ignore field metadata in schema compatibility check in index_table_scan by @Jeadie in #10778
• Display pushed-down limits in EXPLAIN TREE output by @lukekim in #10779
• fix: enable streaming append for Kafka with Cayenne accelerator by @lukekim in #10780
• fix: bound chunked-index intermediate batch size to prevent OOM by @phillipleblanc in #10783
• fix: label all columns in spice cloud metrics table output by @claudespice in #10784
• fix: use checked arithmetic for Turso integer-millis timestamp read path by @claudespice in #10786
• fix: use checked arithmetic in timestamp-to-nanosecond conversions by @claudespice in #10666
• Upgrade to DuckDB v1.5.2 by @sgrebnov in #10788
• Improve CDC ingestion performance by @lukekim in #10789
• Fix tool_search/tool_invoke spans by @lukekim in #10791
• Add Cayenne inline mutations and benchmark coverage by @lukekim in #10792
• Ensure we always resolve table names in distributed mode/metadata by @Jeadie in #10793
• Remove permanent errors from DynamoDB Streams by @krinart in #10794
• Add expanded view mode for wide table display in SQL REPL by @lukekim in #10797
• Fix Cayenne CDC schema mismatch error by @sgrebnov in #10800
• Executors should create catalog tables on join by @Jeadie in #10807
• Add compressed file support for listing connectors by @lukekim in #10809
• Improve Cayenne mutation, scan, and inline memtable scaling by @lukekim in #10811
• Add range fallback for large join filters by @lukekim in #10816
• Improve Cayenne join filter pushdown by @lukekim in #10818
• Synchronize Cayenne partition commits across partitions by @phillipleblanc in #10819
• fix: Deny nondistributed cayenne catalog by @peasee in #10821
• Enable parallel Cayenne Vortex writes by @lukekim in #10822
• Expand Arrow type handling in formatting and Elasticsearch by @lukekim in #10825
• Add response.output_text.delta to responses API by @krinart in #10828
• feat(cayenne): add join filter propagation and no-spill Q21 planning by @lukekim in #10840
• Upgrade Turso to v0.6.0 by @sgrebnov in #10843
• feat(cli): add spice feedback command to open community Slack by @lukekim in #10856
• Upgrade iceberg to v0.9.1 by @sgrebnov in #10859
• feat(cluster): per-request executor readiness gate on /v1/ready by @phillipleblanc in #10860
• fix: Require dim-side statistics for CayennePropagateFilterAcrossEquiJoinKeys by @sgrebnov in #10863
• fix: Debezium schema evolution breaks dataset init on reload by @claudespice in #10144
• fix(mssql): Push topK limit to SQL Server for non-nullable sort columns by @Jeadie in #10621
• fix(ScyllaDB): disable physical filter pushdown by @sgrebnov in #10772
• fix: handle typed NULLs and prevent overflow in DynamoDB DML type conversions by @krinart in #10511
• fix: use InsertOp::Overwrite in DynamoDB bootstrap scan_and_overwrite_accelerator by @krinart in #10639
• Improve DynamoDB Bootstrap performance by @krinart in #10616
• fix: preserve field and schema metadata in Vortex type transformation by @lukekim in #10628
• fix: GH connector - explicitly use AWS LC RS crypto provider for jwt by @phillipleblanc in #10619
• fix: add snapshot mode guards to delete_from/update and delegate DML in SwappableTableProvider by @phillipleblanc in #10685
• Persist HTTP rate-control state in object storage by @lukekim in #10697
• Rate limit metrics HTTP endpoint by @lukekim in #10162
• feat(geo): add optional spatial SQL UDF support by @lukekim in #10833
• feat(cayenne): CDC throughput, compaction, scan caching, and benchmarks by @lukekim in #10852
• fix(cayenne): fix Vortex panic on highly compressible data by @sgrebnov in #10855
• fix(cayenne): Read live protected snapshots after cleanup grace period by @sgrebnov in #10901
• fix: Disable Cayenne HashJoin rewriter optimizer by @sgrebnov in #10882
• Fix GetFlightInfo vs DoGet Flight Schema by @krinart in #10864
• fix(search): preserve column casing in /v1/search primary key plumbing by @claudespice in #10909
• fix(object-store): dedupe s3 url style auto-detection log by @phillipleblanc in #10898
• Improve Spice CLI manifest editing and direct command modes by @lukekim in #10815
• Persist Kafka CDC offsets in sidecar tables by @lukekim in #10823
• feat(task-history): record Ballista stages for distributed queries by @phillipleblanc in #10831
• Add '#[deny(clippy::missing_trait_methods)]' to wrapper/delegation trait impls by @Jeadie in #10795
• Optimize Cayenne catalog maintenance paths by @lukekim in #10904
• Centralize DuckDB settings for accelerator by @ewgenius in #10895
• deps(ballista): bump to 47e2b494 to fix S3 shuffle reads under cluster mode by @phillipleblanc in #10910
• Authorization header + Bump async-openai + responses_adapter fix by @krinart in #10911
• Tune accelerators by storage profile by @lukekim in #10913
• feat: add dataset-level on_schema_change config by @lukekim in #10908
• Handle NULL sentinel for nullable partition expressions by @Jeadie in #10880
• fix: Remove Cayenne Catalog from catalog registration by @peasee in #10914
• Add catalog name to foreign key metadata in postgres catalog by @Jeadie in #10917
• Cayenne perf: eliminate redundant clones, PK point-lookup fanout fix, IN-list rewrite + microbench coverage by @lukekim in #10916
• fix(turso-shared): retry on Turso BEGIN CONCURRENT "Write-write conflict" by @lukekim in #10946
• Vendor Vortex DataFusion for Cayenne by @lukekim in #10933
• perf(cayenne): background retention + enable CDC pipelining for retention-configured tables by @lukekim in #10936
• feat(cayenne): scale metastore pool to 32 + vs_duckdb_scaling benches (1→128 concurrency, sqlite + turso lanes) by @lukekim in #10943
• feat(mcp): support auth for streamable HTTP tools by @phillipleblanc in #10927
• Explicit error if v1/search requests a table without search index by @Jeadie in #10968
• Fix spicepod loading failure when directory name contains dots by @sgrebnov in #10958
• Extend append tests with arrow engine configurations by @sgrebnov in #10959
• Remove dataset on_schema_change Policy from rc.5 release notes by @sgrebnov in #10964
• Skip tpcds_q78 for Cayenne engine at SF100 by @sgrebnov in #10966
• fix: Update benchmark snapshots May-20 by @app/github-actions in #10952
• Fix #10951: UdtfExec invariant Vec lengths must match children count by @phillipleblanc in #10953
• docs(release): update v2.0.0-rc.5 notes with latest trunk PRs by @lukekim in #10949
• Remove eval related things for v2.0.0 by @Jeadie in #10945
• build(deps): bump ubuntu from 24.04 to 26.04 in the docker-dependencies group by @app/dependabot in #10883
• fix: Add publish = false to chbench-driver by @sgrebnov in #10939
• [Bug] Timing between reconnect and AllocateInitialPartitions leaves connection without flight_sql_client by @Jeadie in #10805
• Fix: refresh_mode: snapshot reports Ready with empty data when no snapshot exists by @sgrebnov in #10979
• fix(cluster): gate scheduler readiness on executor partition loads by @phillipleblanc in #10992
• fix: handle EXISTS/NOT EXISTS subqueries in federation analyzer by @sgrebnov in #10996
• Refactor spice dataset configuration command by @Jeadie in #10999
• fix: preserve field and schema metadata in Vortex physical schema calculation by @claudespice in #11013
• fix: validate Snowflake account identifiers and auth config by @Jeadie in #11024
• Fix Unity Catalog connector deserialization failure with OSS Unity Catalog by @ewgenius in #11026
• feat(cayenne): allow inline writes with pending deletions (deletes/upserts) by @sgrebnov in #11031
• Expose metadata descriptions via PostgreSQL UDFs by @lukekim in #11032
• Remove default runtime features - enable explicitly in spiced by @phillipleblanc in #11037
• feat(cayenne): fast-path CDC deletes by extracting PK values from filters by @sgrebnov in #11049
• Cayenne optimizer rules: auto relevance test for q21-shape (all-Cayenne CH-Bench) and runtime rule selection by @lukekim in #11050
• refactor(cdc): reduce CDC sub-batch splits for interleaved upsert/delete workloads by @sgrebnov in #11051
• fix(snowflake): enforce function deny-list in federation pushdown by @claudespice in #11057
• fix(mcp): trace external server tool calls in task history by @ewgenius in #11058
• perf(cdc): Last-write-wins dedup in group_into_sub_batches to reduce sub-batch splits by @sgrebnov in #11059
• PM edits to v2.0.0-rc5 by @lukekim in #11067
• fix(snowflake): wire deny-list in extracted connector crate (#10703) by @claudespice in #11071
• perf(cayenne): keep CDC upsert PK keysets resident to avoid per-batch full-table rebuilds by @lukekim in #11074
• Fix metadata on search indexing by @Jeadie in #11080
• feat(cayenne): merge-on-read position deletes for PK upsert tables + memory-pool accounting by @lukekim in #11085
• perf(cayenne): scale CDC inline flush caps with memory + storage class by @lukekim in #11087
• feat(cluster): report per-executor table statistics so distributed JoinSelection can size joins by @phillipleblanc in #11089
• Improve Cayenne CDC write and compaction path tracing by @sgrebnov in #11091
• Support tuple-IN composite PK extraction in Cayenne delete fast-path by @sgrebnov in #11093
• feat(cluster): NDV-aware executor stats so CDC q18 join swap fires by @phillipleblanc in #11098
• feat(cayenne): maintain join-sizing stats on the write path by @phillipleblanc in #11104
• fix(cache): run periodic moka maintenance for idle caches by @phillipleblanc in #11106
• Upgrade to DuckDB 1.5.3 + statically link the VSS (HNSW) extension by @sgrebnov in #11107
• Fix fetched_at for HTTP connector by @Jeadie in #11116
• fix(cayenne): tombstone inline-checkpointed rows on upsert to prevent duplicate PKs by @sgrebnov in #11129
• feat: dedicated compaction runtime for Cayenne + CDC pipelining, protected snapshots, and test coverage by @lukekim in #11130
• Add datasets dimension to the query_executions metric by @phillipleblanc in #11138
• Fix #11137: localpod child not tracking parent refreshes with in-memory (arrow) parent accelerator by @phillipleblanc in #11139
• Fix Windows build: vendor the VSS extension (drop nested submodule) by @phillipleblanc in #11140
• fix(spiceai): keep correlated subqueries out of JOIN ON for Spice Cloud federation by @phillipleblanc in #11143
• Refactor spice dataset configuration command by @Jeadie in #10999
• feat(cayenne): sharded parallel Vortex encode with key/time clustering by @lukekim in #11144
• fix(cluster): prevent DoPut write pipeline self-deadlock under ingest backpressure by @phillipleblanc in #11160
• fix(cayenne): only warn on genuine protected-snapshot amplification by @lukekim in #11158

Full Changelog: https://github.com/spiceai/spiceai/compare/v1.11.6...v2.0.0

Spice v2.0-rc.5 is now available! 🔥

v2.0.0-rc.5 is the fifth release candidate for advanced testing of v2.0, building on v2.0.0-rc.4.

This release completes the mTLS implementation across server endpoints and outbound connectors, adds MongoDB Change Streams and durable Kafka offset persistence as new CDC sources, expands DML write-back to PostgreSQL, Snowflake, and Arrow, promotes DuckLake to Beta, introduces user-defined functions, on-demand dataset loading, unified query cancellation, dynamic HTTP request headers and subquery-driven request parameters, provider-aware LLM prompt caching, and a long list of Cayenne performance improvements.

Highlights in this release candidate include:

• Spice Cayenne — CDC throughput, compaction and scan caching, synchronized partition commits, join filter propagation, parallel Vortex writes, lock-free deletion caches
• Mutual TLS (mTLS) — TLS cert hot-reload, public mTLS for HTTP and Flight (channel + identity modes), mTLS client certs for FlightSQL and Spice.ai connectors
• MongoDB Change Streams — native real-time CDC for MongoDB, no Debezium or Kafka required
• Kafka CDC offsets — offsets persisted in sidecar tables for durable, resumable Kafka CDC
• PostgreSQL DML — INSERT, UPDATE, DELETE write-back on PostgreSQL datasets
• Snowflake DML — INSERT, UPDATE, DELETE write-back on Snowflake datasets
• Arrow Primary Key Upserts — native upsert path using primary key matching
• DuckLake promoted to Beta — with INSERT support on catalog tables
• User-Defined Functions — define SQL UDFs in spicepods, plus remote UDFs over HTTP (Spice.ai Enterprise)
• Spatial SQL UDFs — optional geospatial UDFs (ST_*) for geometry workloads
• On-Demand Dataset Loading — datasets can be deferred and loaded on first reference
• Unified Query Cancellation — Ctrl-C and HTTP request cancellation propagate across all execution paths
• Dynamic HTTP Connector — pass-through request headers, subquery-driven params, and JSON schema decomposition
• HTTP Rate-Control persistence — rate-limit state persisted in object storage across restarts
• refresh_mode: snapshot — point-in-time snapshot acceleration with SQLite/Turso WAL flushing
• Storage-profile accelerator tuning — accelerators auto-tune defaults based on local SSD, EBS-class disk, or tmpfs
• Provider-Aware LLM Prompt Caching — automatic prompt caching for OpenAI-compatible providers that support it
• Responses API — support across all model providers with streaming response.output_text.delta, plus Authorization: Bearer header support

What's New in v2.0.0-rc.5​

Cayenne Improvements​

Significant performance work across Spice Cayenne-backed catalogs and accelerators.

• Ingest throughput: End-to-end improvements to CDC ingest, background compaction, and a new scan-result cache for hot reads; parallel Vortex partition writes; lock-free deletion caches with bloom-prefiltered probes; background retention with CDC pipelining; SQLite metastore pool scaled to 32 for high-concurrency mutation workloads.
• Data inlining: Small writes are serialized as Arrow IPC and committed directly into the Cayenne metastore (cayenne_inlined_data), bypassing the staged Vortex write path for low-latency ingest. Inline upserts atomically rewrite existing inline rows instead of emitting side delete markers, and inline data remains query-visible via an in-memory union scan with a generation-keyed decode cache. Inline rows are checkpointed to Vortex when row, segment, or byte thresholds are reached. Defaults are refresh-mode aware: inline writes are enabled by default for high-frequency caching, changes, and fast append workloads and disabled for full, snapshot, and slower append.
• Query planning: Join filter propagation across equi-join keys (gated behind runtime.params.cayenne_filter_propagation), range fallback for large join filters, hot-path clone elimination, and IN-list rewrites for large filter lists.
• Correctness: Synchronized partition commits across partitions, correct NULL-sentinel handling for nullable partition expressions (e.g. bucket(N, col)), Vortex panic fix on highly compressible data, and live reads through expired protected snapshots.
• Catalog and platform: Refresh-mode-aware compaction defaults, rejection of non-distributed Cayenne catalog configurations, and a vendored Vortex DataFusion integration for faster iteration on the Cayenne planner.

Mutual TLS (mTLS)​

Spice.ai Enterprise feature. See Enterprise Security.

Spice now supports full mutual TLS for both HTTP and Arrow Flight endpoints.

TLS cert hot-reload (#10727): The Spice runtime watches for SIGHUP and reloads TLS certificates without restarting, enabling cert rotation with zero downtime.

Public mTLS for HTTP and Flight (#10753): Two client_auth_mode values control how the server handles client certificates:

• request — optional mTLS: the server requests a client cert but accepts connections without one (useful for migration windows).
• required — strict mTLS: the server requires a valid client cert signed by the configured CA.

mTLS client certs for FlightSQL and Spice.ai connectors (#10764): Outbound connections from the FlightSQL and Spice.ai data connectors can now present client certificates for mutual authentication with upstream services.

Example configuration:

runtime:
  tls:
    enabled: true
    certificate_file: /etc/spice/tls/server.crt
    key_file: /etc/spice/tls/server.key
    client_auth_mode: required
    client_auth_ca_file: /etc/spice/tls/client-ca.crt

MongoDB Change Streams​

MongoDB datasets configured with refresh_mode: changes now stream changes from MongoDB Change Streams into any local accelerator (#10813), providing real-time CDC without Debezium or Kafka.

Example configuration:

datasets:
  - from: mongodb:my_collection
    name: my_collection
    params:
      host: my-cluster.mongodb.net
      db: mydb
    acceleration:
      enabled: true
      engine: duckdb
      refresh_mode: changes

CDC Improvements​

See Change Data Capture (CDC) for an overview of CDC in Spice.

• Kafka CDC offset persistence (#10823): Kafka CDC offsets are persisted in sidecar tables for durable, resumable streams. On restart or failover, Spice resumes from the last committed offset.
• Pipelined CDC ingestion (#10676): Source reads overlap with batch apply, with additional batching, envelope coalescing, and nullability propagation improvements across the apply pipeline.
• Debezium schema evolution fix (#10144): Schema changes in Debezium-sourced datasets no longer break dataset initialization on reload (fixes #9782).

PostgreSQL DML Support​

The PostgreSQL data connector now supports write-back via INSERT, UPDATE, and DELETE operations (#10446). Combined with the existing read-side federation, PostgreSQL-backed datasets can serve as full read/write tables. The PostgreSQL Catalog connector additionally exposes foreign-key metadata for NSQL and query planning (#10849).

Snowflake DML Support​

The Snowflake data connector now supports write-back via INSERT, UPDATE, and DELETE operations (#10747), complementing its existing read capabilities.

Arrow Primary Key Upserts​

Arrow-accelerated tables now support native upsert operations using primary key matching (#10749), providing efficient update-or-insert semantics for in-memory datasets.

DuckLake Promoted to Beta​

The DuckLake Catalog and Data Connector are promoted to Beta quality (#10743).

DuckLake catalog tables with read_write access now support INSERT operations (#10744), enabling full read/write workflows against DuckLake-backed catalogs. The DuckLake connector also gains a series of correctness fixes for downcast, module registration, schema discovery, and S3 credentials (#10650).

User-Defined Functions​

Spice now supports user-defined functions (UDFs) as a first-class spicepod component (#10571), letting you define reusable SQL functions in the spicepod or invoke remote functions over HTTP. The runtime also gains table user functions with HTTP server gating (#10675).

A security fix closes a remote-UDF SSRF vector (#10757).

Spatial SQL UDFs​

Spice now ships an optional set of geospatial SQL UDFs (ST_*) for geometry workloads (#10833). The functions are gated behind a build feature and can be invoked from any SQL surface.

On-Demand Dataset Loading​

Datasets can now be marked for on-demand loading (#10629). Deferred datasets are registered with a declared schema at startup (#10669) and only fully resolve when first referenced, reducing startup time and memory footprint for spicepods with many seldom-used datasets.

Spicepods also gain columns[].type and columns[].nullable (#10661) with a lenient type parser for declaring schemas inline.

Unified Query Cancellation​

All query execution paths — HTTP, Flight, FlightSQL, MCP, and internal — now honour a unified cancellation signal (#10390). When a client disconnects, presses Ctrl-C in the REPL, or cancels an in-flight HTTP request, the corresponding query is cancelled end-to-end, freeing resources promptly.

Dynamic HTTP Connector​

The HTTP data connector gains dynamic request headers parameterised from query predicates (#10604), subquery-driven request parameters for fan-out queries (#10636), HTTP response metadata as queryable columns via JSON schema decomposition (#10679), no-limit pagination (#10673), and shared rate-control across HTTP-based connectors using the same backend host (#10648).

HTTP Rate-Control Persistence​

The HTTP rate-control state (per-endpoint throttle counters) is now persisted in object storage (#10697), ensuring rate limits survive restarts and are consistent across replicas. Rate-control metrics now use an origin label rather than the connector name for cleaner aggregation (#10689).

The metrics HTTP endpoint (/metrics) is also independently rate-limited (#10162) to prevent scraping from impacting query serving.

refresh_mode: snapshot​

Spice.ai Enterprise feature. See Acceleration Snapshots.

A new refresh_mode: snapshot provides point-in-time snapshot acceleration (#10651), with SQLite and Turso WAL flushing and a Cayenne metastore slice integration so accelerated readers see a consistent snapshot while writes continue.

Storage-Profile Accelerator Tuning​

Acceleration configs gain a new storage_profile field (#10913) with values auto (default), local_ssd, ebs, and tmpfs. Under auto, the runtime detects whether the acceleration store is backed by local SSD, EBS-class network disk, or tmpfs, and applies storage-aware defaults across DuckDB, partitioned DuckDB, SQLite, Turso, and Cayenne file-mode accelerators. Explicit per-accelerator parameters always override the profile defaults.

Provider-Aware LLM Prompt Caching​

LLM calls automatically use provider-aware prompt caching (#10645) when the configured model provider supports it (e.g., Anthropic, OpenAI). System prompts and tool descriptions are marked for caching so repeated invocations within the cache window reuse the provider-side cached prefix, reducing latency and cost.

A new searchable registry mode for LLM tools (#10647) lets agents discover tools by semantic search rather than enumerating all tools in the system prompt, which scales to large tool inventories.

Responses API Improvements​

The Responses API is now supported across all configured model providers (#10724). Streaming delta events via response.output_text.delta are also supported (#10828). The runtime now also accepts Authorization: Bearer headers in addition to x-api-key, bumps async-openai, and stops populating FunctionToolCall.id so OpenAI-compatible servers can assign the ID themselves (#10911).

Distributed Cluster Improvements​

Spice.ai Enterprise feature. See High Availability.

• Per-request executor readiness gate (#10860): /v1/ready on schedulers waits for a configurable quorum of executors before returning healthy, enabling proper rolling deployments.
• Ballista S3 shuffle reads under cluster mode (#10910): The shuffle reader builds its S3 client from the executor pod's environment, matching the writer. Async queries with runtime.params.shuffle_location: s3://... now complete instead of failing with AccessDenied on shuffle fetches.
• Flattened scheduler config (#10450): runtime.scheduler.partition_management.* fields are flattened directly onto runtime.scheduler and renamed under the canonical "partition assignment" terminology. See Breaking Changes.

Caching & Search​

Improvements across Caching and Search:

• Per-principal cache namespacing (#10702): SQL, search, and caching-accelerator caches are now namespaced per authenticated principal, so cached results never cross identity boundaries.
• DuckDB HNSW vector indexes (#10695, #10674, #10668): DuckDB-accelerated views support HNSW vector indexes for vector search, vector search SQL is rewritten to activate HNSW_INDEX_SCAN, and HNSW indexes are preserved across data refresh.

Security Improvements​

See Authentication and TLS for configuring Spice security.

• API key timing-position leak and remote-UDF SSRF (#10757): Closed a timing-based position-disclosure leak in API key comparison and blocked SSRF via remote UDF endpoint parameters.
• Configurable allowed_hosts for MCP (#10638): MCP servers can be restricted to an explicit allowlist of upstream hosts.

SQL, Query, and Developer Experience​

See the SQL Reference for the full SQL surface area.

• SQL REPL expanded view (#10797): Toggle \x in the REPL for a vertical key-value layout on wide result sets.
• FlightSQL Substrait plan support (#10761): The Spice runtime now implements CommandStatementSubstraitPlan, enabling clients that submit plans as Substrait-encoded protobuf.
• MCP auth for streamable HTTP tools (#10927): Streamable HTTP MCP tools support native authentication via mcp_auth_token and mcp_headers, both with full Spice secret expansion.
• Elasticsearch FTS engine config and index lifecycle (#10672): Direct FTS engine configuration plus index lifecycle and ingestion controls for the Elasticsearch connector.
• Self-hosted Spice connector (#10546): Connect Spice to another self-hosted Spice runtime as a federated source.

Connector Bug Fixes​

Notable correctness fixes across the Data Connectors: DynamoDB Streams retry on transient errors (#10794) and typed-NULL handling in DML (#10511); ScyllaDB physical filter pushdown disabled to fix incorrect results (#10772); MSSQL TOP N pushdown for non-nullable sort columns (#10621); DuckLake include filter applied (#10738); DuckDB DELETE/UPDATE on full and caching refresh modes (#10632); checked arithmetic for Turso integer-millis and timestamp-to-nanosecond conversions (#10786, #10666); and Flight GetFlightInfo/DoGet schema parity (#10864). See the Changelog for the full list.

Dependency Updates​

Contributors​

• @ewgenius
• @Jeadie
• @krinart
• @lukekim
• @peasee
• @phillipleblanc
• @sgrebnov

Breaking Changes​

Flattened runtime.scheduler configuration (#10450): The nested runtime.scheduler.partition_management block has been flattened and renamed to use the canonical "partition assignment" terminology. Migrate as follows:

# Before
runtime:
  scheduler:
    partition_management:
      interval: 30s
      max_assignments_per_cycle: 16
      discovery_timeout: 10s

# After
runtime:
  scheduler:
    partition_assignment_interval: 30s
    max_assignments_per_interval: 16
    partition_discovery_timeout: 10s

Cookbook Updates​

No new cookbook recipes.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading​

To upgrade to v2.0.0-rc.5, use one of the following methods:

CLI:

spice upgrade v2.0.0-rc.5

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:2.0.0-rc.5 image:

docker pull spiceai/spiceai:2.0.0-rc.5

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 2.0.0-rc.5

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed​

Changelog​

• Enable DML support for PostgreSQL data connector by @phillipleblanc in #10446
• feat(postgres): support inline PEM sslrootcert by @claudespice in #10578
• Add foreign key metadata discovery to PostgreSQL Catalog by @sgrebnov in #10849
• Add Snowflake DML support by @lukekim in #10747
• Add MongoDB Change Streams support by @lukekim in #10813
• Add user-defined functions by @lukekim in #10571
• Add table user functions and gate HTTP servers by @lukekim in #10675
• feat: add on-demand dataset loading by @phillipleblanc in #10629
• feat(runtime): declared-schema deferred datasets by @phillipleblanc in #10669
• feat(spicepod, runtime): add columns[].type / nullable + lenient type parser by @phillipleblanc in #10661
• Replace external smb crate with internal SMB 3.1.1 client by @phillipleblanc in #10516
• Add unified query cancellation across all paths by @lukekim in #10390
• Add dynamic HTTP request headers by @lukekim in #10604
• feat(http): Support dynamic HTTP connector request params from subqueries by @lukekim in #10636
• feat(http): pass through HTTP metadata columns with JSON schema decomposition by @lukekim in #10679
• Add nolimit HTTP pagination max pages by @lukekim in #10673
• Add shared HTTP rate control for connectors by @lukekim in #10648
• Use origin label instead of name for HTTP rate control metrics by @lukekim in #10689
• fix(http): reject OR across different HTTP filter columns by @lukekim in #10625
• Add provider-aware LLM prompt caching by @lukekim in #10645
• Add searchable registry mode for LLM tools by @lukekim in #10647
• feat: refresh_mode: snapshot + SQLite/Turso WAL flush + Cayenne metastore slice by @phillipleblanc in #10651
• feat: per-principal cache namespacing for SQL/search/caching-accelerator by @lukekim in #10702
• Add self-hosted Spice connector support by @phillipleblanc in #10546
• Add Delta Lake Azure tenant parameter by @phillipleblanc in #10671
• Support OAuth2 client credentials in 'spice cloud login' by @ewgenius in #10586
• Add configurable allowed_hosts for MCP by @lukekim in #10638
• fix: make Helm chart probes configurable by @peasee in #10696
• Strip high-cardinality datasets dim from anonymous telemetry by @lukekim in #10711
• feat(elasticsearch): direct FTS engine config + index lifecycle and ingestion controls by @lukekim in #10672
• Add DuckDB HNSW vector index support for accelerated views by @sgrebnov in #10695
• Rewrite DuckDB vector search SQL to activate HNSW_INDEX_SCAN by @sgrebnov in #10674
• Fix DuckDB HNSW vector indexes lost after data refresh by @sgrebnov in #10668
• Fix DuckDB DELETE/UPDATE on full and caching refresh mode datasets by @phillipleblanc in #10632
• Fix DuckLake connector: downcast, module registration, schema discovery, and S3 credentials by @sgrebnov in #10650
• Fix federation pushing denied functions inside subqueries to remote engines by @phillipleblanc in #10692
• fix(caching): honour refresh_on_startup: always in caching mode by @phillipleblanc in #10594
• fix(iceberg): rebuild storage factory when Hadoop catalog scheme is inferred by @sgrebnov in #10601
• Pipeline CDC ingestion: overlap source reads with batch apply by @lukekim in #10676
• fix: add NULL check to CDC primary key extraction by @lukekim in #10684
• Properly handle nullability during CDC processing by @krinart in #10803
• Flatten scheduler config and rename partition management → partition assignment by @lukekim in #10450
• Improve NSQL UX and harden internal LLM tools by @lukekim in #10715
• Support Responses API across model providers by @lukekim in #10724
• Update xAI default model and handle Grok model retirements by @Jeadie in #10723
• Improve cli table layout by @krinart in #10725
• TLS cert hot-reload (mTLS plan M1) by @phillipleblanc in #10727
• Fix DuckLake catalog include filter being ignored by @phillipleblanc in #10738
• Promote DuckLake Catalog and Data Connector to Beta quality by @sgrebnov in #10743
• feat(ducklake): Support INSERT on catalog tables with read_write access by @sgrebnov in #10744
• perf(cdc): coalesce envelopes and overlap commits in apply pipeline by @lukekim in #10745
• feat: Allow full version tags in spicepod version by @peasee in #10748
• Add Arrow primary key upserts by @lukekim in #10749
• fix(snapshot): keep refresh_mode snapshot read-only by @phillipleblanc in #10752
• feat(tls): public mTLS for HTTP and Flight (channel + identity modes) by @phillipleblanc in #10753
• perf(cayenne): lock-free deletion caches with bloom-prefiltered probe by @lukekim in #10756
• fix(security): close API key timing-position leak and remote-UDF SSRF by @lukekim in #10757
• Fix 'wait_until_dependent_tables_are_ready' for catalogs by @phillipleblanc in #10758
• Fixes for views and resolved tables on 'spice refresh' CLI by @phillipleblanc in #10759
• Implement FlightSQL CommandStatementSubstraitPlan support by @lukekim in #10761
• feat(connectors): mTLS client cert support for flightsql and spiceai connectors by @phillipleblanc in #10764
• Allow arbitrary filenames when specifying spicepod path + kind validation by @krinart in #10777
• fix: ignore field metadata in schema compatibility check in index_table_scan by @Jeadie in #10778
• Display pushed-down limits in EXPLAIN TREE output by @lukekim in #10779
• fix: enable streaming append for Kafka with Cayenne accelerator by @lukekim in #10780
• fix: bound chunked-index intermediate batch size to prevent OOM by @phillipleblanc in #10783
• fix: label all columns in spice cloud metrics table output by @claudespice in #10784
• fix: use checked arithmetic for Turso integer-millis timestamp read path by @claudespice in #10786
• fix: use checked arithmetic in timestamp-to-nanosecond conversions by @claudespice in #10666
• Upgrade to DuckDB v1.5.2 by @sgrebnov in #10788
• Improve CDC ingestion performance by @lukekim in #10789
• Fix tool_search/tool_invoke spans by @lukekim in #10791
• Add Cayenne inline mutations and benchmark coverage by @lukekim in #10792
• Ensure we always resolve table names in distributed mode/metadata by @Jeadie in #10793
• Remove permanent errors from DynamoDB Streams by @krinart in #10794
• Add expanded view mode for wide table display in SQL REPL by @lukekim in #10797
• Fix Cayenne CDC schema mismatch error by @sgrebnov in #10800
• Executors should create catalog tables on join by @Jeadie in #10807
• Add compressed file support for listing connectors by @lukekim in #10809
• Improve Cayenne mutation, scan, and inline memtable scaling by @lukekim in #10811
• Add range fallback for large join filters by @lukekim in #10816
• Improve Cayenne join filter pushdown by @lukekim in #10818
• Synchronize Cayenne partition commits across partitions by @phillipleblanc in #10819
• fix: Deny nondistributed cayenne catalog by @peasee in #10821
• Enable parallel Cayenne Vortex writes by @lukekim in #10822
• Expand Arrow type handling in formatting and Elasticsearch by @lukekim in #10825
• Add response.output_text.delta to responses API by @krinart in #10828
• feat(cayenne): add join filter propagation and no-spill Q21 planning by @lukekim in #10840
• Upgrade Turso to v0.6.0 by @sgrebnov in #10843
• feat(cli): add spice feedback command to open community Slack by @lukekim in #10856
• Upgrade iceberg to v0.9.1 by @sgrebnov in #10859
• feat(cluster): per-request executor readiness gate on /v1/ready by @phillipleblanc in #10860
• fix: Require dim-side statistics for CayennePropagateFilterAcrossEquiJoinKeys by @sgrebnov in #10863
• fix: Debezium schema evolution breaks dataset init on reload by @claudespice in #10144
• fix(mssql): Push topK limit to SQL Server for non-nullable sort columns by @Jeadie in #10621
• fix(ScyllaDB): disable physical filter pushdown by @sgrebnov in #10772
• fix: handle typed NULLs and prevent overflow in DynamoDB DML type conversions by @krinart in #10511
• fix: use InsertOp::Overwrite in DynamoDB bootstrap scan_and_overwrite_accelerator by @krinart in #10639
• Improve DynamoDB Bootstrap performance by @krinart in #10616
• fix: preserve field and schema metadata in Vortex type transformation by @lukekim in #10628
• fix: GH connector - explicitly use AWS LC RS crypto provider for jwt by @phillipleblanc in #10619
• fix: add snapshot mode guards to delete_from/update and delegate DML in SwappableTableProvider by @phillipleblanc in #10685
• Persist HTTP rate-control state in object storage by @lukekim in #10697
• Rate limit metrics HTTP endpoint by @lukekim in #10162
• feat(geo): add optional spatial SQL UDF support by @lukekim in #10833
• feat(cayenne): CDC throughput, compaction, scan caching, and benchmarks by @lukekim in #10852
• fix(cayenne): fix Vortex panic on highly compressible data by @sgrebnov in #10855
• fix(cayenne): Read live protected snapshots after cleanup grace period by @sgrebnov in #10901
• fix: Disable Cayenne HashJoin rewriter optimizer by @sgrebnov in #10882
• Fix GetFlightInfo vs DoGet Flight Schema by @krinart in #10864
• fix(search): preserve column casing in /v1/search primary key plumbing by @claudespice in #10909
• fix(object-store): dedupe s3 url style auto-detection log by @phillipleblanc in #10898
• Improve Spice CLI manifest editing and direct command modes by @lukekim in #10815
• Persist Kafka CDC offsets in sidecar tables by @lukekim in #10823
• feat(task-history): record Ballista stages for distributed queries by @phillipleblanc in #10831
• Add '#[deny(clippy::missing_trait_methods)]' to wrapper/delegation trait impls by @Jeadie in #10795
• Optimize Cayenne catalog maintenance paths by @lukekim in #10904
• Centralize DuckDB settings for accelerator by @ewgenius in #10895
• deps(ballista): bump to 47e2b494 to fix S3 shuffle reads under cluster mode by @phillipleblanc in #10910
• Authorization header + Bump async-openai + responses_adapter fix by @krinart in #10911
• Tune accelerators by storage profile by @lukekim in #10913
• feat: add dataset-level on_schema_change config by @lukekim in #10908
• Handle NULL sentinel for nullable partition expressions by @Jeadie in #10880
• fix: Remove Cayenne Catalog from catalog registration by @peasee in #10914
• Add catalog name to foreign key metadata in postgres catalog by @Jeadie in #10917
• Cayenne perf: eliminate redundant clones, PK point-lookup fanout fix, IN-list rewrite + microbench coverage by @lukekim in #10916
• fix(turso-shared): retry on Turso BEGIN CONCURRENT "Write-write conflict" by @lukekim in #10946
• Vendor Vortex DataFusion for Cayenne by @lukekim in #10933
• perf(cayenne): background retention + enable CDC pipelining for retention-configured tables by @lukekim in #10936
• feat(cayenne): scale metastore pool to 32 + vs_duckdb_scaling benches (1→128 concurrency, sqlite + turso lanes) by @lukekim in #10943
• feat(mcp): support auth for streamable HTTP tools by @phillipleblanc in #10927
• Explicit error if v1/search requests a table without search index by @Jeadie in #10968
• Fix spicepod loading failure when directory name contains dots by @sgrebnov in #10958
• Extend append tests with arrow engine configurations by @sgrebnov in #10959
• Remove dataset on_schema_change Policy from rc.5 release notes by @sgrebnov in #10964
• Skip tpcds_q78 for Cayenne engine at SF100 by @sgrebnov in #10966
• fix: Update benchmark snapshots May-20 by @app/github-actions in #10952
• Fix #10951: UdtfExec invariant Vec lengths must match children count by @phillipleblanc in #10953
• docs(release): update v2.0.0-rc.5 notes with latest trunk PRs by @lukekim in #10949
• Remove eval related things for v2.0.0 by @Jeadie in #10945
• build(deps): bump ubuntu from 24.04 to 26.04 in the docker-dependencies group by @app/dependabot in #10883
• fix: Add publish = false to chbench-driver by @sgrebnov in #10939

Full Changelog: https://github.com/spiceai/spiceai/compare/v2.0.0-rc.4...v2.0.0-rc.5

Announcing the release of Spice v1.11.0-stable! ⚡

In Spice v1.11.0, Spice Cayenne reaches Beta status with acceleration snapshots, Key-based deletion vectors, and Amazon S3 Express One Zone support. DataFusion has been upgraded to v51 along with Arrow v57.2, and iceberg-rust v0.8.0. v1.11 adds several DynamoDB & DynamoDB Streams improvements such as JSON nesting, and adds significant improvements to Distributed Query with active-active schedulers and mTLS for enterprise-grade high-availability and secure cluster communication.

This release also adds new SMB, NFS, and ScyllaDB Data Connectors (Alpha), Prepared Statements with full SDK support (gospice, spice-rs, spice-dotnet, spice-java, spice.js, and spicepy), Google LLM Support for expanded AI inference capabilities, and significant improvements to caching, observability, and Hash Indexing for Arrow Acceleration.

What's New in v1.11.0​

Spice Cayenne Accelerator Reaches Beta​

Spice Cayenne has been promoted to Beta status with acceleration snapshots support and numerous performance and stability improvements.

Key Enhancements:

• Key-based Deletion Vectors: Improved deletion vector support using key-based lookups for more efficient data management and faster delete operations. Key-based deletion vectors are more memory-efficient than positional vectors for sparse deletions.
• S3 Express One Zone Support: Store Cayenne data files in S3 Express One Zone for single-digit millisecond latency, ideal for latency-sensitive query workloads that require persistence.

Improved Reliability:

• Resolved FuturesUnordered reentrant drop crashes
• Fixed memory growth issues related to Vortex metrics allocation
• Metadata catalog now properly respects cayenne_file_path location
• Added warnings for unparseable configuration values

For more details, refer to the Cayenne Documentation.

DataFusion v51 Upgrade​

Apache DataFusion has been upgraded to v51, bringing significant performance improvements, new SQL features, and enhanced observability.

Performance Improvements:

• Faster CASE Expression Evaluation: Expressions now short-circuit earlier, reuse partial results, and avoid unnecessary scattering, speeding up common ETL patterns
• Better Defaults for Remote Parquet Reads: DataFusion now fetches the last 512KB of Parquet files by default, typically avoiding 2 I/O requests per file
• Faster Parquet Metadata Parsing: Leverages Arrow 57's new thrift metadata parser for up to 4x faster metadata parsing

New SQL Features:

• SQL Pipe Operators: Support for |> syntax for inline transforms
• DESCRIBE <query>: Returns the schema of any query without executing it
• Named Arguments in SQL Functions: PostgreSQL-style param => value syntax for scalar, aggregate, and window functions
• Decimal32/Decimal64 Support: New Arrow types supported including aggregations like SUM, AVG, and MIN/MAX

Example pipe operator:

SELECT * FROM t
|> WHERE a > 10
|> ORDER BY b
|> LIMIT 5;

Improved Observability:

• Improved EXPLAIN ANALYZE Metrics: New metrics including output_bytes, selectivity for filters, reduction_factor for aggregates, and detailed timing breakdowns

Arrow 57.2 Upgrade​

Apache Arrow has been upgraded to v57.2, bringing major performance improvements and new capabilities.

Key Features:

• 4x Faster Parquet Metadata Parsing: A rewritten thrift metadata parser delivers up to 4x faster metadata parsing, especially beneficial for low-latency use cases and files with large amounts of metadata
• Parquet Variant Support: Experimental support for reading and writing the new Parquet Variant type for semi-structured data, including shredded variant values
• Parquet Geometry Support: Read and write support for Parquet Geometry types (GEOMETRY and GEOGRAPHY) with GeospatialStatistics
• New arrow-avro Crate: Efficient conversion between Apache Avro and Arrow RecordBatches with projection pushdown and vectorized execution support

DynamoDB Connector Enhancements​

• Added JSON nesting for DynamoDB Streams
• Improved batch deletion handling

Distributed Query Improvements​

High Availability Clusters: Spice now supports running multiple active schedulers in an active/active configuration for production deployments. This eliminates the scheduler as a single point of failure and enables graceful handling of node failures.

• Multiple schedulers run simultaneously, each capable of accepting queries
• Schedulers coordinate via a shared S3-compatible object store
• Executors discover all schedulers automatically
• A load balancer distributes client queries across schedulers

Example HA configuration:

runtime:
  scheduler:
    state_location: s3://my-bucket/spice-cluster
    params:
      region: us-east-1

mTLS Verification: Cluster communication between scheduler and executors now supports mutual TLS verification for enhanced security.

Credential Propagation: S3, ABFS, and GCS credentials are now automatically propagated to executors in cluster mode, enabling access to cloud storage across the distributed query cluster.

Improved Resilience:

• Exponential backoff for scheduler disconnection recovery
• Increased gRPC message size limit from 16MB to 100MB for large query plans
• HTTP health endpoint for cluster executors
• Automatic executor role inference when --scheduler-address is provided

For more details, refer to the Distributed Query Documentation.

iceberg-rust v0.8.0 Upgrade​

Spice has been upgraded to iceberg-rust v0.8.0, bringing improved Iceberg table support.

Key Features:

• V3 Metadata Support: Full support for Iceberg V3 table metadata format
• INSERT INTO Partitioned Tables: DataFusion integration now supports inserting data into partitioned Iceberg tables
• Improved Delete File Handling: Better support for position and equality delete files, including shared delete file loading and caching
• SQL Catalog Updates: Implement update_table and register_table for SQL catalog
• S3 Tables Catalog: Implement update_table for S3 Tables catalog
• Enhanced Arrow Integration: Convert Arrow schema to Iceberg schema with auto-assigned field IDs, _file column support, and Date32 type support

Acceleration Snapshots​

Acceleration snapshots enable point-in-time recovery and data versioning for accelerated datasets. Snapshots capture the state of accelerated data at specific points, allowing for fast bootstrap recovery and rollback capabilities.

Key Features:

• Flexible Triggers: Configure when snapshots are created based on time intervals or stream batch counts
• Automatic Compaction: Reduce storage overhead by compacting older snapshots (DuckDB only)
• Bootstrap Integration: Snapshots can reset cache expiry on load for seamless recovery (DuckDB with Caching refresh mode)
• Smart Creation Policies: Only create snapshots when data has actually changed

Example configuration:

datasets:
  - from: s3://my-bucket/data.parquet
    name: my_dataset
    acceleration:
      enabled: true
      engine: cayenne
      mode: file
      snapshots: enabled
      snapshots_trigger: time_interval
      snapshots_trigger_threshold: 1h
      snapshots_creation_policy: on_changed

Snapshots API and CLI: New API endpoints and CLI commands for managing snapshots programmatically.

CLI Commands:

# List all snapshots for a dataset
spice acceleration snapshots taxi_trips

# Get details of a specific snapshot
spice acceleration snapshot taxi_trips 3

# Set the current snapshot for rollback (requires runtime restart)
spice acceleration set-snapshot taxi_trips 2

HTTP API Endpoints:

For more details, refer to the Acceleration Snapshots Documentation.

Caching Acceleration Mode Improvements​

The Caching Acceleration Mode introduced in v1.10.0 has received significant performance optimizations and reliability fixes in this release.

Performance Optimizations:

• Non-blocking Cache Writes: Cache misses no longer block query responses. Data is written to the cache asynchronously after the query returns, reducing query latency for cache miss scenarios.
• Batch Cache Writes: Multiple cache entries are now written in batches rather than individually, significantly improving write throughput for high-volume cache operations.

Reliability Fixes:

• Correct SWR Refresh Behavior: The stale-while-revalidate (SWR) pattern now correctly refreshes only the specific entries that were accessed instead of refreshing all stale rows in the dataset. This prevents unnecessary source queries and reduces load on upstream data sources.
• Deduplicated Refresh Requests: Fixed an issue where JSON array responses could trigger multiple redundant refresh operations. Refresh requests are now properly deduplicated.
• Fixed Cache Hit Detection: Resolved an issue where queries that didn't include fetched_at in their projection would always result in cache misses, even when cached data was available.
• Unfiltered Query Optimization: SELECT * queries without filters now return cached data directly without unnecessary filtering overhead.

For more details, refer to the Caching Acceleration Mode Documentation.

Prepared Statements​

Improved Query Performance and Security: Spice now supports prepared statements, enabling parameterized queries that improve both performance through query plan caching and security by preventing SQL injection attacks.

Key Features:

• Query Plan Caching: Prepared statements cache query plans, reducing planning overhead for repeated queries
• SQL Injection Prevention: Parameters are safely bound, preventing SQL injection vulnerabilities
• Arrow Flight SQL Support: Full prepared statement support via Arrow Flight SQL protocol

SDK Support:

Example (Go):

import "github.com/spiceai/gospice/v8"

client, _ := spice.NewClient()
defer client.Close()

// Parameterized query with typed parameters
results, _ := client.SqlWithParams(ctx,
    "SELECT * FROM products WHERE price > $1 AND category = $2",
    spice.Float64Param(10.0),
    spice.StringParam("electronics"),
)

Example (Java):

import ai.spice.SpiceClient;
import ai.spice.Param;
import org.apache.arrow.adbc.core.ArrowReader;

try (SpiceClient client = new SpiceClient()) {
    // With automatic type inference
    ArrowReader reader = client.queryWithParams(
        "SELECT * FROM products WHERE price > $1 AND category = $2",
        10.0, "electronics");

    // With explicit typed parameters
    ArrowReader reader = client.queryWithParams(
        "SELECT * FROM products WHERE price > $1 AND category = $2",
        Param.float64(10.0),
        Param.string("electronics"));
}

For more details, refer to the Parameterized Queries Documentation.

Spice Java SDK v0.5.0​

Parameterized Query Support for Java: The Spice Java SDK v0.5.0 introduces parameterized queries using ADBC (Arrow Database Connectivity), providing a safer and more efficient way to execute queries with dynamic parameters.

Key Features:

• SQL Injection Prevention: Parameters are safely bound, preventing SQL injection vulnerabilities
• Automatic Type Inference: Java types are automatically mapped to Arrow types (e.g., double → Float64, String → Utf8)
• Explicit Type Control: Use the new Param class with typed factory methods (Param.int64(), Param.string(), Param.decimal128(), etc.) for precise control over Arrow types
• Updated Dependencies: Apache Arrow Flight SQL upgraded to 18.3.0, plus new ADBC driver support

Example:

import ai.spice.SpiceClient;
import ai.spice.Param;

try (SpiceClient client = new SpiceClient()) {
    // With automatic type inference
    ArrowReader reader = client.queryWithParams(
        "SELECT * FROM taxi_trips WHERE trip_distance > $1 LIMIT 10",
        5.0);

    // With explicit typed parameters for precise control
    ArrowReader reader = client.queryWithParams(
        "SELECT * FROM orders WHERE order_id = $1 AND amount >= $2",
        Param.int64(12345),
        Param.decimal128(new BigDecimal("99.99"), 10, 2));
}

Maven:

<dependency>
  <groupId>ai.spice</groupId>
  <artifactId>spiceai</artifactId>
  <version>0.5.0</version>
</dependency>

For more details, refer to the Spice Java SDK Repository.

Google LLM Support​

Expanded AI Provider Support: Spice now supports Google embedding and chat models via the Google AI provider, expanding the available LLM options for AI inference workloads alongside existing providers like OpenAI, Anthropic, and AWS Bedrock.

Key Features:

• Google Chat Models: Access Google's Gemini models for chat completions
• Google Embeddings: Generate embeddings using Google's text embedding models
• Unified API: Use the same OpenAI-compatible API endpoints for all LLM providers

Example spicepod.yaml configuration:

models:
  - from: google:gemini-2.0-flash
    name: gemini
    params:
      google_api_key: ${secrets:GOOGLE_API_KEY}

embeddings:
  - from: google:text-embedding-004
    name: google_embeddings
    params:
      google_api_key: ${secrets:GOOGLE_API_KEY}

For more details, refer to the Google LLM Documentation (see docs PR #1286).

URL Tables​

Query data sources directly via URL in SQL without prior dataset registration. Supports S3, Azure Blob Storage, and HTTP/HTTPS URLs with automatic format detection and partition inference.

Supported Patterns:

• Single files: SELECT * FROM 's3://bucket/data.parquet'
• Directories/prefixes: SELECT * FROM 's3://bucket/data/'
• Glob patterns: SELECT * FROM 's3://bucket/year=*/month=*/data.parquet'

Key Features:

• Automatic file format detection (Parquet, CSV, JSON, etc.)
• Hive-style partition inference with filter pushdown
• Schema inference from files
• Works with both SQL and DataFrame APIs

Example with hive partitioning:

-- Partitions are automatically inferred from paths
SELECT * FROM 's3://bucket/data/' WHERE year = '2024' AND month = '01'

Enable via spicepod.yml:

runtime:
  params:
    url_tables: enabled

Cluster Mode Async Query APIs (experimental)​

New asynchronous query APIs for long-running queries in cluster mode:

• /v1/queries endpoint: Submit queries and retrieve results asynchronously

OpenTelemetry Improvements​

Unified Telemetry Endpoint: OTel metrics ingestion has been consolidated to the Flight port (50051), simplifying deployment by removing the separate OTel port (50052). The push-based metrics exporter continues to support integration with OpenTelemetry collectors.

Note: This is a breaking change. Update your configurations if you were using the dedicated OTel port 50052. Internal cluster communication now uses port 50052 exclusively.

Observability Improvements​

Enhanced Dashboards: Updated Grafana and Datadog example dashboards with:

• Snapshot monitoring widgets
• Improved accelerated datasets section
• Renamed ingestion lag charts for clarity

Additional Histogram Buckets: Added more buckets to histogram metrics for better latency distribution visibility.

For more details, refer to the Monitoring Documentation.

Hash Indexing for Arrow Acceleration (experimental)​

Arrow-based accelerations now support hash indexing for faster point lookups on equality predicates. Hash indexes provide O(1) average-case lookup performance for columns with high cardinality.

Features:

• Primary key hash index support
• Secondary index support for non-primary key columns
• Composite key support with proper null value handling

Example configuration:

datasets:
  - from: postgres:users
    name: users
    acceleration:
      enabled: true
      engine: arrow
      primary_key: user_id
      indexes:
        '(tenant_id, user_id)': unique  # Composite hash index

For more details, refer to the Hash Index Documentation.

SMB and NFS Data Connectors​

Network-Attached Storage Connectors: New data connectors for SMB (Server Message Block) and NFS (Network File System) protocols enable direct federated queries against network-attached storage without requiring data movement to cloud object stores.

Key Features:

• SMB Protocol Support: Connect to Windows file shares and Samba servers with authentication support
• NFS Protocol Support: Connect to Unix/Linux NFS exports for direct data access
• Federated Queries: Query Parquet, CSV, JSON, and other file formats directly from network storage with full SQL support
• Acceleration Support: Accelerate data from SMB/NFS sources using DuckDB, Spice Cayenne, or other accelerators

Example spicepod.yaml configuration:

datasets:
  # SMB share
  - from: smb://fileserver/share/data.parquet
    name: smb_data
    params:
      smb_username: ${secrets:SMB_USER}
      smb_password: ${secrets:SMB_PASS}

  # NFS export
  - from: nfs://nfsserver/export/data.parquet
    name: nfs_data

For more details, refer to the Data Connectors Documentation.

ScyllaDB Data Connector​

A new data connector for ScyllaDB, the high-performance NoSQL database compatible with Apache Cassandra. Query ScyllaDB tables directly or accelerate them for faster analytics.

Example configuration:

datasets:
  - from: scylladb:my_keyspace.my_table
    name: scylla_data
    acceleration:
      enabled: true
      engine: duckdb

For more details, refer to the ScyllaDB Data Connector Documentation.

Flight SQL TLS Connection Fixes​

TLS Connection Support: Fixed TLS connection issues when using grpc+tls:// scheme with Flight SQL endpoints. Added support for custom CA certificate files via the new flightsql_tls_ca_certificate_file parameter.

Developer Experience Improvements​

• Turso v0.3.2 Upgrade: Upgraded Turso accelerator for improved performance and reliability
• Rust 1.91 Upgrade: Updated to Rust 1.91 for latest language features and performance improvements
• Spice Cloud CLI: Added spice cloud CLI commands for cloud deployment management
• Improved Spicepod Schema: Improved JSON schema generation for better IDE support and validation
• Acceleration Snapshots: Added configurable snapshots_create_interval for periodic acceleration snapshots independent of refresh cycles
• Tiered Caching with Localpod: The Localpod connector now supports caching refresh mode, enabling multi-layer acceleration where a persistent cache feeds a fast in-memory cache
• GitHub Data Connector: Added workflows and workflow runs support for GitHub repositories
• NDJSON/LDJSON Support: Added support for Newline Delimited JSON and Line Delimited JSON file formats

Additional Improvements & Bug Fixes​

• Model Listing: New functionality to list available models across multiple AI providers
• DuckDB Partitioned Tables: Primary key constraints now supported in partitioned DuckDB table mode
• Post-refresh Sorting: New on_refresh_sort_columns parameter for DuckDB enables data ordering after writes
• Improved Install Scripts: Removed jq dependency and improved cross-platform compatibility
• Better Error Messages: Improved error messaging for bucket UDF arguments and deprecated OpenAI parameters
• Reliability: Fixed DynamoDB IAM role authentication with new dynamodb_auth: iam_role parameter
• Reliability: Fixed cluster executors to use scheduler's temp_directory parameter for shuffle files
• Reliability: Initialize secrets before object stores in cluster executor mode
• Reliability: Added page-level retry with backoff for transient GitHub GraphQL errors
• Performance: Improved statistics for rewritten DistributeFileScanOptimizer plans
• Developer Experience: Added max_message_size configuration for Flight service

Contributors​

• @ewgenius
• @Jeadie
• @krinart
• @lukekim
• @mach-kernel
• @peasee
• @phillipleblanc
• @sgrebnov

Breaking Changes​

OTel Ingestion Port Change​

OTel ingestion has been moved to the Flight port (50051), removing the separate OTel port 50052. Port 50052 is now used exclusively for internal cluster communication. Update your configurations if you were using the dedicated OTel port.

Distributed Query Cluster Mode Requires mTLS​

Distributed query cluster mode now requires mTLS for secure communication between cluster nodes. This is a security enhancement to prevent unauthorized nodes from joining the cluster and accessing secrets.

Migration Steps:

1. Generate certificates using spice cluster tls init and spice cluster tls add
2. Update scheduler and executor startup commands with --node-mtls-* arguments
3. For development/testing, use --allow-insecure-connections to opt out of mTLS

Renamed CLI Arguments:

Removed CLI Arguments:

• --cluster-api-key: Replaced by mTLS authentication

Cookbook Updates​

New ScyllaDB Data Connector Recipe: New recipe demonstrating how to use the ScyllaDB Data Connector. See ScyllaDB Data Connector Recipe for details.

New SMB Data Connector Recipe: New recipe demonstrating how to use the SMB Data Connector. See SMB Data Connector Recipe for details.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading​

To upgrade to v1.11.0, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:1.11.0 image:

docker pull spiceai/spiceai:1.11.0

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 1.11.0

AWS Marketplace:

Spice is available in the AWS Marketplace.

Dependencies​

• DataFusion: Upgraded to v51 (release notes)
• Arrow: Upgraded to v57.2 (release notes)
• iceberg-rust: Upgraded to v0.8.0 (release notes)

What's Changed​

Changelog​

• OTel exporter for push metrics by @lukekim in #8442
• fix: Update benchmark snapshots by @app/github-actions in #8448
• Add TPCH append tests to scheduled dispatch workflow by @sgrebnov in #8451
• Add snapshot creation logging by @krinart in #8469
• Fix PeriodicReader panic by @krinart in #8471
• Benchmarks: increase readiness timeout for turso acceleration (TPC-H) by @sgrebnov in #8470
• fix: Pin CUDA build actions to commits by @peasee in #8477
• Add Criterion benchmarking to chunking crate. by @Jeadie in #8431
• DuckDB agg pushdown: gate behind accelerator parameter by @mach-kernel in #8474
• Rename aggregate_pushdown_optimization -> optimizer_duckdb_aggregate_pushdown by @ewgenius in #8485
• Handle throttling exception for DynamoDB streams by @phillipleblanc in #8492
• docs: Add release notes by @peasee in #8478
• Update spicepod.schema.json by @app/github-actions in #8496
• Move 'test_projection_pushdown' to runtime-datafusion by @Jeadie in #8490
• Fix OTEL metrics HTTP exporter client setup by @phillipleblanc in #8489
• Update endgame to include new caching accelerator cookbook by @phillipleblanc in #8487
• DynamoDB tests and fixes by @lukekim in #8491
• Align make lint-rust-fix with make lint-rust by @Jeadie in #8499
• fix: Remove unused Cayenne parameters by @peasee in #8500
• Force task history captured_plan outputs to be captured even if they would be filtered out otherwise by @phillipleblanc in #8501
• release: post-release updates by @peasee in #8503
• CI: Fix E2E models dispatch by @mach-kernel in #8505
• Use an isolated Tokio runtime for refresh tasks that is separate from the main query API by @phillipleblanc in #8504
• Update openapi.json by @app/github-actions in #8512
• Update dependencies by @phillipleblanc in #8513
• fix: Avoid double hashing cache key by @peasee in #8511
• fix: Eagerly drop cached records for results larger than max by @peasee in #8516
• feat: Support vortex zstd compressor by @peasee in #8515
• warning if column is defined in spicepod but is non-existant by @Jeadie in #8498
• Return summarized spicepods from /v1/spicepods by @phillipleblanc in #8404
• Fix for idle DynamoDB Stream by @krinart in #8506
• Use Datafusion::Plan over Datafusion::Internal for user-facing search errors. by @Jeadie in #8484
• DDB Streams Integration Test + Memory Acceleration + Improved Warning by @krinart in #8520
• Upgrade to gospice v8 by @lukekim in #8524
• Vortex file format for object store by @Jeadie in #8525
• docs: Add missing cookbooks to endgame, focus area section by @peasee in #8527
• ListingTableConnector: Drop partition columns that reoccur in file schema by @mach-kernel in #8519
• fix(cluster): initialize secrets before object stores in executor by @sgrebnov in #8532
• Use separate Tokio runtime for SWR refreshes by @phillipleblanc in #8530
• fix: SQL Results Cache SWR triggers incorrect cache miss metric by @phillipleblanc in #8529
• feat: testoperator: OTLP streaming metrics / connect to existing instance / infinite mode / query timeout by @phillipleblanc in #8537
• Update openapi.json by @app/github-actions in #8518
• Add better attributes for search testing by @Jeadie in #8531
• fix: Improve Cayenne errors, ID selection for table/partition creation by @peasee in #8523
• Percent-encode Kubernetes secret name path segment by @phillipleblanc in #8522
• Initial parameterisation of Search integration tests by @Jeadie in #8066
• fix: Add warning when multiple partitions are defined for the same table by @peasee in #8540
• Add DuckDB file-mode support for search test parameterization. by @Jeadie in #8541
• fix: Add recursion depth limits to prevent DoS via deeply nested data (DynamoDB + S3 Vectors) by @phillipleblanc in #8544
• Remove the clippy::too_many_lines lint by @phillipleblanc in #8549
• feat: Add spice cluster tls commands by @phillipleblanc in #8550
• Move OTel ingestion to Flight port, remove separate OTel port 50052 by @phillipleblanc in #8551
• Move verbose tool init messages to trace by @phillipleblanc in #8552
• Add SANs to spice cluster tls add certificates by @phillipleblanc in #8554
• Add cpu, gpu, and memory to telemetry by @lukekim in #8483
• feat: Add workflows and workflow runs to GitHub Data Connector by @peasee in #8548
• Add S3Vectors option for paramterised search tests by @Jeadie in #8555
• Distributed query: TLS + API key by @mach-kernel in #8468
• Refactor RRF SQL to use LogicalPlanBuilder by @Jeadie in #7968
• Require mTLS for distributed query cluster mode by @phillipleblanc in #8580
• Fix stats for rewritten DistributeFileScanOptimizer plans by @mach-kernel in #8581
• Bump actions/cache from 4.3.0 to 5.0.1 by @app/dependabot in #8573
• Show user-friendly error on empty DDB table by @krinart in #8586
• Add (Deprecated) labels to deprecated spice sql params by @krinart in #8588
• Fix kafka warning when security.protocol is set to PLAINTEXT by @krinart in #8587
• Upgrade dependencies by @phillipleblanc in #8593
• Release notes for v1.10.1 by @Jeadie in #8568
• Run search benchmarks twice a week. by @Jeadie in #8592
• Add cayenne data accelerator by @Jeadie in #8553
• SQL allowlist for tools: sql, list_datasets, search, table_schema by @Jeadie in #8449
• use rstest for llms integration tests by @Jeadie in #8566
• Post v1.10.1 housekeeping by @Jeadie in #8600
• Add checklist for SDK publication in end_game.md by @Jeadie in #8602
• Fix IMAGE_TAG assignment for Docker compatibility by @Jeadie in #8599
• Modify cluster arguments to spiced for UX review by @phillipleblanc in #8603
• Update QA analytics with new release data by @Jeadie in #8601
• Remove 'tract-core' dependency. by @Jeadie in #8605
• Google embedding and chat models. by @Jeadie in #8423
• Fix test_github_workflows integration test by @sgrebnov in #8607
• Update openapi.json by @app/github-actions in #8604
• ci: Upload artifacts to MinIO eagerly after each build step by @phillipleblanc in #8615
• fix: SQLite accelerator decimal/date handling by @phillipleblanc in #8606
• Configure mTLS for executor-to-executor gRPC connections by @sgrebnov in #8617
• feat: Enable localpod with caching mode accelerator for tiered caching by @phillipleblanc in #8621
• Add Cayenne S3 Express One Zone support for data files by @lukekim in #8502
• Add snapshot interval for acceleration snapshots by @phillipleblanc in #8627
• Add dataset_load_parallelism parameter to spicepod.yml by @peasee in #8630
• Json Nesting for DynamoDB by @krinart in #8623
• Restore deprecated open-telemetry flag in spiced by @phillipleblanc in #8629
• Implement batching for Kafka/Debezium + null Decimal handling by @krinart in #8622
• fix: Status field in /v1/datasets & /v1/models by @lukekim in #8633
• Add Spice test operator improvements by @sgrebnov in #8625
• Add v1.10.2 release notes by @sgrebnov in #8640
• Align object-store vortex with runtime feature flagging by @Jeadie in #8620
• Extended LLM & search tests on cron by @Jeadie in #8624
• Test-operator: emit main metrics as part of load tests by @sgrebnov in #8639
• Build a local docker image from an existing Spice binary by @phillipleblanc in #8619
• fix: Use runtime-rate-control for GitHub Data Connector by @peasee in #8638
• Upgrade dependencies by @phillipleblanc in #8655
• Bump headers-accept from 0.1.4 to 0.3.0 by @app/dependabot in #8644
• Update openapi.json by @app/github-actions in #8637
• Update SECURITY.md - Include v1.10.2 by @sgrebnov in #8661
• Serialize acceleration snapshots with refresh writes by @phillipleblanc in #8652
• Update AI Installation test to use minilm_l6_v2 by @sgrebnov in #8659
• Fixes for search integration test CI by @Jeadie in #8656
• fix: Use a GitHub rate controller per auth context by @peasee in #8662
• fix: Update Search integration test snapshots by @app/github-actions in #8654
• Make E2E Test Release Installation (AI, Local HF model) test more robust by @sgrebnov in #8666
• Fix issue with location predicate for custom S3 endpoints + regression integration test by @phillipleblanc in #8668
• fix: Validate schema match before projection pushdown in UnionProjectionPushdownOptimizer by @phillipleblanc in #8669
• Proper batch commit for kafka/debezium by @krinart in #8671
• Improve spicepod json schema generation by @ewgenius in #8547
• Start the anonymous telemetry exporter asynchronously by @phillipleblanc in #8679
• fix: Move enforce-pulls to hosted runner by @phillipleblanc in #8686
• Update QA analytics with 1.10.2 release data by @sgrebnov in #8667
• fix: Azure does not support suffix range requests by @phillipleblanc in #8685
• Remove spicepod-validator cargo build from build-dev target by @Jeadie in #8684
• fix: Update test snapshots by @app/github-actions in #8680
• fix: Update Search integration test snapshots by @app/github-actions in #8681
• SMB and NFS Data Connectors by @lukekim in #8674
• Upgrade to openai-async v0.32 by @lukekim in #8635
• v1.10.3 release notes by @phillipleblanc in #8693
• Upgrade dependencies by @phillipleblanc in #8704
• fix: Support NDJSON and LDJSON by @lukekim in #8649
• move OpenAI overrides to non-prefixed by @Jeadie in #8678
• Update Google LLM param: google_dimensions -> dimensions by @Jeadie in #8677
• Make cluster mTLS optional with insecure flag by @phillipleblanc in #8703
• Revert "fix: Move enforce-pulls to hosted runner (#8686)" by @phillipleblanc in #8709
• Initial 'testoperator run text-to-sql' by @Jeadie in #8618
• Add support for abfss by @krinart in #8706
• Add testoperator TPCH dispatch for ABFS with hierarchical namespace disabled + versioning enabled by @phillipleblanc in #8711
• Update openapi.json by @app/github-actions in #8692
• cluster: validate --role argument by @phillipleblanc in #8717
• Upgrade to Turso v0.3.2 by @lukekim in #8716
• Rename --insecure to --allow-insecure-connections to be consistent with existing naming by @lukekim in #8720
• Remove 'testoperator run http-consistency/http-overhead' by @Jeadie in #8708
• refactor: Remove cluster feature flag by @phillipleblanc in #8718
• Docs: Distributed query ADR by @mach-kernel in #8608
• Use model.datasets to allowlist on tools by @Jeadie in #8714
• cluster: quality of life improvements to starting cluster mode locally by @phillipleblanc in #8719
• Docs: Ballista extension ADR by @mach-kernel in #8616
• Improve deprecation messages when going from prefixed -> non-prefixed. by @Jeadie in #8724
• Remove tools from auto-defaults by @Jeadie in #8725
• Make distinct providers for vector spilling, vector partitioning. by @Jeadie in #8546
• cluster: default scheduler address port by @phillipleblanc in #8728
• Add Makefile targets for testoperator by @Jeadie in #8729
• text-to-sql dispatch in testoperator by @Jeadie in #8705
• DR-006: High Availability Distributed Query with Stateless Schedulers by @lukekim in #8721
• DR-007: mTLS for Distributed Query Cluster Communication by @lukekim in #8722
• SMB and NFS improvements by @lukekim in #8710
• fix: Cluster executors use scheduler's temp_directory for shuffle files by @phillipleblanc in #8733
• use 'max_message_size' in flight service too by @Jeadie in #8730
• Add page-level retry for transient GraphQL errors with backoff and increase GitHub rate limit buffer up to 100 by @ewgenius in #8726
• Make testoperator Dockerfile; CI to build docker image to ghcr.io. by @Jeadie in #8732
• cluster: UnionProjectionPushdownOptimizer: Add projection pushdown diagnostics for union children by @phillipleblanc in #8734
• Fix column projection order mismatch with location metadata columns by @phillipleblanc in #8738
• Fixes for testoperator. by @Jeadie in #8737
• Improve Cayenne Deletion Vectors with KeyBased support by @lukekim in #8713
• Fix testoperator_dispatch.yaml by @Jeadie in #8740
• Add spice cloud CLI commands by @lukekim in #8528
• Add FTP, NFS, & SMB TPCH SF1 spicepods by @lukekim in #8739
• Prepared Statements by @lukekim in #7588
• Schedule dispatch of testoperator run text-to-sql. by @Jeadie in #8745
• Fix minio for ai benchmark CI by @Jeadie in #8743
• Upgrade to Rust 1.91 by @phillipleblanc in #8749
• fix: Update benchmark snapshots by @app/github-actions in #8763
• Benchmarks: make row count validation skip logic configurable by scale factor, query set, and overrides by @sgrebnov in #8756
• Make benchmark tests more robust by @sgrebnov in #8766
• Add parameter to force using iam_role for DynamoDB by @krinart in #8767
• fix: Update Search integration test snapshots by @app/github-actions in #8735
• v1.10.4 release notes by @phillipleblanc in #8790
• Trace metrics export errors by @sgrebnov in #8791
• v1.10.4 SECURITY.md update by @phillipleblanc in #8800
• Add timezone database to Docker image to fix Cayenne acceleration panic by @sgrebnov in #8799
• Upgrade dependencies by @phillipleblanc in #8801
• Fix table_allowlist for table sampling and NSQL by @Jeadie in #8789
• Cayenne primary key on-conflict handling by @lukekim in #8788
• fix: Update benchmark snapshots by @app/github-actions in #8773
• fix: correctly identify deprecated openai_* parameters by @phillipleblanc in #8809
• fix: Update benchmark snapshots by @app/github-actions in #8812
• Use workspace version for cayenne crate by @phillipleblanc in #8811
• Don't CAST strings which breaks push down optimizer by @lukekim in #8810
• fix: Update benchmark snapshots by @app/github-actions in #8815
• Update async-openai to latest revision 4dcd633aad6f - brings fix for openai compatible model providers by @ewgenius in #8816
• Add auth/iam_role_source to DynamoDB connector by @krinart in #8808
• DynamoDB fixes: JSON nesting for Streams, proper batch deletions by @krinart in #8821
• Rough roadmap for 2026-2027 by @lukekim in #8805
• Release notes for v1.11.0-rc1 by @ewgenius in #8786
• Make S3V integration tests prepare_for_aws_tests more robust by @sgrebnov in #8820
• Bump rsa from 0.9.9 to 0.9.10 in the cargo group across 1 directory by @app/dependabot in #8819
• Add timezone database to Release and CUDA Docker images to fix Cayene panic by @sgrebnov in #8832
• fix: UnionProjectionPushdownOptimizer - Schema change during transform_down breaks parent nodes by @phillipleblanc in #8831
• Update grafana/datadog example dashboards by @krinart in #8833
• Add Dev bird bench as text-to-sql queryset in CI. by @Jeadie in #8753
• Update testoperator scheduler to use release/1.11 branch by @ewgenius in #8829
• Spice Cayenne fixes and test spicepods for Beta & RC by @lukekim in #8787
• testoperator dispatch all bird-bench database variants by @Jeadie in #8835
• feat: Improve column statistics handling with safe access and defaults by @phillipleblanc in #8836
• cluster: mTLS verification by @phillipleblanc in #8837
• fix: 8770: Unsupported ScalarFunctionExpr in ORDER BY by @lukekim in #8838
• Workflow tweaks by @lukekim in #8845
• Cayenne: metadata catalog should respect cayenne_file_path location by @sgrebnov in #8844
• Expand Cayenne feature coverage by @lukekim in #8848
• docs: HA distributed query decisions by @phillipleblanc in #8817
• fix(optimizer): Fix correctness issues in UnionProjectionPushdownOptimizer by @phillipleblanc in #8851
• Pin reqwest to 0.12.24 to fix HuggingFace embedding model download by @ewgenius in #8853
• Fix builds and pin to Ubuntu 22.04 by @lukekim in #8856
• Revert "Fix builds and pin to Ubuntu 22.04" by @lukekim in #8861
• Ensure setup Rust is run by @lukekim in #8862
• fix: Ubuntu 24.04+ renamed libaio1 to libaio1t64 by @lukekim in #8865
• Upgrade to Pulls with Spice v2 by @lukekim in #8866
• Add limit and configuration name to 'testoperator run text-to-sql' by @Jeadie in #8839
• PR check and test optimization by @lukekim in #8868
• Upgrade S3 Vectors SDK and improve test robustness by @lukekim in #8867
• [Testoperator] Query level and improved aggregate level for NSQL by @Jeadie in #8840
• Add docker build for private branches for ghcr.io/spiceai/spiceai-dev by @phillipleblanc in #8873
• Expand the data acceleration round-trip test coverage by @lukekim in #8855
• fix: Provide a better error for improper bucket UDF arguments by @peasee in #8849
• ScyllaDB Data Connector by @lukekim in #8827
• Use tokio-rusqlite for Spice Cayenne SQLite by @lukekim in #8857
• Cayenne: fix FuturesUnordered reentrant drop crash by @sgrebnov in #8863
• Bump github/codeql-action from 4.31.9 to 4.31.10 by @app/dependabot in #8884
• Bump golang.org/x/sys from 0.39.0 to 0.40.0 by @app/dependabot in #8881
• Bump github.com/spiceai/gospice/v8 from 8.0.0 to 8.0.1 by @app/dependabot in #8883
• Bump roaring from 0.11.2 to 0.11.3 by @app/dependabot in #8885
• Bump golang.org/x/mod from 0.31.0 to 0.32.0 by @app/dependabot in #8882
• Bump aws-sdk-s3 from 1.115.0 to 1.119.0 by @app/dependabot in #8887
• Bump libc from 0.2.177 to 0.2.180 by @app/dependabot in #8886
• Bump tokio-util from 0.7.17 to 0.7.18 by @app/dependabot in #8889
• Bump governor from 0.10.2 to 0.10.4 by @app/dependabot in #8888
• fix: flaky test test_concurrent_partition_creation by @phillipleblanc in #8898
• Update Cayenne snapshots for TPC-DS by @lukekim in #8890
• Add more buckets to histogram metrics by @krinart in #8850
• feat: Add HTTP health endpoint for cluster executors by @phillipleblanc in #8899
• feat: Implement model listing functionality for multiple providers by @lukekim in #8901
• feat: Initial HA schedulers distributed query implementation by @phillipleblanc in #8852
• fix: infer executor role from --scheduler-address when --role is omitted by @phillipleblanc in #8903
• Improve install scripts and remove jq dependency by @lukekim in #8847
• Benchmarks: sort PartitionedUnionExec children for deterministic snapshot comparison by @sgrebnov in #8877
• Cayenne: share VortexFileCache across partitions via CayenneContext by @sgrebnov in #8880
• Update ballista to add exponential backoff for scheduler disconnection by @phillipleblanc in #8905
• Configurably add BirdBench evidence to testoperator text-to-SQL. by @Jeadie in #8904
• Helm: Allow command override via values.yaml by @sgrebnov in #8906
• Fix distributed query gRPC message size limit (16MB -> 100MB) by @phillipleblanc in #8900
• OS specific setup actions by @lukekim in #8909
• Cayenne should warn if unable to parse configuration value by @sgrebnov in #8907
• Add snapshots widgets to example dashboard by @krinart in #8910
• Add quality criteria for the features by @krinart in #8897
• Improve Accelerated Datasets section for Grafana/Datadog dashboards by @krinart in #8915
• Use HTTP traceparent in NSQL to support concurrency in 'testoperator run text-to-SQL' by @Jeadie in #8912
• Remove setup for cc from integration_models.yml by @Jeadie in #8917
• Propagate Azure and GCS credentials to executors in cluster mode by @phillipleblanc in #8918
• Cayenne: fix memory growth due to vortex metrics allocation by @sgrebnov in #8908
• fix(caching): Deduplicate refresh requests for JSON array responses by @sgrebnov in #8921
• fix(caching): Return cached data directly for unfiltered queries (SELECT *) by @sgrebnov in #8919
• Correct MinIO path syntax for spiced download by @Jeadie in #8916
• Acceleration snapshots compaction + Improved Snapshots UX by @krinart in #8858
• Change base image from bookworm-slim to trixie-slim by @Jeadie in #8923
• Add testoperator run text-to-sql metrics from LogicalPlan by @Jeadie in #8895
• Fix spicepod dependencies in testoperator by @Jeadie in #8875
• Update copilot instructions for data correctness by @lukekim in #8922
• Add BootstrapStatus + Snapshot bootstrapping parallelization by @krinart in #8926
• fix: add missing feature-gate for AWS Secrets Manager error variant by @phillipleblanc in #8928
• refactor: make ConnectorParams fields public for external connectors by @phillipleblanc in #8929
• fix(caching): SWR refreshes only accessed entry instead of all stale rows by @sgrebnov in #8931
• Cayenne: include cayenne_metadata_dir to known params by @sgrebnov in #8933
• Rename Ingestion Lag chart in example dashboards by @krinart in #8932
• fix(caching): Fix HTTP caching always MISS when projection excludes fetched_at by @sgrebnov in #8930
• Reset expiry after snapshot bootstraping for Caching by @krinart in #8925
• Set use_ssl=false for sccache by @lukekim in #8945
• Hash indexing for Arrow Acceleration by @lukekim in #8924
• [Cayenne] Acceleration snapshots support by @lukekim in #7973
• perf(caching): Non-blocking cache writes on cache miss by @sgrebnov in #8948
• Update NSQL models by @lukekim in #8951
• Hash Index Key verification by @lukekim in #8949
• Add snapshots_creation_policy param by @krinart in #8954
• Remove candle & cudarc from non-models build by @lukekim in #8955
• Acceleration Snapshots API and CLI by @lukekim in #8934
• Ignore test for data_components arrow::indexed::test_primary_key_value_matches_batch by @Jeadie in #8962
• fix: Update benchmark snapshots by @app/github-actions in #8965
• Hash Index secondary index support by @lukekim in #8958
• fix: Support primary key constraints in partitioned DuckDB tables mode by @sgrebnov in #8966
• perf(caching): Batch cache writes by @sgrebnov in #8959
• CI perf optimizations by @lukekim in #8968
• Fix Makefile linting by @Jeadie in #8970
• Fixes in testoperator run text-to-sql. by @Jeadie in #8927
• implement Chat::as_sql for xAI anthropic by @Jeadie in #8957
• Fix duckdb_file_path in search integration test by @Jeadie in #8972
• fix: Update benchmark snapshots by @app/github-actions in #8971
• Maintenance updates to Anthropic API by @Jeadie in #8956
• Add CacheBackend Trait, implement pingora-lru, and add throughput tests by @lukekim in #8080
• fix: Update benchmark snapshots by @app/github-actions in #8974
• fix: Update benchmark snapshots by @app/github-actions in #8975
• Make accelerator shutdown more robust by @lukekim in #8969
• feat(duckdb): Add on_refresh_sort_columns for post-write data ordering (initial version) by @sgrebnov in #8964
• Proper handling for initial snapshot by @krinart in #8911
• fix: Remove --no-default-features from cargo-hack command in features workflow by @phillipleblanc in #8977
• build(deps): bump actions/cache from 5.0.1 to 5.0.2 by @app/dependabot in #8983
• build(deps): bump actions/checkout from 4 to 6 by @app/dependabot in #8982
• build(deps): bump actions/setup-go from 6.1.0 to 6.2.0 by @app/dependabot in #8984
• build(deps): bump github.com/olekukonko/tablewriter from 1.1.2 to 1.1.3 by @app/dependabot in #8979
• build(deps): bump github.com/klauspost/compress from 1.18.2 to 1.18.3 by @app/dependabot in #8980
• Add /v1/queries and Arrow Flight async APIs by @lukekim in #8946
• build(deps): bump Vampire/setup-wsl from 5 to 6 by @app/dependabot in #8981
• fix: Update Search integration test snapshots by @app/github-actions in #8973
• build(deps): bump insta from 1.46.0 to 1.46.1 by @app/dependabot in #8988
• build(deps): bump schemars from 1.1.0 to 1.2.0 by @app/dependabot in #8985
• fix: Update benchmark snapshots by @app/github-actions in #8978
• fix: Data correctness edge cases by @lukekim in #8953
• Correct MinIO path syntax for spiced download (Part 2) by @Jeadie in #8995
• Make .spice/data in search integration tests by @Jeadie in #8992
• fix: Hash index composite keys null values by @lukekim in #9001
• Update Cayenne status to Beta by @lukekim in #9002
• fix: Disable TPC-DS result validation (not yet supported) by @sgrebnov in #9004
• feat: Upgrade to DataFusion v51 and dependencies by @lukekim in #8864
• Improvements for snapshots_creation_policy by @krinart in #9003
• fix(ci): restore cached spicepod-validator binary instead of lookup-only by @phillipleblanc in #9007
• Update version by @krinart in #9010
• Update lock file - https://github.com/spiceai/spiceai/commit/53babbf07ca8c1c7b2e1da42ce58c465d9bc9276/
• fix: Enable Cayenne acceleration snapshots by @lukekim in #9020
• Add TPC-DS integration tests with S3 source and PostgreSQL acceleration by @phillipleblanc in #9006
• fix(tests): fix flaky/slow/failing unit tests by @phillipleblanc in #9009
• fix: Update benchmark snapshots for DF51 upgrade by @app/github-actions in #9008
• fix: add feature gate to rrf TEST_EMBEDDING_MODEL by @phillipleblanc in #9017
• fix: features check by @phillipleblanc in #9014
• URL table support by @lukekim in #9018
• ScyllaDB key filter by @lukekim in #8997
• fix: Schema mismatch when using column projection with HTTP caching by @phillipleblanc in #9021
• Add more tests for HTTP caching with columns selection by @sgrebnov in #9025
• HTTP cache snapshots: default to time_interval and fix snapshots_creation_policy: on_change by @sgrebnov in #9026
• Fix duplicate snapshot creation on startup by @sgrebnov in #9029
• Remove waiting for runtime to be ready before creating snapshot by @krinart in #9033
• Fix snapshot on_change policy to skip when no writes occurred by @sgrebnov in #9028
• Release notes for release release/1.11.0-rc.2 by @krinart in #9016
• ci: use arduino/setup-protoc for official protobuf compiler by @phillipleblanc in #9036
• ci: install unzip on aarch64 runner for arduino/setup-protoc by @phillipleblanc in #9038
• fix: don't fail release if upload to minio fails by @phillipleblanc in #9039
• Improve validation and logging for hash indexes by @lukekim in #9047
• Pin to ubuntu-22.04 by @lukekim in #9068
• Fix broken telemetry for testoperator by @krinart in #9054
• Fix release builds by @lukekim in #9069
• Spice 1.11.0-rc3 release notes by @krinart in #9070
• Update spicepod.schema.json by @app/github-actions in #9071
• Add missing protoc step to setup-cc action by @krinart in #9041
• Fix TLS connection for grpc+tls:// Flight SQL endpoints and add custom CA certificate support by @phillipleblanc in #9073
• Update 1.11.0-rc.3 release notes by @krinart in #9082
• Fix formula_1 and codebase_community in bird-bench by @Jeadie in #9000
• Cayenne S3 Express One Zone improvements by @lukekim in #9015
• Add zlib1g-dev to CI by @lukekim in #9052
• Upgrade Vortex with CASE-WHEN by @lukekim in #9051
• fix: Cayenne CatalogError handling for constraint violations by @lukekim in #9050
• Fix Docker build failing to copy shared libraries due to ldd output parsing by @phillipleblanc in #9058
• feat: Change /v1/sql and FlightSQL to use local execution in cluster mode by @phillipleblanc in #9055
• Remove unmaintained dependencies by @lukekim in #9045
• Enable cayenne + changes stream by @Jeadie in #9053
• feat(cli): add spice query command for async queries REPL by @phillipleblanc in #9057
• Remove unncessary allocations by @lukekim in #9059
• Add dataset_acceleration_size_bytes metric by @krinart in #9062
• Fix tracing of sql_query beneath tool_use::sample_data. by @Jeadie in #9043
• Basic script to run distributed spice by @Jeadie in #9049
• Add integration tests for Acceleration Snapshots by @krinart in #9067
• Upgrade CUDA toolkit to 12.6.0 by @sgrebnov in #9079
• Install required protoc dependency for CUDA build by @sgrebnov in #9080
• feat(cluster): add executor control stream heartbeat by @phillipleblanc in #9072
• feat: Fix async queries API and integrate Ballista shuffle improvements by @lukekim in #9075
• Remove models variant (now default) & Windows builds (use WSL) by @lukekim in #9063
• Cayenne: share upload semaphore across partitions to bound memory growth and optimize I/O by @sgrebnov in #9078
• Snowflake data connector - add snowflake_private_key parameter by @ewgenius in #9085
• Rewrite Go CLI in Rust by @phillipleblanc in #9061
• GCS Data Connector (Alpha) by @lukekim in #9084
• Skip 'latest' Docker tag for pre-release versions by @sgrebnov in #9077
• Add HTTP endpoints for acceleration snapshots API by @phillipleblanc in #9065
• Cayenne: Allow append mode with both primary_key and time_column by @sgrebnov in #9090
• Add Cluster Observability (Metrics+Dashboard) by @phillipleblanc in #9066
• proto for 'CayenneAccelerationExec' by @Jeadie in #9094
• Add 'anthropic-beta' header for structured outputs by @Jeadie in #9093
• Cayenne: refactor write path to use insert_into() as single entry point (part 1) by @sgrebnov in #9088
• Fix testoperator dispatch by @sgrebnov in #9097
• Fix setup-spiced GH action (_models suffix does not exist anymore) by @sgrebnov in #9102
• build(deps): bump github/codeql-action from 4.31.10 to 4.31.11 by @app/dependabot in #9108
• Remove DistributeFileScanOptimizer and UnionProjectionPushdownOptimizer & set target_partitions dynamically based on cluster capacity by @phillipleblanc in #9100
• build(deps): bump zip from 2.4.2 to 6.0.0 by @app/dependabot in #9111
• fix: Preserve query parameter order in HTTP connector to match filter values by @sgrebnov in #9114
• Add PollNow interrupt for Ballista executors to reduce task scheduling latency by @phillipleblanc in #9098
• Revert "GCS Data Connector (Alpha) " by @lukekim in #9084
• Fix stack overflow for CDC batching by @krinart in #9115
• fix: update Ballista fork to include executor timeout fix by @phillipleblanc in #9124
• Properly propagate SIGINT/SIGTERM from CLI to runtime by @krinart in #9127
• fix: Use the same vortex dependency as ballista by @peasee in #9123
• release: Bump version to 1.11.0 for stable - https://github.com/spiceai/spiceai/commit/14d09f8e262008df69ded898ed3bebee08471508/
• Cayenne snapshots with shared metadata by @lukekim in #9118
• Improve error handling for URL tables with Azure URLs by @phillipleblanc in #9129
• Add missing Windows build step for spice CLI in build_and_release workflow by @phillipleblanc in #9143
• Fix install-dev to use debug build path for spice binary by @phillipleblanc in #9142
• fix: CLI builds by @peasee in #9145
• Always create initial snapshots (unless bootstrapped) + when no snapshots exist by @krinart in #9119
• fix(cayenne): Fix upsert with pending deletions causing duplicate PKs by @sgrebnov in #9152
• fix(flightrepl): Add chrono-tz feature to flightrepl for timezone formatting by @sgrebnov in #9153
• fix(delta_lake): Preserve container name in ABFSS URLs for Azure Delta Lake tables by @sgrebnov in #9155
• fix: Make CLI system and asset type detection more robust by @peasee in #9148
• fix: Set query set properly on benchmarks telemetry metrics attributes by @peasee in #9162
• fix: Download _models variant - https://github.com/spiceai/spiceai/commit/27f3058d0007595b02c198755c3b22319032ff30/
• fix: Helm chart image tag - https://github.com/spiceai/spiceai/commit/7405c8df0db4ecce0ed6d4a4d424553d604b9036/
• Revert "Remove models variant (now default) & Windows builds (use WSL) " by @lukekim in #9063
• fix(cli): Several CLI fixes from the Go to Rust migration by @lukekim in #9157

Announcing the release of Spice v1.11.0-rc.3! ⭐

v1.11.0-rc.3 is a patch release that includes improvements to Hash Indexing for Arrow Acceleration and fixes for TLS connections with Flight SQL endpoints.

What's New in v1.11.0-rc.3​

Hash Indexing for Arrow Acceleration (experimental)​

Arrow-based accelerations now support hash indexing for faster point lookups on equality predicates. Hash indexes provide O(1) average-case lookup performance for columns with high cardinality.

Features:

• Primary key hash index support
• Secondary index support for non-primary key columns
• Composite key support with proper null value handling

Example configuration:

datasets:
  - from: postgres:users
    name: users
    acceleration:
      enabled: true
      engine: arrow
      primary_key: user_id
      indexes:
        '(tenant_id, user_id)': unique  # Composite hash index

For more details, refer to the Hash Index Documentation.

Flight SQL TLS Connection Fixes​

TLS Connection Support: Fixed TLS connection issues when using grpc+tls:// scheme with Flight SQL endpoints. Added support for custom CA certificate files via the new flightsql_tls_ca_certificate_file parameter.

Contributors​

• @lukekim
• @phillipleblanc

Breaking Changes​

No breaking changes.

Cookbook Updates​

No major cookbook updates.

The Spice Cookbook includes 86 recipes to help you get started with Spice quickly and easily.

Upgrading​

To upgrade to v1.11.0-rc.3, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:v1.11.0-rc.3 image:

docker pull spiceai/spiceai:v1.11.0-rc.3

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai --version 1.11.0-rc.3

AWS Marketplace:

Spice is available in the AWS Marketplace.

What's Changed​

Changelog​

• Hash indexing for Arrow Acceleration by @lukekim in #8924
• Improve validation and logging for hash indexes @lukekim in #9047
• Fix TLS connection for grpc+tls:// Flight SQL endpoints and add custom CA certificate support @phillipleblanc in #9073

Announcing the release of Spice v1.4.0! ⚡

This release upgrades DataFusion to v47 and Arrow to v55 for faster queries, more efficient Parquet/CSV handling, and improved reliability. It introduces the AWS Glue Catalog and Data Connectors for native access to Glue-managed data on S3, and adds support for Databricks U2M OAuth for secure Databricks user authentication.

New Cron-based dataset refreshes and worker schedules enable automated task management, while dataset and search results caching improvements further optimizes query, search, and RAG performance.

What's New in v1.4.0​

DataFusion v47 Highlights​

Spice.ai is built on the DataFusion query engine. The v47 release brings:

Performance Improvements 🚀: This release delivers major query speedups through specialized GroupsAccumulator implementations for first_value, last_value, and min/max on Duration types, eliminating unnecessary sorting and computation. TopK operations are now up to 10x faster thanks to early exit optimizations, while sort performance is further enhanced by reusing row converters, removing redundant clones, and optimizing sort-preserving merge streams. Logical operations benefit from short-circuit evaluation for AND/OR, reducing overhead, and additional enhancements address high latency from sequential metadata fetching, improve int/string comparison efficiency, and simplify logical expressions for better execution.

Bug Fixes & Compatibility Improvements 🛠️: The release addresses issues with external sort, aggregation, and window functions, improves handling of NULL values and type casting in arrays and binary operations, and corrects problems with complex joins and nested window expressions. It also addresses SQL unparsing for subqueries, aliases, and UNION BY NAME.

See the Apache DataFusion 47.0.0 Changelog for details.

Arrow v55 Highlights​

Arrow v55 delivers faster Parquet gzip compression, improved array concatenation, and better support for large files (4GB+) and modular encryption. Parquet metadata reads are now more efficient, with support for range requests and enhanced compatibility for INT96 timestamps and timezones. CSV parsing is more robust, with clearer error messages. These updates boost performance, compatibility, and reliability.

See the Arrow 55.0.0 Changelog and Arrow 55.1.0 Changelog for details.

Runtime Highlights​

Search Result Caching: Spice now supports runtime caching for search results, improving performance for subsequent searches and chat completion requests that use the document_similarity LLM tool. Caching is configurable with options like maximum size, item TTL, eviction policy, and hashing algorithm.

Example spicepod.yml configuration:

runtime:
  caching:
    search_results:
      enabled: true
      max_size: 128mb
      item_ttl: 5s
      eviction_policy: lru
      hashing_algorithm: siphash

For more information, refer to the Caching documentation.

AWS Glue Catalog Connector Alpha: Connect to AWS Glue Data Catalogs to query Iceberg, Parquet, or CSV tables in S3.

Example spicepod.yml configuration:

catalogs:
  - from: glue
    name: my_glue_catalog
    params:
      glue_key: <your-access-key-id>
      glue_secret: <your-secret-access-key>
      glue_region: <your-region>
    include:
      - 'testdb.hive_*'
      - 'testdb.iceberg_*'

sql> show tables;
+-----------------+--------------+-------------------+------------+
| table_catalog   | table_schema | table_name        | table_type |
+-----------------+--------------+-------------------+------------+
| my_glue_catalog | testdb       | hive_table_001    | BASE TABLE |
| my_glue_catalog | testdb       | iceberg_table_001 | BASE TABLE |
| spice           | runtime      | task_history      | BASE TABLE |
+-----------------+--------------+-------------------+------------+

For more information, refer to the Glue Catalog Connector documentation.

AWS Glue Data Connector Alpha: Connect to specific tables in AWS Glue Data Catalogs to query Iceberg, Parquet, or CSV in S3.

Example spicepod.yml configuration:

datasets:
  - from: glue:my_database.my_table
    name: my_table
    params:
      glue_auth: key
      glue_region: us-east-1
      glue_key: ${secrets:AWS_ACCESS_KEY_ID}
      glue_secret: ${secrets:AWS_SECRET_ACCESS_KEY}

For more information, refer to the Glue Data Connector documentation.

Databricks U2M OAuth: Spice now supports User-to-Machine (U2M) authentication for Databricks when called with a compatible client, such as the Spice Cloud Platform.

datasets:
  - from: databricks:spiceai_sandbox.default.messages
    name: messages
    params:
      databricks_endpoint: ${secrets:DATABRICKS_ENDPOINT}
      databricks_cluster_id: ${secrets:DATABRICKS_CLUSTER_ID}
      databricks_client_id: ${secrets:DATABRICKS_CLIENT_ID}

Dataset Refresh Schedules: Accelerated datasets now support a refresh_cron parameter, automatically refreshing the dataset on a defined cron schedule. Cron scheduled refreshes respect the global dataset_refresh_parallelism parameter.

Example spicepod.yml configuration:

datasets:
  - name: my_dataset
    from: s3://my-bucket/my_file.parquet
    acceleration:
      refresh_cron: 0 0 * * * # Daily refresh at midnight

For more information, refer to the Dataset Refresh Schedules documentation.

Worker Execution Schedules: Workers now support a cron parameter and will execute an LLM-prompt or SQL query automatically on the defined cron schedule, in conjunction with a provided params.prompt.

Example spicepod.yml configuration:

workers:
  - name: email_reporter
    models:
      - from: gpt-4o
    params:
      prompt: 'Inspect the latest emails, and generate a summary report for them. Post the summary report to the connected Teams channel'
    cron: 0 2 * * * # Daily at 2am

For more information, refer to the Worker Execution Schedules documentation.

SQL Worker Actions: Spice now supports workers with sql actions for automated SQL query execution on a cron schedule:

workers:
  - name: my_worker
    cron: 0 * * * *
    sql: 'SELECT * FROM lineitem'

For more information, refer to the Workers with a SQL action documentation;

Contributors​

• @Jeadie
• @phillipleblanc
• @Sevenannn
• @lukekim
• @kczimm
• @ewgenius
• @peasee
• @sgrebnov

Breaking Changes​

• No breaking changes.

Cookbook Updates​

• Added Glue Catalog Connector and Data Connector cookbooks: Connect to tables and databases in the AWS Glue Data catalog.
• Added Cron-based Dataset Refresh: Refresh datasets on defined schedules.

The Spice Cookbook now includes 70 recipes to help you get started with Spice quickly and easily.

Upgrading​

To upgrade to v1.4.0, use one of the following methods:

CLI:

spice upgrade

Homebrew:

brew upgrade spiceai/spiceai/spice

Docker:

Pull the spiceai/spiceai:1.4.0 image:

docker pull spiceai/spiceai:1.4.0

For available tags, see DockerHub.

Helm:

helm repo update
helm upgrade spiceai spiceai/spiceai