We use cookies to give you a better online experience
Got it

FAQ

Find quick answers to common questions about Firebolt
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

How does Firebolt's sub-plan result caching improve query speed?

Sub-plan result caching allows Firebolt to reuse intermediate query artifacts, such as hash tables computed during previous requests when serving new requests, reducing query processing times significantly.It includes built-in automatic cache eviction for efficient memory utilization while maintaining real-time, fully transactional results.

Low Latency
COPY LINK TO ANSWER
how-does-firebolts-sub-plan-result-caching-improve-query-speed

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolts-sub-plan-result-caching-improve-query-speed

What makes Firebolt ideal for low-latency, data-intensive workloads?

Firebolt is engineered to handle hundreds of analytical queries per second; without compromising speed. It offers unparalleled cost efficiency with industry-leading price-to-performance ratios and scales seamlessly to handle terabytes of data with minimal performance impact.

Low Latency
COPY LINK TO ANSWER
what-makes-firebolt-ideal-for-low-latency-data-intensive-workloads

https://firebolt.io/faqs-v2-knowledge-center/what-makes-firebolt-ideal-for-low-latency-data-intensive-workloads

How can I select the right primary index to optimize performance in Firebolt?

To optimize query performance in Firebolt, follow these guidelines for selecting a primary index:

Frequently Queried Columns: Choose columns often used in WHERE clauses or joins for faster data retrieval.

Range Queries: Include columns used in range filters, like dates, to improve performance in range-based queries.

Data Distribution: Pick columns with many unique values (high cardinality) to ensure even data distribution.

Sorting: Select columns based on how data is typically sorted in queries to minimize the amount of scanned data.

For more detailed information, check out Firebolt’s comprehensive guide on primary indexes.

These steps ensure efficient data pruning and faster query execution.

Low Latency
COPY LINK TO ANSWER
how-can-i-select-the-right-primary-index-to-optimize-performance-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/how-can-i-select-the-right-primary-index-to-optimize-performance-in-firebolt

What are aggregating indexes, and how do they benefit performance?

Firebolt's aggregating index pre-calculates and stores aggregate function results for improved query performance, similar to a materialized view that works with Firebolt's F3 storage format. Firebolt selects the best aggregating indexes to optimize queries at runtime, avoiding full table scans. These indexes are automatically updated with new or modified data to remain consistent with the underlying table data. In multi-node engines, Firebolt shards aggregating indexes across nodes, similar to the sharding of the underlying tables.

Low Latency
COPY LINK TO ANSWER
what-are-aggregating-indexes-and-how-do-they-benefit-performance

https://firebolt.io/faqs-v2-knowledge-center/what-are-aggregating-indexes-and-how-do-they-benefit-performance

When, how, and why should I warm up an aggregating index in Firebolt?

Warming up an aggregating index preloads the data into the cache, improving query performance. Use the CHECKSUM function on a query matching the index definition to warm up the index, leading to faster execution when it is utilized.

Solution:

Use the CHECKSUM function to preload specific data into the cache. Focus on frequently accessed columns or data ranges to optimize performance and minimize cache usage.

Example:

-- Warm-up the entire table SELECT CHECKSUM(*) FROM playstats;
-- Warm-up specific columnsSELECT CHECKSUM(GameID, PlayerID, CurrentScore) FROM playstats;
-- Warm-up specific data rangeSELECT CHECKSUM(*) FROM playstats WHERE CurrentLevel BETWEEN 1 AND 5;

Warming up tables using CHECKSUM ensures data is stored in the cache, improving performance for large tables or frequently queried datasets. Use filters or column selection to target relevant data efficiently.

Low Latency
COPY LINK TO ANSWER
when-how-and-why-should-i-warm-up-an-aggregating-index-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/when-how-and-why-should-i-warm-up-an-aggregating-index-in-firebolt

How do I warm up a table in Firebolt?

Warming up a table can improve query performance by preloading data into the cache. Running warm-up queries after an engine starts ensures faster execution of subsequent queries.

Low Latency
COPY LINK TO ANSWER
how-do-i-warm-up-a-table-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-warm-up-a-table-in-firebolt

What is the performance impact of queries on cold data?

Querying cold data, or data not yet cached in Firebolt's local SSD storage, may result in slightly slower performance compared to querying hot (cached) data. However, Firebolt's efficient caching mechanisms ensure that even cold data is accessed quickly, minimizing the performance impact.

Low Latency
COPY LINK TO ANSWER
what-is-the-performance-impact-of-queries-on-cold-data

https://firebolt.io/faqs-v2-knowledge-center/what-is-the-performance-impact-of-queries-on-cold-data

What is the Shuffle operation, and why is it critical for distributed queries?

The Shuffle operation is the key ingredient to executing queries at scale in distributed systems like Firebolt. Firebolt leverages close to all available network bandwidth and streams intermediate results from one execution state to the next whenever possible. By overlapping the execution of different stages, Firebolt reduces the overall query latency

Low Latency
COPY LINK TO ANSWER
what-is-the-shuffle-operation-and-why-is-it-critical-for-distributed-queries

https://firebolt.io/faqs-v2-knowledge-center/what-is-the-shuffle-operation-and-why-is-it-critical-for-distributed-queries

What is vectorized execution, and why is it important?

Firebolt’s engine uses vectorized execution, which processes batches of thousands of rows at a time, leveraging modern CPUs for maximum efficiency. Combined with multi-threading, this approach allows queries to scale across all CPU cores, optimizing performance.*

Boncz, Peter A., Marcin Zukowski, and Niels Nes. "MonetDB/X100: Hyper-Pipelining Query Execution." CIDR. Vol. 5. 2005.
* Nes, Stratos Idreos Fabian Groffen Niels, and Stefan Manegold Sjoerd Mullender Martin Kersten. "MonetDB: Two decades of research in column-oriented database architectures." Data Engineering 40 (2012).

Low Latency
COPY LINK TO ANSWER
what-is-vectorized-execution-and-why-is-it-important

https://firebolt.io/faqs-v2-knowledge-center/what-is-vectorized-execution-and-why-is-it-important

What is data pruning, and how does it work in Firebolt?

Data pruning in Firebolt involves using sparse indexes to minimize the amount of data scanned during queries. This allows for tens of millisecond response times by reducing I/O usage, making your queries highly performant.

Low Latency
COPY LINK TO ANSWER
what-is-data-pruning-and-how-does-it-work-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/what-is-data-pruning-and-how-does-it-work-in-firebolt

How does Firebolt optimize query performance?

Firebolt uses advanced query processing techniques such as granular range-level data pruning with sparse indexes, incrementally updated aggregating indexes, vectorized multi-threaded execution, and tiered caching, including sub-plan result caching.These techniques both minimize data being scanned and reduce CPU time by reusing precomputed, enabling query processing times in tens of milliseconds latency on hundreds of TBs of data.

Low Latency
COPY LINK TO ANSWER
how-does-firebolt-optimize-query-performance

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-optimize-query-performance

How does Firebolt handle scaling for large datasets?

Firebolt scales to manage hundreds of terabytes of data without performance bottlenecks. Its distributed architecture allows it to leverage all available network bandwidth and execute queries at scale with efficient cross-node data transfer using streaming data shuffle.

Low Latency
COPY LINK TO ANSWER
how-does-firebolt-handle-scaling-for-large-datasets

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-handle-scaling-for-large-datasets

How does Firebolt support high concurrency?

Firebolt engines can scale up and out to handle high-concurrency workloads. Firebolt supports adding up to 10 clusters within a single engine to manage spikes in concurrent queries. These clusters can be dynamically added on-demand, ensuring optimal performance even during peak loads.

Low Latency
COPY LINK TO ANSWER
how-does-firebolt-support-high-concurrency

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-support-high-concurrency

How can I monitor and optimize performance in Firebolt?

Firebolt offers observability views through information_schema, allowing you to access real-time engine metrics. These insights help you size your engines for optimal performance and cost efficiency. Read more here- https://docs.firebolt.io/general-reference/information-schema/views.html

Low Latency
COPY LINK TO ANSWER
how-can-i-monitor-and-optimize-performance-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/how-can-i-monitor-and-optimize-performance-in-firebolt

Can you provide me with specific benchmarks of Firebolt against my current DWH? (Snowflake, BQ, RS, etc.)

Firebolt has been benchmarked against several major data warehouses, including Snowflake, BigQuery, and Redshift. These benchmarks highlight Firebolt's superior performance in low-latency, high-concurrency queries, especially for fast aggregations and real-time analytics. See further details in our benchmark Github repo and our benchmark articles about handling concurency,  high-volume ingestion and DML operations.

Low Latency
COPY LINK TO ANSWER
can-you-provide-me-with-specific-benchmarks-of-firebolt-against-my-current-dwh-snowflake-bq-rs-etc

https://firebolt.io/faqs-v2-knowledge-center/can-you-provide-me-with-specific-benchmarks-of-firebolt-against-my-current-dwh-snowflake-bq-rs-etc

What are Firebolt Engines?

In Firebolt, an “engine” refers to a virtual compute resource that provides the processing power to execute queries, load data, and perform various SQL driven tasks. Unlike traditional cloud data warehouses, Firebolt engines can be resized, paused, and resumed in a much more granular, and cost effective way to optimize performance and cost.

Engines
COPY LINK TO ANSWER
what-are-firebolt-engines

https://firebolt.io/faqs-v2-knowledge-center/what-are-firebolt-engines

How does Firebolt ensure data integrity?

Firebolt is ACID compliant and treats every operation as a transaction. For example, data from a COPY FROM operation is visible only after the entire operation is successful, ensuring data integrity. This eliminates partial updates ensuring data integrity at all times.

ELT
COPY LINK TO ANSWER
how-does-firebolt-ensure-data-integrity

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-ensure-data-integrity

What SQL capabilities does Firebolt offer?

Everything in Firebolt is done through SQL. Firebolt’s SQL dialect is compliant with Postgres’s SQL dialect and supports running SQL queries directly on structured and semi-structured data without compromising speed. Firebolt also has multiple extensions in its SQL dialect to better serve modern data applications.

SQL
COPY LINK TO ANSWER
what-sql-capabilities-does-firebolt-offer

https://firebolt.io/faqs-v2-knowledge-center/what-sql-capabilities-does-firebolt-offer

Can Firebolt be used with dbt?

Yes, Firebolt integrates seamlessly with dbt (data build tool). Firebolt’s dbt adapter allows you to model, transform, and manage your data workflows using dbt. This integration combines dbt’s transformation capabilities with Firebolt’s high-performance query engine, enabling ELT workflows. You can also define models in dbt to run directly on Firebolt, helping you process large volumes of data more efficiently. For more details, visit Firebolt's blog on ELT with dbt.

Integrations
COPY LINK TO ANSWER
can-firebolt-be-used-with-dbt

https://firebolt.io/faqs-v2-knowledge-center/can-firebolt-be-used-with-dbt

Are there cross-regional costs when transfering data from one region to another in Firebolt?

Yes, transferring data between different AWS regions incurs cross-region data transfer costs according to AWS pricing. Firebolt itself does not add additional fees for cross-regional data transfers, but users should consider AWS network charges when moving data across regions.

Deployment & Architecture
COPY LINK TO ANSWER
are-there-cross-regional-costs-when-transfering-data-from-one-region-to-another-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/are-there-cross-regional-costs-when-transfering-data-from-one-region-to-another-in-firebolt

What is the level of Firebolt billing report?

Firebolt provides comprehensive billing view that break down both compute (engine) consumption and storage usage. You can access detailed information on engine usage through the information_schema.engines_billing table and storage usage through the information_schema.storage_billing table. These tables and UI view offer granular insights into usage by specific engines, storage by table, and usage patterns, allowing for better cost tracking and resource optimization. The billing details can be viewed by hour, day, or month in the Firebolt UI, helping users stay informed about their resource consumption.

Pricing & Billing
COPY LINK TO ANSWER
what-is-the-level-of-firebolt-billing-report

https://firebolt.io/faqs-v2-knowledge-center/what-is-the-level-of-firebolt-billing-report

Are all identified security and regulatory requirements contractually addressed and remediated before granting customers access to Firebolt systems?

Yes, more details in our End User License Agreement (EULA) and Data Processing Addendum (DPA).

Security
COPY LINK TO ANSWER
are-all-identified-security-and-regulatory-requirements-contractually-addressed-and-remediated-before-granting-customers-access-to-firebolt-systems

https://firebolt.io/faqs-v2-knowledge-center/are-all-identified-security-and-regulatory-requirements-contractually-addressed-and-remediated-before-granting-customers-access-to-firebolt-systems

Why did the last unsaved script disappear in Firebolt?

Firebolt stores unsaved scripts in your browser’s local storage, which has a limit of around 5 MB. If multiple websites use local storage, it can get full, causing unsaved scripts in the Firebolt SQL editor to be erased.

To avoid this:
Save your scripts regularly.
Clear your browser cache/cookies to free up local storage and prevent data loss.
Remember, clearing your cache will also remove other saved data, so use this solution carefully.

Miscellaneous
COPY LINK TO ANSWER
why-did-the-last-unsaved-script-disappear-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/why-did-the-last-unsaved-script-disappear-in-firebolt

How can I view Firebolt's current roadmap or see open feature requests?

Firebolt values transparency and customer feedback when planning its roadmap. To view the current roadmap or see open feature requests, reach out to Firebolt’s support or your customer success manager. Additionally, Firebolt’s team actively gathers feedback from users and considers feature requests as part of ongoing development efforts. Regular updates are communicated through newsletters and user forums. Stay connected to get insights into upcoming releases and features tailored to your needs.

Roadmap
COPY LINK TO ANSWER
how-can-i-view-firebolts-current-roadmap-or-see-open-feature-requests

https://firebolt.io/faqs-v2-knowledge-center/how-can-i-view-firebolts-current-roadmap-or-see-open-feature-requests

What are the key dimensions of an engine that determine its topology?

An engine has three key dimensions:

Type - This refers to the type of nodes used in an engine.

Cluster - A collection of nodes of the same type.

Nodes - The number of nodes in each cluster.

An engine comprises one or more clusters. Every cluster in the engine has the same type and the same number of nodes.

Engines
COPY LINK TO ANSWER
what-are-the-key-dimensions-of-an-engine-that-determine-its-topology

https://firebolt.io/faqs-v2-knowledge-center/what-are-the-key-dimensions-of-an-engine-that-determine-its-topology

What options does Firebolt provide to import data?

Firebolt offers multiple data import options, including: COPY FROM SQL command for importing data from S3 buckets with built-in schema inference and automatic table creation. The 'Load data' wizard in the WebUI to explore, set options, infer schema, and load data into Firebolt tables. Direct read for CSV and Parquet files from S3 using read_csv and read_parquet table-valued functions. External tables for data stored in Amazon S3 buckets, supporting formats such as CSV, Parquet, AVRO, ORC, and JSON.

ELT
COPY LINK TO ANSWER
what-options-does-firebolt-provide-to-import-data

https://firebolt.io/faqs-v2-knowledge-center/what-options-does-firebolt-provide-to-import-data

Is Firebolt easy to use for data professionals familiar with SQL?

Yes, Firebolt is designed for ease of use, leveraging SQL simplicity and PostgreSQL compliance. It allows data professionals to manage, process, and query data effortlessly using familiar SQL commands.

SQL
COPY LINK TO ANSWER
is-firebolt-easy-to-use-for-data-professionals-familiar-with-sql

https://firebolt.io/faqs-v2-knowledge-center/is-firebolt-easy-to-use-for-data-professionals-familiar-with-sql

Does Firebolt have API connections to external data sources like Google Sheets?

At present, Firebolt does not have a direct API connection to external data sources like Google Sheets. However, you can leverage third-party tools or custom ETL pipelines to load data from sources like Google Sheets into Firebolt for analysis.

Integrations
COPY LINK TO ANSWER
does-firebolt-have-api-connections-to-external-data-sources-like-google-sheets

https://firebolt.io/faqs-v2-knowledge-center/does-firebolt-have-api-connections-to-external-data-sources-like-google-sheets

Can Firebolt be used with a GCP/Azure backend?

Firebolt is built natively on AWS and currently does not support running directly on Google Cloud Platform (GCP) or MS Azure. You would need to use AWS as the backend for Firebolt, but you can still ingest data from other cloud platforms through various data ingestion tools and connectors, or by loading data from those platforms into S3.

Deployment & Architecture
COPY LINK TO ANSWER
can-firebolt-be-used-with-a-gcp-azure-backend

https://firebolt.io/faqs-v2-knowledge-center/can-firebolt-be-used-with-a-gcp-azure-backend

What is the timing of the bill email from Firebolt, and how does it correlate with the AWS bill generation?

Firebolt's billing is generally sent monthly, aligning with the AWS billing cycle. The bill email provides a breakdown of engine usage and storage consumption, giving you visibility into your total cost. Because Firebolt runs on AWS infrastructure, its billing is influenced by the resources consumed in AWS, and the timing of Firebolt’s billing is closely aligned with AWS bills for the same period.

Pricing & Billing
COPY LINK TO ANSWER
what-is-the-timing-of-the-bill-email-from-firebolt-and-how-does-it-correlate-with-the-aws-bill-generation

https://firebolt.io/faqs-v2-knowledge-center/what-is-the-timing-of-the-bill-email-from-firebolt-and-how-does-it-correlate-with-the-aws-bill-generation

Do you allow customers to view your SOC 2 certification reports?

Yes, our SOC 2 Type-2 + HIPAA report is available subject to a Non-Disclosure Agreement (NDA).

Security
COPY LINK TO ANSWER
do-you-allow-customers-to-view-your-soc-2-certification-reports

https://firebolt.io/faqs-v2-knowledge-center/do-you-allow-customers-to-view-your-soc-2-certification-reports

What are Firebolt's plans for enabling table cloning and time travel capabilities?

Firebolt has recognized the demand for table cloning and time travel capabilities, which are important features for various use cases, such as data versioning and simplified testing environments. While these features are not currently available, Firebolt's product team is actively evaluating them as part of its long-term roadmap. Stay tuned for updates, and feel free to check in with Firebolt support or your customer success manager for the latest developments.

Roadmap
COPY LINK TO ANSWER
what-are-firebolts-plans-for-enabling-table-cloning-and-time-travel-capabilities

https://firebolt.io/faqs-v2-knowledge-center/what-are-firebolts-plans-for-enabling-table-cloning-and-time-travel-capabilities

What are the different types of nodes available in Firebolt?

There are four node types available in Firebolt: Small, Medium, Large, and X-Large. Each node type provides a certain amount of CPU, RAM, and SSD. These resources scale linearly with the node type. For example, an "M" type node provides twice as much CPU, RAM, and SSD as a "S" type node.

Engines
COPY LINK TO ANSWER
what-are-the-different-types-of-nodes-available-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/what-are-the-different-types-of-nodes-available-in-firebolt

What file formats are supported by 'COPY FROM'?

Firebolt currently supports Parquet and CSV formats. For AVRO, JSON, or ORC, use the external table option.

ELT
COPY LINK TO ANSWER
what-file-formats-are-supported-by-copy-from

https://firebolt.io/faqs-v2-knowledge-center/what-file-formats-are-supported-by-copy-from

How do I implement and organize fact and dimension tables in Firebolt?

When deciding between a fact or dimension table in Firebolt, it's important to consider how the data will be used and queried, as this choice impacts performance and how data is handled in multi-node engines.

Fact tables are typically large and contain measurable events, like sales or sensor readings. They usually hold foreign keys to dimension tables and measures that are aggregated (e.g., sums or averages). Fact tables benefit from aggregate indexes, which optimize heavy aggregations.

Dimension tables describe the entities in fact tables, such as product details or customer information. Dimension tables are usually smaller, updated more frequently, and replicated across nodes for faster lookups. Join indexes can be applied to dimensions to speed up lookup queries.

In general, choose a fact table when you need to aggregate large volumes of data, and a dimension table for smaller, descriptive datasets primarily used for lookups. For multi-node engines, keep in mind that fact tables are sharded, while dimension tables are replicated.

SQL
COPY LINK TO ANSWER
how-do-i-implement-and-organize-fact-and-dimension-tables-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-implement-and-organize-fact-and-dimension-tables-in-firebolt

Does Firebolt integrate with common BI and data tools?

Yes, Firebolt integrates with a wide range of popular BI and data tools, including Looker, Tableau, and Power BI, among others. These integrations allow users to leverage Firebolt’s performance while visualizing and analyzing data in their preferred tools. Additionally, Firebolt offers JDBC and ODBC drivers to facilitate connectivity with other tools.

Integrations
COPY LINK TO ANSWER
does-firebolt-integrate-with-common-bi-and-data-tools

https://firebolt.io/faqs-v2-knowledge-center/does-firebolt-integrate-with-common-bi-and-data-tools

Does Firebolt support multi-region deployments?

Firebolt supports deployment in multiple AWS regions, allowing you to choose the most appropriate region for your data and workloads. However, Firebolt does not currently offer seamless, cross-region deployments within a single account. To deploy across multiple regions, you need to create separate accounts in each region.

Deployment & Architecture
COPY LINK TO ANSWER
does-firebolt-support-multi-region-deployments

https://firebolt.io/faqs-v2-knowledge-center/does-firebolt-support-multi-region-deployments

What is a Firebolt Unit (FBU)?

Firebolt Unit is a normalized measurement of consumption. FBU normalizes consumption management irrespective of node type, number of nodes, number of clusters, duration of consumption, etc. Thanks to Firebolt’s multidimensional scaling, per-second billing, and auto-stop/start capabilities, compute consumption can be a fraction of a minute. FBU eliminates the need to keep track of individual node types, nodes, and the number of clusters. There’s no binding to specific instance types, so you are free to use pre-paid credits on any node type.

Pricing & Billing
COPY LINK TO ANSWER
what-is-a-firebolt-unit-fbu

https://firebolt.io/faqs-v2-knowledge-center/what-is-a-firebolt-unit-fbu

Do you allow customers to view your ISO 27001 or similar certification reports?

Firebolt is certified for ISO 27001 and ISO 27018. Certification reports are available here.

Security
COPY LINK TO ANSWER
do-you-allow-customers-to-view-your-iso-27001-or-similar-certification-reports

https://firebolt.io/faqs-v2-knowledge-center/do-you-allow-customers-to-view-your-iso-27001-or-similar-certification-reports

How many nodes can I use for each cluster in a given engine?

You can use anywhere from 1-128 nodes per cluster in a given engine.

Engines
COPY LINK TO ANSWER
how-many-nodes-can-i-use-for-each-cluster-in-a-given-engine

https://firebolt.io/faqs-v2-knowledge-center/how-many-nodes-can-i-use-for-each-cluster-in-a-given-engine

Can I directly copy data from S3 to Firebolt without creating a schema first?

Yes, Firebolt’s COPY FROM command can automatically create the destination table using AUTO_CREATE = TRUE, which maps columns and creates the table when it doesn't exist.

ELT
COPY LINK TO ANSWER
can-i-directly-copy-data-from-s3-to-firebolt-without-creating-a-schema-first

https://firebolt.io/faqs-v2-knowledge-center/can-i-directly-copy-data-from-s3-to-firebolt-without-creating-a-schema-first

How do I display numbers without commas in the Firebolt UI?

In Firebolt's UI, numeric values are automatically displayed with commas for readability (e.g., 123,456,789). However, this may be undesirable for fields like IDs or other values where commas aren’t needed.

Solution:
To remove commas from numbers in the UI, CAST the numeric field to TEXT using ::TEXT. This ensures that the number is displayed as a plain text string, without commas.

Example:

SELECT 
  playerid AS playerid_default,
  playerid::text AS playerid_text,
  nickname,
  email
FROM players
LIMIT 10;

In this example, playerid_default will display with commas, while playerid_text will display the number without commas.

This method only affects how numbers are displayed in the Firebolt UI and does not alter the underlying data or its formatting in external tools.

SQL
COPY LINK TO ANSWER
how-do-i-display-numbers-without-commas-in-the-firebolt-ui

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-display-numbers-without-commas-in-the-firebolt-ui

Does Firebolt support geospatial data and queries?

While this is coming soon, Firebolt does not natively support geospatial data types or queries. However, you can still store and manage geospatial data using standard data types like strings and numeric values, and process geospatial information via external tools or data pipelines integrated with Firebolt.

Integrations
COPY LINK TO ANSWER
does-firebolt-support-geospatial-data-and-queries

https://firebolt.io/faqs-v2-knowledge-center/does-firebolt-support-geospatial-data-and-queries

How does Firebolt handle disaster recovery and high availability?

On Firebolt Data is stored in Amazon S3, which inherently offers durability and availability features leveraging copies of data stored in 3 Availability Zones per Region. However, Firebolt does not natively provide cross-region disaster recovery (DR) at this time, so manual processes would need to be in place for cross-region DR setups. Compute High Availability across Availability Zones is a roadmap item.

Deployment & Architecture
COPY LINK TO ANSWER
how-does-firebolt-handle-disaster-recovery-and-high-availability

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-handle-disaster-recovery-and-high-availability

Does a given number of FBUs provide the same performance profile irrespective of configuration?

While FBUs measure consumption, the performance profile of a workload depends on the engine topology.

Pricing & Billing
COPY LINK TO ANSWER
does-a-given-number-of-fbus-provide-the-same-performance-profile-irrespective-of-configuration

https://firebolt.io/faqs-v2-knowledge-center/does-a-given-number-of-fbus-provide-the-same-performance-profile-irrespective-of-configuration

Do you allow customers to view your HIPAA reports?

Yes. As a business associate under HIPAA, we support business associate agreements (BAAs) to ensure healthcare data protection. Our SOC 2 Type-2 + HIPAA report is available subject to a Non-Disclosure Agreement (NDA)

Security
COPY LINK TO ANSWER
do-you-allow-customers-to-view-your-hipaa-reports

https://firebolt.io/faqs-v2-knowledge-center/do-you-allow-customers-to-view-your-hipaa-reports

How many clusters can I use per engine?

You can use up to 10 clusters per engine.

Engines
COPY LINK TO ANSWER
how-many-clusters-can-i-use-per-engine

https://firebolt.io/faqs-v2-knowledge-center/how-many-clusters-can-i-use-per-engine

How do I create an external table in Firebolt?

Use the CREATE EXTERNAL TABLE command to reference data stored outside Firebolt, like in an S3 bucket, while specifying the file format and schema.

ELT
COPY LINK TO ANSWER
how-do-i-create-an-external-table-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-create-an-external-table-in-firebolt

How do I choose between using a column in PARTITION BY versus in the primary index?

Use PARTITION BY when you need to split the table into distinct data segments for better data management or to prune large amounts of data quickly. Partitioning allows for efficient data removal (e.g., ALTER TABLE...DROP PARTITION).

Use the Primary Index when you want to organize the order of data for optimal query performance. The primary index helps Firebolt efficiently prune data during queries based on filter conditions.

Example:

If you often query by playerid but also need to manage data by tournamentid, you could use playerid in the primary index and tournamentid in PARTITION BY. This would allow you to both optimize query performance and manage large data segments.

CREATE TABLE playstats_partition (
  playerid integer,
  tournamentid integer,
  stattime timestampntz
) PRIMARY INDEX playerid
PARTITION BY tournamentid;
SQL
COPY LINK TO ANSWER
how-do-i-choose-between-using-a-column-in-partition-by-versus-in-the-primary-index

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-choose-between-using-a-column-in-partition-by-versus-in-the-primary-index

How can I handle errors related to missing credentials when accessing AWS S3 from Firebolt?

If you encounter errors due to missing credentials when accessing AWS S3 from Firebolt, ensure that you have the correct IAM roles and policies assigned. Alternatively, you can provide AWS keys directly within your external table definition using the CREDENTIALS parameter. Check your AWS permissions and Firebolt’s documentation for troubleshooting credential errors.

Integrations
COPY LINK TO ANSWER
how-can-i-handle-errors-related-to-missing-credentials-when-accessing-aws-s3-from-firebolt

https://firebolt.io/faqs-v2-knowledge-center/how-can-i-handle-errors-related-to-missing-credentials-when-accessing-aws-s3-from-firebolt

What are the options for setting up replication cross-region?

Firebolt does not yet support automatic cross-region replication. If you need to replicate data across regions, you will need to handle the data replication process manually using external tools or services like AWS DataSync or S3 cross-region replication.

Deployment & Architecture
COPY LINK TO ANSWER
what-are-the-options-for-setting-up-replication-cross-region

https://firebolt.io/faqs-v2-knowledge-center/what-are-the-options-for-setting-up-replication-cross-region

How is per-second billing calculated?

Each node type consumes a specified number of FBUs per hour. Compute consumption is billed in one-second increments. For example, a type ‘M’ node consumes 16 FBUs per hour. The same node running for one minute will consume FBU calculated as such: Consumed FBU = (Available FBU per hour / 3600) x ( 1 x 60 seconds) = (16/3600) x 60 = 0.27 FBUs.

Pricing & Billing
COPY LINK TO ANSWER
how-is-per-second-billing-calculated

https://firebolt.io/faqs-v2-knowledge-center/how-is-per-second-billing-calculated

What if I’m an existing AWS customer and have already opted-in to the AWS BAA?

A separate BAA with Firebolt is required since our service includes proprietary technology and other sub-processors not covered under the standard AWS HIPAA Eligible Services.

Security
COPY LINK TO ANSWER
what-if-im-an-existing-aws-customer-and-have-already-opted-in-to-the-aws-baa

https://firebolt.io/faqs-v2-knowledge-center/what-if-im-an-existing-aws-customer-and-have-already-opted-in-to-the-aws-baa

Do engines and databases have a one-to-one relationship?

No. Engines and databases are fully decoupled in Firebolt. A given engine can be used with multiple databases, and conversely, multiple engines can be used with a given database. On Firebolt, all engines can write to the same database. No need to segregate engines as read-write and read-only.

Engines
COPY LINK TO ANSWER
do-engines-and-databases-have-a-one-to-one-relationship

https://firebolt.io/faqs-v2-knowledge-center/do-engines-and-databases-have-a-one-to-one-relationship

How does Firebolt support incremental ingestion?

Firebolt allows filtering on file-level information such as name, modified time, and size using metadata fields like $source_file_timestamp, $source_file_name, and $source_file_size.

ELT
COPY LINK TO ANSWER
how-does-firebolt-support-incremental-ingestion

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-support-incremental-ingestion

How do I implement LEFT() and RIGHT() string functions in Firebolt?

To implement LEFT() and RIGHT() string functions in Firebolt, you can use the SUBSTR() function, as Firebolt does not natively support these functions.

LEFT() Alternative
To replicate the LEFT() function, use SUBSTR() to extract characters from the left side of a string. For example:

SELECT SUBSTR(nickname, 1, 6) FROM players WHERE nickname = 'murrayrebecca';
-- This returns "murray"
This extracts the first 6 characters from the string.

RIGHT() Alternative
For the RIGHT() function, combine SUBSTR() with LENGTH() to extract characters from the right side of the string. For example:

SELECT SUBSTR(nickname, LENGTH(nickname) - 6) FROM players WHERE nickname = 'murrayrebecca';
-- This returns "rebecca"

This extracts the last 7 characters by calculating the length of the string and subtracting the desired number of characters.

These methods allow you to achieve the same functionality as LEFT() and RIGHT() using SUBSTR() in Firebolt.

SQL
COPY LINK TO ANSWER
how-do-i-implement-left-and-right-string-functions-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-implement-left-and-right-string-functions-in-firebolt

How do I integrate Firebolt with Coralogix for better log visibility and troubleshooting?

Firebolt can be integrated with Coralogix through OpenTelemetry. Firebolt’s OTel Exporter allows you to export Firebolt engine metrics, query logs, and other telemetry data to any OpenTelemetry-compatible platform, including Coralogix. This integration enables real-time monitoring and troubleshooting, giving you better insights into engine performance, query execution, and resource usage. You can refer to Firebolt's GitHub repository for additional setup details and code samples.

Integrations
COPY LINK TO ANSWER
how-do-i-integrate-firebolt-with-coralogix-for-better-log-visibility-and-troubleshooting

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-integrate-firebolt-with-coralogix-for-better-log-visibility-and-troubleshooting

Is there a limit on number of Databases in a single account?

There is a soft limit of 100 databases per account, that can be increased if needed.

Deployment & Architecture
COPY LINK TO ANSWER
is-there-a-limit-on-number-of-databases-in-a-single-account

https://firebolt.io/faqs-v2-knowledge-center/is-there-a-limit-on-number-of-databases-in-a-single-account

When does consumption measurement start?

Consumption starts when the engine endpoint is available for querying.

Pricing & Billing
COPY LINK TO ANSWER
when-does-consumption-measurement-start

https://firebolt.io/faqs-v2-knowledge-center/when-does-consumption-measurement-start

Do you allow customers to view your PCI-DSS certification reports?

Firebolt is not PCI-DSS compliant and does not permit credit card data storage on its platform.

Security
COPY LINK TO ANSWER
do-you-allow-customers-to-view-your-pci-dss-certification-reports

https://firebolt.io/faqs-v2-knowledge-center/do-you-allow-customers-to-view-your-pci-dss-certification-reports

Is there a limit on the number of databases a given engine can support?

No. While there is no theoretical limit on the number of databases you can use with a given engine, note that the configuration of your engine will determine the performance of your applications. Based on the performance demands of your applications and the needs of your business, you may want to create the appropriate number of engines.

Engines
COPY LINK TO ANSWER
is-there-a-limit-on-the-number-of-databases-a-given-engine-can-support

https://firebolt.io/faqs-v2-knowledge-center/is-there-a-limit-on-the-number-of-databases-a-given-engine-can-support

How does Firebolt address streaming ingestion?

While streaming ingestion is on the roadmap, Firebolt currently don't have a native straming ability. However, Firebolt has the ability to run hiligh preforment micro-batching to persist data to S3 in Parquet or Avro format for near real-time ingestion.

ELT
COPY LINK TO ANSWER
how-does-firebolt-address-streaming-ingestion

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-address-streaming-ingestion

What causes "Unable to cast 'TEXT' to xxx target data type" errors when selecting from external tables in Firebolt?

This error occurs when Firebolt cannot convert data from a text format (e.g., CSV or TSV) to the expected column data type defined in the external table schema.

Common Scenarios:

Mismatched Data Types: If a column contains a value that doesn’t match the expected type (e.g., a string in a numeric column).

Example: A file contains the value "abc" in a column defined as LONG, which leads to the error.

Header Rows in Files: If a CSV file includes a header row and it's not excluded, Firebolt tries to interpret the header text as data.

Solution: Use SKIP_HEADER_ROWS in the TYPE parameter of the CREATE EXTERNAL TABLE DDL.

Troubleshooting Tip: Use a text editor to inspect the first few rows of the file for mismatches. If the issue isn’t obvious, use SELECT...LIMIT and OFFSET to locate problematic rows and identify the file using the SOURCE_FILE_NAME column.

Example query:

SELECT SOURCE_FILE_NAME, COUNT(*) 
FROM (SELECT *, SOURCE_FILE_NAME FROM my_external_table LIMIT 10000 OFFSET 0)
GROUP BY SOURCE_FILE_NAME;
SQL
COPY LINK TO ANSWER
what-causes-unable-to-cast-text-to-xxx-target-data-type-errors-when-selecting-from-external-tables-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/what-causes-unable-to-cast-text-to-xxx-target-data-type-errors-when-selecting-from-external-tables-in-firebolt

How do I use system settings in the REST API in Firebolt?

System settings in Firebolt allow you to control query execution behavior and performance, providing flexibility when needed. This is particularly useful when you want to override default settings for specific queries via the REST API.

To adjust settings such as the time_zone, you can embed them directly in the URL of your API call. For example, if you need to set the time_zone to UTC, include the parameter in the API call URL.

Example API call:

curl --location 'https://<user engine URL>?engine=<engine_name>&database=<database_name>&time_zone=UTC' \
--header 'Authorization: Bearer <authentication_token>' \
--data "SELECT TIMESTAMPTZ '1996-09-03 11:19:33.123456 Europe/Berlin'"

This query sets the time_zone system setting to UTC for the duration of the query. Each new API call requires you to include the necessary system settings again if you want to apply specific overrides.

Integrations
COPY LINK TO ANSWER
how-do-i-use-system-settings-in-the-rest-api-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-use-system-settings-in-the-rest-api-in-firebolt

What are the considerations for splitting into separate Databases?

The considerations for splitting into separate databases include governance, logical isolation, and performance aspects related to metadata caching. Here are the key points:

Governance and Isolation: Different databases can have different owners and permissions, allowing for better governance. This is particularly important when different teams or departments manage their own data.

Logical Grouping: Currently, without support for custom schemas, databases serve as the primary mechanism to logically group tables and views. This will change when custom schemas are introduced.

Performance on Metadata Caching: The packdb caches metadata per database. A single large database with all tables may complicate this caching process, although the practical impact is likely minimal except in specific scenarios.

Cross Database Queries: At present, cross-database queries are not supported, making it impractical to have a separate database for each table if joins are required. When cross-database queries are supported, they may incur some performance degradation compared to querying within the same database due to metadata storage methods.

Security: From a security perspective, Role-Based Access Control (RBAC) can be applied at the table level to restrict access to specific users, enhancing data security.

In summary, while there are some advantages to splitting databases, such as improved governance and security, the current limitations regarding cross-database queries and potential performance issues should be carefully considered before making a decision.

Deployment & Architecture
COPY LINK TO ANSWER
what-are-the-considerations-for-splitting-into-separate-databases

https://firebolt.io/faqs-v2-knowledge-center/what-are-the-considerations-for-splitting-into-separate-databases

What regions does Firebolt support?

US East (Virginia), US West (Oregon) and EU (Frankfurt)

Pricing & Billing
COPY LINK TO ANSWER
what-regions-does-firebolt-support

https://firebolt.io/faqs-v2-knowledge-center/what-regions-does-firebolt-support

Do you allow customers to view your FedRAMP authorization reports?

While Firebolt adheres to NIST SP 800-53, NIST 800-171, and NIST CSF guidelines, we are not currently FedRAMP compliant.

Security
COPY LINK TO ANSWER
do-you-allow-customers-to-view-your-fedramp-authorization-reports

https://firebolt.io/faqs-v2-knowledge-center/do-you-allow-customers-to-view-your-fedramp-authorization-reports

What is the typical start-up time for the Firebolt engine? Is it Guaranteed?

The typical start-up time for a Firebolt engine is 10-15 seconds, but this is not guaranteed due to potential resource constraints on AWS.

Engines
COPY LINK TO ANSWER
what-is-the-typical-start-up-time-for-the-firebolt-engine-is-it-guaranteed

https://firebolt.io/faqs-v2-knowledge-center/what-is-the-typical-start-up-time-for-the-firebolt-engine-is-it-guaranteed

How to size an engine for ingestion?

Start with a small node type (CREATE ENGINE ingest_engine TYPE=S NODES=1) and monitor CPU and RAM utilization via information_schema.engine_metrics_history. Scale out the engine (e.g., ALTER ingest_engine SET NODES=4) as needed to increase throughput. As a general rule of thumb, most ingestion workloads benefit from paralellism, specifically when importing multiple files. Adding to that, Firebolt will be even more efficient when files are roughly equivalent in size.

ELT
COPY LINK TO ANSWER
how-to-size-an-engine-for-ingestion

https://firebolt.io/faqs-v2-knowledge-center/how-to-size-an-engine-for-ingestion

What causes NULL to be excluded from results when using NOT IN?

When using a NOT IN filter, rows where the column value is NULL are excluded from the results, even though NULL is not in the list of values. This is because SQL treats comparisons with NULL as UNKNOWN, which prevents those rows from being returned.

How to include NULL in NOT IN results:

To include rows with NULL values, add an explicit condition checking for NULL using OR column IS NULL.

Example:

SELECT * 
FROM players 
WHERE playerid NOT IN (1, 2, 3) OR playerid IS NULL;

This query will include rows where playerid is either NOT IN the list or is NULL, ensuring that NULL values are part of the result set.

SQL
COPY LINK TO ANSWER
what-causes-null-to-be-excluded-from-results-when-using-not-in

https://firebolt.io/faqs-v2-knowledge-center/what-causes-null-to-be-excluded-from-results-when-using-not-in

How well does Firebolt integrate with Delta Lake and Databricks?

While this is on our roadmap, Firebolt does not natively integrate with Delta Lake or Databricks. However, you can use data transfer solutions to migrate data between Firebolt and Databricks or Delta Lake via standard ETL tools, enabling the two platforms to coexist in a broader data architecture

Integrations
COPY LINK TO ANSWER
how-well-does-firebolt-integrate-with-delta-lake-and-databricks

https://firebolt.io/faqs-v2-knowledge-center/how-well-does-firebolt-integrate-with-delta-lake-and-databricks

Does Firebolt offer commitment-based discounts?

Yes, commitment based discounts are available. Contact our sales team for more information.

Pricing & Billing
COPY LINK TO ANSWER
does-firebolt-offer-commitment-based-discounts

https://firebolt.io/faqs-v2-knowledge-center/does-firebolt-offer-commitment-based-discounts

How Does Firebolt Ensure Data Privacy and Compliance with GDPR and CCPA?

Firebolt processes customer data in compliance with both GDPR and CCPA regulations. We securely collect, store, and manage data according to the highest standards, ensuring that all GDPR and CCPA requirements are met.

Security
COPY LINK TO ANSWER
how-does-firebolt-ensure-data-privacy-and-compliance-with-gdpr-and-ccpa

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-ensure-data-privacy-and-compliance-with-gdpr-and-ccpa

How do I create an engine in Firebolt?

All operations in Firebolt can be performed via SQL or UI. To create an engine, you can use the “CREATE ENGINE” command (shown above), specifying a name for the engine, number of clusters the engine will use, number of nodes in each cluster and the type of the nodes used in the engine. After the engine is successfully created, users will get an endpoint that they can use to submit their queries. For example, you can create an engine named MyEngine with two clusters, each with two nodes of type “M” as below:

CREATE ENGINE IF NOT EXISTS MyEngine WITH TYPE = “M” NODES = 2 CLUSTERS = 2;

This creates an engine named "MyEngine" with two clusters, each containing two nodes of type "M". For more details, see the documentation.

Engines
COPY LINK TO ANSWER
how-do-i-create-an-engine-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-create-an-engine-in-firebolt

How does Firebolt handle data ingestion performance optimization?

Firebolt boosts data ingestion performance through parallel processing, multi-node scaling as the engine grows, and pipelined execution for efficient resource use. Using COPY FROM enables linear scaling with the number of nodes, accelerating ingestion speed with larger engines—ideal for latency-sensitive ELT scenarios.

ELT
COPY LINK TO ANSWER
how-does-firebolt-handle-data-ingestion-performance-optimization

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-handle-data-ingestion-performance-optimization

I am not seeing my connector/preferred source in Firebolt's documentation. What should I do?

Firebolt is continuously expanding its integration ecosystem to support a wide range of data sources and connectors. If your preferred connector isn't listed in the current documentation, don’t worry! Firebolt’s development team is actively working on adding new integrations, and you can expect ongoing enhancements to its capabilities.

In the meantime, you can reach out to Firebolt support to inquire about upcoming connectors or even request a specific integration. Firebolt also supports custom connectors through its API and can integrate with many systems using standard protocols like JDBC and ODBC, giving you the flexibility to connect to external sources in various ways.

Integrations
COPY LINK TO ANSWER
i-am-not-seeing-my-connector-preferred-source-in-firebolts-documentation-what-should-i-do

https://firebolt.io/faqs-v2-knowledge-center/i-am-not-seeing-my-connector-preferred-source-in-firebolts-documentation-what-should-i-do

How does Firebolt help control costs?

Firebolt provides multidimensional scaling to help right-size workloads. Autostop and Autostart are features that help reduce costs by eliminating idle time. Firebolt also provides global visibility of consumption and costs through built-in organizational governance and account-level consumption breakdown.

Pricing & Billing
COPY LINK TO ANSWER
how-does-firebolt-help-control-costs

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-help-control-costs

Who should I contact for data access or privacy concerns?

For Data Subject Access Requests (DSARs) or any privacy-related inquiries, please reach out to us at privacy@firebolt.io

Security
COPY LINK TO ANSWER
who-should-i-contact-for-data-access-or-privacy-concerns

https://firebolt.io/faqs-v2-knowledge-center/who-should-i-contact-for-data-access-or-privacy-concerns

How does scaling work with Firebolt engines?

In Firebolt, you can scale an engine across multiple dimensions. All scaling operations in Firebolt are dynamic, meaning you do not need to stop your engines to scale them.

Scale Up/Down You can vertically scale an engine by using a different node type that best fits the needs of your workload.

Scaling Out/In You can horizontally scale an engine by modifying the number of nodes per cluster in the engine. Horizontal scaling can be used when your workload can benefit by distributing your queries across multiple nodes.

Concurrency Scaling Firebolt allows you to add or remove clusters in an engine. You can use concurrency scaling when your workload has to deal with a sudden spike in the number of users or number of queries. Note that you can scale along more than one dimension simultaneously. For example, the command below changes both the node type to “L” and the number of clusters to two.

ALTER ENGINE MyEngine SET TYPE = “L” CLUSTERS = 2;

All Scaling operations can be performed via SQL using the ALTER ENGINE statement or via UI. For more information on how to perform scaling operations in Firebolt, see the Guides section in documentation.

Engines
COPY LINK TO ANSWER
how-does-scaling-work-with-firebolt-engines

https://firebolt.io/faqs-v2-knowledge-center/how-does-scaling-work-with-firebolt-engines

How does Firebolt ensure data consistency during ingestion?

Firebolt uses transactional semantics and ACID guarantees. Ingestion operations are fully isolated from ongoing reads or queries, ensuring consistency. There are no partial inserts or copies to clean up.

ELT
COPY LINK TO ANSWER
how-does-firebolt-ensure-data-consistency-during-ingestion

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-ensure-data-consistency-during-ingestion

Is there a connector available to connect Redshift data to Firebolt?

Yes, Firebolt supports data migration from Redshift through standard ETL tools. You can move data from Redshift to Firebolt by exporting Redshift data to S3 and then using Firebolt’s COPY FROM command to ingest data into Firebolt tables.

Integrations
COPY LINK TO ANSWER
is-there-a-connector-available-to-connect-redshift-data-to-firebolt

https://firebolt.io/faqs-v2-knowledge-center/is-there-a-connector-available-to-connect-redshift-data-to-firebolt

How does Firebolt provide visibility into spend?

Firebolt provides engine consumption and spend information in the Web UI. Additionally, granular engine-level consumption can be found via the information_schema.engine_metering_history view that details the hourly consumption of all the engines within an account. Users can also drill down into how the topology of their engines (node type, number of nodes and number of clusters) was modified over time, providing visibility into the FBU consumption of their engines.

Pricing & Billing
COPY LINK TO ANSWER
how-does-firebolt-provide-visibility-into-spend

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-provide-visibility-into-spend

Are business continuity plans tested periodically or after significant changes?

Yes, our policies, including Disaster Recovery (DR) and Business Continuity Plans (BCP), are tested regularly to ensure effectiveness.

Security
COPY LINK TO ANSWER
are-business-continuity-plans-tested-periodically-or-after-significant-changes

https://firebolt.io/faqs-v2-knowledge-center/are-business-continuity-plans-tested-periodically-or-after-significant-changes

Do scaling operations result in any downtime for my applications?

No. Scaling operations in Firebolt are dynamic and do not require stopping the engine, so your applications will not experience downtime.

Engines
COPY LINK TO ANSWER
do-scaling-operations-result-in-any-downtime-for-my-applications

https://firebolt.io/faqs-v2-knowledge-center/do-scaling-operations-result-in-any-downtime-for-my-applications

How should I organize S3 structures for efficient ingestion?

Optimize file sizes (500MB–1GB), use efficient formats (Parquet), and relocate files after ingestion to avoid reprocessing.

ELT
COPY LINK TO ANSWER
how-should-i-organize-s3-structures-for-efficient-ingestion

https://firebolt.io/faqs-v2-knowledge-center/how-should-i-organize-s3-structures-for-efficient-ingestion

What Airflow operator does Firebolt have that works directly with the platform?

Firebolt provides a custom Airflow connector that allows you to orchestrate and automate your Firebolt data workflows directly from Airflow. This integration helps in managing ETL processes, scheduling queries, and handling data pipelines efficiently.

Integrations
COPY LINK TO ANSWER
what-airflow-operator-does-firebolt-have-that-works-directly-with-the-platform

https://firebolt.io/faqs-v2-knowledge-center/what-airflow-operator-does-firebolt-have-that-works-directly-with-the-platform

Can Firebolt provide cost estimates based on my needs and plans?

Yes, during our POC process, Firebolt's team will provide you with fast and accurate cost estimates based on real usage data. During the POC, our team will closely support you, analyzing engine usage, query patterns, and resource consumption to deliver a precise cost breakdown. With our efficient benchmarking and expert guidance, you’ll quickly understand your projected costs, ensuring transparency and confidence in scaling with Firebolt.

Pricing & Billing
COPY LINK TO ANSWER
can-firebolt-provide-cost-estimates-based-on-my-needs-and-plans

https://firebolt.io/faqs-v2-knowledge-center/can-firebolt-provide-cost-estimates-based-on-my-needs-and-plans

Is access to Firebolt’s information security management systems restricted, logged, and monitored?

Yes, customer access is managed via Auth0, while organizational access is controlled using Okta. All accesses are logged and monitored, and alerts are in place for any unauthorized configuration changes across our systems.

Security
COPY LINK TO ANSWER
is-access-to-firebolts-information-security-management-systems-restricted-logged-and-monitored

https://firebolt.io/faqs-v2-knowledge-center/is-access-to-firebolts-information-security-management-systems-restricted-logged-and-monitored

What happens to my currently running queries when I perform a scaling operation?

Your queries will continue to run uninterrupted during a scaling operation. When you perform horizontal or vertical scaling operations on your engine, Firebolt adds additional compute resources per your new configuration. While new queries will be directed to the new resources, the old compute resources will finish executing any queries currently running, after which they will be removed from the engine.

Engines
COPY LINK TO ANSWER
what-happens-to-my-currently-running-queries-when-i-perform-a-scaling-operation

https://firebolt.io/faqs-v2-knowledge-center/what-happens-to-my-currently-running-queries-when-i-perform-a-scaling-operation

How does Firebolt manage data transformation during ingestion?

Data transformations can be applied directly within INSERT INTO SELECT statements during ingestion. Standard SQL functions can be used to manipulate data types, perform calculations, and format strings.

ELT
COPY LINK TO ANSWER
how-does-firebolt-manage-data-transformation-during-ingestion

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-manage-data-transformation-during-ingestion

What is the integration status with Kafka, and is there a timeline for when the integration will be available?

While this is on our roadmap, Firebolt currently does not have a native integration with Kafka. However, you can ingest Kafka data into Firebolt using intermediate storage systems like S3.

Integrations
COPY LINK TO ANSWER
what-is-the-integration-status-with-kafka-and-is-there-a-timeline-for-when-the-integration-will-be-available

https://firebolt.io/faqs-v2-knowledge-center/what-is-the-integration-status-with-kafka-and-is-there-a-timeline-for-when-the-integration-will-be-available

Do you integrate security into your software development lifecycle?

We use tools like SCA, SAST for code analysis, along with practices such as Fuzzing, scanning for pipeline weaknesses (like the use of unverified external sources), and secret scans as part of our secure software development lifecycle.

Security
COPY LINK TO ANSWER
do-you-integrate-security-into-your-software-development-lifecycle

https://firebolt.io/faqs-v2-knowledge-center/do-you-integrate-security-into-your-software-development-lifecycle

Will the creation of an engine automatically result in the creation of the underlying cluster(s)?

Yes. By default, creating an engine would result in the creation of the underlying engine clusters and start the engine. This would enable the engine to be in a running state where it is ready to start serving the queries. However, you have the option to defer the creation of the underlying clusters for an engine by setting the property “INITIALLY STOPPED” to True while calling CREATE ENGINE. You can start the engine at a later point, when you are ready to start running queries on the engine. Note that you cannot modify this property after an engine has been created.

CREATE ENGINE IF NOT EXISTS MyEngine WITH

TYPE = “S” NODES = 2 CLUSTERS =1 START_IMMEDIATELY = FALSE;

Engines
COPY LINK TO ANSWER
will-the-creation-of-an-engine-automatically-result-in-the-creation-of-the-underlying-cluster-s

https://firebolt.io/faqs-v2-knowledge-center/will-the-creation-of-an-engine-automatically-result-in-the-creation-of-the-underlying-cluster-s

Can Firebolt handle complex data types like JSON during ELT processes?

Yes, Firebolt supports semi-structured data types like JSON. JSON data can be ingested as text columns or parsed into individual columns for flexible schema-on-read or flattened structures.

ELT
COPY LINK TO ANSWER
can-firebolt-handle-complex-data-types-like-json-during-elt-processes

https://firebolt.io/faqs-v2-knowledge-center/can-firebolt-handle-complex-data-types-like-json-during-elt-processes

What versions of Presto does Firebolt support?

Firebolt does not natively support Presto. However, Firebolt provides its own high-performance SQL engine and you can integrate it with your existing data infrastructure via ODBC, JDBC, and REST API.

Integrations
COPY LINK TO ANSWER
what-versions-of-presto-does-firebolt-support

https://firebolt.io/faqs-v2-knowledge-center/what-versions-of-presto-does-firebolt-support

How do you protect against DDoS attacks?

We use AWS Shield, WAF, and other logical layers to protect against DDoS. Additionally, we leverage auto-scaling to maintain availability during attacks by dynamically adjusting resources like EC2 instances, ELBs, and other global services capacity. (Though some scenarios may require manual intervention).

Security
COPY LINK TO ANSWER
how-do-you-protect-against-ddos-attacks

https://firebolt.io/faqs-v2-knowledge-center/how-do-you-protect-against-ddos-attacks

How do I start and stop engines in Firebolt?

To start an engine:

sql
START ENGINE MyEngine;

To stop an engine:

vbnet
STOP ENGINE MyEngine;

Engines
COPY LINK TO ANSWER
how-do-i-start-and-stop-engines-in-firebolt

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-start-and-stop-engines-in-firebolt

How do I handle complex structures like arrays in Parquet?

Firebolt supports the ARRAY data type for mapping arrays from Parquet files and provides functions like ARRAY_AGG and UNNEST for working with arrays.

ELT
COPY LINK TO ANSWER
how-do-i-handle-complex-structures-like-arrays-in-parquet

https://firebolt.io/faqs-v2-knowledge-center/how-do-i-handle-complex-structures-like-arrays-in-parquet

How are SQL errors handled in the SDK?

Firebolt's Python SDK provides detailed error message handling for SQL queries. When an error occurs, the SDK generates helpful error messages, allowing users to quickly diagnose and fix issues such as syntax problems or missing credentials. The SDK also offers robust logging and debugging capabilities, making it easier for developers to troubleshoot errors in their applications. For more information, refer to the Firebolt Python SDK documentation or visit the GitHub repository for examples.

Integrations
COPY LINK TO ANSWER
how-are-sql-errors-handled-in-the-sdk

https://firebolt.io/faqs-v2-knowledge-center/how-are-sql-errors-handled-in-the-sdk

How does Firebolt protect customer data?

Firebolt employs a comprehensive security strategy that includes network security policies, encryption practices, tenant isolation, and governance controls. We are committed to safeguarding your data through state-of-the-art security systems, policies, and practices.

Security
COPY LINK TO ANSWER
how-does-firebolt-protect-customer-data

https://firebolt.io/faqs-v2-knowledge-center/how-does-firebolt-protect-customer-data