Elastic Data Warehousing: The Future of Scalable Data Management

Instant and Online
Handle sudden spikes in data queries or continuous growth in data volume without performance degradation.
Performant and Predictable
Leverage engine observability features to optimize performance and scale your workloads efficiently, while reducing costs.
Cost-Effective
Scale and de-allocate resources online—only pay for what you use, eliminating cost overruns due to compute overprovisioning.

Multidimensional Elasticity

Independently scale your compute resources across multiple dimensions, such as up/down, out/in, and concurrency scaling with consistent performance predictability and zero service interruptions.

CREATE ENGINE IF NOT EXISTS MyEngine
WITH TYPE =
S NODES = 1 CLUSTERS = 1;
Scale-Up/Down
Adjust compute node sizes to handle varying workloads. Scale up to increase node sizes or scale down to reduce costs.
ALTER ENGINE MyEngine SET TYPE = L;
Scale-Out/In
Add or remove compute nodes to adjust performance and cost. Scale out to increase nodes, scale in to reduce them.
ALTER ENGINE MyEngine SET NODES = 2;
Concurrency Scaling
Additional clusters are added to handle more simultaneous queries, ensuring high query throughput without performance degradation.
ALTER ENGINE MyEngine SET CLUSTERS = 2;

Granular Scaling

Scale one node at a time to adjust compute resources incrementally, ensuring an ideal price-performance ratio tailored to your evolving workload requirements.

Right size your engines
If your workload requires more than one L node, there's no need to double capacity to two L nodes. Instead, right-size your configuration with five S type nodes, costing 37.5% less than two L nodes. Since one L node has resources equivalent to four S nodes, you can right-size your configuration with five S nodes.
ALTER ENGINE MyEngine SET TYPE
= S NODES = 5;

Engine Observability

Optimize performance with real-time insights into engine metrics. Leverage built-in views, accessible through information_schema, to correctly size your engines, ensuring both optimal performance and cost efficiency.

SELECT * FROM information_schema.engine_metrics_history
SELECT * FROM information_schema.engine_running_queries
SELECT * FROM information_schema.engine_query_history

Online Scaling and Upgrades

Experience consistent performance and zero downtime with advanced upgrades and instant scaling, optimizing your infrastructure to handle any workload without service interruptions.

Dynamic Scaling
Instantly adjust resources to match workload requirements, avoiding over-provisioning.
Online Transition
System automatically directs traffic to new configurations while gracefully phasing out the old ones.
Zero Downtime
Automatic upgrades without service interruptions.
Transparent Process
Built-in validation of workload performance before engine upgrades

Automatic Start and Stop

Eliminate idle time costs and pay only for the compute you actively use with auto start/stop functionality. Go online instantly while scaling resources to match your needs.

Instant
Stop using compute resources when idle, and quickly restarting to handle varying workloads.
Configurable
Fine-tune engine settings and optimize costs to match your workload requirements.
Automatically start engine
ALTER ENGINE my_prod_engine WITH
AUTO_START = TRUE;
Automatically stop engine
ALTER ENGINE my_prod_engine WITH
AUTO_STOP = 20;

Frequently Asked Questions

Why Choose an Elastic Data Warehouse?

  1. Scalability: Automatically or manually adjust resources to meet changing demands, ensuring performance consistency.
  2. Cost Efficiency: Pay only for the resources you use. Elastic pricing models align with your usage, preventing unnecessary expenses.
  3. Operational Flexibility: Handle spikes in data processing or storage needs without delays or system overhauls.
  4. Improved Performance: Allocate resources dynamically to maintain speed and efficiency, even during peak workloads.
  5. Seamless Integration: Connect with existing tools, applications, and data pipelines for a unified data management approach.

Key Features of Elastic Data Warehouses

  1. Dynamic Scaling: Automatic resource adjustment based on real-time or scheduled needs.
  2. Separation of Storage and Compute: Allows for independent scaling of storage and processing power.
  3. Multi-Cloud Compatibility: Support for deployment across various cloud providers like AWS, Azure, and Google Cloud.
  4. Pay-As-You-Go Pricing: Billing based on actual resource usage rather than fixed capacity.
  5. High Availability: Ensures minimal downtime with built-in redundancy and fault tolerance.
  6. Real-Time Analytics: Supports instant query execution and analytics even as workloads fluctuate.

Benefits of Elastic Data Warehousing

  1. Supports Business Growth: Scale resources up or down as your data requirements evolve.
  2. Enhances Agility: Quickly adapt to market changes, seasonal trends, or new business opportunities.
  3. Simplifies IT Management: Minimize manual intervention with automated scaling and monitoring.
  4. Empowers Data-Driven Decisions: Faster processing ensures timely insights for decision-making.
  5. Reduces Operational Overhead: Eliminate the need for over-provisioning or frequent hardware upgrades.

What Is an Elastic Data Warehouse?

An elastic data warehouse is a cloud-based system that can scale storage and compute resources independently or together based on workload requirements. It allows businesses to adjust resources in real-time, providing flexibility, cost efficiency, and operational agility. Elasticity is a cornerstone of modern cloud data platforms, enabling organizations to handle unpredictable data patterns without over-provisioning or performance degradation.

How does elastic data warehousing help reduce costs?

Elastic data warehouses use pay-as-you-go pricing models, ensuring you only pay for the resources consumed. This eliminates the need for upfront investments in unused capacity.

Can I use an elastic data warehouse for real-time analytics?

Yes, most elastic data warehouses are optimized for real-time data ingestion and querying, enabling instant insights and timely decisions.

Are elastic data warehouses secure?

Yes, they typically come with advanced security features such as encryption, access controls, and compliance certifications to protect sensitive data.

How quickly can resources be scaled in an elastic data warehouse?

Scaling can occur in real-time or near real-time, depending on the platform and configuration.

Can elastic data warehouses integrate with existing BI tools?

Yes, they are designed to integrate seamlessly with popular BI tools like Tableau, Power BI, and Looker for streamlined analytics and reporting.

Dig Deeper
Docs
Elasticity Whitepaper
Pricing