Running the most efficient data warehouse with Databricks serverless SQL new announcements(Nov. 2022)
Databricks serverless SQL team has been busy working on several new and exciting features. We’ve recently added new capabilities and introduced discounts up to 40% that will help our customers run the most efficient data warehouse. In addition to that, thanks to customer feedback, we’ve launched a new serverless SQL region and plan to launch more in the future. Here’s what we’ve been up to:
We’ve recently introduced the capability for our customers to reduce autostop time to 5 minutes via UI and 1 minute via API. Just as a reminder, the minimum autostop on non-serverless (including pro SKU) warehouses is 10 minutes. This feature can help many of our customers reduce idle time and as a result reduce the overall cost.
We’ve also recently announced the Predictive IO (available on serverless and pro SKU) which is a new Photon capability that allows queries to scan less data and as a result accelerates the query execution. This can improve user experience and allow customers to reduce cost by finishing queries faster and shutting down the warehouse earlier. This feature along with shorter autostop time can have a direct impact on the overall cost-performance.
Starting soon, our serverless SQL customers can start taking advantage of persistent cache (available in the preview channel). This is a critical improvement to customers who like to shutdown the warehouse more frequently but do not want to miss out on result caching. Again another important feature to improve performance. We will share mode details in the form of public documentations soon.
Along the topic of improving cost-performance, we like to announce that starting Nov 1st, the AWS serverless SQL discount (up to 40% until Apr 30, 2023) has gone into effect and a discount for Azure is coming soon. Reducing cost has been an important topic recently and we’re happy to deliver this to our customers. The discount along with the features mentioned above are great ways to ensure our customers are running the most cost-performance warehouse.
Diverging from the topic of cost-performance, we like to announce that we’ve recently launched Azure WestUS serverless SQL region and are planning to launch new regions in the coming months.
Our team has been working hard introducing features that not only makes our customers’ workloads more efficient but also it does so with cost in mind. We believe Databricks serverless SQL is the best data warehouse in the market and cannot wait to see our customers build amazing data products with it.
If you have any questions, feedback, or like to ask for new features please feel free to reach out to me (Twitter, LinkedIn) or your Databricks account team.
