Dynamic allocation for Apache Spark in Azure Synapse now generally available

You can now further customize autoscale Apache Spark in Azure Synapse by enabling the ability to scale within a minimum and a maximum number of executors required at the pool, Spark job, or notebook session-level. This enhances the autoscale capabilities within Apache Spark on Synapse by allowing you to customize how your clusters scale based on specific workload requirements.

Dynamic allocation for Apache Spark in Azure Synapse now generally available | Azure updates | Microsoft Azure