New-FabricSparkCustomPool
Creates a new Spark custom pool in a specified Microsoft Fabric workspace.
Syntax
New-FabricSparkCustomPool [-WorkspaceId] <guid> [-SparkCustomPoolName] <string>
[-NodeFamily] <string> [-NodeSize] <string> [-AutoScaleEnabled] <bool>
[-AutoScaleMinNodeCount] <int> [-AutoScaleMaxNodeCount] <int>
[-DynamicExecutorAllocationEnabled] <bool> [-DynamicExecutorAllocationMinExecutors] <int>
[-DynamicExecutorAllocationMaxExecutors] <int> [-WhatIf] [-Confirm] [<CommonParameters>]Description
This function sends a POST request to the Microsoft Fabric API to create a new Spark custom pool in the specified workspace. It supports various parameters for Spark custom pool configuration.
Examples
Example 1
This example creates a new Spark custom pool named "New Spark Pool" in the workspace with ID "workspace-12345" with the specified configuration.
New-FabricSparkCustomPool -WorkspaceId "workspace-12345" -SparkCustomPoolName "New Spark Pool" -NodeFamily "MemoryOptimized" -NodeSize "Large" -AutoScaleEnabled $true -AutoScaleMinNodeCount 1 -AutoScaleMaxNodeCount 10 -DynamicExecutorAllocationEnabled $true -DynamicExecutorAllocationMinExecutors 1 -DynamicExecutorAllocationMaxExecutors 10Parameters
| Name | Type | Req. | Pos. | Pipeline | Description |
|---|---|---|---|---|---|
| -AutoScaleEnabled | bool | ✓Required | 4 | – | Specifies whether auto-scaling is enabled for the Spark custom pool. This parameter is mandatory. Default: False |
| -AutoScaleMaxNodeCount | int | ✓Required | 6 | – | The maximum number of nodes for auto-scaling in the Spark custom pool. This parameter is mandatory. Default: 0 |
| -AutoScaleMinNodeCount | int | ✓Required | 5 | – | The minimum number of nodes for auto-scaling in the Spark custom pool. This parameter is mandatory. Default: 0 |
| -DynamicExecutorAllocationEnabled | bool | ✓Required | 7 | – | Specifies whether dynamic executor allocation is enabled for the Spark custom pool. This parameter is mandatory. Default: False |
| -DynamicExecutorAllocationMaxExecutors | int | ✓Required | 9 | – | The maximum number of executors for dynamic executor allocation in the Spark custom pool. This parameter is mandatory. Default: 0 |
| -DynamicExecutorAllocationMinExecutors | int | ✓Required | 8 | – | The minimum number of executors for dynamic executor allocation in the Spark custom pool. This parameter is mandatory. Default: 0 |
| -NodeFamily | string | ✓Required | 2 | – | The family of nodes to be used in the Spark custom pool. This parameter is mandatory and must be 'MemoryOptimized'. |
| -NodeSize | string | ✓Required | 3 | – | The size of the nodes to be used in the Spark custom pool. This parameter is mandatory and must be one of 'Large', 'Medium', 'Small', 'XLarge', 'XXLarge'. |
| -SparkCustomPoolName | string | ✓Required | 1 | – | The name of the Spark custom pool to be created. This parameter is mandatory. |
| -WorkspaceId | guid | ✓Required | 0 | – | The unique identifier of the workspace where the Spark custom pool will be created. This parameter is mandatory. |
| -Confirmalias: cf | switch | Named | – | Prompts you for confirmation before running the cmdlet. |
|
| -WhatIfalias: wi | switch | Named | – | Runs the command in a mode that only reports what would happen without performing the actions. |
This cmdlet also supports the common parameters, such as -Verbose and -ErrorAction. See about_CommonParameters.
Notes
- Calls
Confirm-TokenStateto ensure token validity before making the API request.
Author: Tiago Balabuch, Kamil Nowinski