--- title: Get SPA recommendations v2 description: Datadog, the leading service for cloud-scale monitoring. breadcrumbs: Docs > API Reference > Spa --- > For the complete documentation index, see [llms.txt](https://docs.datadoghq.com/llms.txt). # Get SPA recommendations v2{% #get-spa-recommendations-v2 %} {% tab title="v2" %} **Note**: This endpoint is in preview and may change in the future. It is not yet recommended for production use. | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------- | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/spa/recommendations-v2/{service} | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/spa/recommendations-v2/{service} | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/spa/recommendations-v2/{service} | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/spa/recommendations-v2/{service} | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/spa/recommendations-v2/{service} | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/spa/recommendations-v2/{service} | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/spa/recommendations-v2/{service} | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/spa/recommendations-v2/{service} | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/spa/recommendations-v2/{service} | ### Overview This endpoint is experimental and restricted to Datadog internal use only. Retrieve resource recommendations for a Spark job. The caller (Spark Gateway) provides a service name and the job's raw arguments. SPA determines which arguments are relevant for the service and returns structured recommendations for driver and executor resources. ### Arguments #### Path Parameters | Name | Type | Description | | ------------------------- | ------ | -------------------------------- | | service [*required*] | string | The service name for a Spark job | ### Request #### Body Data (required) {% tab title="Model" %} | Parent field | Field | Type | Description | | ------------ | ---------------------------- | -------- | ------------------------------------------------------------------------------------------------------------------------------------------------ | | | data [*required*] | object | JSON:API resource object for the SPA v2 recommendation request. | | data | attributes [*required*] | object | Attributes for requesting SPA recommendations by forwarding a Spark job's raw arguments instead of a precomputed shard. | | attributes | arguments [*required*] | [string] | Raw, unfiltered Spark job arguments as submitted (for example, `--org_id=2`). SPA determines which arguments are relevant for the given service. | | data | type [*required*] | enum | JSON:API resource type for the SPA v2 recommendation request. Allowed enum values: `recommendation_v2_request` | {% /tab %} {% tab title="Example" %} ```json { "data": { "attributes": { "arguments": [ "" ] }, "type": "recommendation_v2_request" } } ``` {% /tab %} ### Response {% tab title="200" %} OK {% tab title="Model" %} | Parent field | Field | Type | Description | | ------------ | ---------------------------- | ------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | | data [*required*] | object | JSON:API resource object for SPA Recommendation. Includes type, optional ID, and resource attributes with structured recommendations. | | data | attributes [*required*] | object | Attributes of the SPA Recommendation resource. Contains recommendations for both driver and executor components. | | attributes | confidence_level | double | The confidence level of the recommendation, expressed as a value between 0.0 (low confidence) and 1.0 (high confidence). | | attributes | driver [*required*] | object | Resource recommendation for a single Spark component (driver or executor). Contains estimation data used to patch Spark job specs. | | driver | estimation [*required*] | object | Recommended resource values for a Spark driver or executor, derived from recent real usage metrics. Used by SPA to propose more efficient pod sizing. | | estimation | cpu | object | CPU usage statistics derived from historical Spark job metrics. Provides multiple estimates so users can choose between conservative and cost-saving risk profiles. | | cpu | max | int64 | Maximum CPU usage observed for the job, expressed in millicores. This represents the upper bound of usage. | | cpu | p75 | int64 | 75th percentile of CPU usage (millicores). Represents a cost-saving configuration while covering most workloads. | | cpu | p95 | int64 | 95th percentile of CPU usage (millicores). Balances performance and cost, providing a safer margin than p75. | | estimation | ephemeral_storage | int64 | Recommended ephemeral storage allocation (in MiB). Derived from job temporary storage patterns. | | estimation | heap | int64 | Recommended JVM heap size (in MiB). | | estimation | memory | int64 | Recommended total memory allocation (in MiB). Includes both heap and overhead. | | estimation | overhead | int64 | Recommended JVM overhead (in MiB). Computed as total memory - heap. | | attributes | executor [*required*] | object | Resource recommendation for a single Spark component (driver or executor). Contains estimation data used to patch Spark job specs. | | executor | estimation [*required*] | object | Recommended resource values for a Spark driver or executor, derived from recent real usage metrics. Used by SPA to propose more efficient pod sizing. | | estimation | cpu | object | CPU usage statistics derived from historical Spark job metrics. Provides multiple estimates so users can choose between conservative and cost-saving risk profiles. | | cpu | max | int64 | Maximum CPU usage observed for the job, expressed in millicores. This represents the upper bound of usage. | | cpu | p75 | int64 | 75th percentile of CPU usage (millicores). Represents a cost-saving configuration while covering most workloads. | | cpu | p95 | int64 | 95th percentile of CPU usage (millicores). Balances performance and cost, providing a safer margin than p75. | | estimation | ephemeral_storage | int64 | Recommended ephemeral storage allocation (in MiB). Derived from job temporary storage patterns. | | estimation | heap | int64 | Recommended JVM heap size (in MiB). | | estimation | memory | int64 | Recommended total memory allocation (in MiB). Includes both heap and overhead. | | estimation | overhead | int64 | Recommended JVM overhead (in MiB). Computed as total memory - heap. | | data | id | string | Resource identifier for the recommendation. Optional in responses. | | data | type [*required*] | enum | JSON:API resource type for Spark Pod Autosizing recommendations. Identifies the Recommendation resource returned by SPA. Allowed enum values: `recommendation` | {% /tab %} {% tab title="Example" %} ```json { "data": { "attributes": { "confidence_level": "number", "driver": { "estimation": { "cpu": { "max": "integer", "p75": "integer", "p95": "integer" }, "ephemeral_storage": "integer", "heap": "integer", "memory": "integer", "overhead": "integer" } }, "executor": { "estimation": { "cpu": { "max": "integer", "p75": "integer", "p95": "integer" }, "ephemeral_storage": "integer", "heap": "integer", "memory": "integer", "overhead": "integer" } } }, "id": "string", "type": "recommendation" } } ``` {% /tab %} {% tab title="Model" %} JSON:API document containing a single Recommendation resource. Returned by SPA when the Spark Gateway requests recommendations. | Parent field | Field | Type | Description | | ------------ | ---------------------------- | ------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | | data [*required*] | object | JSON:API resource object for SPA Recommendation. Includes type, optional ID, and resource attributes with structured recommendations. | | data | attributes [*required*] | object | Attributes of the SPA Recommendation resource. Contains recommendations for both driver and executor components. | | attributes | confidence_level | double | The confidence level of the recommendation, expressed as a value between 0.0 (low confidence) and 1.0 (high confidence). | | attributes | driver [*required*] | object | Resource recommendation for a single Spark component (driver or executor). Contains estimation data used to patch Spark job specs. | | driver | estimation [*required*] | object | Recommended resource values for a Spark driver or executor, derived from recent real usage metrics. Used by SPA to propose more efficient pod sizing. | | estimation | cpu | object | CPU usage statistics derived from historical Spark job metrics. Provides multiple estimates so users can choose between conservative and cost-saving risk profiles. | | cpu | max | int64 | Maximum CPU usage observed for the job, expressed in millicores. This represents the upper bound of usage. | | cpu | p75 | int64 | 75th percentile of CPU usage (millicores). Represents a cost-saving configuration while covering most workloads. | | cpu | p95 | int64 | 95th percentile of CPU usage (millicores). Balances performance and cost, providing a safer margin than p75. | | estimation | ephemeral_storage | int64 | Recommended ephemeral storage allocation (in MiB). Derived from job temporary storage patterns. | | estimation | heap | int64 | Recommended JVM heap size (in MiB). | | estimation | memory | int64 | Recommended total memory allocation (in MiB). Includes both heap and overhead. | | estimation | overhead | int64 | Recommended JVM overhead (in MiB). Computed as total memory - heap. | | attributes | executor [*required*] | object | Resource recommendation for a single Spark component (driver or executor). Contains estimation data used to patch Spark job specs. | | executor | estimation [*required*] | object | Recommended resource values for a Spark driver or executor, derived from recent real usage metrics. Used by SPA to propose more efficient pod sizing. | | estimation | cpu | object | CPU usage statistics derived from historical Spark job metrics. Provides multiple estimates so users can choose between conservative and cost-saving risk profiles. | | cpu | max | int64 | Maximum CPU usage observed for the job, expressed in millicores. This represents the upper bound of usage. | | cpu | p75 | int64 | 75th percentile of CPU usage (millicores). Represents a cost-saving configuration while covering most workloads. | | cpu | p95 | int64 | 95th percentile of CPU usage (millicores). Balances performance and cost, providing a safer margin than p75. | | estimation | ephemeral_storage | int64 | Recommended ephemeral storage allocation (in MiB). Derived from job temporary storage patterns. | | estimation | heap | int64 | Recommended JVM heap size (in MiB). | | estimation | memory | int64 | Recommended total memory allocation (in MiB). Includes both heap and overhead. | | estimation | overhead | int64 | Recommended JVM overhead (in MiB). Computed as total memory - heap. | | data | id | string | Resource identifier for the recommendation. Optional in responses. | | data | type [*required*] | enum | JSON:API resource type for Spark Pod Autosizing recommendations. Identifies the Recommendation resource returned by SPA. Allowed enum values: `recommendation` | {% /tab %} {% tab title="Example" %} ```json { "data": { "attributes": { "confidence_level": "number", "driver": { "estimation": { "cpu": { "max": "integer", "p75": "integer", "p95": "integer" }, "ephemeral_storage": "integer", "heap": "integer", "memory": "integer", "overhead": "integer" } }, "executor": { "estimation": { "cpu": { "max": "integer", "p75": "integer", "p95": "integer" }, "ephemeral_storage": "integer", "heap": "integer", "memory": "integer", "overhead": "integer" } } }, "id": "string", "type": "recommendation" } } ``` {% /tab %} {% /tab %} {% tab title="400" %} Bad Request {% tab title="Model" %} API error response. | Field | Type | Description | | ------------------------ | -------- | ----------------- | | errors [*required*] | [string] | A list of errors. | {% /tab %} {% tab title="Example" %} ```json { "errors": [ "Bad Request" ] } ``` {% /tab %} {% /tab %} {% tab title="403" %} Not Authorized {% tab title="Model" %} API error response. | Field | Type | Description | | ------------------------ | -------- | ----------------- | | errors [*required*] | [string] | A list of errors. | {% /tab %} {% tab title="Example" %} ```json { "errors": [ "Bad Request" ] } ``` {% /tab %} {% /tab %} {% tab title="404" %} Not Found {% tab title="Model" %} API error response. | Field | Type | Description | | ------------------------ | -------- | ----------------- | | errors [*required*] | [string] | A list of errors. | {% /tab %} {% tab title="Example" %} ```json { "errors": [ "Bad Request" ] } ``` {% /tab %} {% /tab %} {% tab title="429" %} Too many requests {% tab title="Model" %} API error response. | Field | Type | Description | | ------------------------ | -------- | ----------------- | | errors [*required*] | [string] | A list of errors. | {% /tab %} {% tab title="Example" %} ```json { "errors": [ "Bad Request" ] } ``` {% /tab %} {% /tab %} ### Code Example ##### \# Path parameters export service="CHANGE_ME" \# Use a Personal Access Token or Service Access Token export DD_BEARER_TOKEN="" \# Curl command curl -X POST "https://api.datadoghq.com/api/v2/spa/recommendations-v2/${service}" \ -H "Accept: application/json" \ -H "Content-Type: application/json" \ -H "Authorization: Bearer ${DD_BEARER_TOKEN}" \ -d @- << EOF { "data": { "attributes": { "arguments": [ "" ] }, "type": "recommendation_v2_request" } } EOF {% /tab %}