Skip to content

Commit 16cb21b

Browse files
authored
databricks djm exclude logs docs
Show users how to exclude all log collection from an individual cluster
1 parent a2181c5 commit 16cb21b

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

content/en/data_jobs/databricks.md

+8
Original file line numberDiff line numberDiff line change
@@ -222,6 +222,14 @@ In Datadog, view the [Data Jobs Monitoring][6] page to see a list of all your Da
222222

223223
## Advanced Configuration
224224

225+
### Filter log collection on a clusters
226+
227+
#### Exclude all log collection from an individual cluster
228+
Configure the following environment variable in the Advanced Configuration section of your cluster in the Databricks UI or as [Spark env vars][2] in the Databricks API.
229+
```bash
230+
DD_LOGS_CONFIG_PROCESSING_RULES=[{\"type\": \"exclude_at_match\",\"name\": \"drop_all_logs\",\"pattern\": \".*\"}]
231+
```
232+
225233
### Tag spans at runtime
226234

227235
{{% djm-runtime-tagging %}}

0 commit comments

Comments
 (0)