A data engineer wants to enforce the principle of least privilege when configuring ACLs for Databricks jobs in a collaborative workspace.
Which approach should the data engineer use?

• A. Grant CAN RUN permission to everyone and CAN MANAGE to a single admin group.
• B. Grant all users CAN MANAGE permission on all jobs to avoid access issues.
• C. Use only folder-level permissions and avoid setting permissions on individual jobs.
• D. Assign users only the minimum permission level (e.g., CAN RUN or CAN VIEW) required for their role on each job.

A data engineering team is migrating off its legacy Hadoop platform. As part of the process, they are evaluating storage formats for performance comparison. The legacy platform uses ORC and RCFile formats.
After converting a subset of data to Delta Lake , they noticed significantly better query performance. Upon investigation, they discovered that queries reading from Delta tables leveraged a Shuffle Hash Join , whereas queries on legacy formats used Sort Merge Joins . The queries reading Delta Lake data also scanned less data.
Which reason could be attributed to the difference in query performance?

• A. Delta Lake enables data skipping and file pruning using a vectorized Parquet reader.
• B. Shuffle Hash Joins are always more efficient than Sort Merge Joins.
• C. The queries against the Delta Lake tables were able to leverage the dynamic file pruning optimization.
• D. The queries against the ORC tables leveraged the dynamic data skipping optimization but not the dynamic file pruning optimization.

A data engineer is designing a pipeline in Databricks that processes records from a Kafka stream where late- arriving data is common.
Which approach should the data engineer use?

• A. Implement a custom solution using Databricks Jobs to periodically reprocess all historical data.
• B. Use an Auto CDC pipeline with batch tables to simplify late data handling.
• C. Use a watermark to specify the allowed lateness to accommodate records that arrive after their expected window, ensuring correct aggregation and state management.
• D. Use batch processing and overwrite the entire output table each time to ensure late data is incorporated correctly.

Which of the following technologies can be used to identify key areas of text when parsing Spark Driver log4j output?

• A. Julia
• B. Regex
• C. C++
• D. pyspsark.ml.feature
• E. Scala Datasets

A data engineer is configuring a Databricks Asset Bundle to deploy a job with granular permissions. The requirements are:
* Grant the data-engineers group CAN_MANAGE access to the job.
* Ensure the auditors' group can view the job but not modify/run it.
* Avoid granting unintended permissions to other users/groups.
How should the data engineer deploy the job while meeting the requirements?

• A. resources:
  jobs:
  my-job:
  name: data-pipeline
  tasks: [...]
  job_clusters: [...]
  permissions:
  - group_name: data-engineers
  level: CAN_MANAGE
  - group_name: auditors
  level: CAN_VIEW
  - group_name: admin-team
  level: IS_OWNER
• B. resources:
  jobs:
  my-job:
  name: data-pipeline
  tasks: [...]
  job: [...]
  permissions:
  - group_name: data-engineers
  level: CAN_MANAGE
  permissions:
  - group_name: auditors
  level: CAN_VIEW
• C. permissions:
  - group_name: data-engineers
  level: CAN_MANAGE
  - group_name: auditors
  level: CAN_VIEW
  resources:
  jobs:
  my-job:
  name: data-pipeline
  tasks: [...]
  job_clusters: [...]
• D. resources:
  jobs:
  my-job:
  name: data-pipeline
  tasks: [...]
  job_clusters: [...]
  permissions:
  - group_name: data-engineers
  level: CAN_MANAGE
  - group_name: auditors
  level: CAN_VIEW