Study with Databricks : Certified-Data-Engineer-Professional Exam Torrent as your best preparation materials

Databricks Certified-Data-Engineer-Professional Exam Overview:

Databricks Certified-Data-Engineer-Professional Exam Syllabus Topics:

Databricks Certified Data Engineer Professional Sample Questions:

1. A data engineer and a platform engineer are working together to automate their system tasks. A script needs to be executed outside of Databricks only if a particular daily Databricks job finishes successfully for the day. Databricks CLI command was used to check the last execution of the job. What are the required command options for that task?

A) databricks jobs list-runs --job-id JOB_ID --start-time-to TODAY_MIDNIGHT_EPOCH_MS --active- only
B) databricks jobs list-runs --job-id JOB_ID --start-time-to TODAY_MIDNIGHT_EPOCH_MS -- completed-only
C) databricks jobs list-runs --job-id JOB_ID --start-time-from TODAY_MIDNIGHT_EPOCH_MS -- completed-only
D) databricks jobs list-runs --job-id JOB_ID --start-time-from TODAY_MIDNIGHT_EPOCH_MS -- active-only

2. A data engineer is analyzing a large, partitioned retail dataset in Databricks, where each row represents a sale made by a salesperson. The dataset contains millions of records with the following schema:
sales_df: [salesperson_id: string, region: string, sale_amount: double, sale_date: date] The data engineer needs to generate a DataFrame that ranks salespeople within each region based on their total cumulative sales, with the highest seller ranked as 1. If multiple salespeople have the same total sales, they should share the same rank.
The data engineer wants to implement this logic using a PySpark window function and the dense_rank () function.
Which code snippet will perform this ranking?

A)

B)

C)

D)

3. A data governance team at a large enterprise is improving data discoverability across its organization. The team has hundreds of tables in their Databricks Lakehouse with thousands of columns that lack proper documentation. Many of these tables were created by different teams over several years, with missing context about column meanings and business logic. The data governance team needs to quickly generate comprehensive column descriptions for all existing tables to meet compliance requirements and improve data literacy across the organization. They want to leverage modern capabilities to automatically generate meaningful descriptions rather than manually documenting each column, which would take months to complete. Which approach should the team use in Databricks to automatically generate column comments and descriptions for existing tables?

A) Use Delta Lake's DESCRIBE HISTORY command to analyze table evolution and infer column purposes from historical changes.
B) Use the DESCRIBE TABLE command to extract existing schema information and manually write descriptions based on column names and data types.
C) Navigate to the table in Databricks Catalog Explorer, select the table schema view, and use the AI Generate option which leverages artificial intelligence to automatically create meaningful column descriptions based on column names, data types, sample values, and data patterns.
D) Write custom PySpark code using df.describe() and df.schema to programmatically generate basic statistical descriptions for each column.

4. A data team's Structured Streaming job is configured to calculate running aggregates for item sales to update a downstream marketing dashboard. The marketing team has introduced a new field to track the number of times this promotion code is used for each item. A junior data engineer suggests updating the existing query as follows: Note that proposed changes are in bold.
Original query:

Proposed query:

Which step must also be completed to put the proposed query into production?

A) Run REFRESH TABLE delta, /item_agg'
B) Increase the shuffle partitions to account for additional aggregates
C) Remove .option (mergeSchema', true') from the streaming write
D) Specify a new checkpointlocation
E) Register the data in the "/item_agg" directory to the Hive metastore

5. A data engineer is tasked with building a nightly batch ETL pipeline that processes very large volumes of raw JSON logs from a data lake into Delta tables for reporting. The data arrives in bulk once per day, and the pipeline takes several hours to complete. Cost efficiency is important, but performance and reliability of completing the pipeline are the highest priorities. Which type of Databricks cluster should the data engineer configure?

A) A high-concurrency cluster designed for interactive SQL workloads.
B) A lightweight single-node cluster with low worker node count to reduce costs.
C) An all-purpose cluster always kept running to ensure low-latency job startup times.
D) A job cluster configured to autoscale across multiple workers during the pipeline run.

Solutions: