Skip to content
Choose another stack

Data Engineering & Big Data skill check

Seven quick questions: where you are with Data Engineering & Big Data, then how well you can do six things engineers do every day in it. Be honest; the plan is only as good as the answers. Nothing here is saved.

Question 1 of 7
  1. Where are you with Data Engineering & Big Data?
  2. 01 · SQL for data workWrite complex SQL with window functions and explain why a query is slow
  3. 02 · SparkProcess a large dataset with PySpark and tune a slow job
  4. 03 · Hadoop and the data lakeOrganise data in a lake with the right formats and partitions
  5. 04 · Kafka and streamingBuild a pipeline that processes events from Kafka as they arrive
  6. 05 · AirflowSchedule and monitor a multi-step pipeline in Airflow
  7. 06 · WarehousingDesign warehouse tables that analysts can query easily