Post

Important skills for data engineers

Posted Updated
By Dorian Beganovic 1 min read

Data engineering specific:

  • SQL (advanced SQL, database internals, query tuning, administration…)
  • Good coding (Python + a JVM language)
  • Data pipeline design
  • Data modeling techniques
  • Architectural projections
  • Business domain knowledge
  • Communication skills

Secondary:

  • Software engineering (clean code, OOP, logging, monitoring…)
  • DevOps (Unix, infrastructure management, deployment…)
  • Data science/Business intelligence
  • Visualisation (Front-end code or just GUIs)

Good to know

  • Cloud / K8s (but really depends on the environment and the size of DevOps team)
data-engineering
principles
This post is licensed under CC BY 4.0 by the author.

Comments powered by Disqus.