Senior Data Engineer - Spark/Pyspark and TSQL (m/f/d)

Your Tasks:

• Migration of the existing on-premises data warehouse (MSSQL) to the Microsoft Fabric environment (lakehouse/data product architecture)
• Design and development of (source-aligned and consumer-aligned) data products in Microsoft Fabric based on a Medaillon Lakehouse architecture.
• Migration of the transformation logic from TSQL Stored Procedures to Pyspark Notebooks
• Data migration from the onprem data warehouse to Microsoft Onelake (delta format)
• Development and optimisation of data pipelines with Spark/PySpark
• Creation of semantic models, reports and dashboards in Power BI
• Optional use of additional Azure components such as Azure Databricks, Azure Data Factory and Azure SQL Database to expand the migration and transformation processes

Your Profil:

• Bachelor or Master in Computer Science or Engineering or similar
• 5+ years of experience in the BI and DWH fields
• Proven experience and seniority with Spark/Pyspark and TSQL
• Experience with some or all of the following:
  • Spark/SparkSQL
  • Microsoft Fabric Lakehouse and/or Notebooks
  • PowerBI Semantic Models, PowerBI Reports & Dashboards
  • Azure Databricks, Azure Data Factory, Azure SQL Database
• Motivated and dedicated personality with strong communication skills
• Analytical and structured mindset, solution-oriented, and excellent problem-solving skills
• Fluent in English, German is a plus