Senior Data Analyst - Databricks & PySpark

• Standort: Neckarsulm
• Abteilung / Bereich:
• Level: Berufserfahrene
• Referenznummer: 2316
• Minimum 8 years of experience as a data or BI analyst
• Demonstrated ability in stakeholder communication and management
• Experience working with Agile methodology
• Ability to work flexibly and independently
• Experience in creating and maintaining project documentation
• Good understanding of related data disciplines (e.g. data engineering, data science)
• Ability to understand, analyze and translate business requirements into data-driven solutions
• Enthusiasm for collaboration, knowledge sharing and joint learning
• Very good English skills - German is a plus at minimum B1 level.

Einleitungstext

As a digital system provider for Lidl's online business, we at Lidl e-commerce create efficient, scalable digital products and services and develop them further for the future. As a brand of the IT and digital division Schwarz Digits, our divisions are divided into Commerce Platforms, Marketing Tech & Enablement, Payment, New Digital Business Models and SCRM Loyalty Platforms.

Your tasks

• Perform exploratory data analysis on large datasets to identify inconsitencies, trends & anomalies
• Building ETL pipelines & curate data following medallion architecture
• Ensuring data quality & integrity: design and implement robust data quality frameworks, including unit tests and automated schema checks
• Apply statistical methods & techniques to answer business questions
• Experience with Databricks and Snowflake platforms
• Strong proficiency in SQL (nice to have), PySpark and Python (must have)
• Proficiency with local development tools including VSCode, PyCharm, and Git
• Experience in building reports
• Being able to work with or in a setup with: CI/CD, Unit & Integration Tests, Code Quality Tools , Vulnerability Scans
• Working in Cloud Environments