Senior Data Engineer (Pipelines & Ingestion) (f/m/d)

bei Enpal

Hybrid
Information Technology
IT & Softwareentwicklung
Data Science & Analyse
Construction

Beschäftigungsart:

Vollzeit

Fähigkeiten:

Apache Spark
Python
Sql
AWS
CI / CD
Docker
Orchestration
Apache Kafka
Apache License
Apache Http Server
Big data
Airflow
Backbone
Software versioning
Unicorn
Fighting platform
SCHEMA
Ping
Apache Airflow
Veröffentlicht am:
Bewerbungsfrist:

Company Description

About The Team

Job Description

  • Data Pipeline Architecture: You'll design and build scalable data ingestion and transformation pipelines, handling both batch and real-time streams.
  • ETL/ELT Best Practices: You'll build robust, efficient workflows using tools like dbt, Apache Airflow, or similar orchestration frameworks.
  • Workflow Automation Integration: You'll collaborate with software and platform engineers to ensure data workflows can incorporate automation logic and business rules (e.g., auto-escalation, anomaly detection).
  • Quality & Governance: You'll enforce data integrity, version control, and security protocols to safeguard data quality.
  • Performance Optimization: You'll diagnose bottlenecks in data processing and implement best practices to improve throughput and reliability.
  • Mentorship & Team Building: You'll lead by example in code reviews, provide guidance to junior engineers, and actively shape a knowledge-sharing culture within the team.

Qualifications

  • You gained solid experience in data engineering, designing robust and large-scale data solutions.
  • You are experienced in Python, database interactions (SQL & NoSQL), using modern data platforms (Snowflake, Databricks, or similar), and you have a strong understanding of dimensional modeling, data warehousing concepts, and schema design.
  • Familiarity with real-time streaming (Kafka, Spark, or similar), cloud providers (AWS, Azure, or GCP), containers (Docker), CI/CD pipelines, or energy-sector data is a nice to have.
  • You communicate clearly in English. Knowledge of German is a plus.
  • You embody agile values and take ownership of identifying data issues and implementing robust solutions. You're comfortable with ambiguity, move fast with MVPs, and keep a long-term architectural view in mind.

Benefits and Additional Information

  • Work in Germany's first green unicorn and actively shape the solar energy revolution.
  • The sun shines all over the world - at Enpal you will find a highly motivated and diverse team with more than 65 different nationalities.
  • Would you rather keep your pet company at home or your colleagues at the office? Even after the pandemic, we offer you a hybrid working model
  • We fulfill every start-up cliché - in our modern office in Berlin-Friedrichshain, you'll find everything your heart desires, from a ping-pong table and yoga corner to a roof terrace and stocked drinks fridges.
  • Your kick-start at Enpal - Get to know the company, your team colleagues and our founder Mario on your onboarding day.
  • Stay up to date - Whether it's company figures at our monthly all-hands meetings or how a photovoltaic system works at the Lunch & Learn, you'll always know exactly what's going on.
  • Energy transition only works together - At Enpal, you can expect a legendary team spirit and unforgettable team events.
  • No mistakes, no progress - We live a strong feedback culture and grow with your input, either personally or anonymously via our feedback tool Culture Amp.