Lead Data Engineer
6.0/10
Alfa-Bank
Not specified
Remote
mid
23 days ago
aianalyticsdevtechfintechSQLPythonScalaApache AirflowSparkKafka
AI Summary
The vacancy is well-defined but lacks compensation details, affecting overall attractiveness to applicants.
Check Match — Just drop your CV
See your fit for Lead Data Engineer in seconds.
Description
Responsibilities
- •Design and develop scalable data infrastructure (batch and streaming pipelines);
- •Work with ClickHouse (MergeTree), S3 Data Lake, Kafka, Airflow (ETL/ELT);
- •Architect and implement data marts for analytics, ML, and AI agents;
- •Support and write ETL/ELT pipelines (dbt / Airflow / Spark / Kafka / etc.);
- •Optimize performance, storage costs, and data consumption;
- •Implement and support CI/CD standards and monitoring of pipelines;
- •Collaborate with analysts, ML engineers, developers, and product teams;
- •Participate in building feature store, ML infrastructure, and support GenAI systems.
Requirements
Requirements
- •3+ years of experience working with data as a Data Engineer;
- •Experience designing data platforms in production (from ingestion to marts);
- •Excellent knowledge of SQL, Python (or Scala), experience with Apache Airflow, Spark, Kafka;
- •Experience building CI/CD processes and monitoring data pipelines;
- •Understanding of data governance, data quality, and data contracts.
Loading similar jobs...