About the role: Company expands its team of analytics to enhance Company’s platform and offer advanced AI-based analytics and recommendation data to support 1000 stores. In this role, you will take charge of managing and optimizing Company’s data infrastructure. Your responsibilities will include designing and implementing scalable data pipelines, ensuring data quality and reliability, and collaborating closely with the data science team to facilitate efficient data analysis.
Responsibilities:
- Review the built system and suggest possible improvements in terms of code and configuration of Spark jobs;
- Architect and develop complex ETL/ELT processes for big data.
Requirements and skills:
- 3-4 years of experience in the field of data engineering;
- Mandatory skills in Apache Droid, Apache Hive, Apache Spark, Apache Airflow, Scala/Java, MySQL, S3, Apache Kafka, experience with Linux based operating systems, Ansible;
- Working knowledge of message queuing, and stream processing systems;
- Experience in setting up data streaming pipelines (ETL, ELT);
- Familiarity with Druid, Python, Redis, Prometheus, Grafana, ELK is a plus;
- Certificates related to data engineering and contribution to Spark/Druid are a plus.
Company offers:
- Career planning and regular performance review;
- Flexible bonus system;
- Paid leave days;
- Free medical insurance;
- Sports reimbursement according to Company HR Policies;
- English lessons and speaking club;
- Support in the maintenance of all documentation for private entrepreneurs.
Apply for the position (please make sure your CV/Profile contains contact information)
