Data Engineer (Stores/Customer Order)
Summary
Data Engineer at Tesco Technology in Kraków building and optimizing data pipelines for retail order, delivery, and fulfillment data. Day-to-day work centers on Apache Spark (Scala/Python), HDFS/CEPH, Hive/Kyuubi, and Airflow in a hybrid big-data stack.
About the role
The Data Engineering department at Tesco Technology is at the forefront of data processing within the retail and technology industry. This vital department handles a range of responsibilities, including:
- Analyzing order and delivery data to optimize logistics processes and enhance delivery efficiency.
- Managing critical data related to customer orders, suppliers, and products to ensure the seamless flow of our fulfillment operations.
- Upholding data integrity and security during the processing of order and delivery-related information.
As we continue to expand, we are actively seeking a skilled Data Engineer to join our team of analytics experts. In this role, you will take charge of expanding and refining our data and data pipeline architecture. Additionally, you will be instrumental in optimizing data flow and collection to cater to the needs of cross-functional teams.
Our ideal candidate is an experienced data pipeline builder and data enthusiast who relishes the opportunity to optimize data systems and construct them from the ground up. As a Data Engineer, you will collaborate closely with software developers, database architects, data analysts, and data scientists on various data-driven initiatives. You will play a crucial role in ensuring that the optimal data delivery architecture remains consistent across all ongoing projects.
What is in it for you
- Up to 20% yearly salary bonus – based on both individual and business performance
- Permanent contract from the go – as a sign of our trust in your abilities
- Tax-deductible expenses (IP)
- Private healthcare (LuxMed)
- Cafeteria & Multisport
- Additional 4 days of paid leave to support your well-being and family life
- Increase in annual leave (from 20 to 25 days) for those not yet eligible for the full holiday entitlement
- Learning opportunities – certified technical training and a learning platform (Udemy)
- Back-to-school day – 1 day off for parents of primary school children
- Fertility leave – up to 2 weeks of paid leave for IVF treatment
- Sports activities with a personal trainer in the office
- Referral bonus
- MacBook as your work tool
About us
You will need
Mandatory skills:
- Data Processing: Apache Spark - Scala or Python
- Data Storage: Apache HDFS, CEPH S3 or respective cloud alternative
- Resource Manager: Apache Yarn or respective cloud alternative
- Lakehouse: Apache Hive/Kyuubi or alternative
- Workflow Scheduler: Airflow or alternative
Nice to have skills:
- Functional programming
- Apache Kafka
- Kubernetes
- Stream processing
- CI/CD
Unsure if you fit all the criteria? Apply and give us the chance to evaluate your potential – you could be the perfect fit!