Senior Data Engineer

ING Hubs Poland is hiring!

The expected salary for this position:13000 - 28000 PLN

The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.

We are looking for you if You:

• have hands-on experience with Hadoop ecosystem and related tools with strong proficiency in Confluent Kafka for real-time data streaming
• have expertise in Java/Scala, Python and Ansible for data engineering and platform development
• are experienced in building batch and streaming data pipelines using Apache Nifi and Spark
• are proficient in building microservices and event driven architecture
• have proven experience in designing and implementing highly available, scalable, and fault-tolerant data platforms
• can define and implement the infrastructure required for optimal loading of data from a wide variety of data sources using big data technologies.
• have worked in DevOps environment (CI/CD with Azure DevOps, Test Automation, Docker/Kubernetes)
• have good understanding of CI/CD concepts and Elastic based monitoring solutions
• demonstrate a knowledge of relational database concepts, design and performance tuning.
• have knowledge on data security, access management and risk compliance
• understand data governance practices including lineage, retention, quality and cataloging.

You'll get extra points for:

• Exposure to public cloud platforms like GCP or Azure.

• Excellent communication skills and stakeholder management
• Ability to translate functional and non-functional requirements (e.g. Security, High Availability, Performance)
• Understanding of Agile – Scrum methodology is considered a plus.

Your responsibilities:

• Deal with a wide spectrum of tech from ETL/ELT pipelines, Data Warehouses, Batch and Event processing, and more.
• Contribute to strategy and lifecycle management of Data Lake implementation.
• Assess the efficiency of end-to-end processes by identifying and mitigating risks.
• Collaborate closely with an international team made of Chapter Leads, Product Owners, DevOps engineers and Infrastructure Specialists.
• Up to date with the latest industry standards and trends in Data Management

Information about the squad:

As a senior-level professional, you will be responsible for designing, implementing, and maintaining an on-premises Cloudera Hadoop-based data platform. You will collaborate with other senior engineers to define, propose, and build core capabilities that elevate the platform to the next level. This is a hands-on role, where you will work as part of a team of Big Data engineers to help our client develop and deliver data-driven products.

The role naming convention in the global ING job architecture will be “Engineer IV”.

The financial ranges specified in the announcement are adjusted and may differ from the range specified in the remuneration regulations.