Senior Data Engineer

Data Engineer

Responsibilities 

• Implement and maintain data workflows, ETL / ELT processes, and pipelines to move identified data into target platforms for further consumption and integration as required by product owners.
• Design and implement identified data processes and storage such as usage of databases, data warehouses, data marts, and data lakes with data security in mind. 
• Build supporting tooling and procedures needed for data movement and monitoring activities. 
• Implement available automations for data movement processes.
• Ensure delivered workflows and processes meet expected quality outputs through conducting testing.  
• Document specs and implementations of deliverables mentioned. 
• Work with operations teams for maintenance and continuous improvement of workflows and pipelines.
• Work on distributed Data processing and database with Distribution & partitioning
• Ability to perform tasks related to end-to-end Data Journey including Reporting.
• Ensure integrated data pipeline validation is performed.

Job Description:

We are looking for you, if you:

• You have experience in data processing using Azure Data Factory,
• Worked with Power BI Service or Power BI Report Server and have experience in dashboard creation (incl. DAX) and administration,
• Know SQL and SQL Server/Oracle Database,
• Have knowledge of methodologies for creating data warehouses and designing ETL processes,
• Have expertise with  the implementation of programming solutions on large data sets, statistical analysis Plans and technical specifications documents,
• Are a naturally collaborative person who listens and invests in others to achieve common goals,
• Love to challenge the status quo and are eager to propose creative solutions to problems,
• Have ability to quickly adopt to change and still complete your tasks,
• Have good communication skills, writing and verbal in English.

You will get extra points for:

• Experience with Business Intelligence tools such as Visual Analytics,
• Basic SAS knowledge,
• Knowledge about Credit Risk and how bank works,
• Azure DevOps.

Your responsibilities:

• Building scalable and efficient pipelines in Azure Data Factory,
• Translate the business requirements into strong visualizations in Power BI,
• Development of Business Intelligence environment,
• Architectural improvements,
• Documentation – technical and for business users.

Information about the squad:

• As a Data Engineer, you will be part of ING Hubs Poland. You will be involved in data processing automation, data structures development, dashboards preparation.
• You will be working in an Agile environment by being a member of a multidisciplinary team of 5 to 9 specialists. Your colleagues will have a background in Data Analytics, Data Management, Reporting in the Credit Risk domain.

Nice to have

• Proficiency and experience in programming languages such as Python, shell scripting