Senior Data Engineer
Key Responsibilities
- Implement and maintain data workflows, ETL / ELT processes, and pipelines to move identified data into target platforms for further consumption and integration as required by product owners.
- Design and implement identified data processes and storage such as usage of databases, data warehouses, data marts, and data lakes with data security in mind.
- Build supporting tooling and procedures needed for data movement and monitoring activities.
- Implement available automations for data movement processes.
- Ensure delivered workflows and processes meet expected quality outputs through conducting testing.
- Document specs and implementations of deliverables mentioned.
- Work with operations teams for maintenance and continuous improvement of workflows and pipelines.
- Work on distributed Data processing and database with Distribution & partitioning
- Able to convert LDM to PDM in Data-vault Data warehouse.
- Ability to perform tasks related to end-to-end Data Journey including Reporting.
- Ensure integrated data pipeline validation is performed.
Key Capabilities/Experience
- Expertise in one/ some of ETL tools like ADF, Airflow.
- Expertise in SQL / RDBMS databases, handling of structured data.
- Extensive experience in design and implementation of data handling processes (ingestion, transformation, modelling, and storage)
- Experience in creating of Big Data warehouses, its design, and its various implementation methods.
- Flexible and willing to learn various ETL / data integration tools and products.
- Strong problem solving and solutions engineering mindset.
- Experience in working and coordinating remotely with teams and stakeholders.
- Experience with data integration and ETL technologies.
- Experienced with software version control technologies such as Git.
- Experience in CI / CD and DevOps is a plus.
- Experience in Agile way of working is a plus.
Minimum Qualifications
- Expertise in one/ some of ETL tools like ADF, Airflow.
- Expertise in SQL / RDBMS databases, handling of structured data.
- Extensive experience in design and implementation of data handling processes (ingestion, transformation, modelling, and storage)
- Experience in creating of Big Data warehouses, its design, and its various implementation methods.
Nice to have
- Proficiency and experience in programming languages such as Python, shell scripting
- Experience in cloud platforms and technologies (Azure, AWS, GCP) is a plus.
Questions? Just ask
ING Recruitment team
Chez ING, nous voulons libérer tout le potential de nos collaborateurs, grâce notamment à une culture inclusive où tout le monde peut se développer et avoir un impact sur nos clients et sur la société. Nous veillons à ce que la diversité, l'équité et l'inclusion soient prioritaires. En tant qu'employeur souscrivant au principe de l'égalité des chances, nous ne tolérons aucune forme de discrimination, qu’elle soit liée à l'âge, au sexe, à l'identité sexuelle, à l'origine culturelle, à l'expérience, à la religion, à la race, à l'origine ethnique, au handicap, aux responsabilités familiales, à l'orientation sexuelle, à l'origine sociale ou à tout autre statut protégé par la législation. Si vous avez besoin d'aide lors du processus de candidature et/ou d'entretien, veuillez contacter le (la) recruteur(se) du poste concerné. Nous serons heureux de vous accompagner pour garantir un processus équitable et accessible. Apprenez-en plus sur notre engagement en faveur de la diversité, de l’inclusion et de l’appartenance.
Plus pour vous
-
Technologie Rejoignez ING Technology : Innover à l'échelle mondiale, créer des solutions intelligentes et protéger les données avec une technologie qui change des vies. May 15, 2024 Article Expertise & Teams
-
Travailler à ING aux Philippines Rejoignez ING Hubs Philippines et influencez la finance mondiale. Explorez des carrières en IT, KYC, data, et plus dans un environnement innovant. August 13, 2024 Article Location Spotlight ING Hubs Related Content
Jobs for you
No jobs found
No saved jobs.
Jobs for you
- Recommended
- Recently viewed
- Saved
No jobs found
No saved jobs.