Data Engineer with Java Development Full-time Job

This role requires a blend of a Data Engineer and a Developer who will be responsible for designing, building, monitoring, tuning, and troubleshooting data pipelines for Global Finance & Risk Technology.

Is this role right for you? In this role, you will: 

• Design, Develop and maintain robust data pipelines for the ingestion, transformation, and distribution of large datasets.
• Utilize services and tools to automate data workflows and streamline the data engineering process.
• Collaborate with other stakeholders to support data analysis, data mapping and reporting needs.
• Monitor application performance, identifying bottlenecks, and implementing improvements to enhance efficiency.
• Conduct data quality checks and implementing measures to ensure data accuracy and integrity.
• Stay current with emerging technologies and data engineering practices to recommend and adopt innovations that improve data systems.
• Provide technical expertise and support for data-related issues, including troubleshooting and resolving data pipeline failures.
• Document data engineering processes, creating data flow diagrams, and maintaining metadata for data lineage and cataloging.

 

Do you have the skills that will enable you to succeed in this role?  We’d love to work with you if you have experience with:

 

• Proficiency in Java is crucial.
• Experience using Streaming Architecture (Kafka) and Big Data Platform (Hadoop) is required.
• Strong SQL knowledge is needed.
• Experience in NiFi is desired.
• General Understanding of continuous integration/continuous deployment (CI/CD) pipelines
• Experience building CI/CD pipelines using GitHub, Artifactory etc. to reduce cycle times and ensure quality.
• Strong scripting skills (i. e. shell scripting for automation.
• Working experience with source control systems like Git.
• Exposure to working on cloud platforms like Azure/GCP/AWS
• Experience with Agile/Scrum development methodologies
• Team player with effective communication skills (verbal and written)
• Able to see tasks through to completion without significant guidance.
• Self-managed and results-oriented with sense of ownership is required.
• A university degree in Mathematics, Science, Engineering, Management or relevant.

 

 What's in it for you? 

• We have an inclusive and collaborative working environment that encourages creativity, curiosity, and celebrates success!
• We provide you with the tools and technology needed to create meaningful customer experiences.
• An opportunity for mentorship from experienced and knowledgeable technologists
• You'll get to work with and learn from diverse industry leaders, who have hailed from top technology companies around the world.
• We offer a competitive total rewards package that includes a base salary, a performance bonus, company matching programs (on pension & profit sharing), generous vacation, personal & sick days, personal development funding, maternity leave top-up, parental leave and much more.

The Bank of Nova Scotia, operating as Scotiabank, is a Canadian multinational banking and financial services company headquartered in Toronto, Ontario. One of Canada's Big Five banks, it is the third-largest Canadian bank by deposits and market capitalization. In 2023, the companys seat in Forbes Global 2000 was 88.