Sr. Data Engineer Full-time Job
Jan 29th, 2024 at 13:56 Engineering Vancouver 234 views Reference: 4279Job Details
As a Senior Data Engineer, you will be responsible building the underlying infrastructure and systems that enable data storage, processing, and retrieval. You will work closely with Data Architects and Data Scientists to develop scalable and robust data pipelines that support the organization's data-driven initiatives. You will also responsible for implementing data security and privacy measures to protect sensitive data.
Key Responsibilities
• Direct analysis of technology, industry and market trends, and determine their potential impact on Bell’s technology environment
• Ensure alignment of architectural strategy with business requirements
• Provide vision for and direct oversight of an Architecture function (Enterprise, Data, Infrastructure, Applications, Integration, Cloud, Security, etc.)
• Gather and analyze data and develop architectural requirements at project/program/portfolio level
• Consult with project teams to ensure compatibility with existing solutions, infrastructure and services and strategic requirements
• Support the development of software and data delivery platforms with reusable components that can be orchestrated for reuse through different methods for different business purposes
• Assist in post-implementation continuous-improvement efforts to enhance performance and provide increased functionality
• Analyze current architecture to identify gaps and determine opportunities for improvement
• Perform ongoing architecture quality review activities relative to specific projects/programs/portfolio that one is responsible for
• Keep technology and service managers aware of key customer issues, identifying and resolving potential problems and conflicts
• Develop and communicate architecture technical guidance, design patterns, and standards, and collaborate with IT stakeholders in the development and evaluation of architecture-compliant technical solutions
• Conduct an evaluation of the current IT environment to detect critical deficiencies, and recommend solutions for improvement
• Responsible for reviewing the technical architecture from a security, accessibility, data integrity, and availability points of view
• Overseeing and monitoring progress on complex and/or multiple projects relative to scope, schedules, budgets and quality
• Provide technology evaluation and selection advice regarding the use of COTS, custom approaches, open source and cloud appropriateness
• Preparing and distributing architectural vision, goals, standards, structure, behavior patterns, models, to all affected stakeholders
• Checking conformance to standards and architectural decision and resolving design and architectural conflicts by explaining and justifying design and architectural decisions
• Minimize the impact of integration on various existing processes
Qualifications
• A relevant University degree/technical certification, and/or relevant experience commensurate to the role
• Telco Experience is considered an asset
• 5+ years of IT technology, operations, people leadership and strategy experience in a large company
• Entrepreneur, self-motivated and independent worker
• Approaches a problem by using a logical, systematic, and sequential approach
• Ability to work effectively under pressure and in rapidly changing environments or uncertain conditions
• Demonstrates openness and willingness to adapt to different and new ways of doing things
• Ability to work cooperatively with others on a team, and to establish and maintain effective business relationships
• Ability to communicate (verbally and in writing) effectively with all levels of the organization
• Hands-on experience with
• Data model (OpenAPI, TM Forum, IETF, MEF, TIP, OpenConfig, etc.), Yang, YAML, XML, Kafka, hadoop, Data Lake, Data Warehouse, and big data
• JSON schema and Rest/RestConf API development
• DevOps tools (Jenkins, jira, etc.)
• Software architecture and engineering best practices across multiple teams (CI/CD, code review, and testing)
• Pipeline, search, and analytics platforms, e.g., ELK (Elasticsearch, Logstash, and Kibana)
• Micro service architecture design and development
• Linux (KVM, OpenStack, RHEL, Ubuntu) application deployment
• Enthusiastic to quickly learn and adapt to new technologies (green field), with a strong aptitude for innovation