Senior Data Engineer

Mô tả Công việc

Job Objective:

• Building a platform with strong architecture
• Be part of the data & and analytics center of excellence (CoE) working on a wide range of data infrastructure and data engineering projects across

Key Responsibilities

1. Data Architecture:

• Architects, Designs, Builds, Develops, Maintains, and Implements new data systems where needed, the Architecture with best practices and data infrastructure reliable and scalable.
• Responsible for deploying secure and well-tested software that meets privacy and compliance requirements, and maintains and improves CI / CD pipeline.
• Proactively drive the effort of identifying opportunities to manage data and provide data solutions.
• Evaluate various data architectures in the market and utilize them to develop data solutions to meet business requirements.
• Drive the delivery of data products and services into systems and business processes in compliance with internal regulatory requirements.
• Oversee the review of internal and external business and product requirements for data operations and activity and suggest changes and upgrades to systems and storage to accommodate ongoing needs

2. Data Integration:

• Review and analyze existing data systems, and make recommendations on improvement, maintenance, or other factors to improve the system, automate manual processes, optimize data delivery, and re-design infrastructure for scale and performance and greater scalability
• Monitoring and quality assurance within the system (Server/ Services/ETL /Networking/Security).
• Design, build, and maintain optimized data pipelines and ETL solutions as business support tools in providing analysis and real-time analytics platforms for critical decision-making, support of data and analytics projects, integrating new sources of data into our central data warehouse to meet business requirements, and experience building and optimizing ‘big data’ architectures for read-and-write performance.
• Ensure data assets are organized and stored efficiently so that information is high quality, reliable, flexible, and efficient.
• Manage and enhance to ensure that DWH, Data mart and BI tools work stably through aligned business/ system/ and data processes.
• Ensure data is accessible to the required personnel to ensure the ease of understanding and access to the data needed to make informed business decisions.
• Experience with building reports and data visualizations, using data from the data warehouse or other sources and mapping are helpful (but not required)

3. Project Management:

• The role plays is highly collaborative and, as such, works closely with data analysts, data scientists, and other data consumers within the business.
• Establishes the documentation of reports, data infrastructure, privacy controls and develops, maintains technical specification documentation, and processes, and effectively manages data systems that have the relevant security.
• Work with team leads to resolve people problems and projects to ensure maximum productivity.
• Understand business and technical requirements and constraints to design effective software solutions.
• Strong stakeholder management and collaboration with them to understand user requirements
• Effective time management skills, including demonstrated ability to manage and prioritize multiple tasks and projects.
• Experience working in Agile teams to lead successful digital transformation projects, having mastered Agile principles, practices, and Scrum methodologies

4. Talent Development:

• Support line manager training and mentor “Junior Data Engineer”
• Provide training and guidance on new systems and new skills and share knowledge that is being implemented into the team adding to the already
• Ability to work effectively in teams, in both a lead and support role.
• Take on research to improve data processing and any implemented frameworks used by our team
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Ability to build processes supporting data transformation, data structures, metadata, dependency, and workload management.

5. Direct Manager (Key Relationships): Senior Manager/ Manager, BI&A

• And other tasks as assigned.
• Continuous learning and improvement mindset
• Ability to work long and extended hours as needed
• Ability to prioritize own time and workload
• Ability to read, understand, and write code
• Have teamwork skills, work independently, and self-study.
• Good number sense, listening, logical thinking, analytical thinking (with keen attention to detail), problem-solving abilities, and communication skills (both written and verbal).