Data DevOps Consultant
Beijing
- Organization: AIIB - Asian Infrastructure Investment Bank
- Location: Beijing
- Grade: Consultancy - Consultant - Contractors Agreement
-
Occupational Groups:
- Statistics
- Information Technology and Computer Science
- Closing Date: 2025-02-14
Application close date
02/14/2025
1. Project Background
With the data platform established, DevOps (continuous development, including data integration and distribution; continuous delivery solution as well as daily operation support) requires more efforts to align with the growing of the data platform to meet business needs.
2. Objectives of the Assignment
With the data platform established, DevOps (continuous development, including data integration and distribution; continuous delivery solution as well as daily operation support) requires more efforts to align with the growing of the data platform to meet business needs. To support the ongoing data platform DevOps activities, we are looking for a Data DevOps Consultant.
3. Scope of Services
Responsibilities for this role include, but are not limited to: • Provide technical support for Azure Cloud-based data platform project, utilizing ADF, Synapse, SQL Server, Data Lake, and Azure Function services. • Support data analysts on data exploratory analysis, develop quick data pipeline to testify different business scenarios • Troubleshoot and resolve issues related to data ingestion, transformation, and storage processes. • Work closely with the vendor development team to identify and resolve bugs and issues during daily operation. • Provide recommendations to improve system performance and optimize processes. • Develop and maintain documentation on system architecture, technical design, processes, and procedures.
4. Consultancy Output / Deliverables
Responsibilities for this role include, but are not limited to: • Provide technical support for Azure Cloud-based data platform project, utilizing ADF, Synapse, SQL Server, Data Lake, and Azure Function services. • Support data analysts on data exploratory analysis, develop quick data pipeline to testify different business scenarios • Troubleshoot and resolve issues related to data ingestion, transformation, and storage processes. • Work closely with the vendor development team to identify and resolve bugs and issues during daily operation. • Provide recommendations to improve system performance and optimize processes. • Develop and maintain documentation on system architecture, technical design, processes, and procedures.
5. Implementation Arrangement
N/A
6. Support to the Consultant by the Bank
N/A
7. Knowledge Transfer and Training
N/A
Qualification Requirement
• Bachelor's degree in Computer Science, Information Engineering or related field. • Experience with data warehouse and database design: A strong foundation in data warehouse and database design is required. Knowledge of relational database management systems (RDBMS) such as SQL Server, Mysql or PostgreSQL is essential. • Proficiency in ETL tools: ETL (extract, transform, load) tools are used to move data from source systems into the data warehouse. Familiarity with tools such as SSIS, Azure Data Factory, or Pentaho which can help automate and streamline data processing process. • Experience with cloud which include Azure and AWS. Familiar with Azure DevOps, Key-vault, App Service, Data Lake, Azure Data Factory. • Advanced SQL knowledge and experience working with relational databases, query authoring. • Nice to have: Familiar with .Net language and .Net development framework.
Applications from non-qualifying applicants will most likely be discarded by the recruiting manager.