Noels IT
DATA ENGINEER
Design, build, and maintain the infrastructure and system necessary to process, store, and manage large volumes of data efficiently and accurately.
Requirements:
-
Diploma in a related IT field (Data Warehousing, Database Management, etc.)
-
At least 3 years of experience as a data engineer.
-
Experience in data integration.
-
Develop, construct, test and maintain data architectures, set or model based on business requirements.
-
Support and solve integration issues, either at application level or infra and network level.
-
Identify the bottlenecks in the existing data pipelines, propose and lead the efforts to optimise and automate the data pipeline work.
-
Leverage on a variety of programming languages and data crawling/processing tools to ensure data reliability, quality, and efficiency.
-
Experience in Data Transformation using ETL/ELT tools such as AWS Glue, Factory, Talend, EAI, and Databricks.
-
Experience in database query using SQL or others in relation.
-
Experience in Cloud Data-related tools (Microsoft Azure, Amazon S3, etc.)