- Responsible to design, build and maintain data pipelines
- Responsible to perform ETL process with data from various sources into central data storage platform
- Implement data quality checks and monitor the data processes to ensure accuracy of data is met
- Work closely with data analyst and data scientist to provide them with data information needed
- Responsible for preparing documentations for data pipelines developments and processes
- Be a part of designing and implementing data governance policies and procedures skills & requirements
- Bachelor degree in data engineering, computer science, information technology
- Minimum 5 years of experience in data engineering function
- Strong hands on technical exprience in Python
- Experience with data processing technologies
- Experence with designing and developing data pipelines is mandatory
experience 5 years
skills no additional skills required
qualifications no additional qualifications required
education Bachelor Degree -
Data Engineer
5 days ago
Unison Consulting Malaysia, Kuala Lumpur Full timeImplement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives · Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions · Ensure ...
-
Data Engineer
5 days ago
Rotate Malaysia, Kuala Lumpur Full timeOur vision · Rotate is building the go-to team in the cargo industry for commercial decision-making tools and solutions. We will utilize the technology, combined with industry and strategy consulting experience, to help airlines turn data into action and improve their day-to-day ...
-
Data Engineer
5 days ago
Jobs via eFinancialCareers Malaysia, Kuala Lumpur Full timeCompany Description · Beyondsoft (listed by the Shenzhen Stock Exchange, stock code is a global provider of IT consulting, product and solution services. Relying on strong R&D and innovation capabilities, the company widely adopts emerging technologies based on big data and mobil ...
-
Data Engineer
5 days ago
Inter Island Group Malaysia, Kuala Lumpur Full timeData Engineer · Salary Range: RM4,000 - RM6,000 · Job Description · Create, enhance, and manage efficient data pipelines from diverse sources into our data lake/warehouse. · Collaborate closely with data scientists and analysts to fulfill their analysis and reporting requirements ...
-
Data Engineer
5 days ago
Agensi Pekerjaan EPS Consultants Sdn Bhd Kuala Lumpur, Malaysia Full timeClient Background: · BPO wing that offering a spectrum of services, from data analysis, customer service, and risk · management to administration, IT support, human resources, marketing, and beyond. · Location: KL · Tenure: Permanent role · Salary: Basic Salary · Responsibili ...
-
Data Engineer
5 days ago
Quandatics Malaysia, Kuala Lumpur Full timeJob Description: · Responsible for supporting stakeholders with data preparation, speeding up the creation of curated trusted data pipelines and their integration. · Engineer, optimize, fine-tune and maintain efficient, secure and reliable data pipelines to ingest, clean and cons ...
-
Data Engineer
5 days ago
Lotus's Malaysia Malaysia, Kuala Lumpur Full timeJob Description:- · Develop, implement, and maintain databases, data systems – reorganizing data in a readable format. · Develop automation on data management. · Automate and develop data solutions for existing processes using integrated tools. · Applies data extraction, transfor ...
-
Data Engineer
2 weeks ago
SIGMA INFO ANALYTICS DATA Malaysia, Kuala Lumpur Full timeABOUT THE JOB · Vacancy: Data Engineer (Contract) · Location: Kuala Lumpur, Malaysia (Hybrid) · Job Family: IT · Your Responsibilities: · 1 Integration & Interoperability Sustenance · Manage and monitor I&I Request submission, I&I Status, and I&I Diagram. · Conduct data integrati ...
-
Data Engineer
5 days ago
Capco Malaysia, Kuala Lumpur Full timeCapco, a Wipro company, is a global technology and management consultancy specializing in driving digital transformation in the financial services industry. With a growing client portfolio comprising of over 100 global organizations, Capco operates at the intersection of business ...
-
Data Engineer
6 days ago
Inter Island Group Kuala Lumpur, MalaysiaJob Description: · Create and manage data pipelines for diverse sources in our data lake/warehouse. · Collaborate with analysts to implement necessary data transformations. Research relevant data sources for property development. · Develop web scraping scripts for data acquisi ...
-
Data Engineer
1 week ago
Cognizant Technology Solutions Kuala Lumpur, Malaysia OTHERRole: Data Engineer (Cantonese Speaker) · Location: KL, Malaysia · Mandatory: · Azure SQL, Azure Databricks, Azure DevOps, Azure Pipeline. · Secondary: · Java, Kafka, API, MS SQL Server, ADF · Description: · Data Analysis of new and existing inhouse systems. · Data analysis of h ...
-
Data Engineer
4 days ago
BASF SE Kuala Lumpur, MalaysiaDigital Hub Kuala Lumpur attracts, inspire and develop diverse talents who will elevate BASF's digital journey. · As one of the world's largest chemical companies, BASF is on a mission to create chemistry with a sustainable future. The Digital Hub Kuala Lumpur, alongside four oth ...
-
Data Engineer
2 weeks ago
Randstad Malaysia Kuala Lumpur, Malaysia Full timeabout the company · leading public listed company with 5 subsidiaries specializing in property development, investment & trading rspectively · about the job · designing, development and maintaining data pipelines from various sources · responsible for data ingestion and transfor ...
-
Data engineer
5 days ago
Unison Consulting Pte Ltd Kuala Lumpur, Malaysia Full timeDesign, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for per ...
-
Data engineer
5 days ago
Growthfn Sdn Bhd Kuala Lumpur, Malaysia Full timeJob Purpose: · • Should be able to troubleshoot errors on Informatica, Teradata, Hadoop platforms and supports applications built on top of it. · • Strong problem solving knowledge on Databases like Hadoop, Teradata & SQL. · • Monitoring Jobs Workflow and working with technica ...
-
Data Engineer
2 weeks ago
Ariston Services Malaysia, Kuala Lumpur Full time· Actively looking for Data Data-Developer Senior & Junior with a hands on experience on the following: · Platform: Informatica, Oracle, AS 400 · Database: Oracle, SQL server · Language: ETL, MDM · OS:AS 400/Linux · Primary Skill: Data Warehouse Tools · Please note: AS 400 expe ...
-
Data engineer
2 days ago
Ambition Kuala Lumpur, Malaysia Full timeJob description Responsibilities: You will oversee the complete software delivery process within the data analytics domain, covering requirement analysis, solution design, development, testing, implementation, and production support in Finance & Risk Analytics. Analyze user requi ...
-
Senior Data Engineer
1 week ago
PublicisGroupe Malaysia, Kuala Lumpur Full timeJob Description · Data Engineer - Data & Analysis · Digitas is a highly-caffeinated playground where brilliant minds come together to bring bold, award-winning ideas to life. · The Data & Analysis team uses data-driven insights to fuel strategic growth for clients. We believe tha ...
-
Senior Data Engineer
5 days ago
PublicisGroupe Malaysia, Kuala Lumpur Full timeJob Description · Data Engineer â€' Data & Analysis · Digitas is a highly-caffeinated playground where brilliant minds come together to bring bold, award-winning ideas to life. · The Data & Analysis team uses data-driven insights to fuel strategic growth for clients. We believe t ...
-
Staff data engineer
5 days ago
bp Malaysia, Kuala Lumpur Full timeEntity: · Innovation & Engineering · Job Family Group: · IT&S Group · Job Description: · At BP, we are playing to win · BP has a clear ambition – to be a net zero company by 2050 or sooner by reimagining energy. Our goal is to deliver the future of mobility, energy, and servic ...
Senior Data Engineer - Kuala Lumpur, Malaysia - Randstad Malaysia
Description
about the company
boutique consulting data and analytics services and solutioning company, providing end to end services including data strategy, data engineering, data visualization, data analytics and application development.
about the job