- Designing, building, and maintaining data pipelines to extract, transform, and load data from various sources (e.g. databases, web APIs, flat files) into a central data storage
- Implementing data quality checks and monitoring processes to ensure the accuracy and completeness of the data
- Collaborating with data analysts and data scientists to understand their data needs and to provide them with the data they need to do their jobs effectively Writing and maintaining documentation for data pipelines and processes
- Investigating and fixing issues with data pipelines and processes
- Participating in the design and implementation of data governance policies and procedures
- Keeping up-to-date with the latest developments and best practices in data engineering
- The ideal candidate for this role will have strong technical skills in programming (e.g. Python, SQL) and data processing technologies (e.g. Hadoop, Spark). They should also be able to work well in a team, be able to communicate effectively with both technical and non technical stakeholders, and be comfortable working in a fast-paced, constantly evolving environment.
- A bachelor's or master's degree in a relevant field, such as computer science, data science, or engineering.
- Proficiency in programming languages such as Python. Experience with SQL and database technologies (e.g., MySQL, PostgreSQL) is also highly valuable.
- Experience with data processing technologies such as Hadoop, Spark, or Flink.
- Familiarity with data management and the ability to design and maintain data pipelines on Internal server.
- Strong problem-solving and analytical skills, with the ability to troubleshoot and debug issues with data pipelines.
- Good communication and collaboration skills, as the role often involves working closely with data analysts, data scientists, and other team members.
-
Data Engineer
Found in: Foundit MY A2 - 5 days ago
Zurich Insurance Company Ltd. KualaLumpur, Malaysia Full timeJob Overview · We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ...
-
Data Engineer
Found in: Foundit MY A2 - 2 days ago
Shopee Malaysia Full timeJob Description: · Design, build and maintain the real-time streaming system to support timely and accurate ingestion of various types of data (e.g. User behavior, RDS, NoSQL DB, and others) into storage · Design, build and maintain data warehouse for Shopee's e-commerce search a ...
-
Data Engineer
Found in: Foundit MY A2 - 1 day ago
Shopee Malaysia Full timeJob Description: · Design, build, and maintain the real-time streaming system to support timely and accurate ingestion of various types of data (e.g. User behavior, RDS, NoSQL DB, and others) into storage. · Design, build, and maintain data warehouse for Shopee's e-commerce sear ...
-
Data Engineer
Found in: Foundit MY A2 - 18 hours ago
Shopee Malaysia Full timeJob Description: · Participate in the development work related to the Marketplace data warehouse, including data collection in offline and real-time data warehouses, data public layer construction, data application layer construction, and data governance. · Participate in support ...
-
Data Engineer
Found in: beBee S2 MY - 4 days ago
AffiliateUp Malaysia Full timeDesign and develop scalable, efficient applications for backend services. · Collaborate with front-end developers, product managers, and other stakeholders to gather requirements and implement solutions. · Write well-structured, maintainable, and testable code following best pr ...
-
BI Data Engineering
Found in: Foundit MY A2 - 4 days ago
Shopee Malaysia Full timeJob Description: · Review and analyze data collection systems and database infrastructures within Shopee Thailand. · Make recommendations on improvement, maintenance, or other factors to improve the database system. · Develop, build, and implement new solutions to help improve th ...
-
Data Engineer II
Found in: Foundit MY A2 - 18 hours ago
Air Asia Malaysia Full time· Job Description · As a Data Engineer II, you will play a crucial role in ensuring the integrity and quality of our data while enhancing internal processes through automation, optimization, and redesign. Collaborating with cross-functional and multidisciplinary teams in a dynam ...
-
Data Engineer Intern
Found in: Foundit MY A2 - 2 days ago
Shopee Malaysia Full timeJob Description: · Design, build, and maintain the real-time streaming system to support timely and accurate ingestion of various types of data (e.g. User behavior, RDS, NoSQL DB, and others) into storage · Design, build, and maintain data warehouse for Shopee's e-commerce search ...
-
Data Operations Engineer
Found in: beBee S2 MY - 5 days ago
PreciX Pte Ltd Malaysia Full timePreciX is aSingapore-based MedTech startup founded in 2016 to revolutionize thehealthcare industry's approach to joint health and mobility assessment,transforming lives by helping people move better and live well. We providesimple, fast, and accessible assessments, and empower he ...
-
Data Engineer Intern
Found in: Foundit MY A2 - 2 days ago
Shopee Malaysia Full timeJob Description: · Participate in the development work related to the Marketplace data warehouse, including data collection in offline and real-time data warehouses, data public layer construction, data application layer construction, and data governance. · Participate in support ...
-
Data Science Engineer
Found in: beBee S2 MY - 6 days ago
Applied Materials Malaysia Full timeKey Responsibilities · Identify Complex problems and needs at the customer site and work throughout the work cycle until the implementation of the solution · Lead recipe creation to optimize system performance and Train PSE/AEs' in recipe creation · Application Qualification o ...
-
Senior Data Engineering Consultant
Found in: beBee S2 MY - 5 days ago
Nigel Frank International Malaysia Full timeJob Description - Data Engineering Consultant · Nigel Frank International are working alongside a market leading Data Consultancy who are on the search for an experience Data Engineering Consultant to join their growing team. This multi-cloud organisation work alongside some of ...
-
Senior engineer master data management
Found in: beBee S2 MY - 4 days ago
Infineon Technologies Malasia, Malaysia Full timeIn your new role you will: Responsible for PBOM maintenance and migration activity in SAP PIO BMS for one SAP FE rolled-out sites. Be the technical Expert for PBOM and maintaining existing PBOM in One SAP PIO. Analyzing PBOM process in Process Mining and documenting PBOM FE Proce ...
-
Assistant Vice President, Data Engineering and Analytics
Found in: beBee S2 MY - 2 days ago
Generali Malaysia Malaysia Full timeJob Scope / Position Summary · The AVP, Data Engineering and Analytics plays an important role within the organization, responsible for es-tablishing a "Data Centre of Excellence" to identify and promote data-driven opportunities, supporting the business development of Generali ...
-
Data Center Design Engineering Project Manager, APAC
Found in: beBee S2 MY - 5 days ago
Edgeconnex Malaysia Full timeData Center Design Engineering Project Manager, APAC (Jakarta) · The Data Center Design Engineering Project Manager will lead technical project coordination for large data centre projects on the engineering side, including schedules, timelines, and lead gathering of technical d ...
-
Manager - Data Engineering (PwC Acceleration Center Kuala Lumpur)
Found in: beBee S2 MY - 1 day ago
PricewaterhouseCoopers International Malaysia Full timeWhether you've just graduated or have years of experience, this is a firm where you can learn and grow. · It's the PwC experience that stays with you as you build strong networks and make lasting friendships. Be part of a larger team as we work together, drawing on everyone's kn ...
-
Technical Product Management Intern- Engineering Infra
Found in: Foundit SG A2 - 18 hours ago
Shopee Malaysia Full timeJob Description: · Gathering of requirements - establish user feedback lifecycle to ensure use cases are continuously reviewed and prioritized into product backlogs · Develop product design and solution, translating technical use cases into UI/UX-friendly management console featu ...
-
Technical Product Manager
Found in: Foundit SG A2 - 5 days ago
Shopee Malaysia Full timeJob Description: · Drive the whole product development process, from discovery to launch, for Business Security products designed to address promotional fraud, account takeovers, and various business security challenges. · Collaborate with various business stakeholders to develop ...
-
Product Manager
Found in: Foundit SG A2 - 18 hours ago
Shopee Malaysia Full timeJob Description: · . Build comprehensive understanding of e-Commerce Clearing & Settlement products, on key business flows, use case scenarios and technical feasibility · . Collaborate effectively with cross-functional stakeholders from Product, Engineering, Design, Data, Finance ...
-
User Growth Operations
Found in: Foundit SG A2 - 18 hours ago
Shopee Malaysia Full timeJob Description: · Manage overall campaign operations and coordinate with stakeholders to schedule comms to users Push Notifications (PN) and Electronic Direct Mail (EDM) including drafting of content copies · Collaborate with regional stakeholders (operations and regional teams) ...
Data Engineer - Malaysia - Monroe Consulting Group
Description
Executive recruitment company Monroe Consulting Technology Division is partnered and is recruiting on behalf of an up and coming data driven technology start-up founded in Malaysia covering European clients. Due to rapid growth and expansion, our distinguished client is currently seeking for an exceptional Data Scientist to join their growing team. The role is based in the Klang Valley.
Job Summary:
As a Data Engineer, you are responsible for designing, building, maintaining, and troubleshooting data pipelines. They work with data from a variety of sources and use their technical skills to ensure that the data is accurate, up-to-date, and easily accessible to other team members.
Job Responsibilities:
Job Requirements: