- Create and manage data pipelines for diverse sources in our data lake/warehouse.
- Collaborate with analysts to implement necessary data transformations. Research relevant data sources for property development.
- Develop web scraping scripts for data acquisition.
- Automate deployment and testing of data pipelines using CI/CD.
- Utilize Azure, AWS, and other technologies for data solutions.
- Implement data integration between systems.
- Monitor and optimize pipeline performance.
- Ensure data security, compliance, and quality.
- Stay updated on data engineering trends.
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- Proven experience as a Data Engineer, with strong understanding of data engineering concepts.
- Hands-on experience with Azure (Azure Function, Azure Data Factory, Azure Databricks) and/or AWS (AWS Glue, Lambda, Amazon Redshift).
- Proficiency in Python, Java, or Scala, and experience with data processing frameworks (e.g., Spark, Hadoop).
- Knowledge of data modelling, warehousing, and database technologies.
-
Data Engineer
1 day ago
Unison Consulting Malaysia, Kuala Lumpur Full timeImplement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives · Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions · Ensure ...
-
Data Engineer
1 day ago
Inter Island Group Malaysia, Kuala Lumpur Full timeData Engineer · Salary Range: RM4,000 - RM6,000 · Job Description · Create, enhance, and manage efficient data pipelines from diverse sources into our data lake/warehouse. · Collaborate closely with data scientists and analysts to fulfill their analysis and reporting requirements ...
-
Data Engineer
4 days ago
Rotate Malaysia, Kuala Lumpur Full timeOur vision · Rotate is building the go-to team in the cargo industry for commercial decision-making tools and solutions. We will utilize the technology, combined with industry and strategy consulting experience, to help airlines turn data into action and improve their day-to-day ...
-
Data Engineer
1 day ago
Agensi Pekerjaan EPS Consultants Sdn Bhd Kuala Lumpur, Malaysia Full timeClient Background: · BPO wing that offering a spectrum of services, from data analysis, customer service, and risk · management to administration, IT support, human resources, marketing, and beyond. · Location: KL · Tenure: Permanent role · Salary: Basic Salary · Responsibili ...
-
Data Engineer
4 days ago
Quandatics Malaysia, Kuala Lumpur Full timeJob Description: · Responsible for supporting stakeholders with data preparation, speeding up the creation of curated trusted data pipelines and their integration. · Engineer, optimize, fine-tune and maintain efficient, secure and reliable data pipelines to ingest, clean and cons ...
-
Data Engineer
1 day ago
Beyondsoft Singapore Malaysia, Kuala Lumpur Full timeCompany Description · Beyondsoft (listed by the Shenzhen Stock Exchange, stock code is a global provider of IT consulting, product and solution services. Relying on strong R&D and innovation capabilities, the company widely adopts emerging technologies based on big data and mobil ...
-
Data Engineer
1 week ago
Lotus's Malaysia Malaysia, Kuala Lumpur Full timeJob Description:- · Develop, implement, and maintain databases, data systems – reorganizing data in a readable format. · Develop automation on data management. · Automate and develop data solutions for existing processes using integrated tools. · Applies data extraction, transfor ...
-
Data Engineer
1 week ago
SIGMA INFO ANALYTICS DATA Malaysia, Kuala Lumpur Full timeABOUT THE JOB · Vacancy: Data Engineer (Contract) · Location: Kuala Lumpur, Malaysia (Hybrid) · Job Family: IT · Your Responsibilities: · 1 Integration & Interoperability Sustenance · Manage and monitor I&I Request submission, I&I Status, and I&I Diagram. · Conduct data integrati ...
-
Data Engineer
1 day ago
Capco Malaysia, Kuala Lumpur Full timeCapco, a Wipro company, is a global technology and management consultancy specializing in driving digital transformation in the financial services industry. With a growing client portfolio comprising of over 100 global organizations, Capco operates at the intersection of business ...
-
Data Engineer
4 days ago
KNOREX Malaysia, Kuala Lumpur Full timeAbout Knorex · Established in 2010, Knorex is a cutting edge advertising technology MNC with offices across USA, Australia, China, Singapore, Vietnam, India, Thailand and Malaysia. Knorex provides Precision Performance Marketing products and solutions to the world's leading brand ...
-
Data Engineer
3 days ago
Cognizant Technology Solutions Kuala Lumpur, Malaysia OTHERRole: Data Engineer (Cantonese Speaker) · Location: KL, Malaysia · Mandatory: · Azure SQL, Azure Databricks, Azure DevOps, Azure Pipeline. · Secondary: · Java, Kafka, API, MS SQL Server, ADF · Description: · Data Analysis of new and existing inhouse systems. · Data analysis of h ...
-
Data Engineer
1 week ago
Randstad Malaysia Kuala Lumpur, Malaysia Full timeabout the company · leading public listed company with 5 subsidiaries specializing in property development, investment & trading rspectively · about the job · designing, development and maintaining data pipelines from various sources · responsible for data ingestion and transfor ...
-
Data Engineer
4 days ago
Terrabit Consulting Sdn Bhd Kuala Lumpur, Malaysia Full timeExperience on Informatica Powercenter development activities · 2. Experience on Hadoop big data platform – Hive, Spark, Hbase · 3. Shell scripting, Python, scripting, SQL · 4. Experience in ingesting Semi-structured/un-structured files into Hadoop platform · 5. Good knowledge ...
-
Data Engineer
1 week ago
Ariston Services Malaysia, Kuala Lumpur Full time· Actively looking for Data Data-Developer Senior & Junior with a hands on experience on the following: · Platform: Informatica, Oracle, AS 400 · Database: Oracle, SQL server · Language: ETL, MDM · OS:AS 400/Linux · Primary Skill: Data Warehouse Tools · Please note: AS 400 expe ...
-
Senior Data Engineer
4 days ago
PublicisGroupe Malaysia, Kuala Lumpur Full timeJob Description · Data Engineer - Data & Analysis · Digitas is a highly-caffeinated playground where brilliant minds come together to bring bold, award-winning ideas to life. · The Data & Analysis team uses data-driven insights to fuel strategic growth for clients. We believe tha ...
-
Senior Data Engineer
4 days ago
PublicisGroupe Malaysia, Kuala Lumpur Full timeJob Description · Data Engineer â€' Data & Analysis · Digitas is a highly-caffeinated playground where brilliant minds come together to bring bold, award-winning ideas to life. · The Data & Analysis team uses data-driven insights to fuel strategic growth for clients. We believe t ...
-
Data Engineer II
1 week ago
GSS AirAsia SEA Sdn. Bhd Kuala Lumpur, Malaysia Full time· • Managing external technical communication with partners and vendors. · • Contributing to the enhancement of data governance policies. · • Staying current with technical and industry developments. · • Providing technical assistance to analysts and data scientists on data a ...
-
Senior Data Engineer
4 days ago
Randstad Malaysia Malaysia, Kuala Lumpur Full timeAbout The Company · courier service provider that provides universal postal services, providing services to both end users and corporate clients. They also provide services within the logistics and aviation industry · About The Job · Responsible for creating and maintaining data ...
-
Data Protection Engineer
1 day ago
Tentacle Sso Sdn Bhd Kuala Lumpur, Malaysia Part timePosition: Data Protection Engineer · Experience: 3-10 Years · Eligible: Apply from anywhere · Visa: Provided by companyBudget: MYR 11.5k/Month · Location: Menara Maybank , KL · Domain: Banking Industry · Job Description: Senior Data Protection Engineer Level 3 (7yrs-10yrs Mus ...
-
Manager – Data Engineering
4 days ago
PwC Malaysia, Kuala Lumpur Full timeJob Description & Summary · A career within Actuarial Services, will provide you with the opportunity to contribute general insurance advice and consulting services to clients such as insurers, banks, regulators, and third party administrators. You'll provide advice covering solv ...
Data Engineer - Kuala Lumpur, Malaysia - Inter Island Group
Description
Job Description:
Requirements: