Jobs
>
Data Engineer
>
Kuala Lumpur

    Data Engineer - Kuala Lumpur, Malaysia - Zurich Insurance Company

    Zurich Insurance Company
    Zurich Insurance Company Kuala Lumpur, Malaysia

    Found in: Talent MY C2 - 3 days ago

    Default job background
    Description

    Job Overview

    We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company's data architecture to support our next generation of products and data initiatives.

    Responsibilities for Data Engineer

  • Create and maintain optimal data pipeline architecture,
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
  • Work together with data scientists and analysts to understand the needs for data and create effective data workflows.
  • Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
  • Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.
  • Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
  • Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
  • Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.

    • Qualifications for Data Engineer

  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools: Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with Azure cloud services implementation. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

    • You are the heart & soul of Zurich

    At Zurich, we like to think outside the box and challenge the status quo. We take an optimistic approach by focusing on the positives and constantly asking What can go right?

    Let's continue to grow together

  • Location(s): MY - Kuala Lumpur
  • Schedule: Full Time
  • Recruiter name: Eilma Fatehah Sabri
  • Closing date: 29th February 2024
  • Publicis Groupe

    Data Engineer – Data

    Found in: Talent MY C2 - 3 days ago

    Publicis Groupe Kuala Lumpur, Malaysia Full time

    Job Description · What you'll do: · As a Data Engineer, you'll build the strategic and tactical foundation for data-driven marketing efforts. You'll work to achieve client goals through proper management and transformation of client data. · Day-to-day, your role includes: · Asse ...

  • United Overseas Bank

    Data Engineer, Data

    Found in: Talent MY C2 - 3 days ago

    United Overseas Bank Kuala Lumpur, Malaysia Full time

    Data Engineer, Data · Posting Date: 13-May-2023 Location: Kuala Lumpur, Wilayah Persekutuan, MY · Company: UOB Innovation Hub 2 Sdn. Bhd. About UOB · United Overseas Bank Limited (UOB) is a leading bank in Asia with a global network of more than 500 branches and offices ...

  • Randstad Malaysia

    Data Engineer

    Found in: Foundit MY A2 - 4 days ago

    Randstad Malaysia Malaysia, Kuala Lumpur Full time

    About The Company · leading public listed company with 5 subsidiaries specializing in property development, investment & trading rspectively · About The Job · designing, development and maintaining data pipelines from various sources · responsible for data ingestion and transfor ...

  • Rotate

    Data Engineer

    Found in: Foundit MY A2 - 5 days ago

    Rotate Malaysia, Kuala Lumpur Full time

    Our vision · Rotate is building the go-to team in the cargo industry for commercial decision-making tools and solutions. We will utilize the technology, combined with industry and strategy consulting experience, to help airlines turn data into action and improve their day-to-day ...

  • Beyondsoft Singapore

    Data Engineer

    Found in: Foundit MY A2 - 2 days ago

    Beyondsoft Singapore Malaysia, Kuala Lumpur Full time

    Company Description · Beyondsoft (listed by the Shenzhen Stock Exchange, stock code is a global provider of IT consulting, product and solution services. Relying on strong R&D and innovation capabilities, the company widely adopts emerging technologies based on big data and mobil ...

  • Mandrill Tech

    Data Engineer

    Found in: Talent MY C2 - 3 days ago

    Mandrill Tech Kuala Lumpur, Malaysia Full time

    Established in Kuala Lumpur since 2015, Mandrill Tech is a fast growing technology company. It serves many clients from various lines of industry. · Being an MSC certified company, Mandrill Tech is recognized as leaders in ICT industry development in Malaysia. It reflects our com ...

  • Quandatics

    Data Engineer

    Found in: Foundit MY A2 - 2 days ago

    Quandatics Malaysia, Kuala Lumpur Full time

    Job Description: · Responsible for supporting stakeholders with data preparation, speeding up the creation of curated trusted data pipelines and their integration. · Engineer, optimize, fine-tune and maintain efficient, secure and reliable data pipelines to ingest, clean and cons ...

  • Lotus's Malaysia

    Data Engineer

    Found in: Foundit MY A2 - 5 days ago

    Lotus's Malaysia Malaysia, Kuala Lumpur Full time

    Job Description:- · Develop, implement, and maintain databases, data systems – reorganizing data in a readable format. · Develop automation on data management. · Automate and develop data solutions for existing processes using integrated tools. · Applies data extraction, transfor ...

  • Keypath Education

    Data Engineer

    Found in: Talent MY C2 - 3 days ago

    Keypath Education Kuala Lumpur, Malaysia Full time

    Data Engineer · Full-time · Company Description · Discover Your Path at Keypath · About Us: · At Keypath, we invite you to be part of something transformative. As a global EdTech leader, we collaborate with prestigious universities to create and deliver online education solut ...

  • SIGMA INFO ANALYTICS DATA

    Data Engineer

    Found in: Foundit MY A2 - 2 days ago

    SIGMA INFO ANALYTICS DATA Malaysia, Kuala Lumpur Full time

    ABOUT THE JOB · Vacancy: Data Engineer (Contract) · Location: Kuala Lumpur, Malaysia (Hybrid) · Job Family: IT · Your Responsibilities: · 1 Integration & Interoperability Sustenance · Manage and monitor I&I Request submission, I&I Status, and I&I Diagram. · Conduct data integrati ...

  • Encora Inc.

    Data engineer

    Found in: Talent MY C2 - 3 days ago

    Encora Inc. Kuala Lumpur, Malaysia

    Data Engineer · Important Information · Location: Kuala Lumpur · Experience: 5 years relevant experience · Job Mode: Contract · Work Mode: On-site · Responsibilities and Duties · Experience in SQL · Have ETL background (In GUI tools like Talend/Informatica) · Have good Experienc ...

  • Mindvalley

    Data Engineer

    Found in: Talent MY C2 - 3 days ago

    Mindvalley Kuala Lumpur, Malaysia

    About Mindvalley: · Mindvalley is the leading and most promising ed-tech company to date. We dominate the US market for Personal Growth Education. We are empowering athletes within every major US sports team and promoting successful learning strategies in major companies. · We'r ...

  • KNOREX

    Data Engineer

    Found in: Foundit MY A2 - 4 days ago

    KNOREX Malaysia, Kuala Lumpur Full time

    About Knorex · Established in 2010, Knorex is a cutting edge advertising technology MNC with offices across USA, Australia, China, Singapore, Vietnam, India, Thailand and Malaysia. Knorex provides Precision Performance Marketing products and solutions to the world's leading brand ...

  • CAPCO

    Data Engineer

    Found in: Talent MY C2 - 3 days ago

    CAPCO Kuala Lumpur, Malaysia

    Data Engineer · at Capco Malaysia - Kuala Lumpur Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, ...

  • Two95 International Inc.

    Data Engineer

    Found in: Talent MY C2 - 3 days ago

    Two95 International Inc. Kuala Lumpur, Malaysia Contract

    Hiring Local Malaysians only - CONTRACT JOB - 12 MONTHS (EXTENDABLE) · DATA ENGINEER - IT with Extensive experience in "Healthcare ". · With Minimum Experience - 3 years & Maximun Experience - 15 years · Core responsibilities include: · Work within a highly specialized and grow ...

  • Swift

    Data Engineer

    Found in: Talent MY C2 - 3 days ago

    Swift Kuala Lumpur, Malaysia Full time

    About the Role · The ideal candidate for this position will possess a strong technical foundation in software development in enterprise environment. You will be responsible for design, develop, test, deliver and support for large-scale data pipelines with big data technologies ...

  • Inter Island Group

    Data Engineer

    Found in: Manatal GBL S2 T2 - 4 hours ago

    Inter Island Group Kuala Lumpur, Malaysia

    Job Description: · Create and manage data pipelines for diverse sources in our data lake/warehouse. · Collaborate with analysts to implement necessary data transformations. Research relevant data sources for property development. · Develop web scraping scripts for data acquisi ...

  • Cognizant Technology Solutions

    Data Engineer

    Found in: beBee S2 MY - 2 days ago

    Cognizant Technology Solutions Kuala Lumpur, Malaysia OTHER

    Role: Data Engineer (Cantonese Speaker) · Location: KL, Malaysia · Mandatory: · Azure SQL, Azure Databricks, Azure DevOps, Azure Pipeline. · Secondary: · Java, Kafka, API, MS SQL Server, ADF · Description: · Data Analysis of new and existing inhouse systems. · Data analysis of h ...

  • Ariston Services

    Data Engineer

    Found in: Foundit MY A2 - 2 days ago

    Ariston Services Malaysia, Kuala Lumpur Full time

    · Actively looking for Data Data-Developer Senior & Junior with a hands on experience on the following: · Platform: Informatica, Oracle, AS 400 · Database: Oracle, SQL server · Language: ETL, MDM · OS:AS 400/Linux · Primary Skill: Data Warehouse Tools · Please note: AS 400 expe ...

  • Terrabit Consulting Sdn Bhd

    Data Engineer

    Found in: Foundit MY A2 - 1 day ago

    Terrabit Consulting Sdn Bhd Kuala Lumpur, Malaysia Full time

    Experience on Informatica Powercenter development activities · 2. Experience on Hadoop big data platform – Hive, Spark, Hbase · 3. Shell scripting, Python, scripting, SQL · 4. Experience in ingesting Semi-structured/un-structured files into Hadoop platform · 5. Good knowledge ...