- Design, develop, and maintain efficient data pipelines to collect, process, and store data from various sources.
- Implement ETL/ELT processes to ensure data is accurately transformed and ready for analysis.
- Optimise pipeline performance and troubleshoot issues to ensure data flows smoothly.
- Implement data quality and governance measures to ensure data accuracy, consistency, and security.
- Monitor data pipelines for anomalies and take proactive measures to address quality issues.
- Adhere to data privacy and compliance regulations.
- Stay up-to-date with the latest data engineering tools and technologies (e.g., Python, Spark, Hadoop, cloud platforms).
- Evaluate and recommend new technologies to enhance our data infrastructure.
- Collaborate with data scientists and analysts to understand their needs and develop appropriate data solutions.
- Collaborate effectively with stakeholders across business, analytics, and engineering teams to understand data requirements.
- Communicate technical concepts clearly to both technical and non-technical audiences.
- Produce clear and concise documentation for data pipelines and processes.
- 2-4 years of experience in data engineering, preferably in a similar role.
- Strong proficiency in programming languages such as Python, Java, or Scala.
- Experience with data warehousing and data modelling concepts.
- Experience with data processing frameworks like Airflow, Fivetran or dbt.
- Familiarity with cloud platforms (AWS, Azure, GCP) is a plus.
- Excellent problem-solving and analytical skills to troubleshoot and optimise data flows.
- Excellent communication and teamwork skills to collaborate effectively with diverse teams.
Data Engineer - Kuala Lumpur, Malaysia - Mindvalley
Description
About Mindvalley:
Mindvalley is the leading and most promising ed-tech company to date. We dominate the US market for Personal Growth Education. We are empowering athletes within every major US sports team and promoting successful learning strategies in major companies.
We're currently on a mission to build the most advanced and complete learning experience to enable personal growth and development for all our amazing customers. We innovate tools that induce enlightenment within every aspect of human life. We are seeking the best engineers to build the best and most advanced education platform our species has seen. The goal to mark our success is: to power up to 100 countries, powering every Fortune 500 company, and progressing humanity towards a better future.
About the Role:
Harness the power of data and build the foundation for a data-driven future
We're seeking a passionate and skilled Data Engineer to join our team in designing, building, and maintaining the data pipelines and infrastructure that fuel our business insights. Your expertise will be crucial in ensuring the availability and integrity of data, empowering data-driven decision-making across the organization.
Responsibilities:
Pipeline Architect:
Data Guardian:
Technology Innovator:
Communication Bridge:
Skills & Experience:
Mindvalley is an equal opportunity employer and does not discriminate on the basis of race, colour, religion, gender identity or expression, national origin, age, disability, marital status, sexual orientation, or any other legally protected status. We are committed to creating a diverse and inclusive workplace and encourage applications from all qualified individuals.