Staff / Lead Data Engineer - Bidding - Agoda

This role involves leading a technical team to enhance the scalability, quality, and efficiency of data and machine learning processes. The engineer will design and build tools, libraries, pipelines, and platforms to support Data Science and Business teams in launching experiments in production. The position requires end-to-end ownership of systems to enable rapid production deployment. The team focuses on processing big data to help validate strategic decisions and react to a fast-changing environment.

Lead the team technically in improving scalability, quality, accuracy, speed, and efficiency of existing Data and ML processes

Analyze data to help make better decisions

Design, build, and test tools, libraries, pipelines, and platforms for launching experiments in production

Work with engineers and product owners to identify and build tools to automate large-scale data management, analysis, and ML tasks

Take and build systems that enable launching experiments in production at a rapid pace

Bachelor’s degree in computer science, information systems, engineering, or a related field

8+ years of experience in software engineering with at least 6+ years in data/ml engineering

Expert in designing, writing, and maintaining data pipelines and systems while ensuring data quality

Expert in SQL, Python3, and JVM-based programming languages (Java or Scala)

Expert in software design, design patterns, best practices, functional programming, and object-oriented programming

Comfortable navigating the technology stack: Python3, Scala Spark, Hadoop, SQL, S3, etc.

Familiar with general Machine Learning concepts and common models (e.g., regularization, Tree Models)

Familiar with statistical analysis concepts (e.g., p-value, z-score)

Strong analytical problem-solving capabilities and a data-driven engineering mindset

Good understanding of Hadoop ecosystems and Big Data architecture

Experience with Scala/Scala Spark development

Experience working in an agile environment using test-driven methodologies

Systems administration skills in Linux

Review Hiring Process Guidelines before interview