MAIN RESPONSIBILITIES
Architecture & Data Platform
- Participate in leading the design and implementation of the Data Lakehouse architecture on Azure, contributing to key technology decisions related to:
- Azure Data Lake Storage Gen2
- Delta Lake
- Azure Synapse Analytics / Azure Databricks
- Build a highly scalable data architecture optimized for both batch processing and real-time/streaming.
Develop & optimize data pipelines
- Design, develop, and optimize high-performance ETL/ELT pipelines from various data sources: on-premise, cloud, streaming, API, file system.
- Ensure pipelines are fault-tolerant, self-healing, well-monitored, and meet SLA requirements in a production environment.
- Build and operate real-time/near-real-time pipelines directly serving analytics and AI/ML systems.
Integration & cross-team collaboration
- Act as a technical bridge between Data Engineering and AI/ML, BI, DevOps, and Product teams.
- Support data integration into:
- Operational Machine Learning models (production)
- BI systems, dashboards, and intelligent reporting
- Complex data analytics applications
- Coordinate with infrastructure and security teams to design and operate a secure data system, complying with security regulations and internal policies.
Performance & data governance
- Pioneer the implementation of advanced optimization strategies for storing and querying big data, balancing performance – scalability – cost.
- Establish and execute best practices for data governance, including:
- Data Quality framework
- Centralized metadata management
- Data lineage and automated data flow tracking
Technical quality & knowledge sharing
- Participate in code reviews, architecture design reviews, and ensure compliance with coding standards.
- Mentor and support the development of junior Data Engineers' capabilities.
- Build and maintain high-quality technical documentation to facilitate knowledge sharing and effective operations between product and analytics teams.
JOB REQUIREMENTS
- Graduated with a Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or related fields.
- A minimum of 8–10+ years of experience in AI/ML development, including experience in real-world production deployment and at least 3 years in a leadership role for AI/ML teams or large-scale projects.
- Experience in deploying end-to-end AI solutions from development to production deployment.
- Deep understanding of designing and scaling AI systems in operational environments.
- Experience working in a cross-functional environment (Product, Data Engineering, Backend, Infrastructure).
- Leadership and coaching skills, with the ability to develop teams.
- Strong analytical and problem-solving skills.
- Good communication skills, with the ability to clearly articulate technical concepts.
- Ability to work effectively with cross-departmental teams.
- A strong sense of ownership, high responsibility, and results-oriented mindset.
- Ability to quickly adapt and a continuous learning mindset in the ever-changing field of AI.
BENEFITS & WELFARE