Associate, Full Stack Data Engineer

Key responsibilities

• Develop data architecture and deliver data-analytics platforms and solutions across on-premises, cloud, and hybrid environments.
• Provide expertise in information delivery and analytics, including data preparation, data insights, and visualization using BI tools, as well as advanced data prediction using AI, ML, DL, etc.
• Oversee AI/ML Ops, including the integration, deployment, and monitoring of AI/ML products and solutions.
• Demonstrate expertise in data management to ensure analytics products are appropriate, ethical, and well-controlled.
• Act as a trusted partner by shaping the information and analytics agenda and collaborating with all the firm’s businesses to develop their information and analytics adoption roadmaps.
• Design and develop scalable data pipelines to collect and process large volumes of data from multiple sources.
• Build physical data models and ETL processes to ensure data quality, integrity, and accessibility.
• Develop and maintain highly scalable and fault-tolerant microservices, including efficient server-side APIs.
• Experience with CI/CD, Jenkins, Ansible, DevOps processes, and enterprise integration patterns.
• Proficiency in programming languages (Python, Java, etc.) and orchestration tools like Airflow.
• Experience with cloud technologies such as EC2, EMR, Snowflake, or similar tools, with the ability to drive design and data model discussions and hybrid data architecture.
• Proficiency in REST services, JSON data, Python 3, and Linux/Unix Shell Scripting.
• Expertise in modern data management methodologies and architecture, such as building data products and implementing data mesh.
• Experience with machine learning libraries and frameworks like LangChain, TruLens, MLFlow, TensorFlow, Scikit-learn, or PyTorch.
• Deploy machine learning models into production environments and monitor their performance over time.
• Collect, clean, and analyse large datasets to train and evaluate machine learning models.
• Flexibility to adapt to multiple demands, shifting priorities, ambiguity, and rapid change.
• Experience with senior stakeholder management is an added advantage.
• Excellent communication (verbal, written, listening), presentation, and interpersonal skills.