A leading provider of innovative solutions in the banking sector, is seeking a talented and experienced Data Engineer to join our dynamic team in Bangalore. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust data infrastructure and ETL processes for our banking client.
Please contact Supriya Naveen and email your cv directly in word format with Job ID- 12167 to HR-India@theedgepartnership.com.
Please note that due to the high number of applications only shortlisted candidates will be contacted. If you do not hear from us in the next 5 business days we regret to inform you that your application for this position was unsuccessful.
HR-India@theedgepartnership.com
Key responsibilities
Data Architecture and Design:
- Collaborate with cross-functional teams to understand data requirements and design scalable data models for efficient data storage and retrieval.
- Architect and implement ETL processes to ensure the timely and accurate flow of data across different systems.
Data Processing and Transformation:
- Utilize Python and PySpark to develop efficient data processing and transformation pipelines.
- Implement data quality checks and validation processes to ensure the integrity of the data.
Database Management:
- Expertise in SQL to design, optimize, and maintain relational databases.
- Perform database tuning and optimization to ensure optimal query performance.
ETL Development:
- Develop, test, and deploy ETL workflows to extract, transform, and load data from diverse sources into the data warehouse.
- Monitor and troubleshoot ETL processes, ensuring data accuracy and reliability.
Collaboration and Documentation:
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Create and maintain comprehensive documentation for data engineering processes and workflows.
Performance Optimization:
- Identify and implement strategies for optimizing data processing and query performance.
- Proactively address scalability challenges to support the growing data needs of the organization.
Role requirements
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
- 4-6 years of proven experience as a Data Engineer in a banking or financial services environment.
- Strong proficiency in Python, PySpark, and SQL.
- Experience with data modeling, ETL development, and data warehousing.
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.