Backend Data Engineer

Job Title: Backend Data Engineer
Overview: We are seeking a skilled and motivated Backend Data Engineer to join our team. The ideal candidate will be responsible for maintaining and enhancing backend APIs, managing ETL processes, and optimizing our data warehouse environment. This role requires a blend of strong technical skills, problem-solving capabilities, and a focus on data integrity and security.
Key Responsibilities:
1.    Backend API Development and Maintenance:
o    Maintain and enhance backend APIs for a web application.
o    Implement changes to data fields as needed, ensuring compatibility and functionality.
o    Troubleshoot and resolve data-related issues efficiently.
o    Ensure robust security practices in all backend operations.
2.    ETL Processes and Data Management:
o    Maintain and optimize ETL pipelines for data processing and transformation.
o    Integrate data from multiple sources, including upstream Snowflake tables and Oracle databases.
o    Combine, flatten, and process data to meet business requirements.
o    Ensure the accuracy, consistency, and availability of processed data.
3.    Data Warehouse Optimization:
o    Continuously improve the performance and efficiency of the Snowflake data warehouse.
o    Monitor and optimize query performance, storage utilization, and processing times.
o    Implement best practices for data warehouse design and management.
4.    Power BI Gateway Management:
o    Manage the Power BI gateway to ensure seamless connectivity between data sources and Power BI dashboards.
o    Troubleshoot and resolve any issues related to the Power BI gateway.
Required Skills and Qualifications:
•    Proven experience in backend API development and maintenance.
•    Strong proficiency in SQL and ETL development, including working with Snowflake and Oracle databases.
•    Experience with data integration, transformation, and processing.
•    Familiarity with data security principles and best practices.
•    Strong analytical and problem-solving skills.
•    Ability to optimize data warehouse performance and handle large-scale data environments.
•    Effective communication and collaboration skills.
Preferred Qualifications:
•    Experience with cloud-based data platforms and tools.
•    Familiarity with Python, JavaScript, or other programming languages commonly used for backend development and ETL.
•    Understanding of CI/CD pipelines and version control systems.