Senior Data Engineer

Key Responsibilities

• Design, implement, and maintain data pipelines and architectures on Snowflake or Azure Cloud platforms.
• Develop ETL processes to extract, transform, and load data from various sources into data warehouses.
• Optimize data storage, retrieval, and processing for performance and cost-efficiency in cloud environments.
• Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
• Implement data security and governance best practices to ensure data integrity and compliance.
• Work with reporting tools such as Tableau or Power BI to create interactive dashboards and visualizations.
• Monitor and troubleshoot data pipelines, ensuring reliability and scalability.
• Automate data workflows and processes using cloud-native services and scripting languages.
• Provide technical expertise and support to data analysts, scientists, and business users.

 

Skills Required

• Cloud Platforms: Experience with Snowflake or Azure Cloud Data Engineering, including setting up and managing data pipelines.
• ETL Processes: Proficiency in designing and implementing ETL processes for data integration.
• Data Warehousing: Knowledge of data warehousing concepts and best practices.
• SQL: Strong SQL skills for querying and manipulating data in Snowflake or Azure databases.
• Data Modeling: Experience with data modeling techniques and tools to design efficient data structures.
• Data Governance: Understanding of data governance principles and experience implementing them in cloud environments.
• Reporting Tools: Proficiency in Tableau or Power BI for creating visualizations and interactive dashboards.
• Scripting: Ability to write scripts (e.g., Python, PowerShell) for automation and orchestration of data pipelines.
• Monitoring and Optimization: Skills to monitor and optimize data pipelines for performance and cost efficiency.
• Security: Knowledge of cloud data security practices and tools to ensure data protection.
• Collaboration: Strong teamwork and communication skills to collaborate with stakeholders.
• Problem-Solving: Analytical and problem-solving skills to troubleshoot and resolve issues in data pipelines.
• Experience with Agile/Scrum: Familiarity with Agile methodologies for software development.
• Data Integration: Experience integrating data from various sources such as databases, APIs, and files.
• Data Visualization: Ability to create effective data visualizations to convey insights to stakeholders.