Senior Data Engineer

Job Responsibilities:

• Take responsibility for the information architecture and how it can be developed to meet business strategy and functional requirements by providing a platform and support system for data analytics that will make it simple and common to access and share data
• In order to create and maintain data pipelines for various data sources and communicate with system owners, examine and apply tools like Databricks, Azure Events Hub, Azure Data Lake, and Synapse are used
• To support use cases, work with real-time data input and modifications.
• Participate in scenarios where you are on call to help with any catastrophic failures
• Support colleagues' thoughts and their understanding of new ideas
• Work with the Azure stack and gain a general grasp of the engineering work made by the Data team.
• Participate in the production support on-call schedule
• Combine strong analytical skills with a thorough knowledge of business to create exceptional data engineering capabilities that will give the corporation the benefits it expects
• Interact with the Management, Data Science, Reporting, and Business Partnering teams in order to play a crucial position in the Data Transformation Program
• Analyze challenging data, then communicate the findings
• Use cutting-edge technology in a cloud-based environment with a multidisciplinary team of analysts, data scientists, data engineers, and SMEs to improve the quality of data-based choices made across the organization
• Produce and work with quality data and technology to guarantee data consistency
• Develop new products actively and help BAU initiatives with other senior and lead engineers
• Ensure that Ad hoc data requests and production difficulties are supported
• Work on process improvement, create JIRA issues, and troubleshoot BAU-related issues

Job Requirements:

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
• At least 9+ years of relevant experience as a data engineer
• Expertise in creating ETL workflows, data warehousing, and Big Data processing, as well as effective and reliable data pipelines
• Extensive experience working with SQL, Python, and PySpark
• Demonstrable working experience and understanding of Azure Databricks, Azure Events Hub, Azure Data Lake, Azure Synapse, and Azure SQL
• Prolific experience writing frameworks with Python
• Solid background in data analytics and business processing mapping.
• Prior knowledge of real-time development and corporate data modeling principles
• Outstanding political insight and prioritization skills 
• Excellent debugging and problem-solving abilities
• Nice to have some Data Engineering certification (such as Azure Data Engineer or Google Certified Professional)
• Fluent in spoken and written English communication