Data Engineering Manager

Data Team plays a central role at Pismo, providing Data-Intensive Analytics for internal product teams, also processing and delivering TBs of high-quality data,  needed by our Partners to produce outstanding products downstream.
Operating mainly in Brazil, the data team recently extended its scope to accelerate the Platformization of data services globally, with representatives in Europe and soon to the US and Asia. We are looking for talented leaders who share our culture of trust, mutual responsibility, and technological excellence to be part of this unprecedented and diverse global Data Organisation.

What you'll do

• As the Manager of Data Engineering at Pismo, you will lead a team responsible for our Data Lake and corporate data platform. Your critical role involves ensuring the Data Lake meets quality standards, Service Level Objectives (SLOs), and Service Level Agreements (SLAs), while continuously evolving the platform.

Minimum Qualifications

• At least 3 years managing Data Platform teams.
• Concrete previous hands-on experience as a Data Engineer, Analytics Engineer, Data Scientist, Software Engineer or Machine Learning Engineer.
• Negotiation and communication skills to deal with different levels of stakeholders.  
• Big Data Architecture
• Parallel processing with Apache Spark.
• Experience with Python, SQL and Orchestration Tools (eg. Airflow). 

Desirable Qualifications

• Experience Developing automated Unit and Integration tests for data pipelines;
• Experience using notebooks for data exploration (e.g. Jupyter, Databricks, Hex);
• Experience consuming data-intensive distributed messaging processing systems (e.g. Kafka, SQS, Pub-Sub, Pulsar, Kinesis);
• Experience developing and maintaining CI/CD for Data Pipelines (e.g. CodeFresh, Jenkins, etc);