Senior Data Engineer

We are looking for a Senior Backend Engineer who thrives on building commercial products and plays a key role in delivering reliable, scalable, and maintainable applications. You will lead projects from start to finish, collaborating with Product Managers, and UX Designers to define requirements, implement solutions, and ensure ongoing success post-deployment. You’ll focus on simplicity while contributing technical insights to enhance the system's performance, stability, and user experience.

• Participate in all stages of the software development life cycle, from design and development to deployment and maintenance.
• Follow clean code principles, using best practices to write secure, testable, and well-documented software.
• Work closely with a global team, including engineers, product managers, and UX designers, to build a stable, high-performance platform.
• Implement comprehensive testing and performance tuning to ensure system stability and uptime.

Responsibilities:

• Translate requirements, estimate effort, and address or escalate blockers as needed.
• Write clean, maintainable code that adheres to best practices in readability, design patterns, reusability, and testing.
• Own end-to-end projects, understanding and contributing to all aspects (infrastructure, application tiers, and data tiers).
• Continuously monitor performance metrics and recommend improvements or refactors.

Our Tech Stack:

• Scala, Apache Spark, Python
• Airflow
• ScyllaDB, PostgreSQL, ClickHouse, Hive, Redis, Kafka, Kafka Connect
• Docker, Jenkins, Terraform, AWS

Technical Skills: 

• 5+ years of experience working in the Data Engineering space, and with building and maintaining big data pipelines 
• 5+ years of experience working in agile environments (ideally Scrum), collaborating with cross-functional teams (engineering, design, product).
• Proficient in Spark (Scala preferred)
• Experience designing, building, and maintaining RESTful APIs and integrating with external services.
• Participate in code reviews to ensure best practices, maintainability, and continuous improvement of the codebase.
• Ability to write and maintain unit and integration tests based on acceptance criteria, ensuring code quality and reliability.
• Proficiency with version control tools, particularly Git, for collaborative development and code management.