Senior Python Data Engineer with AI

We are seeking a highly skilled Senior Python Developer to join our dynamic team and play a pivotal role in building scalable, robust APIs and innovative backend solutions for generative AI applications.

This position will involve close collaboration with cross-functional teams to deliver high-performance, well-architected solutions aimed at solving complex problems.

Responsibilities

• Develop and deploy scalable RESTful APIs to serve web apps and integrations with other software
• Ensure API performance, scalability, and maintainability with focus on clear, concise code and robust logging/monitoring
• Support and optimize database integrations, ensuring efficient data modeling and query performance
• Collaborate with data engineers on pipelines and orchestration frameworks to deliver clean, organized data to APIs
• Conduct thorough unit and integration testing in collaboration with testing teams
• Review code from peers to ensure high-quality solutions and provide constructive feedback
• Create and maintain technical documentation for solutions and Software Development Lifecycle (SDLC) processes
• Apply modern software design best practices including version control, containerization, and scalable service design
• Work collaboratively with product teams throughout all phases of the development lifecycle

Requirements

• 5+ years of professional experience in Python-focused backend development
• Extensive experience with at least one Python backend framework, such as FastAPI
• Proficiency in asynchronous programming and advanced Python development
• Expertise in relational database systems, including PostgreSQL and data modeling
• Knowledge of RESTful API design principles and modern software development practices
• Familiarity with scalable architecture patterns, containerization tools, and cloud-based operations
• Extensive background in version control systems and CI/CD pipelines
• Experience working with data engineering frameworks, such as Spark or PySpark, and orchestration tools like Airflow is a plus

Nice to have

• Knowledge of Amazon Redshift and Databricks for data engineering workflows
• Background in ETL/ELT solutions for data transformation and loading
• Skills in leveraging Apache Airflow for orchestration frameworks
• Familiarity with PySpark and GitHub Actions for workflow automation and development pipelines