Senior Python Developer/Data Engineer

Senior Python Developer to lead the development of scalable, high-performance backend systems and data-driven applications. You will work on building robust services, APIs, and data workflows that power real-time and batch applications.This role is ideal for a seasoned developer who thrives on solving complex problems, building reliable software, and working across data and engineering teams. Youll play a key role in designing and developing Python-based systems that interface with big data frameworks, cloud platforms, and analytics tools.Key ResponsibilitiesDesign and develop robust Python-based backend services and microservices.Build RESTful APIs and integrations with third-party systems and internal tools.Work with data workflows involving ingestion, transformation, and validation.Develop and maintain ETL/ELT pipelines using Python, SQL, and Airflow.Collaborate with DevOps teams to deploy, monitor, and scale applications in cloud environments (AWS, Azure, GCP).Optimize code for performance, scalability, and maintainability.Write unit and integration tests, participate in code reviews, and follow CI/CD best practices.Work with cloud storage, databases, and data lake technologies like S3, Parquet, and DuckDB.Collaborate with data scientists, analysts, and engineers to enable data access and modeling.Required Skills & Qualifications5+ years of experience in backend software development, primarily in Python.Strong understanding of OOP, modular design, and Python design patterns.Experience with web frameworks (e.g., Flask, FastAPI, Django).Hands-on experience with data processing tools like Pandas, SQLAlchemy, PyArrow.Proficiency with SQL and database technologies (PostgreSQL, DuckDB, etc.).Experience with Airflow for workflow orchestration.Knowledge of building scalable, distributed applications and microservices.Familiarity with cloud platforms (AWS, Azure, GCP) and containerization tools (Docker, Kubernetes).Solid understanding of version control (Git), testing frameworks (PyTest), and CI/CD pipelines.Excellent problem-solving, debugging, and communication skills.Preferred Skills (Nice to Have)Experience with data processing frameworks like Apache Spark or Vaex.Familiarity with data storage formats and tools like Parquet, Iceberg.Exposure to data streaming platforms (Kafka, Kinesis, Flink).Experience integrating backend systems with AI/ML pipelines or BI platforms.Understanding of security standards and compliance (GDPR, HIPAA, SOC2).Background in metadata-driven or event-driven architectures.