Job Title:
Senior Data Engineer (5+ Years Experience)
Location:
Bangalore/Hyderabad/Gurgaon/Indore/Raipur
Experience: 5+ Years
Employment Type:
Full-time
Job Summary:
We are looking for a highly skilled Data Engineer with 5+ years of experience in building scalable data pipelines and ETL platforms. The ideal candidate should have strong expertise in Python, Apache Airflow, and data ingestion frameworks, along with hands-on experience in designing robust, modular, and production-grade data systems.
Key Responsibilities:
Design, develop, and maintain scalable ETL/data pipeline frameworksBuild and manage data ingestion pipelines from multiple structured and unstructured sourcesDevelop and orchestrate workflows using Apache AirflowImplement modular and microservices-based architecture for Python data platformsWrite efficient and complex SQL queries for data transformation and analysisDesign and implement REST APIs with proper validation and error handlingMonitor, troubleshoot, and optimize pipeline performanceAnalyze logs and system performance using tools like SplunkCollaborate with cross-functional teams to ensure data quality and reliability
Required Skills & Qualifications:
Strong programming experience in PythonHands-on experience with Apache Airflow (DAG creation, scheduling, monitoring)Solid understanding of ETL concepts and pipeline designExperience working with RDBMS (e.g., Snowflake, PostgreSQL, MySQL, etc.)Strong proficiency in writing complex SQL queriesExperience in building data ingestion frameworksKnowledge of REST API development and integrationFamiliarity with microservices architecture and modular design patternsExperience with Splunk queries/log analysis for debugging and performance tuning
Good to Have:
Experience with any Data Catalog platform (e.g., Open-metadata, Alation, Collibra, DataHub, etc.)Exposure to AWS services (S3, Opensearch service, ALB and K8S etc.)Experience with data governance or metadata management tools
Preferred Traits:
Strong problem-solving and analytical skillsAbility to work in a fast-paced, scalable data environmentGood communication and collaboration skills
