Job Description
- Design and develop data ingestion pipelines using Apache NiFi for structured, semi-structured, and unstructured data sources.
- Build and maintain real-time and batch processing workflows to ingest data into AWS-based data lakes or warehouses.
- Configure and optimize NiFi processors, templates, and flows for scalability and reliability.
- Implement monitoring, alerting, and recovery strategies for NiFi flows and downstream processes.
- Integrate NiFi with AWS services such as S3, Lambda, Redshift, Glue, Kinesis, and RDS.
- Ensure data quality, integrity, and compliance across pipelines.
- Work closely with data analysts, architects, and business teams to define data requirements and delivery models.
- Document workflows, metadata, and lineage using tools like Apache Atlas or custom catalogs. Required Skills & Qualifications - 6-7 years of experience in data engineering or data integration roles.
- Strong hands-on experience with Apache...
- Build and maintain real-time and batch processing workflows to ingest data into AWS-based data lakes or warehouses.
- Configure and optimize NiFi processors, templates, and flows for scalability and reliability.
- Implement monitoring, alerting, and recovery strategies for NiFi flows and downstream processes.
- Integrate NiFi with AWS services such as S3, Lambda, Redshift, Glue, Kinesis, and RDS.
- Ensure data quality, integrity, and compliance across pipelines.
- Work closely with data analysts, architects, and business teams to define data requirements and delivery models.
- Document workflows, metadata, and lineage using tools like Apache Atlas or custom catalogs. Required Skills & Qualifications - 6-7 years of experience in data engineering or data integration roles.
- Strong hands-on experience with Apache...
Apply for This Position
Ready to take the next step? Click the button below to submit your application.
Submit Application