Job Description
Job Description
- Designing and implementing data pipelines from multiple sources using Azure Databricks or Hadoop ecosystem.
- Developing scalable and re-usable frameworks for ingesting of data sets.
- Integrating end to end data pipeline - to take data from source systems to target data repositories ensuring quality and consistency of data is maintained at all times.
- Working with event based / streaming / scheduling technologies to ingest and process data.
- Write python script to process data according to the needs from other engineers.
- Build dashboard using Power BI or Tableau to fulfill the need from end users.
- Evaluating the performance and applicability of multiple tools for the automated data pipeline.
- Involve in application development using low-code platforms such as PowerApps and OutSystems.
- Involve in AI solution development in the organization focus on building python script for data processing.<...
Apply for This Position
Ready to take the next step? Click the button below to submit your application.
Submit Application