Job Description
Drive innovation as a Senior PySpark Engineer with Insight Global, focusing on framework development in a hybrid work model. Utilize your Spark knowledge to enhance data architectures effectively.
This role is tailored for senior-level candidates eager to shape scalable solutions and foster collaboration. You will work on strengthening existing frameworks, designing reusable libraries, and optimizing processing costs. Exceptional communication with stakeholders ensures that you effectively address production requirements and enhance overall team performance.
Key Responsibilities:
• Strengthen frameworks for in-library building
• Design reusable libraries for teams
• Optimize Spark SQL processing costs
• Resolve ambiguous production requirements
• Facilitate operations across shared data platforms
Requirements:
• Strong understanding of PySpark internals
• Hands-on experience with Databricks
• Familiarity with Delta Lake solutions
• Skills in Azure Da...
This role is tailored for senior-level candidates eager to shape scalable solutions and foster collaboration. You will work on strengthening existing frameworks, designing reusable libraries, and optimizing processing costs. Exceptional communication with stakeholders ensures that you effectively address production requirements and enhance overall team performance.
Key Responsibilities:
• Strengthen frameworks for in-library building
• Design reusable libraries for teams
• Optimize Spark SQL processing costs
• Resolve ambiguous production requirements
• Facilitate operations across shared data platforms
Requirements:
• Strong understanding of PySpark internals
• Hands-on experience with Databricks
• Familiarity with Delta Lake solutions
• Skills in Azure Da...
Apply for This Position
Ready to take the next step? Click the button below to submit your application.
Submit Application