The role
is central to maintaining a balance between the flexibility and scalability of data lakes and the structured query and performance benefits of data warehouses.
What you can expect
Create and maintain data pipelines to extract, transform, and load (ETL) data from various sources into a data warehouse or data lake.Ensure the data pipelines are efficient, scalable, and reliable. Integrate data from different sources, such as databases, APIs, logs, and external data providers.Ensure data quality and consistency during the integration process.Design and implement data models, including relational databases, NoSQL databases, and data warehouses, to support data analytics and reporting.Develop and manage data warehouses or data lakes to store structured and unstructured data.Perform data transformation and data cleansing to ensure data is in a usable format for analysis.Implement data ...