Are you interested in being part of the wider roll out for Spark, our new AI-powered, learning chatbot? Register your interest here.
Home Specialist skills Data and Analytics Azure Data Platforms with Azure Synapse and Azure Databricks
Azure Data Platforms with Azure Synapse and Azure Databricks
-
Work with Apache Spark and Data Frames in Azure Databricks to process and analyse large-scale datasets
-
Integrate Azure data platform services, including Azure Synapse Analytics, Azure Databricks, and Azure Data Lake
-
Design and implement data ingestion and transformation pipelines using Azure data services and Databricks workflows
-
Develop scalable data engineering, analytics, and machine learning solutions on the Azure cloud platform
-
Perform exploratory data analysis and large-scale data preparation using Azure Databricks
-
Implement machine learning workflows, including model training, experimentation, and evaluation using Azure Databricks
-
Understand how Azure services can support end-to-end analytics and AI solutions, from data ingestion through to advanced analytics and model deployment
-
Apply best practices for performance optimisation, governance, and scalable cloud data architectures
Overview
Off the shelf (OTS)
This course introduces participants to modern Azure-based data platforms using Azure Synapse Analytics and Azure Databricks. It provides practical experience with distributed data processing, analytics workflows, and machine learning solutions using Apache Spark and Azure cloud services.
The course is designed to support different organisational needs and roles across data engineering, analytics, and machine learning teams.
Participants will gain hands-on experience working with cloud data services, building scalable solutions that support the full data lifecycle, including ingestion, transformation, analysis, and advanced analytics.
To support different learning objectives, the course can be delivered through one of three specialist routes, which are agreed prior to the course delivery.
Available course routes
1. Azure Synapse Analytics with Azure Databricks
Focuses on building modern cloud data platforms that integrate Azure Synapse Analytics with Azure Databricks for large-scale data engineering and analytics.
Topics may include:
• Data ingestion and orchestration using Azure Synapse and Azure data services
• Data transformation and processing using Apache Spark
• Integration of Azure Synapse with Azure Data Lake and Databricks
• Designing scalable analytics architectures
________________________________________
2. Data Analytics with Azure Databricks
Focuses on data analytics and large-scale data preparation using Azure Databricks and Apache Spark.
Topics may include:
• Exploratory data analysis using Databricks notebooks
• Data transformation and preparation using Spark and Data Frames
• Analytics workflows for large datasets
• Visualisation and insights generation from distributed data
________________________________________
3. Machine Learning with Azure Databricks
Focuses on developing machine learning models and AI workflows using Azure Databricks.
Topics may include:
• Data preparation and feature engineering for machine learning
• Training and evaluating machine learning models
• Experiment tracking and model management
• Deploying machine learning solutions in Azure environments
________________________________________
The selected route determines the emphasis of the practical exercises and examples, while maintaining a common foundation in Azure data platforms and Apache Spark technologies.
Delivery method
Virtual
Course duration
14 hours
Competency level
Working