Course Outline
Introduction to the Stratio Platform
- Overview of Stratio’s architecture and its core functional modules.
- Understanding the role of Rocket and Intelligence across the data lifecycle.
- Guided navigation of the Stratio user interface, including login procedures.
Utilizing the Rocket Module
- Establishing data ingestion pipelines and creation strategies.
- Linking data sources and configuring necessary transformations.
- Applying PySpark for preprocessing tasks within the Rocket framework.
Essential PySpark Concepts for Stratio Users
- Key PySpark data structures and standard operations.
- Implementing looping constructs: effective use of for, while, and if/else statements.
- Creating custom functions using def and integrating them into workflows.
Advanced Rocket Applications with PySpark
- Managing streaming ingestion and real-time transformations.
- Deploying loops and functions in both batch and real-time scenarios.
- Best practices for optimizing PySpark pipeline performance.
Exploring the Intelligence Module
- Overview of data modeling capabilities and analysis features.
- Techniques for feature selection, transformation, and data exploration.
- The role of PySpark in enabling custom analytics and generating insights.
Constructing Advanced Analytics Workflows
- Developing user-defined functions (UDFs) within the Intelligence module.
- Utilizing conditionals and loops to manage complex data logic.
- Practical use cases: data segmentation, aggregation, and predictive modeling.
Deployment and Team Collaboration
- Strategies for saving, exporting, and reusing established workflows.
- Collaborative practices for working with team members on Stratio.
- Reviewing output results and integrating with downstream tools.
Summary and Future Directions
Requirements
- Proficiency in Python programming.
- Solid grasp of data analytics and big data processing concepts.
- Foundational understanding of Apache Spark and distributed computing principles.
Target Audience
- Data engineers developing on Stratio-based platforms.
- Analysts and developers utilizing the Rocket and Intelligence modules.
- Technical teams integrating PySpark workflows into their Stratio environments.
Testimonials (3)
Learning that the QGIS and a tool that can used by other different professionals such land survey
Bame Duncan Koko - Bentel Technologies (Pty) Ltd
Course - QGIS for Geographic Information System
How to use open satellites data for real applications
Tshering Dorji - Druk Holding and Investments
Course - Advanced Geographic Information Systems (GIS)
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.
