Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-tier ETL architectural frameworks.
- Creating modular and reusable components.
- Implementing hybrid approaches across various systems.
Advanced Performance Engineering
- Optimizing at the step level.
- Strategies for parallelism and threading.
- Monitoring pipelines under high load.
Automation, Scripting, and Custom Extensions
- Incorporating scripting within transformations.
- Building custom plugins.
- Expanding PDI functionality using Java and JavaScript.
Complex Data Processing and Integrations
- Real-time and streaming data integrations.
- Interaction with big data platforms.
- Advanced handling of files and APIs.
Data Governance, Security, and Compliance
- Safeguarding transformations and credentials.
- Ensuring data lineage and traceability.
- Adhering to regulatory and compliance standards.
Enterprise Orchestration and Scheduling
- Oversight of large job networks.
- Designing error recovery and failover mechanisms.
- Orchestration at the environment level.
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories.
- Connecting PDI with Git.
- Continuous deployment methodologies.
Deployment, Monitoring, and Production Operations
- Transitioning solutions across different environments.
- Operational tools and dashboards.
- Achieving full production readiness.
Summary and Next Steps
Requirements
- Familiarity with ETL pipelines and data modeling principles.
- Proficiency in intermediate-level PDI transformations.
- Strong SQL and scripting capabilities.
Target Audience
- Senior Data Engineers.
- ETL Architects.
- Professionals overseeing complex data integration tasks.
21 Hours
Testimonials (1)
It's a hands-on session.
