Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-tier ETL architectures
- Creating modular and reusable components
- Hybrid integration approaches across systems
Advanced Performance Engineering
- Step-level performance tuning
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Integrating scripting within transformations
- Creating custom plugins
- Enhancing PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integrations
- Integration with big data platforms
- Advanced processing of files and APIs
Data Governance, Security, and Compliance
- Securing transformations and credential management
- Data lineage and traceability
- Regulatory and compliance best practices
Enterprise Orchestration and Scheduling
- Managing extensive job networks
- Error recovery and failover mechanisms
- Orchestration at the environment level
Repository, Version Control, and CI/CD
- Enterprise repository management strategies
- Integrating PDI with Git
- Patterns for continuous deployment
Deployment, Monitoring, and Production Operations
- Promoting solutions across different environments
- Operational tooling and dashboard implementation
- Achieving end-to-end production readiness
Summary and Next Steps
Requirements
- Familiarity with ETL pipelines and data modeling principles
- Hands-on experience with intermediate-level PDI transformations
- Strong command of SQL and scripting languages
Target Audience
- Senior data engineers
- ETL architects
- Professionals overseeing complex data integration operations
Testimonials (1)
It's a hands-on session.
