jaeattorney.blogg.se

Pentaho data integration scaling
Pentaho data integration scaling






pentaho data integration scaling

9 Introduction - Kettle : Environment 1-9 Full GUI called Spoon to edit every option in Kettle Drag & Drop Debugger Rich GUI Command line tools execute jobs execute transformations Web server clustering remote execution Programming API for Java Plugin eco-system.ġ0 Introduction Kettle : Conceptual model 1-10ġ1 1-11 Introduction Kettle : Conceptual modelġ2 Introduction Kettle : User community 1-12 Paying Pentaho customers Large and small corporations All possible sectors Lone rangers & Hobbiests All regions on Earth Meet on our Forum : +30,000 posts in 3 years Use our JIRA case tracking systems Download more than 10,000 copies of Kettle per monthġ3 Typical use-cases 1-13 Load data from text files and store it into a database Export data from database to text-file or more other databases Data migration between database applications Exploration of data in existing databases (tables, views, etc.) Information improvement using lookups Data cleaning Application integration Data warehouse population Application integration Report data generation.ġ4 1-14 Agenda Introduction to Kettle Introduction Use-cases + load demo Performance / Scalability Kettle Slave Servers What & How Kettle Cluster Schemas What & How The Cloud Cloud Examples Q & Aġ5 1-15 Party time!!!! You're preparing for a big event You bought plenty of food: 500 hot-dogs 500 burgers Distaster strikes: invitees are not showing up! What do you do with all that food?ġ6 1-16 Call Joey Chestnut!! Fastest eater in the world ** Local boy from Vallejo 103 burgers in 8 minutes 66 hot dogs in 12 minutes ** Ranked #1 by the International Federation of Competitive Eatingġ7 1-17 Problems with the chosen solution You would need at least 10 Joey Chestnuts to get the job done Getting Joeys to show up costs money $ It's more fun with a crowd!ġ8 1-18 Performance / Scalability Demo: what about MySQL limits? ġ9 1-19 Performance / Scalability MySQL bulk loading limitations.








Pentaho data integration scaling