The State of Open Source Business Intelligence Christian Donner

The State of Open Source Business Intelligence Christian Donner

Getting from data to the source of a problem can be hard . A czar learned that the most disease-ridden province of his empire was also the province with the most doctors. His solution? He promptly ordered all the doctors shot dead. (He clearly lacked Business Intelligence) Folktale from: Freakonomics - A Rogue Economist Explores the Hidden Side of Everything (Steven D. Levitt, Stephen J. Dubner) www.molecular.com 2

or easy "How would you rate the overall job President George W. Bush is doing as president -- excellent, pretty good, only fair, or poor? Excellent or pretty good 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% February March May June July August October November December January February March April May June July August September October November December February April June August October December February April June August September October November February April June August November January February March April May 30.00% 2001 2002 2003 2004 2005 20.00% 2006 Source: Harris Poll, published by the Wall Street Journal Online on 5/12/2006 www.molecular.com 3

Poll Who has implemented something that you would define as a BI solution before, either in your own organization or for someone else? Out of this group, who has used an Open Source BI product? Survey on http://cdonner.com (20 responses): Currently using BI Currently using OSBI Evaluated OSBI in the past Planning to use OSBI 85% 40% 40% 35% www.molecular.com 4

Why this presentation? 2 years ago I started a low-budget BI project Researched many products and technologies OSBI was practically non-existent Decided to go with Microsoft DTS and SQL RS Today, the landscape has changed dramatically I wanted to know: would I go with Open Source BI today? www.molecular.com 5

Agenda What is Business Intelligence? BI Trends OSBI Trends Products Pentaho Jaspersoft OpenI BIRT Bizgres Mondrian Demo www.molecular.com 6

Business Intelligence – A Definition Business Intelligence In 1989 Howard Dresner (Gartner Group) created the term "BI“: “A set of concepts and methods to improve business decisionmaking by using fact-based support systems.” Wikipedia: the technology used for collecting and analyzing business information a set of business processes for this purpose the information obtained from these processes Includes: ETL Tools OLAP/Data Analysis Tools Reporting Tools Databases www.molecular.com 7

Business Intelligence - Components Reporting BI Platform Delivery Operational Datastore MOLAP Aggregation ROLAP Extraction ETL Storage Relational Datastore Multi-dimensional Datastore www.molecular.com 8

Business Intelligence Platform Integrate with business processes Manage and schedule reports Deliver reports through multiple channels, push and pull model support Maintain user security Seamlessly integrate via open standards with portals and applications www.molecular.com 9

Agenda What is Business Intelligence? BI Trends OSBI Trends Products Pentaho Jaspersoft OpenI BIRT Bizgres Mondrian Demo www.molecular.com 10

Forecast: Business intelligence market growth Actual 8,000 Forecast BI services revenue BI maintenance revenue BI license revenue 6,000 4,000 2,000 BI market size (US millions) 0 Size Growth 2003 2004 2005 2006 2007 2008 5,253M 5,596M 5,997M 6,506M 7,005M 7,331M N/A 6.5% 7.2% 8.5% 7.7% 4.7% Source: Forrester Research, “Business Intelligence Growth Is Driven By Compliance, Standardization, And Performance Initiatives” www.molecular.com 11

Mainstream BI Theme Keith Gile, Forrester Research: “We are witness to a change in BI that shifts the emphasis away from functionally powerful tools for power-user “producers” toward context-sensitive BI solutions for a large community of “consumers” of information.” Paul Doscher, CEO Jaspersoft: “The big commercial tool providers can handle performance management applications well, but left Operational BI behind.” License bottleneck Lower-level in-house user Public web sites www.molecular.com 12

Forrester Wave : BI Enterprise Reporting, Q1 ‘06 Where are the Open Source contenders? Source: Forrester Research www.molecular.com 13

Agenda What is Business Intelligence? BI Trends OSBI Trends Products Pentaho Jaspersoft OpenI BIRT Bizgres Mondrian Outlook www.molecular.com 14

Why Open Source? Source: Survey by Computer Economics, Frank Scavo www.molecular.com 15

The Jaspersoft Story: BI for Everyone Operational executives are being asked to make decisions more critical to the Corporation more frequently especially with the added scrutiny of SOX compliance. Legacy BI Companies have failed to solve the Problem “We have Business Objects installed on our corporate data warehouse and 80% of our users only use 20% of the functionality.” Michael Heschel, EVP Information Systems and Services, The Kroger Company “A typical installation for a 1000 users for the full BI suite could run As high as 450k - 700k for software licenses alone.” Intelligent Enterprise, August 2005 The full Business Objects product takes 180 CDs to install!!! This slide 2005 JasperSoft, Inc. www.molecular.com 16

Organizational Involvement with OS BI Don’t Know Not Considering open source BI software 9% 8% 43% Considering open source BI software Has deployed open source BI software 21% 19% In development with open source BI software (c) 2006 Ventana Research Open Source and BI Research www.molecular.com 17

Comparison of OS BI with Commercial BI Cost of Ownership 77% Openness/Flexibility 80% Database Support 72% Reliability 69% Metadata Support 62% Manageability 57% alability/Performance 61% Ease of Use 57% Significantly more Capable More Capable Equivalently Capable Less Capable Significantly less Capable Don’t know (c) 2006 Ventana Research Open Source and BI Research www.molecular.com 18

Extranet Applications - The “Beachhead” of Open Source BI? Technology requirements favor open source Pure J2EE offerings provide a better technology fit than legacy BI technology Licensing requirements contradict prevailing proprietary models “Named user” only – doesn’t map to extranet usage Role-based – meaningless in extranets 1,000 USD per name user – cost prohibitive Net/net: The “old school” BI licensing model breaks down www.molecular.com 19

Free software for sale! Community-based vs. for-profit companies Open Source has become a business model Acquisition of your vendor can change the terms under which you use OS SW Example: Bill Venners account of using Jive for Artima.com Example: Snort, Sale of Martin Roesch’s Checkpoint Software Whatever you do, factor in that your Open Source product may not always remain that. www.molecular.com 20

Example: Jaspersoft Business Model JasperIntelligence Product Family JasperReports, iReports Jasper Decisions, Jasper Server Soon: JasperAnalytics, JasperETL Commercial / Dual license Services packages on Subscription basis (JS & JR) CPU based Pricing plus Support (JD) Support pricing (JR) Commercial License, Support, Training, Documentation Incident support plus three annual support options from web based self-service to comprehensive 24x7x265 Leveraging strong and loyal community SourceForge JasperForge This slide 2005 JasperSoft, Inc. www.molecular.com 21

Agenda What is Business Intelligence? BI Trends OSBI Trends Products Pentaho Jaspersoft OpenI BIRT Bizgres Mondrian Outlook www.molecular.com 22

OSBI Explosion There are about 25 products competing in this space, about half of which did not exist prior to 2005. Many of them will probably return to insignificance Because we are so early in the maturity cycle, it is difficult to make judgments about who will make it. www.molecular.com 23

Open Source Reporting Tools Eclipse BIRT (Actuate) Jasper Reports JFreeReport DataVision Open Reports OpenRPT Agata Reports www.molecular.com 24

Eclipse BIRT (Business Intelligence) and Reporting Tools Eclipse Report Designer (ERD) Eclipse Report Engine (ERE) Eclipse Charting Engine (ECE) Web Based Report Designer (WRD) Source: Actuate www.molecular.com 25

BIRT 2.0 Features Released January 20, 2006 Re-Use Library – A report component environment allows developers with a range of expertise to share report components or functions for reuse. Page-on-Demand HTML- A page-on-demand navigation mechanism enables the efficient viewing of large report documents over the internet. CSS Style Sheets – External style sheets can be used across multiple report designs, making it easy to establish a common look across all reports in one application. Scripting Editor – BIRT supports the ability to code or script the behavior of reports using a perspective for Java Code Editing for BIRT reports. Large, Persistent Reports – Report developers can generate a report and then distribute a URL to end-users. Improved Charting Facility, Scripting – BIRT 2.0 includes a wizard for building common usage charts and advanced capabilities for including detailed charts within a report design. www.molecular.com 26

Open Source OLAP Tools Mondrian JPivot gOLAP PALO pocOLAP www.molecular.com 27

Open Source ETL Tools Clover ETL CPluSQL Enhydra Octopus JetStream KETL Kettle OpenDigger www.molecular.com 28

Open Source BI Suites BEE Bizgres Openi Pentaho SpagoBI www.molecular.com 29

JasperIntelligence Architecture USER COMMUNITY Customers Business Analyst Domain User Executive OUTPU T HTML AJAX MS EXCEL PDF MS WORDJasperExplorer HTTP, SOAP, Web Services, Java API Cube / Data Mart JasperReports JasperDecisions JasperAnalysis JasperETL Content Store Report Definition JasperServer Reporting Services Metadata Services Operational Data Source Rendered Content OLAP Services ETL Services Images, Fonts, etc Meta Data JasperIntelligence Platform JDBC, POJO, XML, XML/A JasperETL Finance Purchasing Inventory CORPORATE DATA This slide 2005 JasperSoft, Inc. www.molecular.com 30

Pentaho Source: Pentaho www.molecular.com 31

OpenI Source: OpenI/Loyalty Matrix www.molecular.com 32

OpenI at a Glance J2EE Web Application Standards-based, integrates other Open Source components Connectors for Relational (JDBC), OLAP (XMLA), and data mining data sets (RServe) currenly only XMLA Supports Jasper .jrxml and custom RDL JPivot for Pivot tables, JFreeChart Supports JSP-168 Form-based authentication with J2EE Security www.molecular.com 33

Bizgres Sponsored by Greenplum Bizgres is a distribution of PostgreSQL (Open Source DB) Bizgres includes the following components: PostgreSQL 8.1.3 (Open Source RDBMS) Bizgres Loader (Mass data loading utility) Demonstration Programs and Utilities KETL Integration (ETL solution for web log analysis) JasperReports Integration Bizgres Clickstream www.molecular.com 34

Bizgres Clickstream Architecture Source: Greenplum www.molecular.com 35

Who leads the pack? Downloads by Month 60000 50000 40000 30000 20000 10000 0 Feb- Mar- Apr- May- Jun- Jul- Aug- Sep- Oct- Nov- Dec- Jan- Feb- Mar- Apr05 05 05 05 05 05 05 05 05 05 05 06 06 06 06 Mondrian JFreeReport Pentaho Jasper Reports Source: sourceforge.net www.molecular.com 36

Agenda What is Business Intelligence? BI Trends OSBI Trends Products BI suites ETL tools OLAP Reporting tools Databases Demo www.molecular.com 37

The State of Open Source Business Intelligence “Business intelligence” is a broad umbrella term Lot of buzz in the media and from analysts Young and growing market Immature, but rapidly improving products No clear market leader www.molecular.com 38

Thank you! Q&A Would I go with Open Source BI today? How about you? www.molecular.com 39