Calling all data quality software vendors….TDWI needs your help

I couldn’t resist posting this one, but I want to start off by saying that I am big fan of The Data Warehouse Institute. They provide great information, their conferences are extremely valuable and their training classes provide the right level of practical learning.

But, their CRM system is in desperate need of some cleansing. Much like how Glyn Heatley discussed Data Quality Going Green (btw – until that post I didn’t realize that Glyn was a tree hugger. You think you know someone), TDWI needs to clean up their registration records. I received 3 emails from Wayne Eckerson (it wasn’t really from Wayne Eckerson) asking me to participate in a TDWI Benchmark survey. The emails all arrived within a few minutes of each other. The first one starts by addressing me as “Dear Graham”, while the second two start with “Dear Peter”. Now, on further inspection it is clear that this is partly my own doing. Each email was sent to a different email address since over the last 3 years we have internally changed our emails here at Palladium. But, that is the whole purpose of organizations house holding their data and identifying duplicates. I just find it entertaining that the organization (TDWI) that espouses having quality data is an offender. And it’s costing them money.

I did a quick search on the TDWI site to see if I could find any whitepapers or studies that I would recommend they take a look at. I found the following best practices report on taking data quality to the enterprise. The great thing is that if they are looking for some software vendors who can help, they can just take a look at the sponsor list for the best practices report.

I am hoping they won’t take away my membership based on this posting.

DIG Bits & Bytes

Some items that have fallen on the blogging scraps floor from the last couple of weeks:

BEA AquaLogic Product Future

There have been a lot of rumblings of the future of the AquaLogic product suite, primarily because of the rumor that the professional services group from BEA is folding into WebLogic team. A component of the platform, among other things, is a set of Web 2.0 technologies and Enterprise social computing. It would be surprising to see these products go away based on the current market, but stranger things have happened.

Sharing Information to Make Decisions

After September 11th, the intelligence community was chastised for their lack of information sharing. The “need to know” culture impeded sharing nuggets of knowledge that could help the different intelligence departments make better decisions. To change this mentality, the CIA developed the Intellipedia platform. The CIA will be sharing their story at the Enterprise 2.0 conference this week in Boston. It is certainly an interesting case study of how an organization, public or private, can leverage social computing to improve information sharing and collaboration.

And Finally, For the Artistic Crowd

I happened across this site “Dashboards by Example”, which provides a wealth of information for those considering implementing a dashboard within your organization. There are some great examples and best practices crossing a broad range of subject areas including web analytics with Google Analytics (we are a user and big fan) to an IT related dashboard. The author provides his perspective on Dashboards versus Scorecards which is always an interesting topic for debate.

Making Business Intelligence more “Social”

A couple of months back, I had written a post on the idea of Using Business Intelligence in E2.0. In the post I discussed how to bring BI into the social aspects of Enterprise 2.0. George Veth also posted on the topic of Social Objects, which is the concept of the “topic” that two people have a conversation about, opposed to the discussion just being about two people talking. There are many examples of this, both in personal and business settings. Wine is a good example of a social object that spurs a lot of dialog. My wife and I had dinner on Saturday night at a Portuguese restaurant, where a good amount of the discussion with our friends was on the topic of the sangria that we had ordered.

So, in the continued quest to figure out how to enhance the value of Business Intelligence I am looking for suggestions, comments and ideas on how to make BI more “social”. Much of today’s BI systems are what I would consider one-way, meaning a majority of solutions produce content to consumers and it stops there. There is no doubt that people are socializing what they are seeing, but not in a way that we are seeing other social computing being applied inside the enterprise. It can thus be said that BI is like Web 1.0 in the sense that a majority of the content is produced by a small group of “users” and consumed and that’s it.

So how can we make BI social?

The Bloglines are open and there are no bad ideas here. I am hoping to spur some discussion and ideas to advance the cause. Maybe we can get to BI 1.5 by the end of the summer.

For those interested in the topic of Enterprise 2.0....

I just received the final evaluation from the DIG conference and the feedback was great. Across the board we had positive scores and commentary from attendees. Here are a few snippets that I wanted to share:

What valuable insights are you walking away with?

• I now understand E2.0 and its possibilities- Andrew McAfee was excellent.
  
• Predictive markets, social networks can have lots of potential positive impacts, could use it to solve a MDM problem.
  
• I have learned master data management concepts. I wanted to get a better understanding of how business intelligence fit into their organization. Learning about enterprise 2.0 and making me aware of some of the new technologies.

Did the Conference Exceed/ Meet / Not meet your Expectations” Why:

• It met my expectations on the first day and exceeded on the second day. I was looking for new things and found it the second day with E2.0.
  
• I would have liked to have some formalized network opportunities with other speakers wither during or prior to the conference.
  
• This met my expectations, although I wished there were more technical components and that the attendance was higher.

All great feedback and certainly will help us shape next year’s conference. Any additional thoughts from those who attended would be appreciated.

One of the big takeaways for me was the level of excitement on the topic of Enterprise 2.0. Going into the final day, I was a bit concerned. Not because of our speakers, but instead based on our preconference survey results. We had asked our delegates two questions prior to the conference on the topic of Enterprise 2.0.

As you can see from the results of the first question, we had a limited number of organizations (<5%)>

For those still interested in the topic of Enterprise 2.0, there is an E2.0 conference in two weeks here in Boston. I believe this is the second year (I could be wrong, so don’t hold me to that) and they have a great lineup of speakers, including Andrew McAfee who was our keynote on Day 2. Professor McAfee will be moderating a panel discussion on the topic of “Enterprise 2.0 Reality Check”.

Dashboard Competition

For all of those Tufte wannabes out there, BonaVista Systems has created an interesting dashboard competition. There are some requirements to enter, such as the dashboard must be developed in Excel and use their Microcharts product (great marketing move). Seeing that I am like a caveman when it comes to visually designing a business dashboard, I figured I would share the competition with others since there is no chance I can win the first place prize, an Apple iPhone.

Let me know if anyone submits an entry. I will provide some free publicity to those daring enough to jump into the competition.

Example of Data Quality Gone Bad

At the DIG conference, Glyn Heatley introduced our data theme with an entertaining example of data quality gone bad. The story was told through a YouTube video. I had stumbled across this story in an industry magazine a few years ago, but I can’t seem to find the original article. Thought I would share the video so people can use it any time someone questions the quantifiable value of data quality initiatives.

Business Intelligence:”I’m not dead.”

If you are a fan of Monty Python, you will recognize this line from “Monty Python and the Holy Grail”.

I had a bit of a positive experience today with a client that caught me a bit off guard. It may be because there are times in this industry where you feel business intelligence has become a commodity. Seems like every organization owns at least one, and in most cases, multiple BI tools. There is pressure in the consulting industry from offshore resources, which I am personally not convinced about for BI applications. So needless to say, at times I am a bit jaded.

So that brings me to today. I am working at a client to build out a new reporting architecture. It’s a pretty significant size initiative and will replace numerous disconnected reporting packages that are managed through a hodge podge of manual processes. We are using the Cognos 8 reporting platform, specifically Report and Query Studio. As part of design, we have been prototyping a reporting package that is currently being done in Excel and packaged into PowerPoint. There are a lot of charts, formatting and commentary that goes into the package. Thus far, I have been thoroughly impressed with the Cognos tools to replicate the current set of reports. But the shocker was the level of excitement from business users who are currently saddled with creating these reports manually. And on top of that, the flexibility to expose the dimensional model would support a majority of the ad-hoc requests that the group receives.

So the point is I guess people are still not getting what they can from their investments in business intelligence and corporate performance management technologies. A majority of organizations are still in the 80/20 position of spending 80% of their time gathering data, creating highly formatted reports manually. If that is the case, it is hard to be called a commodity. I guess the software could be since the tools are there, but organizations haven’t yet realized the value from the investments.

There is another scene from the Holy Grail that draws parallels to the current state of BI.

King Arthur: Go and tell your master that we have been charged by God with a sacred quest. If he will give us food and shelter for the night, he can join us in our quest for the Holy Grail.
French Soldier: Well, I'll ask him, but I don't think he will be very keen. Uh, he's already got one, you see.

(Replace King Arthur with software sales rep and Holy Grail with BI tool)