Content Log

Content Monkey Predicts 2012

It's the last day of January, so I am not too late for predictions for the new year. Besides, it's my birthday and what a great time to predict the future. This year I am influenced by a book I received for Christmas, "Thinking Fast and Slow" by Nobel prize laureate Daniel Kahneman, from our one of investors, Accel Partners. Every year they send out a profound book to their portfolio companies and boy is this one potentially life changing.

I won't go into the book in detail, but one of the things that Kahneman, who is a psychologist and decision theorist, discusses is why experts are so bad at predicting the future. There are a few reasons including some things called the Theory-Induced Blindness, Optimistic Bias, Hindsight Bias and the Planning Fallacy among others. But put simply, experts just try to be too clever.

Kahneman referenced the 20-year study by Philip Tetlock at the University of Pennsylvania that studied 284 experts in economics and politics and 80,000 predictions. The experts were were asked to rate the probabilities of three alternative outcomes: the persistence of the status quo, more of something such as political freedom or economic growth, or less of that thing. As Kahneman states:

"The results were devastating. The experts performed worse than they would have if they had simply assigned equal probabilities to each of the three potential outcomes. In other words, people who spend their time, and earn their living, studying a particular topic produce poorer predictions than dart-throwing monkeys who would have distributed their choices evenly over the options. Even in the region they knew best, experts were not significantly better than nonspecialists."



Tania, the dart-throwing Content Monkey (attribution: Quixado on Flickr)

So there you have it, if we want to know what will happen in 2012, we need a dart-throwing Content Monkey to decide the future. All you analysts please take note, she (I asked her what sex she was) will _probably_ (and the operative word is probably) be more successful than you will be. Her name is Tania Majerus, see http://www.kleimo.com/random/name.cfm and I asked her a series of questions related to "either/or" answers or "less than, same as, more than" answers. I will add my "expert" analysis of the result, because Kahneman suggests that we humans need to think causally and will always look for a cause even when events are random. I swear these are the answers that "Tania" had generated.

Will the ECM market still exist by the end of the year?

Content Monkey says "Yes!"

I guess a market that is some $4 billion or so wouldn't disappear overnight, with a year being classified as overnight. There is some talk about it disappearing or perhaps being absorbed into the infrastructure or being merged with the social business sector. It may not be exciting, but it's still there and still very useful.

Will Mobile be the next big thing in Content Management?

Tania says "Yes!"

It's certainly early days, but with the spread of "Bring Your Own Device", users are certainly challenging IT and the organization to accommodate these mobil devices. Smart phones first and then iPads are starting to create their own demands on the usage of content. I see that OpenText has some sort of offering that bridges mobile devices to internal content management systems. It's not exactly a Cloud offering, but I can assume that other ECM vendors will follow suit.

Will Cloud be the biggest influence in Content Management?

CM says "Yes!"

I guess it is only natural to assume this given the high degree of interest in various surveys of CIOs. We have CEO saying that they "must get into the Cloud" whether they know what that means or not. Flexibility is the clear driver more than cost advantage. The largest corporations say that they can better deals on their own systems than they can from Amazon, but they can add machines on demand. The big question is whether it will be private or public clouds that will have the influence on Content Management. However, I'm not really sure what I would have said if the result was no.

Will companies start to put content into public cloud offerings?

CM says "No!"

If the answer was yes to this one, I would have rationalized this as they are doing this whether they know it or not. People are putting stuff into DropBox and Box whether the IT department and management knows it or not. Still I think we are still a bit away from resolution of a few security issues before companies consciously put content into the Cloud. An AIIM survey last year said that only 6% of corporations are even using a corporate cloud, but that 30% would consider using a public cloud in the future. This may be ignoring the informal usage on the file sharing services.

Will "Big Data" really have an impact on Content Management?

Tania says "No!"

This was one of the big predictions of Real Story Group  and Lubor Ptacek at OpenText. To be fair, Lubor said that "Big Data" in general would be the hype of the year, but that no one knows what that really means. RSG has aggregated their analyst predictions, presumably to avoid the failing pundit syndrome, and make Big Data sound like business intelligence. When I think Big Data, I think Map-Reduce and Key/Value pairs in extremely parallel processing a la Google and Hadoop. IBM sees the former as the future and I would think the latter. Still Tania says "Who care?"

Will Open Source market share in Content Management grow, remain the same or shrink?

Tania says "Grow!"

Whew! I wonder what I would have said if Tania had said shrink? I know Alfresco is growing and quite rapidly. I know that a lot of Drupal and Joomla is eating the commercial vendors lunch. But I can't comment on how other commercial vendors are doing. Still, good call Tania! Sorry, Lubor - did you consider that Cloud and Open Source go hand-in-hand and that most of the Cloud runs on Open Source?

Will EMC sell off Documentum?

CM says "Yes!"

There have been interesting rumors over the last year about Documentum. At this point, I can probably count on one hand the number of people I know who are still there. Interesting to see a number of the engineers going off to Salesforce. I had heard a rumor that SAP was considering buying without a lot of substance. I had also heard a very interesting rumor that a strategic acquisition by Autonomy that they had referenced in their earnings call where related to Documentum. That made sense prior to the HP acquisition. Now, you have to be wondering if EMC is thinking more about the potential drives they could be selling more than the prospects of their dwindling ECM brand.

Will SAP enter the ECM market?

CM says "No!"

I'm not sure if SAP would consider whether Tania is right or not. This is an adjacent market that SAP has been reselling OpenText for a while. Could they consider, once again, whether to purchase OpenText? SAP is also building out a cloud solution and CMIS is part of the cloud solution. Even so, they have said it before and will probably say it again that they are not interested in entering this market. And of course, they are using Alfresco in their enterprise.

Will HP grow, shrink or maintain the size of Autonomy?

CM says "Shrink!"

I would consider encouraging Tania to throw this dart again. When you go to the autonomy.com website, it hardly seems like anything is different. That would call for at least a "Maintain". I can see Meg Whitman investing in the service, but she could consider undoing yet another decision of the hapless Leo Apotheke. Autonomy's cloud offering has been somewhat murky from the financial analysts' perspective in terms of what it actually constitutes. However, it may add a bit of Cloud pizazz to HP's line up and it's not likely given the sunk costs of acquisition. Still Kahneman in the book suggests that sunk costs should not be considered in any rational economic decision and that companies are usually very good at removing CEOs who use "mental accounting" to avoid losing sunk costs. Meg's job is to avoid that mental accounting.

Will we see more consolidation in Content Management?

Tania says "No!"

There has been a lot over the last 10 years and perhaps we are seeing an equilibrium of the old guard of enterprise software. This prediction may fly in the face of a Documentum sell-off. I could also see OpenText folding into a larger software portfolio. But monkey says...

Will SharePoint market share in Content Management grow, shrink or remain the same?

Tania says "Shrink!"

Sorry, I can't see this and I can't explain it away. Sure, growth will slow and the Microsoft brand being tarnished by some bad handling of consumer products. But Microsoft Office is still the main game in office software for a long time to come and it's going to be natural for Microsoft to hook in SharePoint as part of the deal as well as SharePoint driving Office sales.

Will OpenText's market share grow, shrink or remain the same?

CM says "Shrink!"

I am going to be accused of being biased of even acknowledging this answer. I personally say "Remain", but we'll see.

Will those anti-Documentum ads that Oracle are producing actually work?

CM says "Yes!"

These ads really piss me off. Sure we compete against Documentum as well, but I can tell you that 8-Track tapes were well and truly dead when we started Documentum. Kids these days probably think we were all living in black and white and called each other "Man!" And can you tell me that Stellent's architecture is really that more advanced than Documentum when they were started within 5 years of each other 20 years ago. Anybody could get great results if they use an Exadata. Just give us a machine and we'll show you.

Updated Bonus Question: Will 2012 be the Year of CMIS?

Monkey says "Yes!"

I guess I have been taking CMIS for granted, otherwise why wouldn't I have asked this question in the first place. It has come a long way over the last several years. Apache Chemistry has made it possible for so many to implement it and Chemistry also means that the lighter weight JSON bindings (think brower plug-ins or mobile apps) can connect so much easier. As the Cloud becomes more important, what better standard to have to connect to content than one that was designed for that purpose and has so many systems like SharePoint, FileNet and OpenText supporting it.

Finally

My final prediction, is my personal one, which is these predictions will beat the others that are out there and that they will have around a 50/50 chance of being accurate at the end. Unfortunately, I won't be able to take credit.

 

8 ECM Predictions for 2010

At the recent AIIM Board Meeting that I attended this month, AIIM President John Mancini asked us to blog using the number 8. Why 8? Because no one else is using that number and AIIM can brand around it. So what better way to start than with my 8 predictions for ECM and Open Source - emphasis on the former. I found that I had a lot more that I could have written, so I cheated and added two more on section 7+1 and section 8+1 for a total of 10. Still, I didn't get around to my thoughts on Apple, mobile, Google, Google Wave, New Applications, Mergers and Acquisitions, etc. Since I have to go home and I am the last one in the office, this will have to do! I know it's a lot, but I have been doing a lot of thinking lately.

In no particular order...

1. Economy's affect on ECM.

Nothing affects the ECM industry more than the economy for good or bad. Any sudden downturn has an immediate effect on practically all enterprise software spending regardless of the payback. Until the consequences of the downturn are understood, financial controllers will hold off on purchases above a certain amount. Generally bad for large enterprise purchases. On the flip side, a recovery can and has been an excellent opportunity for ECM as automation is often a better investment than bringing on the old hires that you let go. Middling growth leads to middling results.

The prognosis for the economy is not entirely clear right now. Most recessions endure a double dip, although this one was so sharp it may have washed out most of the bad stuff that a double dip gets rid of. There is a great deal of uncertainty for both downside and upside opportunity in the economy and know one knows for sure what will happen. Most leading indicators are good, but a similar situation arose a couple of years after the 1929 crash and the economy dropped again in the mid-30s. If it gets bad, it can very, very bad as over-stretched governments have very little room for maneuvre. In addition, Tim Geithner has said that prospects for increased employment will not be great in 2010.

My guess is that economic recovery will continue and this could be a good year for ECM and enterprise software in general. Regulation is up, corporate purchasing is up, optimism is up. Content management will be an easier sell than most as investment for the future with less risk than hiring. I'd put the probability at 60-70% for good conditions for ECM. Downside is that is still a pretty risky environment. As the Boy Scouts say, "Be Prepared!"

Having said all that, government will be a growth area for ECM in 2010. Stimulus packages will kick in and new regulations will emerge to put yet more content pressure on organizations. This is one of the reasons we invested so heavily in Compliance, Governance and Records Management in 2009.

2. ECM in the developing world.

Growth in Asia, particularly India and China, is obviously outpacing Europe and North America. While the developed world spent, the developing world saved with more reserves for investment in infrastructure and IT. Even eastern Europe is doing better than expected because of lower debt. Could the developing world be a major growth area for ECM. Pressure on space and skyrocketing real estate prices in rapidly developing urban areas means that digitization of information can be a valuable tool for freeing up space. ECM is ready for the developing world.

If I were a traditional software vendor, I wouldn't count on this for revenue though. These guys got to where they are by being cheap and bargaining ruthlessly. This is no place for a traditional enterprise software sales person. Also, the size and scope of the developing world means that traditional distribution channels won't work and relationship selling can take forever to develop. And it is not just software that is feeling this - so do hardware manufacturers, manufacturing equipment makers, even medical device manufacturers.

I think this is an area where open source will absolutely shine. Internet distribution and download is a much more effective way of getting software to people, but will probably develop new models of monetization. We're seeing a lot of activity in India as an example, but demand is going to come in the form of developer support rather than traditional licenses, particularly in various outsourcing houses. Microsoft too will benefit from the extensive reach of its indirect distribution channels, although the software pirates may benefit as much, if not more.

3. SharePoint in 2010.

You have to hand it to Microsoft; they seem to have scared the bejesus out of the traditional ECM vendors. They have all seemed to rolled over and played dead in the wake of SharePoint 2007. Either that or they have just buried their heads in the sand in complete denial. To claim that SharePoint is not really ECM is ignoring the messages that are coming from the podium of Microsoft conferences. Most seem to say - "Oh we support SharePoint, we offer archiving, records management, etc." Yeah, but who owns the data? SharePoint is not just a front end to your system. It is becoming the platform for knowledge worker applications.

This is probably a make or break year for the ECM industry. If you are an ECM vendor, beware the ever tighter integration with office, better web support, new records management, and claims to better scalability and administration. Still, it is not invulnerable. Microsoft has chosen not to address its fundamental architectural flaw of storing content in the database and it is still an exclusively Microsoft-centric platform. Forget whatever database, operating system, language, browser you have - you better get used to SQL-Server, .NET, Windows, IE and don't forget Silverlight. If the traditional vendors can't battle the crap out of that, then they deserve to lose. The next 12 months will be critical during the transition to SharePoint 2010.

4. The E in ECM.

The whole idea of Enterprise software in the 21st century seems anachronistic. The term Enterprise really only took hold in the 90s in order to describe systems that were able to scale beyond the department. It meant big, powerful, flexible, but it also meant big, clunky and expensive. As Web 2.0 sites with their cheap (read free), simple, but scalable platforms scaled to millions of users in a matter of months, the whole idea of only being able to support thousands of users and take years to implement became ludicrous. Being Enterprise meaning you can support your heavyweight infrastructure of other Enterprise parts also seems less interesting when you consider that the largest databases on the planet run on MySQL using a concept called Sharding.

Support the Enterprise concept if you want, but Brand Enterprise has lost a lot of its value. And while we are at it, so is Management. In a world of wikis, blogs, Facebook and Google, a strictly controlled environment is destined to be locked up in a closet with just a couple of people using it. It's not that control is not valuable, but you need to really consider what would really happen if information were freed up. Transparency and tracking are more valuable tools today than locks, keys and authorization slips. Leave those to the information that really, really needs it. However, the Content in ECM will be more important than ever as more and more of it gets created at an exponential rate. Best to guide it rather than restrain it.

So what replaces Enterprise Content Management? I don't know, but my guess is that we start to find out in 2010. it might even have a new name by December. Hint: I wouldn't jump to the conclusion it is Social Software. Also see Application vs. Platform below.

For the sake of readability of the rest of my predictions though, I am going to stick with ECM.

5. WCM and ECM.

What a funny relationship these two have. ECM was born in the early 90s out of document management. WCM was born in the late 90s because ECM couldn't get out of document management. The in 1999 and the early 2000's (Noughties here in the UK - what do you call them?), both ECM and WCM decided that they were in the same business and started buying up each others capabilities and then jury rigging the architectures together. The logic went that both sides were managing content, they had repositories and their way of handing content was better. From a pure dollar perspective, that one didn't play out as well for the WCM vendors. The largest players from that time, Vignette and Interwoven, are now subsumed by OpenText and Autonomy.

Still WCM didn't do too badly in 2009. The web site is the store front of the 21st century. And most apps are web apps and most web apps are web sites, at least as far as the user is concerned. Companies still invested in branding and applications for customers as a way to weather the recession. Because of the plethora of web sites, styles and characteristics, there seems to be a plethora of WCM vendors as well. It must be the most fragmented industry that I have ever seen in the enterprise software space. Due to these characteristics and the fractious nature of WCM, if you see a WCM vendor and an ECM vendor in the same account, often it means that somebody shouldn't be there.

However, I think WCM should play a very important role for and in ECM and hopefully this will become clearer in 2010. ECM as repositories of trusted information predominantly deliver their content via a web interface. If its up to the end user, it would be the web site that they are using. If web applications are presented as web sites, are content rich and want to dynamically deliver content to end users, then the marriage of WCM and ECM makes a lot of sense. This is why Alfresco is investing in its WCM to work well with the Spring Java Framework - to help build web applications that are web sites and provide dynamic content and repository services for content-rich applications.

I hope the mapping of the WCM industry becomes clearer as well for 2010. We believe our positioning of focusing on WCM for Java web applications, particularly Spring applications, means that we can work with other parts of the WCM industry, such as Drupal/Acquia, Joomla and others. In 2010, some other ECM vendors should just go ahead and get out of the WCM business and stick to the knitting. They should cooperate with, rather than compete with the WCM vendors. I think CMIS will make this a lot easier.

6. The Cloud and ECM.

As my colleague Ian Howells has pointed out, the buzz around Cloud is many times more intense in Silicon Valley as it is outside. And it is a level of buzz that feels like the Web in mid 1990s that was not felt outside the valley. Could we be seeing the start of a huge land rush that we did in 1995? There is a lot of commonality with the experimentation, trials and shear enthusiasm.

The economics of the Cloud seem almost no brainers. Two years ago, the cost of running systems in the cloud were 1/3 the cost of on premise. Now according to "Above the Clouds", a report from the University of California on Cloud Computing, the cost is about 1/5 to 1/7. I know it is a stretch to say that if this trend continues we can see computing at 10% and ultimately 1% the cost of on premise, but this is what I believe. The reason is that we are only just beginning to see the industrial scale of Cloud facilities come on line that have enormous buying power, very cheap energy, and nearly free cooling being in cold climates or near cold rivers. The ever increasing bandwidth available means that location of computing is less and less relevant. There are still lots of obstacle to be overcome, particularly in perception of security and reliability as well as real legal issues of data domicile. But the implications of 100X compute power for the same cost as in house is enormous and unknowable.

A lot of people have predicted that 2010 is the year of the cloud. I think that 2010 will be the start of ECM in the Cloud. Steve Ballmer at the SharePoint conference in October made a big point of talking about SharePoint in the Microsoft Cloud. We have been and will be doing a lot of work in using the elastic power of the Cloud with the Alfresco platform. I expect that you will see other ECM platforms working in this area. I would also expect to see lots of open source in the Cloud. This can't be good for

7. CMIS.

I guess I have been talking about this longer and louder than anyone else out there, so you wouldn't be surprised to see me say I think CMIS will have a significant impact in 2010. In the past two years, I have learned a lot about the standards process, particularly OASIS, and I have learned not to be so optimistic when lots of players are involved, no matter how motivated. But I can see the end is near to getting CMIS 1.0 to an official standard in the Spring 2010. It will not be long before the ECM vendors have their implementations out. But I have also seen portal vendors also building portlets as well to integrate with the ECM systems. I would really be surprised if these aren't out by the end of 2010 and already having an impact.

CMIS is both and an opportunity and a threat for traditional ECM vendors. It is a threat because it provides SharePoint in particular an opportunity to ease users out of those traditional platforms and into SharePoint. SharePoint being a value player at the low end will naturally try to gobble up ECM low end implementations. It is an opportunity for a number of different reasons. This is a chance for the larger vendors to consolidate the small holdings of the lesser or defunct competitors. It means that ISVs and system integrators will be able to reuse solutions from other vendors and apply them to other ECM vendors solutions.  More solutions will mean more money spent on ECM as it solves real business problems, thus making a bigger ECM pie. This in turn will create more solutions. All this played out with the standardization of the DBMS market and there is no reason to expect that it won't in the ECM market.

Whenever I talk to anyone about integrating with Alfresco, I suggest that they integrate using CMIS. CMIS is very rich and usually good enough to do what they need to do store, access and search content. When the integration is done, it works not just with Alfresco, but any CMIS-enabled repository. We have done this with Drupal, Joomla and Confluence in the last year. Expect lots of early integrations in 2010, particularly with portals. We see lots of Liferay used in conjunction with Alfresco and I would encourage portlets developed by customers to be done with CMIS as an example. Expect CMIS to be on tenders, RFIs and RFPs. Finally, you may see the first companies being formed around CMIS and content applications.

7+1. Content Platform vs. Content Application.

I once had a bizarre conversation with Gartner about what constituted "Visionary" in ECM. The answer is that you buy into their vision of CEVAs (Content Enabled Vertical Applications) and have lots of them. Hmmm - visionary means you buy into someone else's vision? But then I asked why SharePoint was considered visionary when they didn't invest in CEVAs. The answer was because of all the interest from their clients in SharePoint as a platform. Hmmm - so you are visionary buying into their vision unless you are Microsoft. Now I understand that CEVAs are gone and replaced or "rebranded" as Composite Content Applications. Does this align with being a provider of CEVAs or being a platform that allows others to create applications?

My belief is that we are seeing a natural swing that has pervaded content management from the very beginning. Is content management an application or a platform? Is it middleware or a fundamental subsystem? A lot of this has to do with how you create, capture and use content. Some of the process of content management is so generic that it makes sense to have an application to perform specific tasks. However, many so called out-of-the-box solutions are so heavily customized that it really is more a platform than an application. Delivery and consumption of content via the web can either be an applet, gadget, portlet, web part or an entirely new piece of HTML/JavaScript/Java/.NET piece of coding.

Content management was never like an ERP or CRM system - plop it in, conform your business processes to that system and configure the rest. Content management was in many ways something closer to a database. Sure it has a rich domain model, but ultimately customers want to use it for all sorts of different applications. They want to write queries, build relationships, define business processes and create rich and elaborate user interfaces, particularly for the web and web sites. The better way to look at it is, that some "CEVAs" may be considered applets that are part of a larger application or business process. ECM systems should make those applets work independently as portlets where they can be provided in context. Capture and consumption can really come from anywhere, so provide the APIs that can provide the content access and manipulation required in the language and development environment of the application that needs the content. The reality is that applications need content as much as they need data in a database, so let's give them the same sort of tools that they have with databases. If portions of the application can be packaged as applets, that is part of the job done, but not all of it.

Three trends will get us to think about ECM as platform more than application in 2010. First, CMIS as a platform-style API will get us to think of ECM and repositories as a platform. CMIS will highlight the areas where we need to build and extend applications by initially system integrators creating solutions with CMIS that will be portable to other ECM systems. Second, the desire to build mash-up applications as a result of experience with Web 2.0 will encourage developers to be pragmatic about pulling in the right tools, including ECM into mashed up or Composite applications. The ECM system is not necessarily to going to be the locus of the Composite application, the web site may. From this perspective the ECM system will be perceived as a platform in support of the web site or web application. Finally, the 5 parts service to 1 part product cost ratio (plus or minus) that has been around since the early days of ECM can not endure in our cost conscious times. If we stop pretending it is a whole app and provide the tools that developers need to pull together the whole app in a fraction of the time, particularly with Web 2.0-style scripting over hard core coding, everyone will benefit.

This is not a massive swing of the pendulum, but it is heading in the clear direction of platform. This is where we are thinking. This is also where Microsoft is thinking based upon comments from Steve Ballmer at the SharePoint 2009 conference.

8. Open Source makes strange bedfellows.

We go into 2010 as what a lot of open source experts have described us as the largest private open source company and cash generative to boot. Not bad going as we celebrate our 5th anniversary in January. In those 5 years, we have learned a lot about the politics, business and religion of open source and it has been absolutely fascinating and fun.  We have had to think about licensing, pricing, subscriptions, alliances, packaging, downloads, new marketing models, confrontations and who are friends and enemies are. Throw a recession in there as well and it makes for interesting times.

As time has passed and we think about how we can apply the open source model, we have focused more on our core competence - Content Services and Content Repository. The more CMIS has become real, the more we can cooperate with others with out locking either party in. Thus we can move away from competition with many players and become best of breed in content services. This has allowed us to more work with a Drupal or a Liferay when in the past there may have been overlap in our product sets. CMIS opens up even more opportunities to work with others as well. Working with others creates a stronger and multiplicative network effect.

Because open source stands parallel to other stacks and encourages others to integrate, particularly through contributions. This opens up alliances that may not require integration work because it has been done by others. We didn't have to build the integration to Kofax or SAP and you will see more integrations in early 2010. Portals - open source or closed - have always worked hand in hand with content management, while not necessarily encroaching on each other's space - SharePoint excepted. These types of integrations in turn allow us to work with other vendors that may need to bolster part of their product set and not feel threatened. Expect to see more integrations and alliances between open source vendors and closed source vendors in 2010.

This is not new for open source. MySQL and JBoss have worked with many non-open source vendors and bolstered their capabilities. In 2010, this will take on a new significance though. The Cloud is requiring many vendors to bolster their product sets for new models of demand and elasticity. The growth and threat of SharePoint and Microsoft product sets can make some products seem incomplete. As we see in the next section, Social software and content management can be very complementary. The ease with which it is now possible to pull together an entire stack of software means that a lot of that stack may be open source and present some really interesting offerings in 2010.

8+1. Social Software and ECM.

Should you buy social software from your ECM vendor asked CMS Watch. Conclusion was maybe not. I personally think that social software will be a category in itself with vendors whose core competency will be social software. Just like any web site could have been Facebook, they weren't because they didn't concentrate on that. A lot of social networking centers on content-centric networking - discussing, arguing and collaborating on content. However, it doesn't necessarily mean that the social platform will own that content. Look at all the YouTube video that show up in social networking sites.

I do think that ECM vendors should concentrate on Content Collaboration - the act of working together to create and manage content, but that in and of itself is not Social Computing. It's about sharing ideas and content in the context of a common problem and it should be presented as such. This collaboration could benefit from more focused social computing platforms, such as instant messaging, on-line conferencing, activity feeds a la Facebook, walls, wikis, blogs and forums. By concentrating on providing content services for those platforms, we are creating a win-win situation. More than that, we are focusing on what we are good at - Content Services. These Social Computing or Networking platform usually have only the most rudimentary content services, which make for very complementary products.

SharePoint has a lot to do with why this question would even come up. For lack of anything else to use in the enterprise, people are trying to build these types of solutions. However, what was once labeled as collaboration in SharePoint is now Social Computing, but the reality of it is that it is generally still content collaboration. At least that is what most customers use it for. This may or may not become a stretch too far for SharePoint, but it is one that we are not going to try. I didn't always feel like this and felt that we had a big opportunity in Social Computing. But as we progress the company, we have more to offer integrating with others and sticking to our core. We can get more from others that do the same.

CMIS one year on - soon in public review

Autumn marks the new school year, business year and CMIS year

It's that time again. Autumn and the new school year and we are about to take another major step with CMIS, the Content Management Interoperability Services proposed standard at OASIS, and we will be that much closer to having CMIS become an official standard. As of today, a majority of the technical committee has voted to put the CMIS specification to public review with zero no votes.

I was recently reminded that I wrote about the public introduction of CMIS around the same time last year. This was the time that IBM, Microsoft and EMC decided it was time to announce the Content Management Interoperability Services that they started October 2006 and release it to OASIS to become an official standard. At that time Alfresco was fortunate enough to have been involved in the process for the previous year before joining the original three, along with Open Text, BEA and SAP. For the year before that, IBM, Microsoft and EMC broke away from AIIM iECM committee to speed up a process that itself had been going since Autumn 2005. Much of the groundwork was laid with iECM and the parallel, but Java-focused JSR-283 committee. All in all, this will not be a fly-by-night standard, but a standard that has been carefully deliberated, considered and grounded in real world use cases.

This last year has seen the number of vendors participating increase substantially with plenty of beneficial results. We have had a few face to face meetings that have triggered some great collaboration in a very competitive industry. The number of eyes looking at the spec has increased, but so have the minds contributing new ideas and expertise. SAP presented real world requirements that needed security in the form of ACLs, so something that we had been willing to punt on before, we added in. Microsoft, IBM, SAP and other owners of search engines participated in a working group to define APIs to get changes to a repository to keep search indexing up to date. Also, Day and Nuxeo set up an Apache project to share Java API and SPI components along with Gabriele Columbro from Alfresco and our friends at SourceSense. David Caruana, Alfresco's chief architect, contributed interfaces to handle renditions and specifically thumbnail previews.

More importantly, committee members were building real life implementations of the specification at each stage to really test its implementability and completeness. As Ethan Gur-esh from Microsoft once said, "I relish the fact that CMIS is retrospective." It can work with existing repositories, not be overly prescriptive, but still describe a powerful content application platform. Regular plug-fests ensured that the systems interoperated with each other. This alone distinguishes it from all other content management standardization initiatives - real life integration matching the current state of the specification. Dave Caruana's Java test harness, now in Chemistry, provided a tool for other vendors to test the completeness of their server implementations.

Developers started creating new applications based upon the early specs, such as CMIS Spaces and CMIS Explorer, which tested its usability as a platform interface for content-centric applications. CMIS's initial focus on real-life use cases has so far paid off as the level of functionality seems to match new applications being built and existing applications integrate content management capability, such as Drupal, Joomla and Confluence have with Alfresco through CMIS. I certainly encouraged anyone who wanted to integrate with Alfresco to do so using CMIS.

Today, unless some catastrophic event occurs, CMIS will go into public review. This is the last step in OASIS before becoming an official standard. As the process is laid out, it could take a maximum of 6 months for completion of the step and CMIS becoming a standard. It also means that only typos and minor corrections will change in the spec, currently at version 0.7. The determination of the spec leads, David Choy from EMC as Chairman and Al Brown from IBM and Ethan Gur-esh from Microsoft as Editors, has ensured that we got to this point and they have done an excellent job marshalling the process along. Everyone on the committee seems determined to see this to as speedy a completion as possible. It seems likely that CMIS will become a standard in the first quarter of 2010. I can't see anything getting in the way of this other than the US government disapproving or Google, whichever is more powerful. All the rest of the major players backing the standard. (Craig Randall, formerly of EMC Documentum, just popped up at the last call representing Adobe.)

Being the eternal optimist, I have very high hopes for CMIS, but I believe I have reason to be optimistic. I have seen it before first hand with SQL. Without vendor lock-in, it will now be possible to build content-rich applications that can run against many different systems. Customers will be able to move content from repository to another. It will be much easier to find stuff in random repositories without having to build multiple connectors. As the breadth of applications and utilities becomes available against these repositories, usage and deployment of content repositories will become more widespread and grow a much bigger pie for all vendors. As Alan Pelz-Sharpe reports in CMS Watch, CMIS is already gaining traction in 15% of AIIM members before it has reached standard status.

I'm really looking forward to this new year!

What Jeff Teper Said at AIIM

It has been two weeks since AIIM and I promised to write up something on the keynote presentation by Jeff Teper, Corporate Vice President for Microsoft Sharepoint. However, I have spent a good chunk of time thinking about the presentation so that I could give a more thoughtful commentary. Since Microsoft is out to disrupt the ECM market, all ECM vendors should care what Jeff and others at Microsoft think.

The title of the presentation was From BI to Blogs and Workflow to Wikis - Enabling Governance and Empowerment. I have the presentation from the AIIM website. I suppose if you want a copy you can email Jeff to get it. If you post a comment or send me an email, I will see what I can do. The title indicates that there is a natural tension between traditional enterprise systems such as business intelligence and ECM and the new generation of content tools such as Blogs and Wikis. This is an interesting observation and the two sets of technologies are rarely juxtaposed against each other. Without ever mentioning “Web 2.0”, Jeff was capturing some of the elements of Web 2.0 and their implications on the enterprise.

In my blog on AIIM, I had originally chastised Jeff for taking a very partisan approach to a keynote address. Looking at the slides, at least in the beginning his presentation had a very neutral perspective to the issues facing corporations. Looking at my notes that I took that captured both what he was saying as well as what was on the screen provided a much different outlook. This presentation was clearly about Sharepoint and where Microsoft was aiming Sharepoint. Although it was a sales pitch for Sharepoint, I nonetheless found it interesting and an important introduction to some of the missing concepts in Enterprise Content Management. Russ Stalters said that he found nothing new in this presentation, but I found new insights into Microsoft’s positioning of Sharepoint. Russ probably gets invited to more Sharepoint events than I ever would. However, I found new messages that I had not seen in other Sharepoint literature that is publicly available.

Governance vs. Empowerment

The major premise of the presentation is that enterprises need to balance governance, a control of information, with empowerment, the free flow of ideas and collaboration between employees, teams,  departments, other enterprises and customers. Identifying the regimes of control in execution-driven organizations as being able meet new regulatory and risk control, he contrasts this with innovation-driven organizations (“like Microsoft” as Jeff mentioned) that empower their employees by allowing them to make their own decisions and provide the technology to do so. Islands of information were also preventing cooperation and collaboration. By providing a “Best of Both” approach, enterprises can meet the financial and legal risk associated with information out of control with the need to innovate to meet the new challenges of internet-based competition, closer partnerships in design, and attracting and retaining talent from a new, web-enabled generation of employees. Microsoft served as a good example of what corporations are up against and he used Microsoft as case studies for many of these examples.

He stated that a new set of technology enablers has made it possible to meet the needs of providing a best-of-both solution. Hardware and software are increasing in functionality with 64-bit computing coming on line and multi-core processors in ordinary desktops. Web-based innovation and changes in user experience have brought new forms of collaboration, searching and shopping (although Microsoft hasn’t exactly been one of the leaders in this area.). Interoperability through web services and XML makes it possible to connect disparate systems together.

It is at this point he provides the new playing field in which to position Sharepoint. Two dimensions outline this playing field with Governance on the Y axis and Empowerment on the X axis. High on Governance, but low on Empowerment are the enterprise software technologies of data warehouses, ECM and portals. High on Empowerment, but low on Governance are the desktop applications of spreadsheets, group and personal databases, and intranets. If only someone would provide the best of both these capabilities, that would be the next generation productivity platform. By balancing both, a platform can provide governance through policy controls, rights management, auditing and controlled architecture along with the empowerment of self-service, better UI, role delegation and pervasive collaboration.

This next generation productivity platform, of course in Microsoft’s opinion, would be Sharepoint and “other products that you can find on the show floor.” I buy the distinction between governance and empowerment, but I believe it is more of a single continuum between governance and empowerment in a single dimension. Why this is important is that the reason we have governance and empowerment has a lot to do with what type of content, what application, context and who in the enterprise is being addressed and not simply at technology trade-off. There are times where governance is essential and times where empowerment can only be handled through laissez faire policies, but the overlap is not as big as he suggests. What is more common is that there are clear interfaces between these activities that prevent contamination of the other.

Microsoft’s Sharepoint Strategy?

Once a best of both is achieved, then a strategy of creating a connected organization, building a holistic information management experience, and investing in a strong vendor ecosystem will yield a “Strategy for Success”. Jeff used the example of a consumer products company that went with a best of breed strategy and met issues of interoperability and challenges to make their information infrastructure work. He emphasized the importance of holistic solutions that link everything together. What he implied was that all the important systems were Microsoft systems.

I didn’t quite get this transition and its connection to the best of both other than Microsoft says so. However, this looks like a reasonable strategy for customer, but more importantly for Microsoft. It is probably Microsoft’s strategy for success in competing against two major forces and laying them against this playing field. On the Governance side are the traditional enterprise vendors, in particular the ECM vendors. On the other end is open source who originated the empowerment tools of the wiki and blogs. Microsoft can add 1 plus 1 and yield 3 by combining these capabilities and leverage their strengths of enterprise pervasiveness, a broader platform, and a strong ecosystem to beat the competition.

The Connected Organization plays to Microsoft’s strengths of going where Windows is and to connect islands of information. Because of Sharepoint’s price point relative to the major ECM vendors, it has gone piecemeal into many organizations and with Sharepoint 2007, there is a strong emphasis on search and portals as the means to aggregate and federate the organization. Jeff presented a chart that linked different lines of business and connected them to the people in those organizations, which is a major theme of Sharepoint 2007.

It was at this point that I expected to hear what I hoped I would get out of this presentation - a definition of what is Sharepoint 2007. One of my most Googled blogs is What the Heck is Sharepoint 2007, which goes to show that a lot of other people are wondering the same thing. We even see eWeek’s Mary Jo Foley frustrated in finding a definition for Sharepoint and potentially sees it as the next operating system.

What is Sharepoint 2007?

What came up was a slide titled “Holistic Information Management”. To the left was the familiar wheel of six technologies: Collaboration, Portal, Search, Content Management, Business Process, and Business Intelligence. However, this time the circle included the words “Experience Management Platform” in the center. So is Sharepoint Holistic Information Management or is it an Experience Management Platform? Neither of these terms is in common usage in IT shops nor would I say that IT managers are seeking either. This must be frustrating for Microsoft that they have not been able to articulate what Sharepoint is nor can they associate it with a specific market that the industry can rally around. It’s not quite as simple as addressing the operating system, database or CRM markets as they have in the past.

It’s worth pausing for a moment to reflect on both terms Holistic Information Management and Experience Management Platform. When Jeff spoke about the platform being holistic, he mentioned issues around interoperability and security. By thinking holistically and integrating with other systems, the experience can be seamless for the end user. Perhaps I was too busy trying to take in what was being said in this slide, but I don’t recall anything being said about Experience Management. A quick search of all of Microsoft.com doesn’t produce any results either against search.microsoft.com or Google against link:microsoft.com. Maybe I am reading too much into this, but at the core this could one of two things. It could be management of the user experience where new UIs are presented in the six different technologies. Nah! It could be managing experience as a synonym for knowledge. My assumption has been that Sharepoint is a knowledge worker platform for creating applications incorporating all the technologies that would normally get folded into a portal to support knowledge workers.

Why this is important is it gives us a clue on what Microsoft thinks Sharepoint is, how comprehensive it is, and where it will get targeted. Equally important, it says what Sharepoint is not - you wouldn’t build an ERP system on top of it. (Would you?) This picture of six technologies expands the notion of content applications beyond the vision of the ECM vendors. It is also a platform that provides insights and access to other systems that can affect content. In other words, it is holistic from the users’ perspective in serving up information to knowledge workers. Ironically, nothing is said about the new empowerment technologies here. Sticking to the same picture that is probably about a year old, with new position of wikis and blogs, the thrust of the first half the presentation is lost. However, I would expect to see more of this type of positioning in the near future.

After positioning the technology, Jeff handed over to Arpan Shah, Group Product Manager, for a demo. Probably because this is AIIM, the demo was very document management focused. However, the demo started with Wikis and Blogs to show the empowerment of end users to add content. In my mind Wikis are associated more with simplified link management rather than formatting, but it was the latter that Arpan emphasized. Blogs were straight forward enough and show what that might mean in an enterprise environment. The rest focused on more document oriented activities like the construction of corporate PowerPoint presentations from Sharepoint, linkage from Office, the creation of a team website, and the set up of basic workflows. Arpan showed Outlook as the off line tools for accessing and syncing documents to and from Sharepoint. The core differentiation from the other ECM vendors that Arpan demonstrated was Office integration and the new media types of wikis and blogs.

Microsoft Ecosystem vs. ECM

Jeff then resumed by displaying the Microsoft ecosystem and customer base. There were a couple of advertisements of customer stories at Starbucks and Miami Dade County Schools as well as the logos of every major company in the world. This should obviously make any ECM vendor concerned. It is for that reason that Microsoft showed that it is working with vendors like EMC, OpenText, Vignette and Interwoven, probably to encourage others to hop on the Sharepoint bandwagon. This is otherwise known as embrace and extend.

Jeff very prominently displayed a collaboration between EMC and Sharepoint from October 2006. An agreement to cooperate that allows Documentum to fit within the Sharepoint hooks of Office and Sharepoint portal to access Documentum more easily. He then presented a collaboration with OpenText where OpenText is building solutions on top of Sharepoint combining Sharepoint empowerment with OpenText expertise in regulated documents. Jeff then made a slip of the tongue about how vendors such as Documentum and OpenText can build solutions on Sharepoint. I’m sure that EMC sees the opportunity for Sharepoint to build applications on top of Documentum.

Microsoft’s strategy seems to be still in formulation, but their objectives are not. Jeff Raikes has said that Sharepoint is one of the fastest growing products Microsoft has ever had and expects Sharepoint to do about $1B in revenue in 2008. Much of that revenue comes not from the portal or BI market but from a zero sum game against the ECM market where revenues are richest. They are changing the game by expanding out a platform that encompasses all the technologies that are useful in building solutions for knowledge worker solutions in enterprises. As my colleague Ian Howells pointed out that Microsoft has five main approaches to marketing: a drag race, platform play, stealth play, best-of-both play and a high-low play. In general, Sharepoint seems to be a platform play, but with a best-of-both twist with the both being ECM vendors on one end and open source collaboration tools on the other.

There are many things that I have to admire about Microsoft’s ambition. It is large and grand. Like many other Microsoft products, they have got a lot of things right in version 3 of Sharepoint. However, there are many things of which I don’t think as highly. Sharepoint got here because closed APIs in Microsoft Office allowed them exclusive access to repository functions from Office into Sharepoint. With Office owning 90% of the Office Suite market after shutting out Lotus and WordPerfect with its Windows monopoly, they are now using the Office monopoly to extend control into the repository market. They used the power of the Windows distribution channels to get free Sharepoint Services in more places than it would naturally. Although they imitate a lot of features of ECM vendors, they are unable to articulate what exactly they have created or innovated despite making public their plans for quite some time. Their choice to focus on an entirely Microsoft stack maybe in their interests, but not for those who have invested in Java, LAMP, Unix or other stacks.

We are tracking Microsoft because they are smart people and what they say and do matters in Enterprise Content Management. However, they are asking you to make an investment in a Holistic Information Architecture that covers a wide variety of functionality, including ECM. Yet they have had a difficult time articulating exactly what this platform is and where it might be applied. They don’t even use the term Enterprise Content Management, yet here they were presenting in the largest conference devoted to that topic referring to other ECM vendors building on their repository. Just as they are coming to market with Sharepoint 2007, new Web 2.0 techniques are becoming hot and they need to be seen addressing these. There vision is simultaneously comprehensive and vague in its target. Given that their product lifecycles are measure in many years, it is important know where they are going and they have just not made that clear in this presentation.

AIIM Higher Guys!

I have returned from AIIM where there was a real contrast from some of the conferences I have been to lately. Having floated around the open source and Web 2.0 world, it seems like between that and the enterprise software world represented by AIIM are two distinct universes where beings never interact. The former is becoming distinctly much more populated as well. The AIIM Show shared with the OnDemand Conference representing tens of billions of dollars of spending and production is physically very big with lots of huge stands and huge machines. OnDemand Expo, indicated by red isle carpets, is about on demand printing, not on demand computing, and hosts giant printing machines from the likes of Kodak, Xerox, Cannon and HP.  Alfresco exhibited in the AIIM Expo half indicated by the blue carpets.

"You mean that in your universe services are free and source code is open? That is illogical." From the episode Mirror, Mirror of that well-known television series

Since the East Coast was hit by bad late April weather, a lot of people found it difficult to make it to the conference compared to previous years. Even the IRS gave New Englanders a break on sending in their income tax this year due to the weather. It makes you wonder if Boston is a great place to host an event like this though. It could be that people are time shifting into that other dimension. Those left behind are vendors talking among themselves. However, traffic seemed to pick up on the Wednesday and Thursday. Still, there was a definite lack of energy in the conference. Vendors talking to vendors is no fun, especially when some companies had giant booths filled with people talking to other people from the same company. The bar next door at the Westin, the only source of beer within a mile, was heaving after the show with people who just seemed to be relieved that the day was over.

This is the most busy picture I could find of AIIM on Flickr

Parallel to the expos was the AIIM and OnDemand conferences which shared keynotes. I attended the sessions on the first day and actually found them very informative. Unfortunately, I missed the first 15 minutes of John Mancini’s presentation on the state of the ECM market due to some confusion on the AIIM conference web site. Russ Stalters was disappointed in the presentation, but I found the latter half pretty interesting. John talked about the measurable benefits of using ECM came in the second half of his presentation. These statistics say that ECM is important and that it is growing. Some key points:

• 53% of enterprises email retention as a key driver for ECM
• 37% see compliance as an ECM driver
• 36% see business continuity and risk as a driver

• 53% of enterprises that rely on ECM manage electronic information effectively vs. 11% who don't rely on ECM
• 45% of ECM enterprises can find customer information in less than a week compared to 30% of non-ECM enterprises
• 60% of ECM enterprises have confidence in their electronic information vs. 30% of non-ECM enterprises
• 56% of ECM private enterprises believe that they are more profitable than their peers vs. 37% of non-ECM private enterprises

These statistics show how important ECM is to American enterprises and it should galvanize the industry. But I think the lack of energy in the expo and the conference comes from continuing to try and bind AIIM to OnDemand together. As one journalist put it, you have one half of the show telling the world that printing on paper is still important and the other half trying to eliminate it. Bringing two brands together dilutes both and defocuses each from what should be their main goals and objectives. Nothing indicates this more than the content of Charlie Pesko, the speaker after John Mancini and the CEO of InfoTrends, who told those in the audience who were interested in printing to adopt the ways of the online world or go out of business. AIIM should be at the forefront of helping enterprises get completely online and avoid the old physical models of printing.

Charlie’s talk, although phrased in Web 1.0 terminology, told us that the print on demand market is maturing and that companies that purely focus on printing are at great risk. This should have come as no surprise to anyone since the boom of the 1990s. Still, I found some of the insights interesting since I have not paid as much attention to this area in the last few years. I didn’t know that color printing was still a growth market and growing at 15% CAGR. I also discovered that the cost of color printing has gone from $1.05 in 1995 to 40 cents now to 20 cents in the next five years. His solution for print service providers to take advantage of this growth in hardware was to focus on adding value to what is being printed. Add workflow so that you can efficiently handle all the processing, since every time a human touches a print job you will lose money. Chillingly, I discovered that the big market will be to take all those mail inserts that you throw away and add them to your bills through glossy printing so that you can’t throw them away, something he called TransPromo or Transactional Promotion. Yikes! I can now see a path to everyone getting all their bills electronically.

How much more different could the next speaker be than one who wants to get rid the marketing tactics that breed all things “TransPromo”. Arkadi Kuhlman is the CEO of ING Direct, which is the largest internet bank after 5 years in business and now one of the top 30 banks in the US. All the things that Arkadi talked about were the concepts that Open Source and Web 2.0 espouse. He talked about turning the banking model upside down where banks currently just keep creating more paper and more profit. He chose to operate the company like a modern retailer with high-volume, low cost services. He encouraged the bank to build customer advocacy, aligning itself with the issues that customers care about rather than coerce them and upsell them through TransPromo marketing initiatives. Customers opt-in, not opt-out. This is not just about technology, but in viewing the customer in a different way and AIIM really needs to take this on board.

After that uplifting talk, how low could Microsoft stoop than to give a SharePoint pitch and demo as an industry trends talk? I’ll tell you that I completely rewrote my Web 2.0 presentation to eliminate practically all traces of Alfresco in order to be more neutral and engage in a conversation that is important. I think Jeff Teper could have done the same thing, but he is a busy guy. His nod to wider issues was that other people on the show floor could do the same things as Sharepoint. Jeff did bring up some interesting points on the bifurcation of the Governance and Empowerment cultures and the need to provide the best of both to most enterprises. I read the descriptions of Empowerment as including Web 2.0 features, since later they demonstrated wikis and blogs inside of SharePoint. However, the demo by Group Product Manager Arpan Shah did little to show us how ECM is really going to change except that you can add a wiki and a blog. I’ll write more about this tomorrow.

Later in the afternoon, I went to some of the sessions. I attended Tony Byrne’s session on Convergence of Content and Data as I indicated in my blog. Unfortunately for Tony there were probably only about 20 people in the session, not counting the four panellists and Tony. Far more popular were the getting started sessions and the session on records management. Wilson and I did alright in our session on Web 2.0 and ECM given the overall attendance of the conference. However, Rory Staunton asked the question “Why are you here?” during the question and answer session. “Good question!” I replied. My response was that I was interested in a dialog in what is going to be really important for ECM.

Now I could have gone to the Web 2.0 Expo in San Francisco. Certainly the weather would have been a lot better. However, AIIM is a good show for us. It shows that we are playing in the same market as the large players. It is where we have met many of our OEM customers. AIIM represents billions of dollars in revenues and millions of end users and for that reason they are important. But they have lost the opportunity to engage in the bigger debate of where do enterprises go to go on line and engage in conversation with their customers. How do they take that transactional information and constructively use it to help their customers. It is not through TransPromo! Take a look at the following graphs of the blogs going on around both the AIIM and Web 2.0 Conferences.

AIIM Blogs


Web 2.0 Expo Blogs

Note that there are many times the number of blogs talking about the Web 2.0 Expo and probably tens to hundreds of thousands of readers. This is about the conversations that all enterprises should be having with their customers. Web 2.0 is not about billions of dollars in revenue today, but it will be about billions of dollars in the future. AIIM must release itself from the big ticket machines of the past and look forward to the content-rich services of the future.

Take AIIM on Security

I am off to the AIIM (Association for Information and Image Management) Conference in Boston right now. This is perhaps the largest Enterprise Content Management conference there is. I will be speaking tomorrow on Web 2.0 and ECM with Wilson D’Souza of MIT. Looking through the agenda of the conference, I was looking for sessions on security.

James McGovern has constantly asked me and other ECM vendors to solve security issues for ECM using the standards that have already been developed for web services, such as XACML. Looking at the agenda at AIIM, it doesn’t look like the vendors are taking it quite as seriously as James. James is an enterprise architect and his role is to look at stuff like this.

Trying to address security in some of the standards groups such as AIIM’s iECM initiative and JSR-283, the successor to JSR-170, has been politically tricky. It is difficult to figure out what a common view of security is given all of the different models of security such as Access Control List, Role-based Security and Policy-based Security used in Records Management, let alone all the different vendors’ implementations of each. However, looking at this problem going forward, without addressing and standardizing security, we are creating huge barriers to interoperability and not meeting the requirements of new models of interaction on the internet.

In looking at how new Web 2.0 companies are starting to mash-up and integrate different services, it is hard to see how we can extend these capabilities into  more secure and sensitive services such as eCommerce or bringing these services into the enterprise without a common notion of identity, role, entitlements or membership. As vendors, we either address these issues or, like so many time before, they will be addressed for us by others on the internet and we will be forced to catch up.

I have been doing some background thinking on this and here are some important points that I think ECM vendors need to consider:

• Common identity. There needs to be a common way of addressing identity between different services whether those services are in the enterprise or outside. As we start to bring customers and partners into the process of serving themselves or helping us design new products and services, we can’t just rely on internal directory services. OpenID is the only standard that I am aware of that provides a neutral way of identifying users and is not dependent on any single vendor.
• Common Models for Rights Management. The big, looming problem in content is the fact that huge numbers of users are adding, accessing or updating an even larger number of pieces of content. This calls for a model that controls content through definition of context such as time, location, metadata or role. XACML could very well fit this model. However, users need to understand this model as they set up the controls on the content.
• Distributed Directory Services. Identity is not sufficient for determining roles or entitlements. There needs to be a more open way of integrating multiple directories without revealing sensitive information. This is the same problem we are trying to solve for content and directories need the same mechanism to define access.
• Mashup Frameworks for Security. Mashups, the integration of different systems at the browser level, represent the fastest-growing and easiest mechanism to weld systems together. Almost all mashups have no notion of security and only work on public systems. In addition, they introduce security holes that require code running on other systems since JavaScript security features in browsers prevent parts in a web page from executing between two domains. Google has introduced a mechanism for Gdata and other mashable components to execute code. This type of mechanism needs to be standardized and a model of trusted sources needs to be integrated.
• Search and Security.  As search becomes increasingly federated, such as through the OpenSearch API, managing identity and entitlements on content becomes very problematic. The search sources should filter out any content to which the user doesn’t have access. However, that requires some cooperation with the software that is doing the aggregating and the content sources. ECM systems will probably control the most sensitive information, but this will need to be aggregated with public sources as well to create effective search applications for the enterprise.

Help the process by asking your vendor how they expect to address these types of security concerns. If you are at AIIM, bring the issue in relevant sessions. I don’t have all the answers nor does any vendor. People in the middle of this problem like James can help by bringing up their use cases. If we start asking the questions, then perhaps we can collaboratively answer the questions and solve this problem. If you think standardizing this is hard, try imagining building next generation systems without standardizing these security needs.

Convergence of Content and Data Management?

Tony Byrne announced that he is hosting a panel on convergence between enterprise data and content management and poses it as a question - will structured and unstructured information management converge? My short answer is no, but that answer has a complicated reason behind it. Much of it has to do with the fact that the larger stack of enterprise software is consolidating around it. Here are some of Apoorv Durga's comments on convergence as well.

"Oh really?"

I have lived in both worlds having worked with relational databases since 1977, being one of the founding engineers at Ingres and then co-founding Documentum with Howard Shao. While at Documentum, we explored what content was and how it was different from databases. Over the years my early bigotry in favor of a purely relational view of the world has given way toward a more relaxed view of how content is structure, indexed and managed. While starting Alfresco, we had the opportunity to start from scratch but still used some of the concepts that have proven effective in capturing and delivering information to users.

The relationship between relational databases and content management is like nuclear physics and organic chemistry. Relational database provides the mechanics to make data and information happen and content management builds upon that. Relational databases provide the transaction controls to ensure data integrity, the back-up tools to make sure that information is recoverable, replication to move data from one location to another, and the query, data manipulation and relationship tools to handle much more complex structures. Content management is more like the organic chemistry of information, combining information and relating it to human beings to make it more usable and consumable. The structures, processes, and models of content are different from other classes of information management. However, just like organic chemistry, content management may combine with other classes of application just as relational databases have. We are just missing the standardization and theoretical foundations of content management that have supported relational constructs.

What makes content management different from data management is how close it is to people. To make content useful, the people who create the information need to understand how it will be used. Content needs to be compelling, original, concise and understandable. Content has context that only humans can provide and only humans can use. This means that the services around content are more about change than integrity. Integrity is important, but that’s why the database is there. There is a whole rich set of services there to deal with transformation, change process, classification, publishing, versioning, content to content relationships, links and a whole bunch of other things that databases just don’t "think" about. Search may be yet another system that has no relational database at all, but should use the concepts that have been built up by the content management system. That’s why content management systems are separate systems built upon relational databases and integrated with separate search systems.

Since the inception of content management, the content management vendors have by and large continued to support the notion of a repository sitting on top of a relational database and integrated with a separate search system. Interestingly, many of the main vendors of ECM are now the database management companies - IBM, Oracle, and Microsoft. This should not be surprising since content management is now one of the fastest growing segments of database applications. Even so, these companies have chosen to layer their content management software on top of their relational database systems. The database groups are then free to focus on data management as their core competency. Databases support not just content management, but transactional systems and analytical business intelligence systems. Internal to these companies, the database groups have not really subsumed the content groups. Microsoft flirted with the idea of combining everything into one server group, but unwound that decision to have Sharepoint in the Office group. IBM’s content group reported into the DB2 group, but remained independent and it remains to be seen where it ends up after the FileNet acquisition. Oracle’s content group has wandered all over the organization since Oracle first attempted to build content systems in the late 1980s.

The non-database vendors of content management - EMC, OpenText, Interwoven, Vignette and Alfresco - still use relational databases in the management of content and layer their services above a database. Interwoven tried to not use databases to improve performance in the early days and took a very XML-based approach to managing, categorizing and controlling content, but this ended up being a losing proposition to companies worried about integrity. EMC sees a future that is independent of all these stack war issues in that people will always need storage and that content management is really about managing storage. They are essentially above (or below) the stack wars, but don’t be surprised to see them try to architect the database out of the equation. OpenText, Interwoven and Vignette look to either get acquired or get out of the way. At Alfresco, we believe that open source is the open alternative to the stack wars, which I will speak about later. The motivation of each is not the convergence of content and data, but the consolidation of the ECM stack at one level and the entire enterprise software stack at another with fewer and fewer players.

From Kathy Sierra's blog

What is happening at the macro business layer is that entire application stacks are consolidating to manage the data of record. IBM, Oracle, Microsoft and SAP are all vying to own the data and make themselves as sticky as possible. Each has Service-Oriented Architecture to make it possible to surround that data and to integrate it with other stacks when necessary. Data in the case of content management is simply the data about the content and is not a whole lot different than customer data as far as these stacks are concerned. These stacks need the checklist of the big items that enterprise customers are buying in order to build or integrate applications. This includes relational database, content management, business intelligence, build and test environment, system administration, and all sorts of XML stuff. Most of these, with the exception of IBM, have gobbled up the top application layer including CRM and ERP. SAP flirted with the database layer in alliance with MySQL, but seems to have abandoned this strategy. It could be though content management may be a common stack component if SAP goes out and purchases an ECM vendor. Content has become an important part of the data being managed and these SOA stacks will just link it like any other data.

Despite the relentless consolidation of these stacks, sucking in the ECM market with it, total integration of all systems into a single stack is impossible. At best, these stacks are fighting for a bigger piece of the enterprise pie by displacing smaller players. Enterprises are trying to go from a choice of 25 different systems to 3, but not down to one. Microsoft building Sharepoint organically can exclude other databases other than SQL Server, but lose a chunk of the market in the process. Will IBM really limit FileNet to only DB2? Will Oracle lock Stellent only to its database? Well maybe, but a totally integrated stack does not solve all problems of enterprise process or control. Likewise, SOA has not delivered on the promise of interoperability, despite the billions of dollars spent by IBM, Microsoft and major enterprises. Nor does it move far outside of back-office systems and into the front-office systems and web sites where most of the value is presented to an enterprise’s customers. It does not deliver the conversation with its customers that enterprises are increasingly demanding.

From Kathy Sierra's blog

There is a lot happening out in the world of the Internet that is making this whole notion of data versus content irrelevant. Web 2.0 has moved the conversation from the whole notion of bits and bytes into what matters is the content, people and the relationships between people and content. Web 2.0 says that people don’t care about data and structure, but in communicating with each other and building closer relationships. This notion is seeping into the enterprise software space with the class of software known as Enterprise 2.0. It is still early days, but billions of dollars of value have already been built upon the foundations of Web 2.0 and those foundations are at least 90% open source.

Open source has provided an alternative view of the vertical stacks that are being created by IBM, Oracle, Microsoft and SAP. In this view, open source is the stack and dominated by no one vendor. Each layer of the stack can be substituted with a best of breed open source component. These layers have been constantly rising from the operating system to the database to the app server and now the application layers. These application layers look a lot different than the enterprise stacks though. Rather than integrating at the depths of the infrastructure in a structured SOA, they are “mashing up” near the user and making it much easier for more providers to create new services and applications not depending on any particular stack. In fact, the stack is irrelevant as long as it is freely available. How many people really know what is behind Amazon, Google, Yahoo or Saleforce.com? The answer is a lot of open source, but which open source doesn’t matter a bit to the end users of those systems. At Alfresco, we are one layer in that open source stack and the user is free to choose that component or any other in the open source stack.

I plan on attending this session and seeing what others think.

AIIM - Web 2.0 and Enterprise Content Management

Next week, I'll be in Boston speaking at the AIIM conference there. My topic of discussion is Web 2.0 and the next generation of Enterprise content management. Joining me is Wilson D'Souza from MIT. We will be speaking at 2pm on Tuesday, the first day of the conference. I hope you can come.

As usual, I am putting finishing touches on my presentation. However, I found some interesting material for the presentation from Kathy Sierra's blog. Kathy has been the source of blogging lately because death threats aimed at her by some thugs posting gruesome images in other blogs. This is her first post-trauma blog and includes some interesting charts that illustrate what is going on with Web 2.0. Here is one my favorites from the post because it really hits home what is different for the ECM world. Click on Web 2.0 to see some of my thoughts.

Last Week at AIIM and Java One

I was at AIIM Expo, the largest content management show in the world, last week since I was giving a presentation at the conference on Open Source and Enterprise Content Management. It is unfortunate that both JavaOne and AIIM were at the same time this year, but Kevin Cochrane has JavaOne well covered where things went very well.

My presentation followed a presentation on the Future of ECM, which was a panel session with EMC|Documentum, Oracle and Microsoft and moderated by Russ Stalters. This session was well attended and at capacity in the room. Some of the themes discussed were consolidation of the ECM space around major infrastructure players, open source and new technologies like automatic classification. Since the ECM industry is just now being affected by open source and so it didn't come up naturally, but Russ Stalters asked the question since he is aware of Alfresco. Lubor Ptacek from EMC muttered something about the open source solutions not being complete. Rich Buchheim from Oracle said that open source is okay for small businesses, although he really knows that isn't true (right Rich? ;-) ). The Microsoft guy waffled on something about Google and their hosted office documents, but he did make a joke about saying that he probably isn't qualified to comment since he is from Microsoft.

My presentation was almost as well attended as the Future of ECM. There seems to be as much interest in open source as there is in the future of ECM. The subject matter that I covered was about how open source was going to affect ECM. I covered the history of ECM from my perspective over the last 15 - 20 years, the power that open source is having over enterprise software in general, and the specific affects that open source will have on ECM in the future. You can down load my presentation here. Munwar Shariff from our partner Cignex took some pictures of the session.

 

At the Expo, our booth has to have got to win an award -- for least pretentious and best home construction project. Compared to the multi-million dollar monstrosities of EMC, IBM, Filenet, Kodak, Xerox, etc., I think we only spent a couple of hundred dollars on it. At least you know that our money is going on product rather than fancy marketing. But because we were near the bathrooms, we got pretty good traffic. We got some fantastic leads and keen interest from our attendance. Luis Sala and Martin Musierowicz diligently manned the booth supported by eCopy who was demonstrating integration of scanning with Alfresco. The scanning solution impressed a lot of the system integrators. Cygnex's booth was right across from ours where they were presenting Alfresco training and consulting services.

It was an extremely productive show for us. We got good exposure in the conference, great leads from large corporations, medium size businesses and system integrators. Since all partners meet in one place, it is also a great place to network. In my next post, I will talk about the activities that went on around AIIM iECM.

Things went equally well at Java One for Kevin Cochrane and Jason Hardin. Kevin reported:

• We were the right product at the right time at this show.  We captured much of the excitement and buzz building here at JavaOne. People we saw on Day One talked about Alfresco and brought a portion of our traffic on Day Two and much of our traffic on Day Three.
• 100% open source and charging for support and maintanence right on the money. People loved the model (and yes, nearly all - except maybe two - thought people would be crazy not to buy maintanence).
• JSR-170 support HUGE. It was a point of significant interest. This only reinforced that we must be the best implementation of JSR-170 around.
• People need something simpler than DCTM that is not Sharepoint.  We are hitting the mark here.
• Our current capabilities hit the mark for the majority of expressed needs, and our plans for WCM fill in any and all outliers (very strong need for those with complex web requirements for the versioning capabilities, etc. we are now building for our upcoming release).

Here is a picture of Jason at our booth at the Java One show