Content Log

Professional Open Source Software

I am constantly asked about why we put our software out as open source. Is it some sort of altruism? Communism? People who have worked with proprietary platforms may not be familiar with open source and its implications or the advantages or disadvantages for the products they are using or for the users’ organizations.

 

Image under Creative Commons Attribution-Noncommercial-Share-Alike License

Much of the early development of what is now known as open source started with the GNU project by Richard Stallman in the early 1980s to create development tools that emulated Unix, but did not require a license from AT&T or any payment to anyone for that matter. Stallman labeled this “Free Software” and felt that the freedom to use this software was paramount. This early development culminated in the mid-1990s in the creation of a completely open and free Unix-based operating system called Linux by Linus Torvalds under the same license terms as GNU. Torvalds designed Linux to be open and to allow other hackers to contribute to it.

In 1999 at the inspiration of Eric Raymond and his book “The Cathedral and the Bazaar” and through the organization of Tim O’Reilly, the community of developers and hackers who had created this free and open software decided to call the movement “Open Source”. Raymond’s and others’ reasoned that “Open Source” would be clearer to the potential users of the software and less threatening to businesses. This change was also timed to coincide with the release of the Netscape browser and the creation of the Mozilla Foundation.

Not long after this, open source got a huge boost when IBM changed strategy of building proprietary Unix systems and decided to adopt open source and Linux as a means of competing against Sun and others in the development tools market. IBM started actively contributing to the Apache project, a collection of open source tools and the most wide used web server. By contributing to Apache, IBM did not have to reinvent tools for integrating with various web technologies and actually benefited from the development as others, just as others had benefited from the IBM’s contributions. Before long, other large vendors started actively contributing to open source.

This also set the stage for start-ups in the early part of the 2000s to create businesses based upon open source and to employ a professional open source business model. MySQL was a database system originally developed in the early 1990s and had used the GNU GPL license to distribute their software. When Martin Mickos became CEO in the 2001, he helped develop the dual license business model of distributing a GPL-version of the software and selling ordinary software licenses to those who wanted support or wanted to distribute their software without the GPL license. Shortly after this, Marc Fleury took his JBoss application server and licensed it under the more liberal LGPL or Lesser/Library GPL license. JBoss raised venture capital and started to acquire other Java-based projects. Both companies thrived in a down economy proving the value of distribution via the open source model and developing business through selling support and services.

• Open source became a change or really a revolution in business model and means of production rather than anything technological. It is underpinned by three main principles:
• Opening intellectual property and transparency spreads faster than concealing intellectual property and builds a bigger pie
• Share and share alike of intellectual property will grow that intellectual property faster
• We should all reuse other people's intellectual property and stop wasting time re-inventing the wheel

This change in business model led to a flurry of start-ups to use open source as their preferred distribution model, including Alfresco in 2005. The advantages of this approach became clear with the success of Linux, MySQL, JBoss and others. These include:

• Broad distribution of product through internet download
• The ability of users to try the product before buying, eliminating much of the sales and demand generation activities of ordinary enterprise software
• Much broader testing and code review of products in the beta and product phase of development
• Word of mouth marketing and open source meet-ups reducing the cost of marketing
• Lower cost of development through use of other open source components and contributions from the many extensions that users create
• Bug fixes from users end up fixing problems themselves

The benefits to the user and business community also became clear:

• Users were not locked into a proprietary platform and they were free to use the open source version of the product
• The vendors providing these products were the support source upon which they could rely if they needed fixes, advice, warranty or indemnity
• The open source vendors were held more accountable than the proprietary vendors since there was always the possibility to switch back to the free version
• Users could see the source code and either make the minor changes they wanted without waiting for the next release or even change wholesale parts of the product
• Because of the lower cost economics and economies of scale of open source distribution, the lower cost of product was passed on to the consumers of services
• The transparency of open source means that there is greater visibility of changes coming and what bugs already exist
• Through the community and transparency aspects of open source, the users played a more intimate role in the development of the products with a greater influence on product direction

There are lots of open source programs and projects out there and many of them are terrible. However, open source works well when software is a commodity and you cannot tell one piece of software from another - e.g. word processors, web browsers, operating systems. When software is a commodity, you are paying only for a brand where the company is getting money for no changes in the software. Professional open source works well when enterprise software is commoditized. Alfresco was created because of the increasing difficulty in differentiating one enterprise content management system from another.

Open source development is painted as chaotic and unreliable by proprietary, but in reality it is generally just as controlled as any other project. There are project leads that make decisions and no more than a handful of people developing it. Sometimes these developers can come from more than one company. This is made easier because there are no secrets or intellectual property to hide. However, the project leads have the final decision on what goes in or out. There can, however, be many times more testing involved than ordinary software. In most successful open source projects, you can have hundreds of people downloading the software and testing it out and sometimes even providing fixes because they could see and fix the source code.

In order to make this process work, somebody must pay for it. Usually an open source company is in markets directly adjacent to the software, such as system integration. By supporting Linux, IBM makes its money by selling hardware that runs Linux and selling consulting services to build solutions for customers. IBM has a huge patent portfolio, but they make twice as much money selling hardware and services around open source than they make from licenses from their patents.

More recently, projects that had been purely community-driven are seeing the opportunity to create a professional open source company that is closely associated with the project. A couple of years ago, Dries Buytaert got funding for Acquia to create professional services around Drupal, the open source web content management project that he started in 2001. Recently, some of the core committers of the Lucene and Solr projects have created Lucid Imagination to provide support and enterprise features on top of those two open source projects. The demand was there in much the same way that previous professional open source project have seen for support, bug fixes and features. They also have fit into categories that are consolidating and commoditizing.

Alfresco Software makes money by selling technical support on the Alfresco system. Not everyone wants or needs support, but it isn’t necessary for everyone to want it. With over a million downloads, a small percentage of users who need support in a product environment, especially in the Global 2000, are sufficient to support the community, the project and the company. By participating in the $4 billion enterprise content management market, Alfresco has sufficient scale to continue growing and service the open source community and product.

Follow me on Twitter @johnnewton

New Alfresco 3.2 was designed for the Great Recession

Back at the height of the market downturn in October, we looked at how Alfresco should address the rapidly changing economic situation. Rather than being pessimistic, we believed that this was a real opportunity for us. Times like these wipe the decks clean and provide openings for companies that provide value for money and can replace existing older technologies. This is the fourth recession in my career and what past experience has shown is that management and IT are under pressure to do more with less, cut costs, make remaining people more productive, and implement new technology if there is a clear zero-sum gain in cost reduction. Regulation also always comes after the disaster hits, but the new regulatory regime must be addressed with fewer resources. It seemed like a perfect time to be in open source!

Today we are releasing Alfresco Community Edition 3.2 and it really is an ECM designed for the Credit Crunch. We have been expanding the capabilities that generally been out of reach of anyone who could not afford a traditional ECM system, but who can now use one to reduce costs, improve productivity, reduce long-term costs of development of content applications or prove compliance. This release tackles  records management capabilities, handling and archiving of emails, mobile access for the worker on the go, the latest and greatest implementation of CMIS, and new extranet collaboration capabilities. All of these are targeted at what we felt would be important factors in a lean economic environment. All are also available as open source to help reduce the cost of managing content in enterprises struggling to do more with fewer resources.

New records management capabilities are very important for us, because this is the platform with which we will be going to the US government to certify for DoD 5015.2, but also because it provides a level of control that any organization facing regulatory requirements will find useful, such as life cycle management, retention policies, review process and disclosure and transparency controls. Built upon the new Share and SURF platforms these records management capabilities are the basis for a new records management application that is planned for certification at the end of September. To support this, we have added a new interactive forms system based upon the Yahoo YUI Ajax library and now allows both types and aspects to be applied and used in Share, including new records or regulatory metadata. By basing these capabilities on Share, we get a lot of the benefits of Share, including in browser viewing without downloading the record, URL-addressability of records information, and collaborative capabilities such as commenting, tagging and discussions. A new import and export capability is designed to simplify archiving records sets and import them to separate records repositories if necessary. A new records life cycle management automatically handles the physical storage of records to offline or tertiary storage. This is also the first records management system designed to be queryable by the proposed OASIS CMIS standard.

New records capabilities are destined for DoD 5015.2 certification

Related to and required by records management is a new ability to manage and archive emails using the IMAP email protocol. Virtually any email client can access, archive and categorize documents, records, attachments and other content with no plug-in required, because the Alfresco repository supports the IMAP protocol natively just as it does CIFS, WebDAV and NFS. This email integration is designed for two purposes. The first is for archiving and managing email, especially records. This interface allows you to manage email according to your organizational policies. If the policy is to archive everything and figure out organization later, the Alfresco rules can accept all content and can invoke rules to help organize, classify and apply the appropriate retention policies. However, if it is important for users to help classify the email as records, then users can drag and drop emails into the appropriate repository folders within their standard email client.

Manage and archive emails as records or access Alfresco from your email client

The second purpose for IMAP integration is to allow users who live in email to be able to access content from the repository without leaving email. Most browsers are IMAP capable, such as my Mac Mail client, and we have done extensive testing on Microsoft Outlook. Metadata and context of content is presented to the user with Freemarker script templates, which are very easy to configure. This metadata appears as email text in folders from the repository and the actual content appears to be an attachment to the email. This makes it easy to forward or send documents as either simple attachments or who content with metadata. It is also easy to use Alfresco from devices designed specifically for email such as the Blackberry, iPhone, Palm Pre or other mobile mail devices.

Every recession seems to create a step change in technology usage and this recession is probably no different. Smart phones now outnumber the number of laptops sold and for many tasks they can be just as effective. That is why we felt that content will be increasing consumed, processed and created on these small devices. However, the smaller form factor means that you can’t just take a big app and make it smaller. With Alfresco 3.2, we have looked at the tasks that people perform today and what content management tasks they could perform on mobile devices. The result is a version of Alfresco Share designed to fit the form-factor of these new smart phones, starting first with the iPhone. According to StatCounter, between the iPhone and iTouch, Apple has approximately 37% of the mobile browser market. It is also the first ECM application designed for business processes on the go. We have focused not only on browsing and access of content, but also on the business processes by allowing users to start and track workflows and activities around content collaboration.

Alfresco Share is now designed for use on the go with the Apple iPhone

This release also has the most complete implementation of the latest release of CMIS, version 0.61 of the OASIS CMIS Technical Committee, of which David Caruana and I are members. We have implemented both the REST-based Atom Pub and SOAP Web Services protocols. Dave has spent a lot of time on these capabilities and it is the future of our API. A lot of the work has gone into the new query language that provides SQL-like query capabilities along with other capabilities that had previously required using Lucene. Alfresco’s implementation of CMIS has been the basis of integrations with Joomla, Drupal, Atlassian’s Confluence, CMIS Spaces and CMIS Explorer and we expect more in the future. Dave and Gabriele Columbro are planning on contributing some our experience to the  Apache Chemistry project. Dave is hoping to contribute our CMIS client test harness, which may be used against any CMIS and currently contains over 100 tests covering all aspects of the spec including schema validation.

Some of the CMIS integrations to Alfresco include Joomla, Drupal and Confluence

Following release of Share last year and updates earlier this year, we have added a number of capabilities to support the use of Share in an extranet in order to provide content collaboration outside the enterprise firewalls or in the cloud. We have been testing scaling Share to tens of thousands of concurrent users. Since extranet use cases are more people-oriented, we have extended the contextual information available about users in the users profiles. We have also simplified the administration of users, groups and sites from a new administration framework integrated into Share. Share can also take advantage of some of the advanced metadata management capabilities of the Alfresco repository with the new forms system mentioned earlier and explicit support for types and aspects in Share. Some of the new user interface components available include Content Favorites and a new Image Gallery. This release of share is Cloud-ready for EC2 and other cloud services.

Alfresco’s Web Content Management Platform has been improved to support larger authoring and deployment environments better. A new parallel deployment engine uses multi-threaded updates to web farms for higher performance updates of web sites. A new web clustering architecture allows authoring installations to scale to more users and allows the deployed servers to also be clustered for shared services. A change to the architecture of previewing means that changes to either content or even code can be instantaneously previewed in a test environment. Improved rendering and transformation of web content provides better support for XML includes, XSL transforms and execution of Freemarker and Web Scripts in the web tier. A new pluggable deployment architecture allows you to deploy to multiple delivery environments such as to file systems, other Alfresco servers or external and web-edge delivery channels.

New WCM capabilities include better scaling of authoring environment and new parallel deployment to web farms

Sorry for the long post, but there is a lot that we have been working on while the Great Global Recession has been raging on. Our goal has been to help you cut costs of traditional ECM, improve your productivity through mobility and efficiency in handling content, address new compliance issues with the first open source records management system, help tame the great email beast, and engage your customers, partners and employees with new WCM and extranet capabilities. We also hope to future-proof your content applications by delivering the first and best with CMIS implementations as they appear from the OASIS technical committee. Last year, we showed you how we can save costs by providing apples to apples comparisons between ECM vendors using the US GSA Schedule 70 pricing. Now we hope to help you beat even those saving with new capabilities that we are releasing with the Alfresco Community 3.2 download. We hope you give it a try at http://wiki.alfresco.com/wiki/Download_Community_Edition

Follow me on Twitter @johnnewton