Blunder Dome Sighting  
privacy 
 
 
 

Hangout for experimental confirmation and demonstration of software, computing, and networking. The exercises don't always work out. The professor is a bumbler and the laboratory assistant is a skanky dufus.



Click for Blog Feed
Blog Feed

Recent Items
 
Steve McConnell Beyond Myths of Rapid Development
 
The Distraction of User Personas?
 
Magical Thinking and the Universal Document Elixir...
 
My FUD is FUDDier than your FUD, so FUD this!
 
Agile Scope-Creep and How to Detect It
 
Sending Orcmid to (Code) Camp
 
Relaxing Patent Licenses for Open Documents
 
Navigating Data Models
 
Assessing Open Source for Corporate Usability
 
Safe Software: Getting Easier?

This page is powered by Blogger. Isn't yours?
  

Locations of visitors to this site
visits to Orcmid's Lair pages

The nfoCentrale Blog Conclave
 
Millennia Antica: The Kiln Sitter's Diary
 
nfoWorks: Pursuing Harmony
 
Numbering Peano
 
Orcmid's Lair
 
Orcmid's Live Hideout
 
Prof. von Clueless in the Blunder Dome
 
Spanner Wingnut's Muddleware Lab (experimental)

nfoCentrale Associated Sites
 
DMA: The Document Management Alliance
 
DMware: Document Management Interoperability Exchange
 
Millennia Antica Pottery
 
The Miser Project
 
nfoCentrale: the Anchor Site
 
nfoWare: Information Processing Technology
 
nfoWorks: Tools for Document Interoperability
 
NuovoDoc: Design for Document System Interoperability
 
ODMA Interoperability Exchange
 
Orcmid's Lair
 
TROST: Open-System Trustworthiness

2005-11-30

 

Open Standards are not Open Source

In discussions on the creation and use of public standards for document formats, there seems to be some cultivated confusion around what the actual conduct of standards-creating organizations is and how public specifications for industry standards are arrived at and used.  I see blurring of the differences between specification of standards, the sometimes-open development of open-source software, and the creation and distribution of (open-source) software that conforms to a standard. 

To clarify how industry standards organizations operate in practice, I have compiled a summary of the four organizations that commonly figure in discussions of document-format standards: ISO, ECMA, OASIS, and the W3C.  I have added IETF, my benchmark for open process, for comparison purposes.  The summaries are in an appendix at the end of this article.

Using Specifications of Standards

Without exception, the specifications of standards are copyright by the issuing organization (and sometimes others).  All rights are reserved.

Without exception, there is no blanket permission to make derivative works of specifications.  The W3C provides a license for creation of derivative works under specific conditions related to documenting, discussing, and explaining a specification.  The OASIS OpenDocument specification carries a comparable limited permission that is specific to that document.

Of course, the whole point of creating a standard is to have a fixed, shared specification for what it is.  Allowing arbitrary derivatives and the prospect of “forking” a standard is not something that fits with the established approach to formal standardization.  Those who want community-owned specifications to be as malleable as open-source software need to find an avenue that does not involve a formal standards-development organization.

Using Schemas Provided with Standards

Typically, schemas are incorporated in the specifications, a practice that began with the specification of protocol and document data units in ISO specifications (Using Abstract Syntax Notation 1, ASN.1 and also various versions of Backus-Naur Form before that). 

In the case of schemas that can be used directly with software, the schemas of interest for office documents carry notices of copyright with all rights reserved.  There are no blanket permissions for derivative works of any kind.  It would appear that translating the RELAX NG schema for OpenDocument to an XML Schema might constitute creation of a derivative work, as would going in the reverse direction with the Microsoft Office 2003 XML Reference Schemas.  It would be surprising for a complaint to arise in either case.

Developing Software That Conforms to Standards

It is customary for the specification of a standard to stipulate what constitutes conformance to the standard.  There are often specific, measurable qualities involved.  It is also customary, in the case of software, to specify aspects that are not constrained by the specification or that are left for resolution by individual implementations.  These conditions establish what it means to claim that a software product conforms to the specification and can be important in specifying and selecting products for procurement.

For specifications that involve computer software (e.g., programming languages and document formats), there are two levels of conformance that are important: (1) the conformance of data streams to the format and (2) the conforming behavior of processors when accepting and producing those data streams. 

For example, the OASIS OpenDocument specification section 1.5 provides definitions for conforming documents and for conforming applications.  The definition for conforming document is straightforward and tolerates the presence of foreign extensions (proprietary or otherwise).  The definition of conforming application does not specify a minimum set for document features that must be accepted and realized in conformance with the standard.

Specifications that are realized by software are unlikely to specify or prohibit a particular software-development methodology or economic regime.  Although some organizations introduce requirements for conformance certification, for labelling, and for technology licensing, that is not the model of the organizations appraised here.

Patent Claims Against Implementation of Standards

It is possible that the implementation of software that conforms to a standard may infringe on patented technology.  All standards-promoting organizations are sensitive to this prospect.   Although it is not possible to know for sure that no encumbering patent has been applied for or issued, all of the five organizations take steps to make sure that specifications can be implemented without infringing on essential claims of a known patent.  In particular, the contributors to the specification must disclose any of their patents that may be applicable (and non-contributors are not so constrained, of course).  If it is not possible to avoid patent infringement, each organization places conditions on availability of licenses so that the specification remains usable.

The W3C requires that all applicable patents with essential claims have royalty-free licenses for implementations of the specification.

For the other organizations, Reasonable and Non-Discriminatory (RAND) license terms are tolerated.  For OASIS, an individual technical committee can specify whether the specifications it produces require royalty-free licenses or whether RAND terms are acceptable, or both.  The OpenDocument Technical Committee operates under royalty-free requirements.

In all cases the license is with respect to implementation of the specification and not with regard to any other software that may involve the patented technology.

Compatibility of Specifications with Open-Source Licenses

Although there are open documentation licenses, including the well-known Creative Commons licenses for copyrightable works, none of these standards organizations produce documents under such licenses.  And, since the specifications are not software, open-source software licensing has little bearing.

In general, these specifications must be considered to be neutral with regard to software development methodologies and licensing of software distributions and source code.

The difficulty is with regard to any patent licensing and the form of license provided by individual (prospective) patent holders.  Some licenses, even if royalty-free, may require explicit notice including notice of the limitations of applicability of the license.  Some licenses, even if royalty-free, require explicit written application and issuance of the license.   An example of this is the license provided by RSA Security Inc. with regard to implementations of the OASIS SAML Specification.  The conditions on such licenses may limit public distribution of source code and may also prohibit sublicensing.

Although requirements for notice of patent licenses and prohibitions on sublicensing, even when royalty-free, are considered inimical to use of the GNU Public License (GPL) in all of its forms, these requirements have an important practical purpose.  They prevent the license from being adhered to software that does not implement the specification and they caution users of the source programs of the limitations surrounding the license.

Open Processes in Specification of Standards

There are varying degrees of of open-ness in how specifications for standards are produced. 

First, some standards-development activities are highly transparent and visible.  IETF working groups are conducted in public and documented in public.  OASIS working groups are documented in public although meeting and conference-call minutes are not necessarily detailed in their accounts of technical deliberations.  W3C working groups preserve a public record, but it need not be public during development of the specification.  ECMA and ISO have documentation requirements that are satisfied essentially internal to the subcommittee operations.

With regard to participation and approval processes, there is greater variation among the organizations.  With the exception of the IETF, which has open participation in working groups, the ability to participate in and influence the technical work is governed by membership requirements, attendance conditions, and the payments of appropriate fees.  OASIS does provide a low-cost membership for un-affiliated individuals.  The W3C may invite participation of experts and academics not affiliated with member organizations.  The actual voting procedures vary at the technical working-group/subcommittee level.  Approval of a specification for issuance is done above the level of individuals, involving member organizations.    

Inventing Versus Ratifying

The invention of standards by standards committees came in disrepute in the period of emergence and then deterioration of the Open Systems Integration suite of standards (under ISO) and the emergence of Internet standards (under IETF).  It’s not as black-and-white as that, but it illustrates the different ways that standards arise. 

In some cases, one ratifies a specification that has been developed privately or by a small community.   In this case there is an existing proposal that is refined to satisfy requirements for usability as a public standard.  There is also some public interest to be served by having such a standard specification.  There is usually an important industrial/commercial interest in having an agreed specification (for the production of audio cassette tapes and recordings, for example) that competitive products will be developed against.  There may have been a private contribution (from Philips, in the example of audio cassettes) and the standard basically ratifies that contribution as a public specification.   An important contribution of industry standards organizations, in this case, is avoiding any improprieties with regard to anti-trust and anti-competitive regulations.

Many successful standards in computing and information technology began life as ratifications.  In some cases there was need to reconcile divergent approaches, but the ratification process was for the purpose of providing a single foundation.  This applies to programming-language standards and other protocols.  The heavy work in development of a ratification is in abstracting and specifying the standard in a reusable way, stripped from any specific implementation that was the inspiration (but not so as to invalidate that implementation).  Developing a solid specification is laborious even when little invention is required.

There are also important invented standards in our field.  The American Standard Code for Information Interchange (ASCII) was such a standard.   It satisfied an important need and it did not ratify an existing code.  ASCII’s descendant, Unicode, is also an invented standard developed and maintained by a consortium.

The IETF is not adverse to inventing standards, although its stringent ratification process is dependent entirely on multiple, successful, interoperable implementations and stability over time.  

For ratification of a standard for a particular purpose, ECMA International is an appealing and experienced organization.  It is an appropriate venue when the work involves creating and reconciling an usable specification of something that exists, such as an open, legacy-preserving format for Microsoft Office documents.  This is different than a public effort to arrive at some sort of universal format or even a preferable format for new applications and new kinds of document interchange.

OASIS and W3C may invent standards in an area of need.  They may also accept proposals that are the basis for development and ratification of standards derived from existing implementations (as was the case with the OASIS Open Office XML Format committee, officially renamed OpenDocument in January 2005).


Standards Organizations

This material is extracted from an extended analysis of the Microsoft Office XML and OpenDocument Format efforts.

  • IETF: The Internet Engineering Task Force.  <http://www.ietf.org>
        The IETF is an activity of the Internet Society (ISOC).   The IETF fosters standards related to the protocols, procedures, and conventions that are used on the Internet.  The process for developing standards is community-based and must undergo progressive maturation through defined stages.  All standards-track progression is dependent on the existence of implementations and demonstrated interoperability.  
         Working groups conduct operations on e-mail distribution lists, are generally open, and all communications and documents related to the development of IETF specifications are publicly archived.   Membership in working groups is by voluntarily-participating individuals who are willing to contribute under the IETF's intellectual-property conditions.
         IETF Specifications (known as Requests for Comment, RFCs), are copyright by the Internet Society.  All rights are reserved and there are restrictions under which derivative works are permitted.  The IETF requires that patents having essential claims be available under fully-disclosed Reasonable and Non-Discriminatory (RAND) license terms.
         Because of the community participation, open conduct, and progressive maturation of implementation-confirmed specifications, the IETF process is respected and considered quite successful.  All RFCs are available on-line and the official version of a standards-track RFC is always in an ASCII text-file format.  Document formats are not the normal purview of the IETF, although the IETF processes are an useful benchmark for "open standards."  The IETF process defines "open standards" of others to include ones by international standards bodies (e.g., ANSI and ISO) and various national and international groups (e.g., W3C, OASIS, and ECMA).
        
        
  • ISO: The International Organization for Standardization.  <http://www.iso.org>
         ISO is, speaking informally, a federating organization that provides development and ratification of standards proposed by recognized national standardization authorities (ANSI in the USA, SCC in Canada, BSI in the United Kingdom, etc.).  OASIS and ECMA International are international organizations that have liaison status with ISO.  Document-format standards are most likely produced in ISO/IEC Joint Technical Committee 1 (JTC1).  The likely subcommittee is ISO/IEC JTC1 SC34 for Document Description and Processing Languages, where 46 standards are supported, starting with ISO 8879:1986 for SGML.  It is conceivable that specific formats will be assigned to other subcommittees.  There are substantial liaison activities among ISO Technical Committees and external organizations as well.
         There are no individual memberships in ISO, and participation in technical work is via representatives of participating standards and liaison organizations.  In many cases, proposals and completed work are brought to ISO after development in another organization (including OASIS and ECMA).  There are minutes and other records of process but for the most part the technical discussions are not public and there is no direct public comment provision in the usual sense (since ratification is by member bodies, not individuals).
         Although ISO standards exist for well-known elements of information technology (C++, SQL, MPEG, Relax-NG, C# and the CLI, etc.), most of the standards are relatively inaccessible and expensive, especially for individuals.   All specifications of ISO Standards carry an ISO copyright with all rights reserved.  ISO/IEC requires worldwide reasonable and non-discriminatory (RAND) licensing availability for any patented technology that is essential in the implementation of an ISO/IEC standard.
         Recently, a body of ISO/IEC JTC1 standards have been made freely available for anyone to download in electronic form, and some of these will be of interest to software developers: <http://isotc.iso.org/livelink/livelink/fetch/2000/2489/Ittf_Home/PubliclyAvailableStandards.htm>.

        
  • ECMA International.  <http://www.ecma-international.org/>
         The members of ECMA International are companies and organizations (including non-profits such as the U.S. NIST, OMG, Mozilla, and Monash University),.  ECMA is not a trade association in the usual sense (in contrast with AIIM International, for example).  The primary purpose of ECMA is the development and publication of standards and technical reports in the fields of information technology, communication technology, and consumer electronics.  Annual membership for the smallest for-profit business category is almost $3,000 US and permits participation on a single technical committee, with voting rights at that technical committee.  There is no fee for non-profit organizations.
         One appeal of ECMA is its success in creating fast-track processes that culminate in rapid adoption at the ISO level.   Over 80% of the 250 fast-tracked ISO/IEC standards were proposed by ECMA, and 2/3 of the 450 specifications developed by ECMA since 1961 have been promulgated as ISO specifications (standards and technical reports).  ECMA promotes the fact that its process minimizes the risk of changes to a submitted specification and that it tolerates Reasonable and Non-Discriminatory (RAND) availability of patented technology (although any contributor could make royalty-free provisions and other reassuring covenants, as Microsoft proposes to do).
         ECMA reports that ECMAScript is its "greatest hit" along with C# and the CLI specifications.  Further harmonization with JavaScript and JScript and other developments are continuing, including integration of E4X, the ECMA specification of ECMAScript for Native XML.  ECMA has developed media standards as well as standards for file structures.  There is current activity on a universal format for interchange of three-dimensional computer-aided-design data for visualization and repurposing.
         The working processes of ECMA technical committees are not public.  Completed standards and technical reports are public and freely available as on-line electronic documents.  Downloaded ECMA specifications (in Adobe PDF format) do not appear to carry any intellectual-property notices which, by international rules, means that they are copyrighted and no rights are transferred.
        
  • OASIS: Organization for the Advancement of Structured Information Standards.  <http://www.oasis-open.org>
         The members of OASIS are companies and organizations (including individuals and non-profits such as the Arizona Supreme Court, OMG, Bruce Garner, and MIT),.  The primary purpose of OASIS is development and adoption of e-business standards.  There is a substantial and diverse membership.  Annual membership for the smallest for-profit business category is almost $3,000 US.  Non-profit organizations are charged a $1,000 membership fee.  There are also reduced fees of $250 US for certain unaffiliated individuals and also for small businesses that qualify at a special associate level.
         OASIS is known for its work in SGML and in XML, including OpenDocument and other document-centric specifications.
         The working processes of OASIS technical committees (TCs) are public.  All committee e-mail archives, minutes, and other materials are stored on OASIS-approved web sites and are available to the public.  There are provisions for E-mail submission of public comments on approved materials and materials under public review.  Technical committees may also provide public-discussion forums at earlier stages of standard development.  There are attendance/participation requirements for voting membership at the technical committee level, and individual members of OASIS are eligible to participate as technical-committee voting members along with employer-approved participants from OASIS member organizations.
        OASIS Specifications are copyright OASIS Open with all rights reserved and with possible notices of other copyright holders (the case for OASIS OpenDocument).  Participants and contributors make non-exclusive, perpetual transfers to OASIS.   Newly chartered OASIS Technical Committees may elect to operate under RAND patent licensing requirements or requirements for royalty-free (RF) licensing with or without additional RAND conditions applicable.  Current TCs must transition to one of those forms, and Technical Committees currently operating under royalty-free (RF) requirements, such as the OpenDocument TC, must transition to one of the new RF forms by 2007-04-15.
        
  • W3C: The Worldwide Web Consortium.  <http://www.w3.org>
         The W3C is a consortium with full-time staff and offices around the world.  W3C is administered by MIT, ERCIM, and Keio University.  Members, staff, and the public collaborate to provide standards for the web.  There are over 400 member organizations.  The lowest annual membership is currently over $6,000 per year.  There are conditions under which unaffiliated individuals and academics may participate as invited experts.
         W3C is known for its work in Web technologies, including HTML, XML, and a portfolio of specifications designed to lead to the Semantic Web.
         The working processes of W3C technical committees (TCs) involves operation under a public charter.  Communications within the group may be restricted to members-only (depending on the charter) although public forms of key materials are provided at some point. 
         W3C Specifications are copyright by W3C with all rights reserved.  There are specific disclaimers and a license statement.   Derivative works of specifications are generally not allowed without prior written permission of W3C.  The W3C requires that patents having essential claims applicable to a W3C specification be available on a royalty-free (RF) basis.  Software components and utilities provided by W3C are free and, when open-source, released under GPL-compatible licenses.
     

 
Construction Structure (Hard Hat Area) You are navigating Orcmid's Lair.

template created 2004-06-17-20:01 -0700 (pdt) by orcmid
$$Author: Orcmid $
$$Date: 10-04-30 22:33 $
$$Revision: 21 $