Module:   dfmc-reader
Synopsis: A tokenizer abstraction for use by the parser.
Author:   CMU, adapted by Keith Playford
Copyright:    Original Code is Copyright (c) 1995-2004 Functional Objects, Inc.
              All rights reserved.
License:      See License.txt in this distribution for details.
Warranty:     Distributed WITHOUT WARRANTY OF ANY KIND

// Derived from the original CMU code.
//
// Copyright (c) 1994  Carnegie Mellon University
// All rights reserved.

// Tokenizer interface.

define primary abstract class <tokenizer> (<object>)
end class <tokenizer>;
