codesimian
Class Compile.TokenizeCode

java.lang.Object
  codesimian.CS<CSGeneric>
      codesimian.DefaultCS
          codesimian.Compile
              codesimian.Compile.TokenizeCode

All Implemented Interfaces:

CodeSimian

Enclosing class:

Compile

public static class Compile.TokenizeCode
extends Compile

                Converts a STRING of CodeSimian code to a list of STRINGs - tokens of code.
                Ignores whitespace.
                TokenizeCode is the first of 3 steps in the default CodeSimian compiler.

                param1 is a STRING of CodeSimian code.
                param0 is a list of (STRING) tokens from that code, created by DForProxy().

                Example: The TOKENS of:
                +#nameOfThisPlus$300(3 nameOfThisPlus  'string lit' 5 )
                are these STRINGS...
                +, #nameOfThisPlus, $300 (, 3, nameOfThisPlus, 'string lit', and ).

                4/06 I'm adding semicolon ; to the syntax.
                Any quantity of semicolons may precede # ( or ) and it is one token.
                9/06 Strange errors occur when I coded that, so I'll wait to build that
                until the first compiler (of codesimian code) made only of codesimian code is created,
                and not that simple one:
                        compilerPipeline(  0 "sound(sine(count))" tokenizeCode(0 0)
                                tokensToObjects(0 0) parseObjects(0 0)  )
        

Nested Class Summary

Nested classes/interfaces inherited from class codesimian.Compile

Compile.CompileDefaultCommand, Compile.CompileLiteral, Compile.CompilerPipeline, Compile.FirstCompilerThatWorks, Compile.LParenSymbol, Compile.MyFuelSymbol, Compile.NameSymbol, Compile.ParseObjects, Compile.ParseObjectsByPriority, Compile.RParenSymbol, Compile.SimpleCompiler, Compile.SmallSymbol, Compile.Symbol, Compile.TokenizeCode, Compile.TokensToObjects, Compile.WhitespaceSymbol

Field Summary

Fields inherited from class codesimian.Compile

LPAREN, MYFUEL, NAME, RPAREN, TEMPORARY_PARAM, WHITESPACE

Fields inherited from class codesimian.CS

DESCRIPTION, END, EXECPROXY, HEAP, JAVACODE, NEWINSTANCE, NULL, PARENT, PARSEPRIORITY, PREV, TESTER, THIS

Constructor Summary

Compile.TokenizeCode()

Method Summary

double	cost() cost() should be changed to return a float, and should be renamed to costToExecute() cost of EXECUTING this CS, not including any CSs it executes recursively.
java.lang.String	description() a short description of this CS, shorter than the javadoc, but long enough to tell what the params are for.
double	DForProxy() Execute this CS and cast to double.
java.lang.String	keyword() For the CodeSimian language as a String. CodeSimian language keyword, like "+" "*" "max" ">" etc. Override this function if you want to specify a keyword other than how I derive them from the class name, like + for Add. Some CSs might never be intended to be used in the language by their keyword. The best example (4/05) is Num, because it is used in the language like "3.4" instead of "num()".
S	stringOfSemicolonsThenSymbol(int semicolons, char symbol)

Methods inherited from class codesimian.Compile

javaCompile, javaCompileSelf, javaCompileSelfSaveJar, javaCompileZipBytes, minP

Methods inherited from class codesimian.DefaultCS

B, C, countP, decrementMyFuel, deleteP, F, fuel, getExec, getObject, heap, I, indexP, indexPName, insertB, insertC, insertD, insertF, insertI, insertJ, insertL, insertL, insertL1, insertP, insertS, insertZ, J, javaCode, LForProxy, LForProxy, myFuel, name, newInstance, objectToCS, objectToCSArray, objectToCSArray, P, prevD, prevL, PType, S, setB, setC, setCountP, setD, setD, setExec, setF, setFuel, setI, setJ, setL, setL, setL, setL1, setMyFuel, setName, setObject, setP, setPrevExec, setPType, setS, setZ, start, toString, V, Z

Methods inherited from class codesimian.CS

addB, addC, addD, addF, addI, addJ, addL, addP, addP, addP, addP, addP, addS, addZ, BForProxy, CForProxy, clone, D, deleteP, FForProxy, GETB, GETC, GETD, GETF, GETI, GETJ, GETL, GETS, GETZ, IForProxy, isIllusion, JForProxy, L, L, L, L, L, maxD, maxP, minD, overwrites, parent, parsePriority, PB, PC, PD, PF, PI, PJ, PL, prevB, prevC, prevF, prevI, prevJ, prevS, prevZ, proxyOf, PS, PZ, reflect, reflect, reflect6, setB, SETB, setC, SETC, setCost, SETD, setDescription, setF, SETF, setHeap, setI, SETI, setJ, SETJ, SETL, setL, setL, setParent, setParsePriority, setProxyOf, setS, SETS, setTester, setZ, SETZ, SForProxy, tester, toJavaCode, VForProxy, voidReflect, ZForProxy

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Compile.TokenizeCode

public Compile.TokenizeCode()

Method Detail

DForProxy

public double DForProxy()

Description copied from class: CS

Execute this CS and cast to double.

D() and DForProxy() are the 2 most important functions in CS. They execute this CS. All other execute functions, by default, return DForProxy cast to their own type.

For example, J() calls the proxy which calls JForProxy() which calls DForProxy(). D() calls the proxy which calls DForProxy().

By default, all other primitive EXECUTE functions defer to D.
Functions that EXECUTE this CS: L(Class) L(int,Class,int) Z() B() C() S() I() J() F() D() V()

Specified by:

DForProxy in class DefaultCS

stringOfSemicolonsThenSymbol

public S stringOfSemicolonsThenSymbol(int semicolons,
                                      char symbol)

keyword

public java.lang.String keyword()

Description copied from class: DefaultCS

For the CodeSimian language as a String.
CodeSimian language keyword, like "+" "*" "max" ">" etc.

Override this function if you want to specify a keyword other than how I derive them from the class name, like + for Add.

Some CSs might never be intended to be used in the language by their keyword.
The best example (4/05) is Num, because it is used in the language like "3.4" instead of "num()".
Default: Returns class name, minus package name (and its dots), and change the first letter to lowercase.

For example, CS.MaxParams does not override keyword(), which returns "maxP".

Overrides:

keyword in class DefaultCS

See Also:

CS.parent(), CS.newInstance(), CS.name()

description

public java.lang.String description()

Description copied from class: CS

a short description of this CS, shorter than the javadoc, but long enough to tell what the params are for. Example use: in automatically generated webpages for CodeSimian. Example: "returns sum of all params" for Add.

Overrides:

description in class DefaultCS

cost

public double cost()

Description copied from class: CS

cost() should be changed to return a float, and should be renamed to costToExecute()

cost of EXECUTING this CS, not including any CSs it executes recursively. The INTERNAL cost.

One unit of myFuel() costs cost() units of fuel(). Beware of CSs that counterfeit fuel.

Returns 1 by default.

Overrides:

cost in class Compile