class Prism::Token

This represents a token from the Ruby source.

Attributes

source [R]

The Source object that represents the source this token came from.

type [R]

The type of token that this token is.

value [R]

A byteslice of the source that this token represents.

Public Class Methods

new (source, type, value, location)

Source

# File lib/prism/parse_result.rb, line 825
def initialize(source, type, value, location)
  @source = source
  @type = type
  @value = value
  @location = location
end

Create a new token object with the given type, value, and location.

Public Instance Methods

== (other)

Source

# File lib/prism/parse_result.rb, line 860
def ==(other)
  Token === other &&
    other.type == type &&
    other.value == value
end

Returns true if the given other token is equal to this token.

deep_freeze ()

Source

# File lib/prism/parse_result.rb, line 873
def deep_freeze
  value.freeze
  location.freeze
  freeze
end

Freeze this object and the objects it contains.

location ()

Source

# File lib/prism/parse_result.rb, line 838
def location
  location = @location
  return location if location.is_a?(Location)
  @location = Location.new(source, location >> 32, location & 0xFFFFFFFF)
end

A Location object representing the location of this token in the source.