Token Class Reference

Represents a token in the source code. More...

#include <token.hpp>

Collaboration diagram for Token:

Public Member Functions
	Token (TokenType type, std::string lexeme, std::any literal, int line)
	Constructs a Token object.
TokenType	getType () const
std::string	getLexeme () const
std::any	getLiteral () const
int	getLine () const
std::string	toString () const

Private Attributes
const TokenType	type
const std::string	lexeme
const std::any	literal
const int	line

Detailed Description

Represents a token in the source code.

The Token class encapsulates the type, lexeme, literal value, and line number of a token. It provides a method to convert the token to a string representation.

Definition at line 14 of file token.hpp.

Constructor & Destructor Documentation

Token()

Token::Token	(	TokenType	type,
		std::string	lexeme,
		std::any	literal,
		int	line
	)

Constructs a Token object.

Parameters

type	The type of the token.
lexeme	The lexeme of the token.
literal	The literal value of the token (if any).
line	The line number where the token was found.

Note

The literal value can be of any type, so it is stored as std::any.

The lexeme and literal values are moved into the object to avoid copying.

Definition at line 4 of file token.cpp.

    : type{type}, lexeme{std::move(lexeme)}, literal{std::move(literal)},
      line{line} {}

Member Function Documentation

getLexeme()

std::string Token::getLexeme

(

)

const

Definition at line 10 of file token.cpp.

{ return lexeme; }

getLine()

int Token::getLine

(

)

const

Definition at line 14 of file token.cpp.

{ return line; }

getLiteral()

std::any Token::getLiteral

(

)

const

Definition at line 12 of file token.cpp.

{ return literal; }

getType()

TokenType Token::getType

(

)

const

Definition at line 8 of file token.cpp.

{ return type; }

toString()

std::string Token::toString

(

)

const

Definition at line 16 of file token.cpp.

                                {
  std::string literal_str;
 
  switch (type) {
  case (TRUE):
    literal_str = "true";
    break;
  case (FALSE):
    literal_str = "false";
    break;
  case (NUMBER):
    literal_str = std::to_string(std::any_cast<int>(literal));
    break;
  case (STRING):
    try {
      literal_str = std::any_cast<std::string>(literal);
    } catch (const std::bad_any_cast &e) {
      literal_str =
          static_cast<std::string>(std::any_cast<const char *>(literal));
    }
    break;
  case (IDENTIFIER):
    literal_str = lexeme;
    break;
  default:
    literal_str = "nil";
    break;
  }
 
  return ::toString(type) + " " + lexeme + " " + literal_str;
}

Member Data Documentation

lexeme

const std::string Token::lexeme

private

Definition at line 17 of file token.hpp.

line

const int Token::line

private

Definition at line 19 of file token.hpp.

literal

const std::any Token::literal

private

Definition at line 18 of file token.hpp.

type

const TokenType Token::type

private

Definition at line 16 of file token.hpp.

---

The documentation for this class was generated from the following files:

• lib/gsc/token.hpp
• src/token.cpp