feat: Add TDFA determinization; Update lexer's tag to final register map using TDFA.

[SharafMohamed]

References

• Depends on feat: Add more debugging to test-lexer.cpp; Add lexer schema to NFA and DFA tests. #92 .
• To review in parallel run:

git fetch upstream pull/92/head:pr-92
git fetch upstream pull/91/head:pr-91
git diff pr-92 pr-91

Description

• Add TDFA determinization.
• Add a generate() function called by the constructor.
• Separate existing determinizations steps into several functions.
• Lexer now updates its tag to final register map using the TDFA's output.

Validation performed

• Update dfa-test.cpp to test tagged DFA.

Summary by CodeRabbit

• New Features

  • Introduced enhanced capture management and unique identifier generation that improve state serialisation and error feedback.

• Refactor

  • Migrated from legacy tag-based processing to capture-based logic across regular expressions, lexing, and automata, resulting in clearer error handling and a more consistent API.

• Tests

  • Expanded test coverage for DFA, NFA, lexer, capture, and register functionalities to ensure robust performance and reliability.