Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add LexiconfreeTimesyncBeamSearch #101

Merged
merged 51 commits into from
Apr 4, 2025
Merged

Add LexiconfreeTimesyncBeamSearch #101

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
51 commits
Select commit Hold shift + click to select a range
1e7035e
Implement simple lexiconfree time-sync beam search
Feb 19, 2025
bf0a8ce
Add some comments
Feb 19, 2025
d6689b4
Add `createSearchAlgorithm` to Search::Module
Feb 20, 2025
664945c
Fix compilation
Feb 26, 2025
488fb0e
Refactor traceback/lattice building and construct proper (nonlinear) …
Feb 28, 2025
1599302
Factor out time statistics into new Core::StopWatch class
Feb 28, 2025
9a60916
Don't copy sibling from predecessor
Feb 28, 2025
8e96423
Better handling of blank index
Feb 28, 2025
536ac82
Apply suggestions from code review
Feb 28, 2025
f21935e
Implement StopWatch class
Mar 4, 2025
5f82460
Use TIMER_START and TIMER_STOP macros instead
Mar 4, 2025
4779dd5
Simplify AdvancedTreeSearch PerformanceCounter by inheriting from Sto…
Mar 4, 2025
f5a3182
Small fixes in StopWatch class
Mar 4, 2025
97e5bd7
Make StopWatch a member of PerformanceCounter instead of inheriting
Mar 4, 2025
b77cf23
Implement LatticeTrace class
Mar 4, 2025
5fcfff7
Make predecessor and sibling public members
Mar 4, 2025
3152300
Look for initial trace instead of associating empty trace with initia…
Mar 4, 2025
0b676f9
Remove redundant includes
Mar 4, 2025
159fbd8
Add assertions for assumptions in lattice building
Mar 5, 2025
f2f4cf7
Merge remote-tracking branch 'origin/lattice_traces' into lexiconfree…
SimBe195 Mar 5, 2025
0577e79
Remove wrong assertion
SimBe195 Mar 5, 2025
04b6ac4
Merge remote-tracking branch 'origin/lattice_traces' into lexiconfree…
SimBe195 Mar 5, 2025
b454e39
Remove initial item in `performTraceback`
SimBe195 Mar 5, 2025
b3d5f02
Merge remote-tracking branch 'origin/lattice_traces' into lexiconfree…
SimBe195 Mar 5, 2025
d393c7e
Fix arc scores
SimBe195 Mar 5, 2025
b1ed20e
Merge remote-tracking branch 'origin/lattice_traces' into lexiconfree…
SimBe195 Mar 5, 2025
f112113
Merge remote-tracking branch 'origin/stopwatch' into lexiconfree_beam…
SimBe195 Mar 5, 2025
d67cf45
Update traceback/lattice building logic
SimBe195 Mar 5, 2025
54535e6
Make `elapsed` functions const
SimBe195 Mar 5, 2025
f0832f8
Merge branch 'stopwatch' into lexiconfree_beam_search
SimBe195 Mar 5, 2025
a125afa
Merge branch 'stopwatch' into lattice_traces
SimBe195 Mar 5, 2025
46ee1a8
Merge branch 'lattice_traces' into lexiconfree_beam_search
SimBe195 Mar 5, 2025
eb17fcb
Remove unused parameters
SimBe195 Mar 21, 2025
abeaa66
Merge branch 'master' into lexiconfree_beam_search
SimBe195 Mar 21, 2025
7a41f8c
Get rid of sorting and perform score-pruning and recombination on uns…
SimBe195 Mar 26, 2025
4d182f4
Use Core::Statistics for hyp counts
SimBe195 Mar 26, 2025
4208e6f
Pre-allocate intermediate vectors
SimBe195 Mar 26, 2025
deb0a68
Rename `createSearchAlgorithm` to `createSearchAlgorithmV2`
SimBe195 Mar 26, 2025
0331bcb
Use `LIBS_SEARCH` in Makefiles
SimBe195 Mar 26, 2025
48765f7
Use dedicated debug channel to replace config parameter "debug-logging"
SimBe195 Mar 26, 2025
1027984
Import sorting
SimBe195 Mar 26, 2025
34780e4
Reorder functions
SimBe195 Mar 28, 2025
f563641
Rename beamPruning->beamSizePruning and populate requests_ and extens…
SimBe195 Mar 28, 2025
13886a5
Rename "allow-label-loop" to "collapse-repeated-labels"
SimBe195 Mar 28, 2025
847fdf6
Move extension reserve to setModelCombination
SimBe195 Mar 28, 2025
5e14645
Move requests_.reserve to setModelCombination as well
SimBe195 Mar 28, 2025
49f106b
Shift search-step-stats xml open tag
SimBe195 Mar 31, 2025
758ce79
Exit decode step early after finished segment
SimBe195 Mar 31, 2025
6a051f6
Update SearchAlgorithmV2 docstring
SimBe195 Mar 31, 2025
a7bf308
Disable debug channel by default
SimBe195 Apr 1, 2025
6c38b15
Apply suggestions from code review
SimBe195 Apr 4, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -148,6 +148,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
LIBS_SEARCH += src/Search/Wfst/libSprintSearchWfst.$(a)
LIBS_SEARCH += src/OpenFst/libSprintOpenFst.$(a)
Expand Down
1 change: 1 addition & 0 deletions apptainer/2022-10-21_tensorflow-1.15_arm_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -143,6 +143,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
LIBS_SEARCH += src/Search/Wfst/libSprintSearchWfst.$(a)
LIBS_SEARCH += src/OpenFst/libSprintOpenFst.$(a)
Expand Down
1 change: 1 addition & 0 deletions apptainer/2022-10-21_tensorflow-1.15_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -143,6 +143,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
LIBS_SEARCH += src/Search/Wfst/libSprintSearchWfst.$(a)
LIBS_SEARCH += src/OpenFst/libSprintOpenFst.$(a)
Expand Down
1 change: 1 addition & 0 deletions apptainer/2023-05-08_tensorflow-2.8_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -143,6 +143,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
LIBS_SEARCH += src/Search/Wfst/libSprintSearchWfst.$(a)
LIBS_SEARCH += src/OpenFst/libSprintOpenFst.$(a)
Expand Down
1 change: 1 addition & 0 deletions apptainer/2023-08-09_tensorflow-2.8_onnx-1.15_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -147,6 +147,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
LIBS_SEARCH += src/Search/Wfst/libSprintSearchWfst.$(a)
LIBS_SEARCH += src/OpenFst/libSprintOpenFst.$(a)
Expand Down
1 change: 1 addition & 0 deletions apptainer/2023-11-08_tensorflow-2.14_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -148,6 +148,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
LIBS_SEARCH += src/Search/Wfst/libSprintSearchWfst.$(a)
LIBS_SEARCH += src/OpenFst/libSprintOpenFst.$(a)
Expand Down
2 changes: 2 additions & 0 deletions src/Nn/LabelScorer/LabelScorer.hh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -83,6 +83,8 @@ public:
LABEL_TO_BLANK,
BLANK_TO_LABEL,
BLANK_LOOP,
INITIAL_LABEL,
INITIAL_BLANK,
};

// Request for scoring or context extension
Expand Down
Loading