Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Miner: Prevent saving duplicate files #37

Open
neoneye opened this issue Jan 19, 2025 · 0 comments
Open

Miner: Prevent saving duplicate files #37

neoneye opened this issue Jan 19, 2025 · 0 comments
Labels
bug Something isn't working miner LODA-RUST miner

Comments

@neoneye
Copy link
Collaborator

neoneye commented Jan 19, 2025

When running a duplicate checker program, it finds duplicate files among the candidate programs.

Every candidate program is executed if it generates the correct integer sequence. So it's wasted effort on computing programs that have already been checked.

Within LODA-RUST, Add the existing candidate programs to the bloomfilter, so candidate programs gets rejected, before starting to compute the integer sequence.

Screenshot of Duplicate Files Finder.
Image

Eventually add a script for removing duplicates.

Thanks to @kotenok2000 for reporting this issue.

@neoneye neoneye changed the title Miner: Prevent saving duplicate files. Miner: Prevent saving duplicate files Jan 19, 2025
@neoneye neoneye added bug Something isn't working miner LODA-RUST miner labels Jan 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working miner LODA-RUST miner
Projects
None yet
Development

No branches or pull requests

1 participant