Paper Downloading Review

[TomLucidor]

Common libraries (skipping those that only download from Arxiv):

• Multi-media are good as well https://github.com/jimmc414/onefilellm
• Alternative *rxiv might need to be listed https://github.com/jannisborn/paperscraper
• Auto-search + Auto-download https://github.com/ppwwyyxx/SoPaper
• Inclusion of Google Scholar https://github.com/CharlesPikachu/paperdl
• "DOI-hunting" https://github.com/mehmoodulhaq570/doi_hunter

Those having more "legit" sites

• https://github.com/NLPatVCU/PaperScraper
• https://github.com/sucv/paperCrawler
• https://github.com/SilenceEagle/paper_downloader
• https://github.com/ch3njust1n/papers_are_all_you_need
• https://github.com/george-gca/ai_papers_scrapper

P.S. Browser tools are also useful and OpenReview seems like a plus https://github.com/vict0rsch/PaperMemory https://github.com/liyuanhe211/LYH_DOI_Tools

[rmusser01]

Thanks I’ll take a look at these.
I’m planning to add a paper review +chat functionality once I get VLM support added so you’ll be able to select a paper and have it parsed + be able to select specific pieces during chat

[TomLucidor]

Hopefully the VLM is good for diagrams, text being handled under pure LLM would still be good (but then table is a gray area)