aboutsummaryrefslogtreecommitdiff
path: root/src/wikiget/dl.py
AgeCommit message (Collapse)Author
2023-11-17Cache site connections for reuse in batch downloadsCody Logan
2023-11-17Merge branch 'master' into reduce-api-callsCody Logan
2023-11-17Add missing docstrings for modulesCody Logan
2023-11-16Code cleanup; reorganize some testsCody Logan
2023-11-16Merge branch 'master' into reduce-api-callsCody Logan
2023-11-16Fix bug when downloading non-local files from a wikiCody Logan
Revert to the pre-v0.6.0 method of checking for file existence. A change introduced in v0.6.0 caused the check to fail if the file existed only in a shared repository and not locally on the requested wiki.
2023-11-16Reuse existing Site object when possible in batch downloadsCody Logan
Previously, every file downloaded in a batch would create a new Site object. Now, the Site object created by the first file will be reused by subsequent files if it matches the file's requested host, which will significantly speed up the download process, assuming all files are from the same site. This is a quick and dirty fix which could be improved to better handle situations where there are a mix of files from different sites.
2023-11-15Convert File.dest from a string to a Path (#14)Cody Logan
2023-11-14Docstring type fixesCody Logan
2023-11-08Add and refine docstrings in src folderCody Logan
2023-11-08Switch to pathlib for file processingCody Logan
2023-11-08Ensure downloaded file handler is always closedCody Logan
2023-11-07Improve logging optimizationCody Logan
Defer string formatting until needed by removing f-strings in log messages.
2023-11-07Use multiple context managers in a single with blockCody Logan
2023-11-07Simplify return logic of process_downloadCody Logan
2023-11-01Rename some symbols and functions to better match their purposeCody Logan
2023-11-01Make process_download return an exit code instead of exiting directlyCody Logan
2023-11-01Refactor download processing code and add some testsCody Logan
2023-11-01Explicit return valueCody Logan
2023-10-31Return early during dry runs; update dev version numberCody Logan
2023-10-30Check for existing files earlier to avoid unnecessary API callsCody Logan
2023-10-30Code cleanupCody Logan
2023-10-27Condense error message when batch file is unreadableCody Logan
2023-10-27Move batch file processing to parse moduleCody Logan
2023-10-24Add dry run option, to test processing without actually downloading anythingCody Logan
2023-10-24Catch possible OS errors when verifying downloadCody Logan
2023-10-24Tweak progress bar appearanceCody Logan
2023-10-24Move API client functions to separate moduleCody Logan
2023-10-24Use per-module loggers and tweak initial log configCody Logan
2023-10-20Add type annotations to source filesCody Logan
2023-10-20Move logging configuration to new fileCody Logan
Also, use a LoggerAdapter to add contextual info (such as filenames) to log messages when downloading, especially useful with threaded batch processing.
2023-10-20Move batch_download function to proper fileCody Logan
2023-10-20Reorganize File classCody Logan
2023-10-17Clean up exception handling and error messagesCody Logan
2023-10-13Refactor parsing logic and revise exception handlingCody Logan
2023-10-03Refactor for better code organizationCody Logan
2023-10-03Update README and do some code cleanupCody Logan
2023-09-26Style and format fixesCody Logan
2023-09-26Merge branch 'logging' into devCody Logan
2023-09-26Reorganize file treeCody Logan
2023-09-26Reorganize code into src layoutCody Logan
generated by cgit v1.2.3 (git 2.25.1) at 2026-02-12 06:23:37 +0000