1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
|
# wikiget
[](https://travis-ci.org/clpo13/wikiget)
[](https://badge.fury.io/py/wikiget)
Something like wget for downloading a file from MediaWiki sites (like Wikipedia
or Wikimedia Commons) using only the file name or the URL of its description
page.
Requires Python 3.6+. Get it with `pip install --user wikiget`.
## Usage
`wikiget [-h] [-V] [-q | -v] [-f] [-s SITE] [-p PATH] [--username USERNAME]
[--password PASSWORD] [-o OUTPUT | -a] FILE`
If `FILE` is in the form `File:Example.jpg` or `Image:Example.jpg`, it will be
fetched from the default site, which is "commons.wikimedia.org". If it's the
fully-qualified URL of a file description page, like
`https://en.wikipedia.org/wiki/File:Example.jpg`, the file is fetched from the
specified site, in this case "en.wikipedia.org". Full URLs may contain
characters your shell interprets differently, so you can either escape those
characters with a backslash `\` or surround the entire URL with single `'` or
double `"` quotes. Use of a fully-qualified URL like this may require setting
the `--path` flag (see next paragraph).
The site can also be specified with the `--site` flag, though this will not have
any effect if the full URL is given. Non-Wikimedia sites should work, but you
may need to specify the wiki's script path with `--path` (where `index.php` and
`api.php` live; on Wikimedia sites it's `/w/`, but other sites may use `/` or
something else entirely). Private wikis (those requiring login even for read
access) are also supported with the use of the `--username` and `--password`
flags.
More detailed information, such as the site used and full URL of the file, can
be displayed with `-v` or `--verbose`. Use `-vv` to display even more detail,
mainly debugging information or API messages. `-q` can be used to silence warnings.
A logfile can be specified with `-l` or `--logfile`. If this option is present, the
logfile will contain the same information as `-v` along with timestamps. New log
entries will be appended to an existing logfile.
By default, the program won't overwrite existing files with the same name as the
target, but this can be forced with `-f` or `--force`. Additionally, the file
can be downloaded to a different name with `-o`.
Files can be batch downloaded with the `-a` or `--batch` flag. In this mode,
`FILE` will be treated as an input file containing multiple files to download,
one filename or URL per line. If an error is encountered, execution stops
immediately and the offending filename is printed.
### Example usage
```bash
wikiget File:Example.jpg
wikiget --site en.wikipedia.org File:Example.jpg
wikiget https://en.wikipedia.org/wiki/File:Example.jpg -o test.jpg
```
## Future plans
- download multiple files at once in batch mode
- continue batch download even if input is malformed or file doesn't exist
(possibly by raising exceptions in `download()`)
- batch download by (Commons) category or user uploads
- maybe: download Wikipedia articles, in plain text, wikitext, or other formats
## Contributing
Pull requests, bug reports, or feature requests are more than welcome.
It's recommended that you use a
[virtual environment manager](https://packaging.python.org/guides/installing-using-pip-and-virtual-environments/)
like venv or [virtualenv](https://virtualenv.pypa.io/en/latest/) to create an
isolated environment in which to install this package's dependencies so as not
to clutter your system Python environment:
```bash
# if you plan on submitting pull requests, fork the repo on GitHub
# and clone that instead
git clone https://github.com/clpo13/wikiget
cd wikiget
python3 -m venv venv
```
To activate the virtual environment, use one of the following commands:
```bash
# Linux and macOS; activate.csh and activate.fish are also available
source venv/bin/activate
# Windows (Command Prompt or PowerShell)
.\venv\Scripts\activate
```
Then run `pip install -e .` to invoke an
["editable" install](https://pip.pypa.io/en/stable/reference/pip_install/#editable-installs),
meaning any changes made to the source will be reflected immediately in the
executable script. Unit tests can be run with `python setup.py test`.
## License
Copyright (C) 2018-2021 Cody Logan and contributors
This program is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.
This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.
You should have received a copy of the GNU General Public License
along with this program (see [LICENSE](LICENSE)). If not, see
<https://www.gnu.org/licenses/>.
|
