kernelzeroday/zimscan
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
No description
26 commits 1 branch 0 tags 61 KiB
  • Python 100%
Find a file
Exact
Johan Berdat a887a3470e Small dependency fix
2023-09-18 16:38:55 +02:00
example/wiktionary Add option to skip metadata, as this is heavy in large ZIM files 2023-09-03 19:02:57 +02:00
src/zimscan Fix versions, drop Python 3.5 support 2023-09-04 07:47:22 +02:00
tests Add buffered file reader 2023-09-03 18:02:02 +02:00
.gitattributes Use more recent project template 2023-09-01 23:13:39 +02:00
.gitignore Small dependency fix 2023-09-18 16:38:55 +02:00
.pre-commit-config.yaml Use more recent project template 2023-09-01 23:13:39 +02:00
LICENSE Use more recent project template 2023-09-01 23:13:39 +02:00
pyproject.toml Small dependency fix 2023-09-18 16:38:55 +02:00
README.md Add option to skip metadata, as this is heavy in large ZIM files 2023-09-03 19:02:57 +02:00
requirements.txt Fix versions, drop Python 3.5 support 2023-09-04 07:47:22 +02:00

README.md

ZIM Scan

Minimal ZIM file reader, designed for article streaming.

Getting Started

Install using pip:

pip install zimscan

Or from Git repository, for latest version:

pip install -U git+https://github.com/jojolebarjos/zimscan.git

Iterate over a records, which are binary file-like objects:

from zimscan import Reader

path = "wikipedia_en_all_nopic_2019-10.zim"
with Reader(open(path, "rb"), skip_metadata=True) as reader:
    for record in reader:
        data = record.read()
        ...

Links