You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Jim Martens 3f5ae9ad34 Added info about firefox binary to README 4 weeks ago
docs Added rudimentary documentation 5 months ago
src/twomartens Added headless option which mysteriously disappeared 4 weeks ago
.gitignore Create config file automatically if missing 5 months ago
CHANGELOG.rst Bumped version number 4 weeks ago
LICENSE Initial commit 5 months ago Added rudimentary documentation 5 months ago
README.rst Added info about firefox binary to README 4 weeks ago
pyproject.toml Added support for modern python build system 5 months ago Bumped version number 4 weeks ago


ALLRIS Scraper

.. image::
:alt: Apache License 2.0
.. image::
:alt: Python 3.7 and 3.8
.. image::
:alt: version 0.3.5

This scraper requires your username and password and performs the following tasks for you:

- login
- download of all agendas and motions related to upcoming meetings of committees and plenary sessions

- Only considers meetings where you already have been invited formally through ALLRIS.

All districts are supported but official committee abbreviations will only work for Eimsbüttel as of now.


- Python 3.7+
- Firefox installed
- `geckodriver binary`_ in PATH

.. _geckodriver binary:

Initial setup
1. Install ALLRIS scraper ``pip install twomartens.allrisscraper`` (you need Python 3.7+)
2. Run ALLRIS scraper a first time ``tm-allrisscraper`` (creates config ini in your current working directory)
3. Fill out the config file with your login credentials and an absolute path on your system to store PDFs of files


.. code-block:: ini

; possible values for district: Altona, Bergedorf, Eimsbüttel, Hamburg-Nord,
; Hamburg-Mitte, Harburg, Wandsbek
district = Eimsbüttel
; if you are not from Eimsbüttel your domain ending will differ
username =
; password is stored in clear text, therefore ini file should have most
; restrictive read permissions
password = VerySecurePassword
; location for storage of PDFs (trailing slash is IMPORTANT)
pdflocation = /path/to/storage/of/PDFs/
; location of the firefox binary
firefoxBinary = /Pfad/zur/firefox.exe

Usage after initial setup

Run ALLRIS scraper: ``tm-allrisscraper`` (takes a few seconds to finish)

In the specified location for download you will find the following structure:

- ``YYYY-MM-DD_Abbreviation of committee or plenary session/`` (one directory for each meeting)
- files inside the directory:
``Einladung.pdf`` (contains invitation), ``Mappe.pdf`` (contains all motions in one document), and ``Tagesordnung.pdf`` (agenda)