To run the pipelines, you need to set your PYTHONPATH environment variable to the path of this project on disk. This can be accomplished in a few ways; two solutions are offered.

Prepend PYTHONPATH=/path/to/recon-pipline to any luigi pipeline command being run.
Add export PYTHONPATH=/path/to/recon-pipeline to your .bashrc

Scheduler

Either add --local-scheduler to your luigi command on the command line or run systemctl start luigid before attempting to run any luigi commands.

Systemd service file for luigid

cat >> /lib/systemd/system/luigid.service << EOF 
[Unit]
Description=Spotify Luigi server
Documentation=https://luigi.readthedocs.io/en/stable/
Requires=network.target remote-fs.target
After=network.target remote-fs.target
[Service]
Type=simple
ExecStart=/usr/local/bin/luigid --background --pidfile /var/run/luigid.pid --logdir /var/log/luigi
[Install]
WantedBy=multi-user.target
EOF

scope file

The pipeline expects a file that describes the project scope to be in the current working directory. By convention, TARGET_NAME should be something like tesla or some other target identifier.

luigi command structure

With the PYTHONPATH setup, luigi commands take on the following structure (prepend PYTHONPATH if not exported from .bashrc):

luigi --module PACKAGENAME.MODULENAME CLASSNAME *args

You can get options for each module by running luigi --module PACKAGENAME.MODULENAME CLASSNAME --help

example help statement luigi --module recon.targets TargetList --help

usage: luigi [--local-scheduler] [--module CORE_MODULE] [--help] [--help-all]
             [--TargetList-target-file TARGETLIST_TARGET_FILE]
             [--target-file TARGET_FILE]
             [Required root task]

positional arguments:
  Required root task    Task family to run. Is not optional.

optional arguments:
  --local-scheduler     Use an in-memory central scheduler. Useful for
                        testing.
  --module CORE_MODULE  Used for dynamic loading of modules
  --help                Show most common flags and all task-specific flags
  --help-all            Show all command line flags
  --TargetList-target-file TARGETLIST_TARGET_FILE
  --target-file TARGET_FILE

An example scope file command, where tesla is the name of the file and it is located in the current directory.

PYTHONPATH=$(pwd) luigi --local-scheduler --module recon.targets TargetList --target-file tesla