worker scripts

Usage

- type: shell_script
  name: foobar
  script: /worker-script/foobar.sh
  interval: 3600
  another_options: values

Scripts

rsync.sh

• path: where downloaded files will be stored, e.g. /mnt/abc
• source: upstream, e.g.rsync://foobar
• ignore_vanish: When specified, ignore file has vanished error from upstream. Read more at https://unix.stackexchange.com/questions/86879/suppress-rsync-warning-some-files-vanished-before-they-could-be-transferred . By default this is not enabled. Example: true
• exclude_hidden: When specified, ignore all hidden files (i.e. starting with .). Used to fix broken partial files from upstream. By default this is not enabled. Example: true

archlinux-cn.sh

Sync from Archlinux-CN.

• path: store path of packages
• username: username of sync.repo.archlinuxcn.org
• password: password of sync.repo.archlinuxcn.org

awss3.sh

Sync from AWS S3 storage.

• source: S3 URL. e.g. s3://static-rust-lang-org/rustup
• path: store path of files

bandersnatch.sh

Sync from PyPI.

• path: store path of packages
• master: upstream. e.g. https://pypi.python.org/

anaconda.py

Sync from anaconda upstream.

pkgs at: https://repo.continuum.io/pkgs/ cloud pkgs at: https://conda.anaconda.org/{name}/{arch}/

• path: base store path of packages
• thread_num: number of working threads. Must be greater than number of upstream + 1! Otherwise deadlock may occur Default: 16
• k: v that starts with https://: Sync a repo at URL v to {path}/{k}. Example: cloud/soumith/osx-64: https://conda.anaconda.org/soumith/osx-64/