luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

License

Apache License 2.0

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

Creator

spotify

Related apps

annoy

annoy

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loadi

C++12504apache-2.0

3 months ago

approximate-nearest-neighbor-searchc-plus-plusgolang

chartify

chartify

Python library that makes it easy for data scientists to create charts.

Python3476apache-2.0

last month

bokehdata-scienceplots

cstar

Apache Cassandra cluster orchestration tool for the command line

Python254apache-2.0

4 months ago

cassandraorchestrationpython

helios

Docker container orchestration platform

Java2102apache-2.0

3 years ago

containerdockerhelios

snakebite

A pure python HDFS client

Python859apache-2.0

2 years ago

hdfspythonpython-hdfs-client

SpotifyLogin

SpotifyLogin

Swift framework for authenticating with the Spotify API

Swift345apache-2.0

3 years ago

SPTDataLoader

SPTDataLoader

The HTTP library used by the Spotify iOS client

Objective-C625apache-2.0

19 days ago

SPTPersistentCache

SPTPersistentCache

Everyone tries to implement a cache at some point in their iOS app’s lifecycle,

Objective-C1242apache-2.0

7 days ago

dh-virtualenv

Python virtualenvs in Debian packages

Python1583gpl-2.0

11 months ago

debiandebian-packagesdh-virtualenv

scio

scio

A Scala API for Apache Beam and Google Cloud Dataflow.

Scala2516apache-2.0

last month

batchbeambigquery

cassandra-opstools

Generic tools and script to help operating Cassandra cluster

Java56apache-2.0

9 years ago

docker-client

INACTIVE: A simple docker client for the JVM

Java1429apache-2.0

2 years ago

containersdockerjava

dockerfile-maven

MATURE: A set of Maven tools for dealing with Dockerfiles

Java2724apache-2.0

2 years ago

dockerjavamaven

dockerfile-mode

An emacs mode for handling Dockerfiles

Emacs Lisp515apache-2.0

2 years ago

docker-gc

INACTIVE: Docker garbage collection of containers and images

Shell5051apache-2.0

3 years ago

dockergarbage-collectionshell

git-test

test your commits

Shell202apache-2.0

last year

agnostictest-automationversion-control

ios-style

Guidelines for iOS development in use at Spotify

239other

4 years ago

code-stylecoding-styleobjective-c

postgresql-metrics

Tool that extracts and provides metrics on your PostgreSQL database

Python585apache-2.0

11 months ago

heroic

heroic

The Heroic Time Series Database

Java844apache-2.0

3 years ago

cassandraelasticsearchgoogle-bigtable