A lightweight opinionated ETL framework, halfway between plain scripts and Apach

Python2082mit

11 months ago

datadata-integrationetl

setup and manage continuous delivery pipelines for code libraries in multiple la

TypeScript375apache-2.0

21 hours ago

Huggingface transformer pipelines in Golang

Go220apache-2.0

4 months ago

Policy enforcement for your pipelines.

Go435mpl-2.0

24 days ago

build-automationdockergo

AI orchestration framework to build customizable, production-ready LLM applicati

Python17820apache-2.0

yesterday

aibertchatgpt

A Python Automated Machine Learning tool that optimizes machine learning pipelin

Python9743lgpl-3.0

4 months ago

adspag066833aiml

Move fast from data science prototype to pipeline. Capture, analyze, and transfo

Jupyter Notebook663apache-2.0

6 months ago

Python ETL framework for stream processing, real-time analytics, LLM pipelines,

Python4330other

yesterday

batch-processingdata-analyticsdata-pipelines

Best-in-class stream processing, analytics, and management. Perform continuous a

Rust7063apache-2.0

23 hours ago

analyticsbig-datacloud-native

A machine learning library for spiking neural networks. Supports training with b

Python53agpl-3.0

10 days ago

deploymentjaxmachine-learning

Write your pipelines in C# !

C#218mit

4 months ago

buildbuild-systembuild-tool

The easiest way to serve AI apps and models - Build Model Inference APIs, Job qu

Python7170apache-2.0

2 days ago

ai-inferencedeep-learninggenerative-ai

A simple mediator for .Net for sending command, publishing event and request res

C#370apache-2.0

7 months ago

buscqrscsharp

A DSL for data-driven computational pipelines

Groovy2642apache-2.0

4 months ago

awsbioinformaticscloud

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere

Python3443apache-2.0

4 months ago

data-engineeringdata-sciencejupyter

Robust, flexible and resource-efficient pipelines using Go and the commandline

Go1076mit

3 months ago

bioinformaticsbioinformatics-pipelinecheminformatics

A Python-based module for creating flexible and robust spike sorting pipelines.

Python530mit

3 days ago

electrophysiologyneurosciencespike-sorting

PipelineAI

Jsonnet4165apache-2.0

7 months ago

airflowartificial-intelligencecassandra

MLeap: Deploy ML Pipelines to Production

Scala1504apache-2.0

11 days ago

data-pipelinespythonscala

Unified Interface for Constructing and Managing Workflows on different workflow

Python915apache-2.0

2 months ago

apache-airflowargo-workflowscloud-native

🌊 Floom, "The K8s for AI", orchestrates & executes Generative AI pipelines, Emp

C#36mit

6 days ago

aiartificial-intelligencegenai

PSR-7 middleware foundation for building and dispatching middleware pipelines

PHP55bsd-3-clause

26 days ago

middlewarepsr-7

Metric learning and retrieval pipelines, models and zoo.

Python884apache-2.0

last month

computer-visiondata-sciencedeep-learning

Bpipe - a tool for running and managing bioinformatics pipelines

Groovy226other

5 months ago

Kedro is a toolbox for production-ready data science. It uses software engineeri

Python10022apache-2.0

yesterday

experiment-trackinghacktoberfestkedro

Towhee is a framework that is dedicated to making neural data processing pipelin

Python3232apache-2.0

last month

computer-visionconvolutional-networksembedding-vectors

:mag: Data pipeline for crawling PDFs from the Web and transforming their conten

TypeScript164mit

6 months ago

awsaws-cdkaws-textract

A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin

6206

last month

awesome-listworkflow

Twitter Image Pipeline is a robust and performant image loading and caching fram

C1853apache-2.0

10 months ago

cacheimage-pipelineios

HTML processing filters and utilities

Ruby2265mit

4 months ago

Algorand's data pipeline framework.

Go37mit

8 days ago

Point cloud registration pipeline for robot localization and 3D perception

C++781bsd-3-clause

4 months ago

3d-perceptionicplidar

A procedural Blender pipeline for photorealistic training image generation

Python2683gpl-3.0

4 months ago

3d-engines3d-front-dataset3d-graphics

A LiDAR odometry pipeline that just works

Python1484mit

4 months ago

3d-mappingicplidar-slam

An image processing pipeline for ROS.

C++773other

4 months ago

c-plus-plusimage-processingpython

MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)

Python1879apache-2.0

8 months ago

Use this sample when creating a simple pipeline in AWS CodePipeline while follow

HTML158apache-2.0

6 months ago

A full spaCy pipeline and models for scientific/biomedical documents.

Python1711apache-2.0

4 days ago

bioinformaticsbiomedicalcustom-pipes

Browser compilation library – an asset pipeline for applications that run in the

JavaScript3325mit

7 months ago

Collection pipeline library for PHP

PHP536mit

7 months ago

collectioncollection-pipelinecollections

Generic but comprehensive pipeline for prokaryotic genome annotation and interro

Nextflow98gpl-3.0

9 days ago

annotationantimicrobial-genes-annotationbarrnap

MagicScaler high-performance, high-quality image processing pipeline for .NET

C#606mit

last month

csharpdotnetimage-processing

A high-performance observability data pipeline.

Rust17091mpl-2.0

4 months ago

eventsforwarderlogs

Fast, pipelined, resilient Redis driver for Elixir. 🛍

Elixir1103mit

2 months ago

elixirelixir-libraryredis

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Manageme

Python5694apache-2.0

2 days ago

aiclearmlcontrol

A Multilingual Latent Dirichlet Allocation (LDA) Pipeline with Stop Words Remova

Python82mit

4 months ago

clusteringenglishfrench

A flexible pipeline for complete analysis of bacterial genomes

Nextflow414mit

10 days ago

bacterial-genomesbiocondaconda

Surging is a micro-service engine that provides a lightweight, high-performance,

C#3241mit

5 months ago

apigatewayapolloconsul

DeepVariant is an analysis pipeline that uses a deep neural network to call gene

Python3240bsd-3-clause

last month

bioinformaticsdeep-learningdeep-neural-network

pySLAM contains a Visual Odometry (VO) pipeline in Python for monocular, stereo

Python1884gpl-3.0

5 days ago

Integration of TinyMCE with the Rails asset pipeline

JavaScript816other

11 days ago

railsrubytinymce

Data search & enrichment library for Machine Learning → Easily find and add rele

Python319bsd-3-clause

8 days ago

automated-feature-engineeringautomlautoml-pipeline

jQuery UI for the Rails asset pipeline

Ruby1127other

5 months ago

This repository contains github actions for usage in our build pipeline.

JavaScript6other

7 months ago

A pipeline for preprocessing NGS data from Illumina, Nanopore and PacBio technol

Nextflow31gpl-3.0

5 months ago

bax2bambioinformaticsillumina

Use your angular templates with rails' asset pipeline

Ruby566mit

3 months ago

angularangular-rails-templatesangular-template

🚨 Design workflows of slog handlers: pipeline, middleware, fanout, routing, fai

Go320mit

4 months ago

attributeerrorerrors

PipelinR is a lightweight command processing pipeline ❍ ⇢ ❍ ⇢ ❍ for your Java aw

Java420mit

2 months ago

androidarchitecturecqrs

Machine is a workflow/pipeline library for processing data

Go151mit

5 months ago

codespacesgithub-actionsgolang

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipel

Makefile2150other

3 days ago

aiapicli

Jenkins single-shot pipeline execution in a GitHub Action POC

Shell199apache-2.0

8 months ago

github-actionsjenkinsjenkins-pipeline

Tenzir is the data pipeline engine for security teams.

C++640bsd-3-clause

last month

dataopshacktoberfestincident-response

Description PROTECT YOUR PRIVACY WITH TUTA MAIL FOR FREE: SECURE, PRIVATE AND

TypeScript6112gpl-3.0

yesterday

emailencryptionjavascript

The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right

Python608apache-2.0

2 years ago

deep-learningframeworkhyperparameter-optimization

This repository hosts sample pipelines

Python462mit-0

5 years ago

ChEMBL database structure pipelines

Python182mit

last year

Compositional pipelines

Haskell486bsd-3-clause

2 years ago

Informatics for RNA-seq: A web resource for analysis on the cloud. Educational t

R1339other

last year

Little command line REST client that you can use in pipelines (bash or zsh).

Shell2646mit

2 years ago

Spooker is a dynamic framework for processing high volume data streams via proce

Java29apache-2.0

9 years ago

Real Time Analytics and Data Pipelines based on Spark Streaming

Scala524apache-2.0

5 years ago

analyticshdfskafka

A system to programmatically run data pipelines

Rust221

3 years ago

crondagjob

CGAT-ruffus is a lightweight python module for running computational pipelines

Python173mit

3 years ago

Easy pipelines for pandas DataFrames.

Jupyter Notebook715mit

2 years ago

datadata-sciencedataframe

:ram: A CLI tool for processing data with functional pipelines

LiveScript573isc

2 years ago

clijsonlivescript

Composable Operations is a tool set for creating operations and assembling multi

Ruby47mit

8 years ago

League\Pipeline

PHP959mit

last year

A pipeline component like jenkins blue ocean plugin.

JavaScript327mit

2 years ago

Use this sample when creating a four-stage pipeline in AWS CodePipeline while fo

Ruby14apache-2.0

5 years ago

A plugin for loading any Markdown into custom element

JavaScript2

9 years ago

:twisted_rightwards_arrows: FluentMediator is an unobtrusive library that allows

C#192apache-2.0

5 years ago

chain-methodschain-of-responsibilitycraftmanship

A lightweight F#/C# library for efficient functional-style pipelines on streams

F#383other

5 years ago

PIPELINE Design System

HTML30mit

2 years ago

GTFS Data Pipeline for TfNSW Bus Datasets

Jupyter Notebook8

2 years ago

data-pipelinedatapipelinegtfs

Use this sample when creating a simple pipeline in AWS CodePipeline while follow

HTML9apache-2.0

7 years ago

Golang Mongodb Pagination for official mongodb/mongo-go-driver package which sup

Go130mit

2 years ago

aggregateaggregationdatabase

Railway oriented programming in Ember

JavaScript18mit

7 years ago

emberember-addonexperimental

Use AWS CDK with CodePipeline to deploy a TypeScript Create-React-App.

TypeScript41mit

4 years ago

aws-cdkaws-codepipelinecra

Unified publishing for Sitecore Helix solutions that extends existing Visual Stu

PowerShell68mit

3 years ago

pipelined erlang redis client

Erlang0

6 years ago

Static Application Security Testing (SAST) engine focused on covering the OWASP

Go511mit

3 years ago

androidandroid-securitycli

Exception handling as a convention in the ASP.NET Core request pipeline

C#272mit

2 years ago

net-corewebapi

LinkedIn's previous generation Kafka to HDFS pipeline.

Java881

4 years ago

An Open Source Malware Analysis Pipeline System

CSS156

3 years ago

Paralleling pipeline

Go31mit

3 years ago

Netflix's distributed Data Pipeline

Java794apache-2.0

2 years ago

Experimental High Level Framework for Vulkan

C++325bsd-3-clause

6 years ago

Multi-Paradigm Pipeline Implementation

R169other

8 years ago

Use this plugin to integrate your Jenkins project with a pipeline in AWS CodePip

Java82apache-2.0

last year

A configurable pipeline, aimed at transforming content for import and export

Python5other

2 years ago

Parallel and Pipelined HTTP GET Utility

Go555bsd-2-clause

6 years ago

Build and deploy a serverless data pipeline on AWS with no effort.

Python110apache-2.0

2 years ago

awsaws-cdkdata-pipeline

Sample code for a java application that uses Elastic Beanstalk, S3, DynamoDB, an

Java54apache-2.0

7 years ago

Scalable cloud load/stress testing pipeline solution with Apache JMeter and Terr

HCL120mit

3 years ago

azureazure-containerazure-container-instances

Simple pipeline for SSR + hydration of Lit components.

Ruby13mit

last year

bridgetownbridgetown-pluginlit-element

Powerful workflow engine and end-to-end pipeline solutions implemented with nati

Go1072apache-2.0

last year

ai-pipelineci-cdcontinuous-delivery

Cookbook for Node on FHIR and the clinical Meteor.js build pipeline. Create FDA

Shell1674

3 years ago

The Ajax.org Cloud9 Editor (Ace) for the Rails 3.1+ asset pipeline.

Ruby134mit

2 years ago

💉 A simple project to demonstrate dependency injection in @Sitecore pipeline pr

C#0

4 years ago

dependency-injectionsitecore

Open source aggregation pipeline for public COVID-19 data, including hospitaliza

Python116apache-2.0

3 years ago

Task pipeline on top of Golem.network

Python5gpl-3.0

4 years ago

Common extensions to Sitecore contentSearch. Hereunder PopulateSolrSchema pipeli

0

6 years ago

contentsearchsitecoresitecore9

Metrics Pipeline for interoperability and Enterprise Prometheus

Go563apache-2.0

2 years ago

cloud-nativecncfcontainer

Bioinformatics-themed kata for practicing string manipulation in a data transfor

9mit

2 years ago

bioinformaticsbiologychallenge

A go library for easy configure and run command chains. Such like pipelining in

Go58mit

2 years ago

commandgogolang

Debug Vinyl file streams to see what files are run through your Gulp pipeline

JavaScript221mit

last year

debuggulp-pluginjavascript

Use this sample when creating a four-stage pipeline in AWS CodePipeline while fo

Ruby49apache-2.0

last year

An asset pipeline wrapper for the TypeScript language

Ruby255mit

8 years ago

Integrate Select2 javascript library with Rails asset pipeline

Ruby964

2 years ago

➕ A pipeline processor to organize Insert Options Rules in @Sitecore's content t

C#1

4 years ago

sitecoresitecore-helix

⏱ Sitecore pipeline processor and extensions to the HttpRouteCollection to enabl

C#0

2 years ago

sitecoreweb-api-2

A deployment pipeline for Ember CLI apps

JavaScript560mit

2 years ago

ember-cliember-cli-deploy

A coding exercise: let's convert dirty machine learning code into clean code usi

Jupyter Notebook18apache-2.0

2 years ago

ECS Reference Architecture for creating a flexible and scalable deployment pipel

Shell851apache-2.0

2 years ago

awscontinuous-deploymentdevops

This input plugin for Logstash scans a specified DynamoDB table and then reads c

Ruby105apache-2.0

3 years ago

Use this sample to help you develop your own job worker when creating a custom a

Java32other

last year

MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone set

Python357other

4 years ago