Chris Fregly

ai-performance-engineering. Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and full-stack tuning.

spark-after-dark. Scala

spark-dynamodb. [WIP] Spark-DynamoDB Data Sources API Implementation

gertrude. A Multilayer and Multivariate Experiment Framework for the JVM

Nut. Build LXC containers using Dockerfile like syntax

lambda-architecture.net. A repository of information, examples and good practices around the Lambda Architecture

sparkinaction. Supporting code and datasets for Spark In Action by Chris Fregly, Manning Publications

aws-step-functions-data-science-sdk-python. Step Functions Data Science SDK for building machine learning (ML) workflows and pipelines on AWS

DeepLearningBook. MIT Deep Learning Book in PDF format

amazon-sagemaker-keras-text-classification. A step-by-step guide that shows how to do text classification by run training/inference for a custom model in Amazon SageMaker

amazon-sagemaker-examples. Example notebooks that show how to apply machine learning and deep learning in Amazon SageMaker

fastbook. The fastai book, published as Jupyter Notebooks

tribe. Social Network Analysis of an Email

sparkmagic. Jupyter magics and kernels for working with remote Spark clusters

notebooks. Notebooks using the Hugging Face libraries 🤗

datasets. TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...

aws-data-wrangler. Pandas on AWS

intro-to-kubernetes-workshop. Intro to Kubernetes Workshop

data. A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

ray. An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

awesome-sagemaker. A curated list of references for Amazon SageMaker

transformers. 🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

eks-workshop. AWS Workshop for Learning EKS

cub. CUB is a flexible library of cooperative threadblock primitives and other utilities for CUDA kernel programming.

guild-python. Rewrite of Guild AI in Python

tensorflow-mnist-tutorial. Sample code for "Tensorflow and deep learning, without a PhD" presentation and code lab.

aws-codeguru-profiler-demo-application. Example application demonstrating the features of Amazon CodeGuru Profiler

kops. Kubernetes Operations (kops) - Production Grade K8s Installation, Upgrades, and Management

tensorflow. Computation using data flow graphs for scalable machine learning

ribbon. Ribbon is a Inter Process Communication (remote procedure calls) library with built in software load balancers. The primary usage model involves REST calls with various serialization scheme support.

servo. Netflix Application Monitoring Library

docker-cookbooks. A collection of Dockerfiles, also shared on the docker index (https://index.docker.io/).

netflixoss-ansible. NetflixOSS Ansible Playbooks

dcos-iot-demo. Demonstrates how to configure a full stack geo-enabled Internet of Things (IoT) solution using Mesosphere's open sourced Data Center Operating System (DC/OS), Docker, Kafka, Spark, and Elasticsearch. (WIP)

tensorframes. Tensorflow wrapper for DataFrames on Apache Spark

node-red. A visual tool for wiring the Internet of Things

serving. A flexible, high-performance serving system for machine learning models

genie. Hadoop Platform as a Service

spark-corenlp. a Stanford CoreNLP wrapper for Spark ML pipeline API