Stephane Maarek

homebridge-daikin-cloud. Homebridge plugin to control Daikin devices via the Daikin Cloud/Onecta API

requestly. Community hub for Requestly API Client — bugs, feature requests, and roadmap. The privacy-first Postman alternative.

kafka-connect-wikimedia. Kafka Connect Source connector for Wikimedia EventStreams

youtube-publish-drafts. Publish all your draft videos without clicking by using javascript

ingraph. InGraph is a declarative infrastructure graph DSL for AWS CloudFormation.

aws-account-controller. Self-service creation and deletion of sandbox-style accounts.

AWS-IAM-Privilege-Escalation. A centralized source of all AWS IAM privilege escalation methods released by Rhino Security Labs.

former2. Generate CloudFormation / Terraform / Troposphere templates from your existing AWS resources.

AWSConsoleRecorder. Records actions made in the AWS Management Console and outputs the equivalent CLI/SDK commands and CloudFormation/Terraform templates.

brooklin. An extensible distributed system for reliable nearline data streaming at scale

serverless-package-external. Add external folders to the deploy package 📦

karapace. Karapace - Your Apache Kafka® essentials in one tool

kaf. Modern CLI for Apache Kafka, written in Go.

quarkus. Quarkus: Supersonic Subatomic Java.

discourse-solved. Allow accepted answers on topics

toml. Python lib for TOML

embedded-kafka-schema-registry. A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.

embedded-kafka. A library that provides an in-memory Kafka instance to run your tests against.

stream-registry. Stream Discovery and Stream Orchestration

confd. Manage local application configuration files using templates and data from etcd or consul

mkcert. A simple zero-config tool to make locally trusted development certificates with any names you'd like.

safe-string-interpolation. A type driven approach to string interpolation, aiming at consistent, secure, and only-human-readable logs and console outputs !

kafka-plain-saslserver-2-ad. Enhancing Kafka security, PlainSaslServer with LDAP binding and SimpleAclAuthorizer with LDAP group membership

bloomrpc. Former GUI client for gRPC services. No longer maintained.

mirus. Mirus is a cross data-center data replication tool for Apache Kafka

java-kafka-client. OpenTracing Instrumentation for Apache Kafka Client

kafka-beginners-course. Apache Kafka Series - Learn Apache Kafka for Beginners v3

kafka-kit. Kafka storage rebalancing, automated replication throttle, cluster API and more

jaquet. Spark stream from kafka(json) to s3(parquet)

schema-registry-plugin. Gradle plugin to interact with Confluent Schema-Registry.

cmak-docker. CMAK (prev. Kafka Manager) and cmak2zk docker images

grpc-go-course. Companion Repository for my gRPC Golang course

clear-config. Scala FP configuration library with a focus on runtime clarity

jib. 🏗 Build container images for your Java applications.

pulumi. Pulumi - Infrastructure as Code in any programming language 🚀

kafka-streams-consumer-offsets-to-json. A Kafka Streams process to convert __consumer_offsets to a JSON-readable topic

every-single-day-i-tldr. A daily digest of the articles or videos I've found interesting, that I want to share with you.

MirrorTool-for-Kafka-Connect. A Kafka Source connector for Kafka Connect

rejoiner. Generates a unified GraphQL schema from gRPC microservices and other Protobuf sources

grpcgateway. A PoC to derive REST services from GRPC specifications

protoc-gen-validate. Protocol Buffer Validation - replaced by https://github.com/bufbuild/protovalidate

gogradle. A Gradle Plugin Providing Full Support for Go

kafkastreams-cep. Complex Event Processing on top of Kafka Streams

java-dataloader. A Java 11 port of Facebook DataLoader

prototool. Your Swiss Army Knife for Protocol Buffers

evans. Evans: more expressive universal gRPC client

awesome-grpc. A curated list of useful resources for gRPC

flamescope. FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.

scalatest-embedded-kafka. A library that provides an in-memory Kafka instance to run your tests against.

scala-kafka-protobuf. PoC using scala that defines single-message protobuf schema per Kafka topic

kafka-streams-viz. Kafka Streams Topology Sketch Diagram Visualization

flutter. Flutter makes it easy and fast to build beautiful apps for mobile and beyond

kafka_ansible_demo_playbooks.

aws-virtual-bastion. A web based terminal for EC2 instances that does not require SSH or any other inbound connections to the instaces. Instead it uses the AWS Systems Manager (SSM) API to run commands (bash or powershell).

lambdash. Lambda shell - Run sh commands inside AWS Lambda environment

sshless. AWS SSM in Action, the next generation of SSH

stacker. An AWS CloudFormation Stack orchestrator/manager.

sceptre. Build better AWS infrastructure

kafka-sniffer. kafka-sniffer is a network traffic analyzer tool for apache kafka, help you find the details of producer request

kafka-security-manager. Manage your Kafka ACL at scale

topiks. An interactive CLI tool for managing Kafka topics

flotilla-os. Open source Flotilla

taskcat. Test all the CloudFormation things! (with TaskCat)

restful-stress. Load and Stress test against RESTful web service

kafka-view. Kafka web UI

kafka-benchmark. A tool to run benchmarks on Kafka clusters

kafka-webview. Full-featured web-based Apache Kafka consumer UI

kafka-monitor. Xinfra Monitor monitors the availability of Kafka clusters by producing synthetic workloads using end-to-end pipelines to obtain derived vital statistics - E2E latency, service produce/consume availability, offsets commit availability & latency, message loss rate and more.

kafka-streams-scala. Thin Scala wrapper around Kafka Streams Java API

kafka-connect-protobuf-converter. Protobuf converter plugin for Kafka Connect

monitoring-demo. Docker - ELK - Tick Stack - Grafana - Kafka

avrohugger. Generate Scala case class definitions from Avro schemas

kafka-avro-course. Learn the Confluent Schema Registry & REST Proxy

lenses-docker. ❤for real-time DataOps - where the application and data fabric blends - Lenses

sbt-avro. Plugin SBT to Generate Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.

medium-blog-kafka-udemy. Supporting repository for the blog post at https://medium.com/@stephane.maarek/how-to-use-apache-kafka-to-transform-a-batch-pipeline-into-a-real-time-one-831b48a6ad85

archaius. Library for configuration management API

kafka-junit. JUnit rule for spinning up a Kafka broker

aws-vault. A vault for securely storing and accessing AWS credentials in development environments

chamber. CLI for managing secrets

cruise-control. Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.

Mobirise. AI Website Builder, Open Source, Bootstrap 5

mockafka. A testing DSL for kafka-streams

kafka-utils. Python

remora. Kafka consumer lag-checking application for monitoring, written in Scala and Akka HTTP; a wrap around the Kafka consumer group command. Integrations with Cloudwatch and Datadog. Authentication recently added

kafka-streams. equivalent to kafka-streams :octopus: for nodejs :sparkles::turtle::rocket::sparkles:

kafka-streams-course. Learn Kafka Streams with several examples!

kafka-as-module-oss. NuCypher for Kafka. Start building from this module (it fetches the appropriate branch from Kafka repository)

kafka. Apache Kafka - A distributed event streaming platform

mockedstreams. Scala DSL for Unit-Testing Processing Topologies in Kafka Streams

exactly-once-streams. An engineering report on using transactions in Kafka 0.11.0.0

cp-docker-images. [DEPRECATED] Docker images for Confluent Platform.

aws-maven. Fork to add support for assumed roles

zookeeper-exhibitor. Docker definition for an Exhibitor-managed ZooKeeper instance

SdbNavigator. A SimpleDB Administration web-interface

insomnia. The open-source, cross-platform API client for GraphQL, REST, WebSockets, SSE and gRPC. With Cloud, Local and Git storage.

zoonavigator-web. Web client for ZooNavigator.

zoonavigator-api. API for ZooNavigator.

zoonavigator. Web-based ZooKeeper UI

pyenv. Simple Python version management

kafka-learning. Go from Zero to Hero in Kafka

zetcd. Serve the Apache Zookeeper API but back it with an etcd cluster

kafkacli. CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry)

kafka-connect-github-source. Get a stream of issues and pull requests for your chosen GitHub repository

kafka-connect-archtype. Maven quick start for building Kafka Connect connectors.

stream-reactor. A collection of Kafka Connect sinks and sources maintained by Lenses.io.

scala-aws-params-reader. Library for reading data from AWS' Parameter Store

localstack. 💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline

scala-credstash. Scala implementation of a credstash client

ecs-nginx-proxy. Reverse proxy for AWS ECS. Lets you address your docker containers by sub domain.

ecs-gen. docker-gen for AWS ECS

fast-data-dev. Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, , 20+ connectors

ansible-aws-infra-services. Manage your AWS infrastructure and ECS tasks with two separate ansible playbooks

kafka-connect-tools. Kafka Connect Tooling

kafka-stack-docker-compose. docker compose files to create a fully working kafka stack

OpenAPI-Specification. The OpenAPI Specification Repository

aws-shell. An integrated shell for working with the AWS CLI.

kafka-tunnel. Access kafka/zookeeper in your AWS cloud via ssh tunnel to consume and produce messages

kafkat. KafkaT-ool

ish. SSH to an AWS server based on name tag, AMI, autoscaling group, or instance ID.

spark-kafka-source. Kafka stream for Spark with storage of the offsets in ZooKeeper

awesome-nifi. A list of useful Apache NiFi resources, processor bundles and tools

kinesis-tee. Unix tee, but for Kinesis streams