Code examples and resources for DBRX, a large language model developed by Databricks

A curated list of awesome Databricks resources, including Spark

Awesome content all about Azure Databricks

Fundamentals of Spark with Python (using PySpark), code examples

Apache Spark 3 - Spark Programming in Python for Beginners

The Data Engineering Cookbook

Base classes to use when writing tests with Spark

This repository contains the notebooks and presentations we use for our Databricks Tech Talks

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Koalas: pandas API on Apache Spark

Sparkling Water provides H2O functionality inside Spark cluster

State of the Art Natural Language Processing

Binding the GDELT universe in a Spark environment

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

Pyspark RDD, DataFrame and Dataset Examples in Python language

🐍 Quick reference guide to common patterns & functions in PySpark.

A curated list of awesome Apache Spark packages and resources.

A curated list of tools, frameworks, and resources for IT compliance, security standards, and regulatory requirements

Module 2: Introduction to Security Within the Organization, Risk Management and Threat Modeling, Governance Frameworks, Compliance, and BCP/DR

Curated list of resources for security Governance, Risk Management, Compliance and Audit professionals and enthusiasts (if they exist).

This project demonstrates a comprehensive understanding of Governance, Risk, and Compliance (GRC) in the field of cybersecurity. It includes scripts and tools to automate risk assessment and compli…

A modern, all-in-one Governance, Risk & Compliance (GRC) solution designed for privacy, security, and compliance teams. As an open-source alternative to Vanta and Drata, this platform empowers team…

Full stack data engineering tools and infrastructure set-up

Practical Data Engineering: A Hands-On Real-Estate Project Guide

Data Engineering Project: Extracting music video metrics of Twice using YouTube API, AWS, and Tableau

This is a repo with links to everything you'd ever want to learn about data engineering

This is a public repository to go over all the LLM-driven data engineering concepts.

Live Training Session: Cleaning Data with Pyspark

Getting start with PySpark and MLlib

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks