Azure Databricks and Lambda Architecture

To get started with Microsoft Azure Databricks, log into your Azure portal. If you do not have an Azure subscription, create a free account before you begin. Another great way to get started with Databricks is a free notebook environment with a micro-cluster called Community Edition. Nathan Marz coined the term Lambda Architecture (LA) while working …

Continue reading Azure Databricks and Lambda Architecture

Azure Databricks Libraries

To get started with Microsoft Azure Databricks, log into your Azure portal. If you do not have an Azure subscription, create a free account before you begin. To view previous posts please visit the following: What is Azure Databricks? Getting started with Azure Databricks Creating Azure Databricks Clusters Azure Databricks – Workloads Libraries Azure Databricks libraries allow …

Continue reading Azure Databricks Libraries

Apache Spark’s History

Spark Introduction Spark is an open-source lightning-fast unified analytics engine for large-scale data processing. The foundation of Spark is designed on resilient distributed dataset (RDD) which is a read-only dataset distributed over a cluster of machines. RDDs are fault tolerant meaning Spark will not crash if one or more failures occurs during processing. Spark requires …

Continue reading Apache Spark’s History

Azure Databricks – Jobs

To get started with Microsoft Azure Databricks, log into your Azure portal. If you do not have an Azure subscription, create a free account before you begin. To view previous posts please visit the following: What is Azure Databricks Getting started with Azure Databricks Creating Azure Databricks Clusters Azure Databricks Workloads Azure Databricks Jobs Jobs allow us …

Continue reading Azure Databricks – Jobs

Azure Databricks – Workloads

To get started with Microsoft Azure Databricks, log into your Azure portal. If you do not have an Azure subscription, create a free account before you begin. To view previous posts please visit the following: What is Azure Databricks? Getting started with Azure Databricks Workloads There are two types of workloads available in Azure Databricks. One is …

Continue reading Azure Databricks – Workloads