Author: admin1

How to connect Databricks to Azure Data Lake?

Databricks is a version of the popular open-source Apache Spark analytics and data processing engine. Azure Databricks is the fully managed version of Databricks and is a premium offering on Azure, that brings you an enterprise-grade and secure cloud-based Big Data and Machine Learning platform.

Data can be ingested in a variety of ways into Azure Databricks. For real-time Machine learning projects, you can ingest data through a wide range of technologies including Kafka, Event Hubs or ,IoT Hubs. In addition, you can ingest batches of data using Azure Data Factory from a variety of data stores including Azure Blob Storage, Azure Data Lake Storage, Azure Cosmos DB, or Azure SQL Data Warehouse which can then be used in the Spark-based engine within Databricks.

In this article, we are going to connect the data bricks to Azure Data Lakes.

Quick Tip: How to Recover the lost password of Remote Desktop Manager?

I have recently come across a typical situation where I completely forgot the Remote Desktop manager’s password. I thought to recover the password by calling the help desk but I knew it is going to take so much time to get it back because of many regulatory and compliance issues. So I found a quick alternative. I wrote a power shell script to decrypt the lost password. Here are the steps: