Category Archives: Big Data Hadoop

If you’ve started your dbt journey and successfully connected dbt Core with Databricks, congratulations! 🎉 The next feature you should learn is dbt Seeds. Seeds are one of the simplest yet most powerful features in dbt, especially when working with reference data, lookup tables, and demo datasets. In this blog, we’ll explore what dbt Seeds […]

  🧩 Part 1: What is a CTE?  “CTE stands for Common Table Expression. It’s like creating a temporary table that exists only while your query runs. You define it using the WITH keyword.” Example: WITH my_cte AS ( SELECT * FROM employees ) SELECT * FROM my_cte; “This is a normal CTE — not […]

Unlock the Power of AI in Your SQL Queries with Databricks ai_query() 1. Introduction: The Data Analyst’s Dilemma (and Solution) Key Points: The Problem: Data analysts constantly deal with unstructured data (text) like customer reviews, support tickets, and open-ended survey responses. Analyzing this data often requires complex, multi-step processes: 1) Export data from the Lakehouse, […]

In this blog post, we’ll explore how to trigger an Amazon SageMaker Jupyter notebook file from an AWS Lambda function using WebSockets. This method allows you to automate your machine learning workflows and run Jupyter notebooks on demand, providing a powerful tool for data scientists and engineers. Prerequisites Before we dive in, ensure you have […]

1)Difference between Dedicated Host and Dedicated Instances A dedicated host gives you your private physical server, while dedicated instances reserve a secure space for your virtual computers within a shared server. 2) Range of Private IP i)Class A (10.0.0.0 to 10.255.255.255): This allows for approximately 16.8 million unique host addresses. The entire 10.0.0.0/8 range is […]