Run your .NET executables (.exe) in Azure Data Factory using Custom activity under Batch Service Overview When migrating SQL Server from on-premises to cloud, there is always an ask how to migrate SSIS packages or other ETL jobs to the cloud? Azure Data Factory SSIS Integration Runtime (IR) offers to run…

Walk through how you can run your code inside Azure Batch and learn how to deploy application packages to compute nodes Problem Statement SQL migration from on-premises to cloud brings challenges with respect to migrating SSIS packages especially when considering PaaS services such as Azure SQL or Azure Managed Instance. Previously, I…

Migrating SSIS packages options — IaaS or PaaS — Introduction SSIS with on-premises SQL Server works differently as compared to running on Azure. Further, not all SSIS packages are written as cloud native. If we are planning to migrate on-premises SSIS packages, we need to understand our options in much detail. In broader terms, there are two major options: Migrate…

Move your local SSIS packages to Azure Data Factory Introduction SQL Server Integration Services (SSIS) emerged as an upgrade to Data Transformation Services (DTS), which was introduced with the version of SQL Server 7.0. With the release of SQL Server 2005, DTS was replaced by SSIS and has been the most…

How to setup Azure Monitor for SQL insights (Public Preview) Overview Monitoring is the very first step to optimize workload performance. It gives you a bird-eye view of the current and previous estate. Analyzing monitoring data can provide deep insights to tune the right knob for the performance. It also provides…

Incrementally Load Data from Azure SQL Database to Azure Storage using Change Data Capture (CDC) — Overview Change data capture (CDC) is not a new concept; it has been around for quite a while and was first introduced in SQL Server in 2008. It is defined as a software process that identifies and tracks changes such as INSERT, UPDATE, and DELETE to data residing in a database…

Power your real time dashboarding experience with Azure Event Hubs and Stream Analytics Introduction Azure Event Hub is a fully managed, real-time data ingestion service. It allows to stream millions of events per seconds from any source and from anywhere to build robust and dynamic data pipelines. …

How to create Django web app in Red Hat OpenShift Container Platform Introduction Django is one of the best web development framework and very popular in developing database driven web applications. There are many commercial apps written using Django, to name a few, Instagram, Spotify, Eventbrite, Pinterest, and etc. Django is…

Evolution of data lake to hybrid cloud with Cisco Data Intelligence Platform Today, in this digitized world, data is being generated at a very high rate and from many different sources, and it is growing exponentially in many use cases. As a result, several peta bytes of data is just…