AWS has Data Pipeline; Google has Google Cloud Dataflow and
Microsoft has recently offered Azure Data Factory and as the name suggests it
is more feature rich and of course it does move data automatically using
PowerShell scripts or the Azure Data Factory Console. General availability of
Azure Data Factory was announced on August 12, 2015.
adf00
If you are interested in getting started you can go here .
References for developers:
Just like SQL Server Integration Services (SSIS) replaced
the older Data Transformation Services (DTS), Azure Data Factory (ADF) is an
evolutional replacement for SSIS. It can of course do lot more than what SSIS
accomplished with more bells and whistles taking in stride the plethora of new
sources, cloud services, and new devices that have come into existence. One of the main features that have had the
most impact are the emergence of Azure Cloud; big data integration and the mobile workforce.
Here is an overview of how data flow along from its sources
to the end user formats where data is consumed. There is extraction, cleaning, transforming, analyzing, visualizing and reporting.
Where do to find ADF?
Azure Data Factory is still in preview and perhaps for the
time being free (check with Microsoft!). You need to have a Microsoft account.
You can then log on to the Azure Portal. From Azure portal you can get to the
Azure's Preview portal, a portal where you find the latest Azure related
offerings.
adf01
Creating a new ADF service is very easy. Just create a New Data Factory.
asdf02
No comments:
Post a Comment