Tag: Big Data Page 1 of 3

Microsoft partners with National Science Foundation to empower data science breakthroughs

Over the past decade, Microsoft has partnered with the National Science Foundation (NSF) on three separate programs, first in 2010, and more recently through a commitment of $6M in cloud credits across two NSF supported data science programs – …

Microsoft Azure Data Lake Storage in Storage Explorer – public preview

Providing a rich GUI for Azure Data Lake Storage resources management has been a top customer ask for a long time, we are thrilled to announce the public preview for supporting Azure Data Lake Storage (ADLS) in the Azure Storage …

New Azure Data Factory self-paced hands-on lab for UI

A few weeks back, we announced the public preview release of the new browser-based V2 UI experience for Azure Data Factory. We’ve since partnered with Pragmatic Works, who have been long-time experts in the Microsoft data integration and ETL …

Accelerated Spark on GPU-enabled clusters in Azure

The ability to run Spark on a GPU enabled cluster demonstrates a unique convergence of big data and high-performance computing (HPC) technologies. In the past several years, we've seen the GPU market explode as companies all over the world integrate …

ADF v2: Visual Tools enabled in public preview

ADF v2 public preview was announced at Microsoft Ignite on Sep 25, 2017. With ADF v2, we added flexibility to ADF app model and enabled control flow constructs that now facilitates looping, branching, conditional constructs, on-demand executions and flexible scheduling

Azure Data Factory: Visual Tools enabled in public preview

Azure Data Factory (ADF) v2 public preview was announced at Microsoft Ignite on Sep 25, 2017. With ADF v2, we added flexibility to ADF app model and enabled control flow constructs that now facilitates looping, branching, conditional constructs, on-demand executions and

Using Qubole Data Service on Azure to analyze retail customer feedback

It has been a busy season for many retailers. During this time, retailers are using Azure to analyze various types of data to help accelerate purchasing decisions. The Azure cloud not only gives retailers the compute capacity to handle peak …

Azure HDInsight Performance Benchmarking: Interactive Query, Spark, and Presto

Fast SQL query processing at scale is often a key consideration for our customers. In this blog post we compare HDInsight Interactive Query, Spark, and Presto using the industry standard TPCDS benchmarks. These benchmarks are run using out of the …

New connectors available in Azure Data Factory V2

We keep enriching the breadth of connectivity in Azure Data Factory to enable customers to ingest data from various data sources into Azure when building modern data warehouse solutions or data-driven SaaS applications. Today, we are excited to announce that …

XBox – Analytics on petabytes of gaming data with Azure HDInsight

This blog post was co-authored by Karan Gulati, Senior Software Engineer, XBOX and Daniel Hagen, Senior Software Engineer, XBOX.

Microsoft Studios produces some of the world’s most popular game titles including the Halo, Minecraft, and Forza Motorsport series. The Xbox …

Announcing Apache Kafka for Azure HDInsight general availability

Apache Kafka on the Azure HDInsight was added last year as a preview service to help enterprises create real-time big data pipelines. Since then, large companies such as Toyota, Adobe, Bing Ads, and GE have been using this service in …

Azure HDInsight Integration with Azure Log Analytics is now generally available

p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 12.0px ‘Helvetica Neue’; color: #454545} p.p2 {margin: 0.0px 0.0px 0.0px 0.0px; font: 12.0px ‘Helvetica Neue’; color: #454545; min-height: 14.0px}

I am excited to announce the general availability of HDInsight Integration with Azure Log …

HDInsight Tools for VSCode supports Azure environments worldwide

To better serve HDInsight customers worldwide, HDInsight Tools for VSCode now can be connected to all the Azure environments which host HDInsight services. This includes Azure government and regional clouds used by customers with specific compliance and data sovereignty requirements. …

Run your PySpark Interactive Query and batch job in Visual Studio Code

We are excited to introduce the integration of HDInsight PySpark into Visual Studio Code (VSCode), which allows developers to easily edit Python scripts and submit PySpark statements to HDInsight clusters. For PySpark developers who value productivity of Python language, VSCode …

Technical reference implementation for enterprise BI and reporting

We are happy to announce the technical reference implementation of an enterprise grade infrastructure to help accelerate the deployment of a BI and reporting solution to augment your data science and analytics platform on Azure.

Azure offers a rich data …

Apache Spark to Azure #CosmosDB Connector is now generally available

We are happy to announce that the Apache Spark to Azure Cosmos DB Connector is now generally available. It enables real-time data analytics and data science, machine learning, and exploration over globally distributed data in Azure Cosmos DB. Connecting Apache …

Highlighting 3 New Features in Azure Data Factory V2

Having just announced the V2 preview availability of Azure Data Factory at Ignite in Orlando, I'm going to start a new blog series focusing on three new features in Azure Data Factory for different types of data integration users. These …

Azure Data Factory V2: visual monitoring added to public preview

We are excited to announce the addition of visual monitoring capabilities for Azure Data Factory V2 (ADF v2) to our customers. With this release, you can easily monitor the data factory v2 pipelines without writing a single line of code. …

Azure Service Bus and Azure Event Hubs Geo-disaster recovery preview released

Two long-standing, well-known and appreciated Azure core services, Azure Service Bus and Azure Event Hubs, just released a preview of an upcoming generally available Geo-disaster recovery feature. With the help of this feature, no client needs to manage Geo-disaster recovery …

Meet the Azure Analysis Services team at PASS Summit 2017

image

Members from the Azure Analysis Services team will be presenting two sessions at this years PASS Summit 2017 in Seattle, WA. Members will also be available in the SQL Clinic to directly answer your Analysis Services questions in a one-on-one …

Azure Data Lake Tools for Visual Studio Code (VSCode) October Updates

If you are a data scientist looking for a lightweight code editor for U-SQL, try ADL Tools for VSCode for rapid development. If you are a developer looking for a modern, simple U-SQL development tool, try ADL Tools for VSCode. …

Azure Log Analytics workspace upgrades are in progress

If you’re currently using Azure Log Analytics to monitor your environments for availability and performance, we’re rolling out new enhancements and changes for Log Analytics that you should be aware of. Including the new and improved query language, so that …

How Azure Security Center unveils suspicious PowerShell attack

In honor of National Cybersecurity Awareness Month (NCSAM), we have a new post in our series highlighting real-world attacks that Azure Security Center helped detect, investigate, and mitigate. This post is about an attack which used PowerShell to run malicious …

Qubole customers now gain insights from Azure Data Lake

Azure Data Lake provides one of the easiest ways to build an enterprise data lake. With Qubole’s latest release of Qubole Data Service (QDS), their customers can now land data of any size, structured or unstructured, in the data lake …

Provision on-demand Spark clusters on Docker using Azure Batch’s infrastructure

Since its release 3 years ago, Apache Spark has soared in popularity amongst Big Data users, but is also increasingly common in the HPC space. However, spinning up a Spark cluster, on-demand, can often be complicated and slow. Instead, Spark …

Introducing HDInsight integration with Azure Log Analytics Preview

Operating Big Data applications successfully at scale is key consideration for our enterprise customers. Typical Big Data applications span across multiple different technologies, as well as operating environments. Monitoring this complex infrastructure in an efficient way is the key challenge …

Paxata launches Self-Service Data Preparation on Azure HDInsight to accelerate Data Prep

We are pleased to announce the expansion of HDInsight Application Platform to include Paxata, a leading self-service data preparation offering. You can get this offering now at Azure Marketplace and read more on the press announcement by Paxata.

Azure

WANdisco enables continuous data replication on Azure HDInsight for Big Data applications

We are pleased to announce the expansion of HDInsight Application Platform to include WANdisco. You can install the WANdisco Fusion app and take advantage of the free trial too.

Azure HDInsight is the industry leading fully-managed cloud Apache Hadoop …

Azure Log Analytics – meet our new query language

Azure Log Analytics has recently been enhanced to work with a new query language. The query language itself actually isn’t new at all, and has been used extensively by Application Insights for some time. Recently, the language and the platform …

Query across resources

We’re excited to introduce cross-resources querying – the ability to query not only the current workspace or application, but analyze data from other resources as well, in a single query.

Until now, queries were limited to the scope of a …

General availability of HDInsight Interactive Query – blazing fast queries on hyper-scale data

It’s 2017, and big data challenges are as real as they get. Our customers have petabytes of data living in elastic and scalable commodity storage systems such as Azure Data Lake Store and Azure Blob storage.

One of the central …

Run you Hive LLAP & PySpark Job in Visual Studio Code

If you’re interested in querying log file and gaining insights through Hive LLAP, please try HDInsight Tools for Visual Studio Code (VSCode). If you’re looking for data warehouse query experiences for big data, please try HDInsight Tools for VSCode. If …

Get insights into your Azure #CosmosDB: partition heatmaps, OMS, and more

Transparency is an important virtue of any cloud service. Azure Cosmos DB is the only cloud service that offers 99.99% SLAs on availability, throughput, consistency, and <10ms latency, and we transparently show you metrics on how we perform against this …

Azure HDInsight training resources – Learn about big data using open source technologies

Azure HDInsight is the only fully-managed cloud Hadoop & Spark offering that gives you optimized open-source analytic clusters for Spark, Hive, MapReduce, HBase, Storm, Kafka, and Microsoft R Server backed by a 99.9% SLA. You can deploy these big data …

Ask us anything about the new Azure Log Analytics language

Join our first AMA session on Thursday, September 21, 2017 from 9:00 AM-10:00 AM Pacific Time. Add the event to your calendar!

Last month, we announced a new query language for Azure Log Analytics, offering advanced search and analytics capabilities, …

Events, Data Points, and Messages – Choosing the right Azure messaging service for your data

With the introduction of Event Grid, Microsoft Azure now offers an even greater choice of messaging infrastructure options. The expanded messaging service fleet consists of the Service Bus message broker, the Event Hubs streaming platform, and the new Event …

Using Azure Analysis Services with Azure Data Lake Store

Support for Azure Data Lake Store (ADLS) is now available in Azure Analysis Services and in SQL Server Data Tools (SSDT). Now you can augment your big data analytics workloads with rich interactive analysis for selected data subsets at the …

Using Azure Analysis Services with Azure Data Lake Storage

Support for Azure Data Lake Store (ADLS) is now available in Azure Analysis Services and in SQL Server Data Tools (SSDT). Now you can augment your big data analytics workloads with rich interactive analysis for selected data subsets at the …

Announcing Azure Data Lake Store Capture Provider for Event Hubs Capture

Event Hubs Capture went to generally availability in June 2017. To this feature, we are adding Azure Data Lake Store as a new Capture provider. Yes, you can now choose your Azure Data Lake Store to capture events from Event …

Hortonworks extends IaaS offering on Azure with Cloudbreak

This blog post is co-authored by Peter Darvasi, Engineer, Hortonworks.

We are excited to announce the availability of Cloudbreak for Hortonworks Data Platform on Azure Marketplace. Hortonworks Data Platform (HDP) is an enterprise-ready, open source Apache Hadoop distribution. With …

Debug Spark Code Running in Azure HDInsight from Your Desktop

This month’s IntelliJ HDInsight Tools release delivers a robust remote debugging engine for Spark running in the Azure cloud. The Azure Toolkit for IntelliJ is available for users running Spark to perform interactive remote debugging directly against code running in …

Imanis Data – Cloud migration, backup for your big data applications on Azure HDInsight

We are pleased to announce the availability of Imanis Data on Azure.

Azure HDInsight is the industry leading fully-managed cloud Apache Hadoop & Spark offering, which allows customers to run reliable open source analytics with an industry-leading SLA. Imanis Data

Azure Time Series Insights API, Reference Data, Ingress, and Azure Portal Updates

Today we are announcing the release of several updates to Time Series Insights based on customer feedback. Time Series Insights is a fully-managed analytics, storage, and visualization service that makes it simple to explore and analyze billions of IoT events …

Data Management Gateway – High Availability and Scalability Preview

We are excited to announce the preview for Data Management Gateway – High Availability and Scalability.

You can now associate multiple on-premise machines to a single logical gateway. The benefits are: 

  • Higher availability of Data Management Gateway (DMG) – DMG

Bring Interactive Analytics to Azure HDInsight: Kyligence Analytics Platform enables sub-second query

In resource-intensive systems, queries will compete for runtime resources and it takes hours to return when the work load is high. SQL on Hadoop is improving continuously, but it is still common to wait minutes or even a couple hours …

HDInsight tools for IntelliJ & Eclipse June updates

HDInsight tools June release has been released! In this release, you can choose SBT as a build tool in addition to Maven when creating Spark projects in IntelliJ. With improvements to Spark job view and job graph in IntelliJ and …

Go serverless with R Scripts on Azure Function

Serverless is all the rage, now you can get in on the action using R! Azure Function supports a variety of languages (C#, F#, js, batch, PowerShell, Python, php and the list is growing). However, R is not natively supported. …

Azure Data Lake Tools for Visual Studio Code (VSCode) July updates

We are pleased to announce the July updates of Azure Data Lake Tools for VSCode. This is a quality milestone and we added local debug capability for C# code behind for window users, refined Azure Data Lake (ADLA & ADLS) …

Event Hubs Capture (formally Archive) is now Generally Available

Today we are announcing Azure Event Hubs Capture, released in public preview in September 2016 as Azure Event Hubs Archive, is now Generally Available.

This capability adds an important dimension to Azure Event Hubs, which is a highly …

Event Hubs Capture (formerly Archive) is now Generally Available

Today we are announcing Azure Event Hubs Capture, released in public preview in September 2016 as Azure Event Hubs Archive, is now Generally Available.

This capability adds an important dimension to Azure Event Hubs, which is a highly …

Java: Manage Azure Container Service, Cosmos DB, Active Directory Graph and more

We released 1.1 of the Azure Management Libraries for Java. This release adds support for:

Cosmos DB Azure Container Service and Registry Active Directory Graph

https://github.com/Azure/azure-sdk-for-java

Getting started

Add the following dependency fragment to your Maven POM file to use …

Predictive maintenance using PySpark

Predictive maintenance is one of the most common machine learning use cases and with the latest advancements in information technology, the volume of stored data is growing faster in this domain than ever before which makes it necessary to leverage …

Announcing public preview of Apache Kafka on HDInsight with Azure Managed disks

HDInsight set a firm goal of helping enterprises build secure, robust, scalable open source streaming pipelines on Azure. To meet this goal, a few months ago we announced a limited preview of Managed Kafka on Azure HDInsight. The addition …

Event Hubs Auto-Inflate, take control of your scale

Azure Event Hubs is a hyper-scalable telemetry ingestion service that can ingest millions of events per second. It gives a distributed streaming platform with low latency and configurable time retention, which enables you to ingress massive amounts of telemetry into …

HDInsight tools for IntelliJ May updates

The primary focus for our May updates is to make the Spark development work easier for you in IntelliJ! In this release, your spark remote debugging experience is significantly improved. Scala SDKs Installation, Scala project creation, and Spark Job submission …

Diagnose sudden changes in your app behavior with a click!

Spikes or steps in the telemetry of your app can now be easily diagnosed.

When you use Application Insights Analytics to explore app metrics over time, sudden changes, such as spikes or dips, are highlighted. With one click, Smart Diagnostics

Deploy Cognitive Toolkit model to Azure Web Apps

Azure offers several ways of deploying a deep-learning model including Windows Web App, Linux Web App, and Azure Container Services. For those less experienced with a Linux environment/containers, Windows Web Apps offers familiar territory. In this post we will …

Announcing Public Preview of HDInsight HBase on Azure Data Lake Store

On November 21, Microsoft announced the general availability of Azure Data Lake Store. Azure Data Lake Store is a hyperscale cloud storage for big data analytics built to the open Hadoop File System (HDFS) standard. Azure Data Lake Store provides enterprise grade …

New Azure Quickstart template – Cloudera CDH and Tableau Server by Slalom

Developers and IT-Pros usually start their Cloud journey by installing software on virtual machines.  While this makes it easy to create running Infrastructure as a Service (IaaS), it requires additional work to load data and develop a coherent business solution.  …

Building a Data Lake with Cloudera and Azure Data Lake – Roadshow

Today we are announcing the Cloudera + Microsoft Roadshow to showcase the partnership and integration with Cloudera Enterprise Data Hub and Azure Data Lake Storage (ADLS).    Linux and Open Source solutions (OSS) have been some of the fastest growing workloads …

Cloudera now supports Azure Data Lake Store

With the release of Cloudera Enterprise Data Hub 5.11, you can now run Spark, Hive, and MapReduce workloads in a Cloudera cluster on Azure Data Lake Store (ADLS). Running on ADLS has the following benefits:

  • Grow or shrink a

Announcing Azure Time Series Insights

Today we are excited to announce the public preview of Azure Time Series Insights, a fully managed analytics, storage, and visualization service that makes it incredibly simple to interactively and instantly explore and analyze billions of events from sources such …

Announcing Azure Stream Analytics on edge devices (preview)

Today, we are announcing Azure Stream Analytics (ASA) on edge devices, a new feature of Azure Stream Analytics that enables customers to deploy analytical intelligence closer to the IoT devices and unlock the full value of the device-generated data.

Azure …

Introducing H2O.ai on Azure HDInsight

We are excited to announce that H2O’s AI platform is now available on Azure HDInsight Application Platform. Users can now use H2O.ai’s open source solutions on Azure HDInsight, which allows reliable open source analytics with an industry-leading SLA.

To …

Azure #DocumentDB Service Level Agreements

Why enterprises trust us for their globally distributed applications.

Enterprise applications and massive scale applications need a data store that is globally distributed, offers limitless scale, geographical reach, and is fast and performant. Along with enterprise grade security and compliance, …

Introducing Dataiku’s DSS on Microsoft Azure HDInsight to make data science easier

We are pleased to announce the expansion of HDInsight Application Platform to include Dataiku.

Azure HDInsight is the industry leading fully-managed cloud Apache Hadoop & Spark offering which allows customers to do reliable open source analytics with an industry-leading SLA. …

Announcing general availability of Azure HDInsight 3.6

This week at DataWorks Summit, we are pleased to announce general availability of Azure HDInsight 3.6 backed by our enterprise grade SLA. HDInsight 3.6 brings updates to various open source components in Apache Hadoop & Spark eco-system to …

Use BigDL on HDInsight Spark for Distributed Deep Learning

Deep learning is impacting everything from healthcare, transportation, manufacturing, and more. Companies are turning to deep learning to solve hard problems like image classification, speech recognition, object recognition, and machine translation. In this blog post, Intel’s BigDL team …

40TiB of advanced in-memory analytics with Azure and ActivePivot

In-memory computing has accelerated the big compute capabilities and enabled customers to extend its experience beyond just the monte carlo simulation and into the analytics. This is of note within Financial Services where business users wish to move away from …

Azure Data Factory offer SAP HANA and Business Warehouse data integration

Azure Data Factory is a cloud-based data integration service that orchestrates and automates the movement and transformation of data, which support copying data from 25+ data stores on-premises and in the cloud easily and performantly. Today, we are excited to …

Azure Data Factory offers SAP HANA and Business Warehouse data integration

Azure Data Factory is a cloud-based data integration service that orchestrates and automates the movement and transformation of data, which support copying data from 25+ data stores on-premises and in the cloud easily and performantly. Today, we are excited to …

Announcing new capabilities of HDInsight and DocumentDB at Strata

This week in San Jose, Microsoft will be at Strata Hadoop + World where will be announcing new capabilities of Azure HDInsight, our fully managed OSS analytics platform for running all open-source analytics workloads at scale, with enterprise grade …

DocumentDB: API for MongoDB now generally available

Today, we are excited to announce that DocumentDB: API for MongoDB is generally available. The API for MongoDB allows developers to experience the power of the DocumentDB database engine with the comfort of a managed service and the familiarity of …

Azure Data Lake Analytics and Data Lake Store now available in Europe

Azure Data Lake Analytics and Azure Data Lake Store are now available in the North Europe region. For more information about pricing, please visit the Data Lake Analytics Pricing and Data Lake Store Pricing webpages. Data Lake Analytics is a …

Azure Data Factory February new features update

Azure Data Factory allows you to bring data from a rich variety of locations in diverse formats into Azure for advanced analytics and predictive modeling on top of massive amounts of data. We have been listening to your feedback and …

Azure Data Lake Tools for VSCode (Preview) – March Update

Continue our journey to launch Azure Data Lake Tools for VSCode for better cross-platform support,  meet developers where they are in Mac, Linux and Windows, and deliver a first class light weight code editor experiences for U-SQL. We are pleased …

Launching online training and certification for Azure SQL Data Warehouse

Azure SQL Data Warehouse (SQL DW) is a SQL-based fully managed, petabyte-scale cloud solution for data warehousing. SQL Data Warehouse is highly elastic, enabling you to provision in minutes and scale capacity in seconds. You can scale compute and storage …

Azure Brings big data, analytics, and visualization capabilities to U.S. Government

To further our commitment to providing the latest in cloud innovation for government customers we’re excited to announce the general availability of HDInsight and Power BI Pro in Microsoft Cloud for Government.  HDInsight and Power BI bring exciting new capabilities …

Announcing preview of Azure HDInsight 3.6 with Apache Spark 2.1

Today, we are pleased to announce a preview of Azure HDInsight 3.6. We are enabling this preview to get feedback on Apache Spark 2.1. You can try out all the features available in the open source release of Apache Spark …

Optimizing rolling feature engineering for time series data

In this blog post, I want to talk about how data scientists can efficiently perform certain types of feature engineering at scale. Before we dive into sample code, I will briefly set the context of how telemetry data gets generated …

Azure brings 5 new services to Canada

Since the beginning of the year, we’ve deployed multiple new services in Canada. Please find below a brief summary of recently deployed services.

Available now

HDInsight is the only fully-managed cloud Hadoop offering that provides optimized open source analytic clusters …

Microsoft MPI v8.0 release

We are happy to announce the release of the newest version of Microsoft MPI (MS-MPI). MS-MPI v8 is the successor to the Microsoft MPI v7.1 redistributable package (released in June 2016). You can download a copy of MS-MPI v8 from …

Microsoft Enterprise Services Tips to using SQL Data Warehouse effectively

Azure SQL Data Warehouse is a SQL-based fully managed, petabyte-scale cloud solution for data warehousing. With tight integration between other Azure products, SQL Data Warehouse represents the backbone of any major cloud data warehousing solution in Azure. With decoupled compute …

Dear #MongoDB users, we welcome you in #Azure #DocumentDB

MongoDB Developers DocumentDB

First and foremost, security is our priority 

Microsoft makes security a priority at every step, from code development to incident response. Azure code development adheres to Microsoft’s Security Development Lifecycle (SDL) – a software development process that helps developers build …

10 GitHub samples with Azure DocumentDB you shouldn’t miss!

Azure DocumentDB is a fully managed, multi-model, scalable, queryable, schema-free NoSQL database service built for modern applications: mobile, web, IoT, bots, AI, etc. Recently, I went on GitHub and have found a lot of useful material and links to step-by-step …

Announcing the new Azure Marketplace experience

This post was co-authored by Vybava Ramadoss, Senior Program Manager, Azure Marketplace.

Azure Marketplace provides a rich catalog of thousands of products and solutions from independent software vendors (ISVs) that have been certified and optimized to run on Azure. …

New in Azure Stream Analytics: Geospatial functions, Custom code and lots more!

Today, we are pleased to announce the roll-out of several compelling capabilities in Azure Stream Analytics. These include native support for geospatial functions, custom code with JavaScript, low latency dashboarding with Power BI and preview of Visual Studio integration and …

HDInsight tools for IntelliJ & Eclipse December Updates

We are pleased to announce the December updates of HDInsight Tools for IntelliJ & Eclipse. The HDInsight Tools for IntelliJ & Eclipse serve the open source community and will be of interest to HDInsight Spark developers. The tools run smoothly …

Microsoft Azure Storage Import/Export Announcements

Azure Import/Export Service enables transfer of data in and out of Azure Blob Storage by shipping data on harddrives. You can use this service when you have large amount of data which takes long to upload/download over network. We are …

Introducing Change Feed support in Azure DocumentDB

 We’re excited to announce the availability of Change Feed support in Azure DocumentDB! With Change Feed support, DocumentDB provides a sorted list of documents within a DocumentDB collection in the order in which they were modified. This feed can be …

Live, online, step-by-step guidance from Cortana Intelligence Suite experts

Learn how to build intelligence into your applications by getting hands-on with the Cortana Intelligence Suite. On December 6, Microsoft Virtual Academy will host Microsoft Architects Todd Kitta and Jin Cho as they lead a workshop where you will …

Announcing StorSimple Data Transformation preview

There has been a popular and persistent ask from customers to do more with the data that moves to the cloud via StorSimple. For example, use an Azure service such as Azure Media Services, Azure HDInsight, or Azure Machine Learning …

R Server for HDInsight now generally available

Today, we announced the general availability of R Server for Azure HDInsight. This gives Azure HDInsight the most comprehensive set of ML algorithms and statistical functions in the cloud that also leverages Hadoop and Spark.

What is R Server on

Kafka for Azure HDInsight now public preview

Today, we are pleased to announce that Kafka for Azure HDInsight is in public preview

What is Apache Kafka for Azure HDInsight?

Kafka for HDInsight is an enterprise-grade, open-source, streaming ingestion service that is cost-effective and easy to provision, …

Public Preview: Azure Data Lake Tools for Visual Studio Code (VSCode)

We are pleased to announce the Public Preview of the Azure Data Lake (ADL) Tools for VSCode. The tools provide users with the best in class light weight, keyboard focused authoring experience for U-SQL as an alternative solution to the …

Data Platform week in review – November 14, 2016

This is the first edition of Data Platform Week in review covering Cortana Intelligence Suite, SQL Server and R Server.

Upcoming Events:

Connect(); is back for the third year in a row and will be livestreaming globally from …

IBM and Microsoft Azure support Spectrum Symphony and Spectrum LSF

This week Microsoft and IBM have tied up an agreement that will provide an enhanced level of testing and support for both hybrid and pure IaaS deployments of Spectrum Symphony and Spectrum LSF into Microsoft's Azure public cloud. IBM Spectrum …

The Santa Cloud

We all know Santa Claus gets help, but perhaps you didn’t realize how much and from where…

‘Twas almost October and up at the pole

The diligent elves were not reaching their goal

The IT department was working nonstop

A

Azure big data services host Ask Me Anything session

The big data teams on Azure will host a special Ask Me Anything session on /r/Azure, Thursday, November 17, 2016 from 10:00 am to 2:00 pm PST.

What's an AMA session?

We'll have folks from the Azure big data …

Azure DocumentDB updates: quick start experience, backup and restore, and firewall support

Over the past couple weeks we released a number of improvements to the developer experience and capabilities of Azure DocumentDB. We added a new quick start experience helping you to get up and running with a working app on DocumentDB in …