Microsoft Build 2018: Day 1 Overview - Intelligence for Apps and Edge IoT, Microsoft 365 experiences
On Monday at Microsoft Build 2018, Microsoft Corp.’s annual developer conference, Microsoft called on developers to embrace Microsoft 365 as a rich development platform. Microsoft 365 brings together Office 365, Windows 10 and Enterprise Mobility + Security, delivering a complete, intelligent and secure solution to empower employees.
As the largest productivity platform in the world, it’s a vital part of the intelligent edge — enabling developers to reach Microsoft customers in a multisense, multidevice way.
New developer opportunities with Microsoft 365
At Microsoft Build, Microsoft announced new opportunities that help developers create smarter ways for people to work, including new tools that give them the flexibility to design experiences in the languages and frameworks of their choice. Microsoft 365, combined with insights from the Microsoft Graph, empowers developers to build intelligent applications. New tools include the following:
New and updated Microsoft Teams APIs in the Microsoft Graph and support for organization-specific applications in Teams allows developers to create tailored, intelligent experiences based on the unique needs of a business or industry. Companies can also publish custom apps to the Teams app store.
Deeper SharePoint integration into Microsoft Teams enables people to pin a SharePoint page directly into channels to enable deeper collaboration. Developers can use modern script-based frameworks like React within their projects to add more pieces that can be organized within SharePoint pages.
New support for Power BI Visualizations in Excel makes it possible for developers to extend the custom visuals created for Power BI to Excel, giving them an opportunity to reach more users.
Updates to the Fluent Design System that help developers create immersive, deeply engaging experiences with Microsoft’s updated design language. Now every organization can make beautiful solutions that empower their customers to do more. With UWP XAML Islands, developers can access more capable, flexible, powerful XAML controls regardless of which UI stack they use — whether it’s Windows Forms, WPF or native Win32.
.NET Core 3.0, which allows developers to use the latest version of .NET and have their application run in a stand-alone .NET environment so they can build amazing app experiences that don’t impact their broader organizational infrastructure.
MSIX, a complete containerization solution providing a simple way to convert large catalogs of applications. It inherits all the great features from UWP including reliable, robust installation and updating, as well as a managed security model and support for both enterprise management and the Microsoft Store.
Windows Machine Learning, a new platform that enables developers to easily develop machine learning models in the intelligent cloud and then deploy them offline and in high performance to the PC platform.
“Microsoft 365 is where the world gets its best work done, with 135 million commercial monthly active users of Office 365 and nearly 700 million Windows 10 connected devices, Microsoft 365 helps developers reach people how and where they work.”
- Joe Belfiore, corporate vice president, Microsoft
New Microsoft 365 experiences empower customers to do more
Microsoft introduced a set of technology experiences that addresses a more mobile workforce, including streamlining mobile Windows experiences across a variety of devices and platforms, as well as better blending web and app experiences.
These new experiences include:
A new way to connect your phone to your PC with Windows 10 that enables instant access to text messages, photos and notifications. Imagine being able to quickly drag and drop your phone’s photos into a document on your PC in one swift movement — without having to take your phone out of your pocket. This new experience will begin to roll out in the Windows Insider Program soon.
The Microsoft Launcher app on Android will support enterprise customers including line-of-business app discovery and IT advisement on configuration. The Microsoft Launcher app will also support Timeline for cross-device app launching.
On an iPhone or iPad, Microsoft Edge browsing sessions are included in the Timeline experience on a Windows 10 PC. Now customers will be able to access Timeline on an iPhone with Microsoft Edge.
Microsoft is enabling any developer to reach and engage new audiences with Sets, an easier way to organize your information and get back to what you were doing. With Sets, what belongs together stays together, making it easier and faster to create and be productive. For developers, UWP will work with Sets from the start, helping to keep customers engaged.
Adaptive Cards now supported within Microsoft 365 enable developers to create rich, interactive content in messages coming from their apps, bots or services into Teams and Outlook. As a result, people can approve expense reports or comment on an issue in GitHub directly within a Teams chat, or even pay bills directly in email.
Microsoft 365 is a comprehensive development platform — with pen, ink, mobile, devices, cloud and developer tools — all with infused intelligence, bringing simplicity to customers and streamlining development.
“The era of the intelligent cloud and intelligent edge is upon us. These advancements create incredible developer opportunity and also come with a responsibility to ensure the technology we build is trusted and benefits all.”
- Satya Nadella, CEO, Microsoft.
As part of Microsoft's commitment to trusted, responsible AI products and practices, the company also today announced AI for Accessibility, a new $25 million, five-year program aimed at harnessing the power of AI to amplify human capabilities for more than 1 billion people around the world with disabilities. The program comprises grants, technology investments and expertise, and will also incorporate AI for Accessibility innovations into Microsoft Cloud services. It builds on the success of the similar AI for Earth initiative.
Advancements in the intelligent edge and intelligent cloud
Smart devices are proliferating in homes and businesses across the globe, with more than 20 billion expected by 2020. These devices are so smart, in fact, they are powering advanced ways to see, listen, reason and predict, without constant connectivity to the cloud. That is the intelligent edge, and it is opening opportunities for consumers, businesses and entire industries, from the operating room to the factory floor.
Microsoft announced new capabilities for developers to extend to the edge:
Microsoft is open sourcing the Azure IoT Edge Runtime, allowing customers to modify, debug and have more transparency and control for edge applications.
Custom Vision will now run on Azure IoT Edge, enabling devices such as drones and industrial equipment to take critical action quickly without requiring cloud connectivity. This is the first Azure Cognitive Service to support edge deployment, with more coming to Azure IoT Edge over the next several months.
DJI, the world’s biggest drone company, is partnering with Microsoft to create a new SDK for Windows 10 PCs, and it has also selected Azure as its preferred cloud provider to further its commercial drone and SaaS solutions. The SDK will bring full flight control and real-time data transfer capabilities to nearly 700M Windows 10 connected devices globally. As part of the commercial partnership, DJI and Microsoft will co-develop solutions leveraging Azure IoT Edge and Microsoft’s AI services to enable new scenarios across agriculture, construction, public safety and more.
Microsoft announced a joint effort with Qualcomm Technologies, Inc. to create a vision AI developer kit running Azure IoT Edge. This solution makes available the key hardware and software required to develop camera-based IoT solutions. Developers can create solutions that use Azure Machine Learning services and take advantage of the hardware acceleration available via the Qualcomm® Vision Intelligence Platform and Qualcomm® AI Engine. The camera can also power advanced Azure services, such as machine learning, stream analytics and cognitive services, that can be downloaded from the cloud to run locally on the edge.
Data and AI development for a new era
Using data, machine learning and cognitive intelligence, developers can build and manage AI-rich solutions that transform the ways people work, collaborate and live:
Microsoft announced Project Kinect for Azure, a package of sensors, including our next-generation depth camera, with onboard compute designed for AI on the Edge. Building on Kinect’s legacy that has lived on through HoloLens, Project Kinect for Azure empowers new scenarios for developers working with ambient intelligence. Combining Microsoft’s industry-defining Time of Flight sensor with additional sensors all in a small, power-efficient form factor, Project Kinect for Azure will leverage the richness of Azure AI to dramatically improve insights and operations. It can input fully articulated hand tracking and high-fidelity spatial mapping, enabling a new level of precision solutions.
A Speech Devices SDK announced today delivers superior audio processing from multichannel sources for more accurate speech recognition, including noise cancellation, far-field voice and more. With this, developers can build a variety of voice-enabled scenarios like drive-thru ordering systems, in-car or in-home assistants, smart speakers, and other digital assistants.
Azure Cosmos DB updates include new and differentiated multimaster at global scale capabilities, designed to support both the cloud and the edge, along with the VNET general availability for increased security. With these new updates, Cosmos DB delivers even greater cost-effectiveness and global scale, further cementing it as the fastest-growing database service in the world.
A preview of Project Brainwave, an architecture for deep neural net processing, is now available on Azure and on the edge. Project Brainwave makes Azure the fastest cloud to run real-time AI and is now fully integrated with Azure Machine Learning. It also supports Intel FPGA hardware and ResNet50-based neural networks.
New Azure Cognitive Services updates include a unified Speech service with improved speech recognition and text-to-speech, which support customized voice models and translation. Along with Custom Vision, these updates make it easier for any developer to add intelligence to their applications.
Microsoft is making Azure the best place to develop conversational AI experiences integrated with any agent. New updates to Bot Framework and Cognitive Services will power the next generation of conversational bots enabling richer dialogs, and full personality and voice customization to match the company’s brand identity.
A preview of Azure Search with Cognitive Services integration. This new feature combines AI with indexing technologies so it’s possible to quickly find information and insights, whether via text or images.
Multisense and multidevice experiences
Microsoft also demonstrated mixed-reality capabilities to enable richer experiences that understand the context surrounding people, the things they use, their activities and relationships:
A new initiative, Project Kinect for Azure — a package of sensors from Microsoft that contains our unmatched time of flight depth camera, with onboard compute, in a small, power-efficient form factor — designed for AI on the Edge. Project Kinect for Azure brings together this leading hardware technology with Azure AI to empower developers with new scenarios for working with ambient intelligence.
With Microsoft Remote Assist, customers can collaborate remotely with heads-up, hands-free video calling, image sharing, and mixed-reality annotations. Firstline Workers can share what they see with any expert on Microsoft Teams, while staying hands on to solve problems and complete tasks together, faster.
With Microsoft Layout, customers can design spaces in context with mixed reality. Import 3-D models to create room layouts in real-world scale, experience designs as high-quality holograms in physical space or in virtual reality, and share and edit with stakeholders in real time.
Modern tooling and experiences for any platform in any language
Microsoft is empowering developers to build for the new era of the intelligent edge, across Azure, Microsoft 365 and other platforms, using the languages and frameworks of their choice:
With Azure Kubernetes Service (AKS), developers can drastically simplify how they build and run container-based solutions without deep Kubernetes experience. Generally available in the coming weeks, AKS integrates with developer tools and workspaces, DevOps capabilities, networking, monitoring tools, and more in the Azure portal, so developers can write code, not stitch services together. In addition, Microsoft is now offering Kubernetes support for Azure IoT Edge devices.
Visual Studio IntelliCode is a new capability that enhances everyday software development with the power of AI. IntelliCode provides intelligent suggestions to improve code quality and productivity and is available in preview today in Visual Studio.
Visual Studio Live Share, now in preview, lets developers easily and securely collaborate in real time with team members who can edit and debug directly from their existing tools like Visual Studio 2017 and VS Code. Developers can use Live Share with any language for any scenario, including serverless, cloud-native and IoT development.
Building on our shared commitment to developers and open source, Microsoft announced a new partnership with GitHub that brings the power of Azure DevOps services to GitHub customers. Today, we released the integration of Visual Studio App Center and GitHub, which provides GitHub developers building apps for iOS and Android devices to seamlessly automate DevOps processes right from within the GitHub experience.
Available today, the new Microsoft Azure Blockchain Workbench makes it easier to develop blockchain applications by stitching together an Azure-supported blockchain network with cloud services like Azure Active Directory, Key Vault and SQL Database, reducing proof-of-concept development time dramatically.