Flink Forward 2019--实战相关(10)--Tencent公司分享Oceanus搭建

Developing and operating real-time applications with Oceanus--Xiaogang Shi(Tencent)

The Tencent Data team (data.qq.com) is responsible to build a reliable and scalable infrastructure for various products at Tencent including Tencent Games, Tencent Video and WeChat. We have to process over 1.6 trillion events per day and the peak throughput reaches 210 million per second. Such a large scale exposes great challenges in the developing and operating of real-time applications. In this talk, we will give an introduction to Oceanus, a platform built at Tencent to facilitate the development of real-time applications. We will introduce typical user cases and how applications are developed, deployed and monitored with Oceanus. We will also introduce the management of Flink jobs in Oceanus, together with some experience gained in our operating practice. Finally, we will discuss some efforts we have done to enhance the reliability and efficiency, e.g. master failover and local keyed streams.

腾讯数据团队（data.qq.com）负责为腾讯的各种产品（包括腾讯游戏、腾讯视频和微信）构建可靠且可扩展的基础设施。我们每天必须处理超过1.6万亿个事件，峰值吞吐量达到2.1亿次/秒。如此大规模的应用暴露了实时应用程序开发和运行中的巨大挑战。在本次演讲中，我们将介绍在腾讯为促进实时应用程序开发而构建的平台Oceanus。我们将介绍典型的用户案例，以及如何使用Oceanus开发、部署和监控应用程序。我们还将介绍Oceanus Flink Jobs的管理，以及我们在运营实践中获得的一些经验。最后，我们将讨论我们为提高可靠性和效率所做的一些努力，例如主故障转移和本地键控流。