首页
学习
活动
专区
工具
TVP
发布

小锋学长生活大爆炸

分享自己学习过程中的笔记、教程、踩坑、经验等等
专栏作者
381
文章
728092
阅读量
31
订阅数
【阅读】A Comprehensive Survey on Distributed Training of Graph Neural Networks——翻译
        Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model in broad application fields for their effectiveness in learning over graphs. To scale GNN training up for large-scale and ever-growing graphs, the most promising solution is distributed training which distributes the workload of training across multiple computing nodes. However, the workflows, computational patterns, communication patterns, and optimization techniques of distributed GNN training remain preliminarily understood. In this paper, we provide a comprehensive survey of distributed GNN training by investigating various optimization techniques used in distributed GNN training. First, distributed GNN training is classified into several categories according to their workflows. In addition, their computational patterns and communication patterns, as well as the optimization techniques proposed by recent work are introduced. Second, the software frameworks and hardware platforms of distributed GNN training are also introduced for a deeper understanding. Third, distributed GNN training is compared with distributed training of deep neural networks, emphasizing the uniqueness of distributed GNN training. Finally, interesting issues and opportunities in this field are discussed.
小锋学长生活大爆炸
2023-02-02
3750
手敲一遍数据结构和排序算法 Java
​ 不管元素在什么情况下都要做这些步骤,所以花销的时间是不变的,所以该算法的最优时间复杂度和最差时间复杂度及平均时间复杂度都是一样的为:O( nlogn )
小锋学长生活大爆炸
2022-03-29
3960
C语言实现hashMap
图中,紫色部分即代表哈希表,也称为哈希数组,数组的每个元素都是一个单链表的头节点,链表是用来解决冲突的,如果不同的key映射到了数组的同一位置处,就将其放入单链表中。
小锋学长生活大爆炸
2020-11-10
4.3K0
Java学习笔记, 不断更新
(1)split表达式,就是一个正则表达式。* ^ | 等符号在正则表达式中属于一种有特殊含义的字符,如果使用此种字符作为分隔符,必须使用转义符即 \ 加以转义。 (2)如果使用多个分隔符则需要借助 | 符号,如 “\^|@|#”,但需要转义符的仍然要加上分隔符进行处理。
小锋学长生活大爆炸
2020-08-13
1K0
Python二叉树详解笔记
退化(或病态)树(Degenerate (or pathological) tree)
小锋学长生活大爆炸
2020-08-13
8820
没有更多了
社区活动
RAG七天入门训练营
鹅厂大牛手把手带你上手实战
Python精品学习库
代码在线跑,知识轻松学
博客搬家 | 分享价值百万资源包
自行/邀约他人一键搬运博客,速成社区影响力并领取好礼
技术创作特训营·精选知识专栏
往期视频·千货材料·成员作品 最新动态
领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档