论文合集|大规模图上的高效gnn

人工智能博士 人工智能博士     2022-12-24     203

关键词:

点上方人工智能算法与Python大数据获取更多干货

在右上方 ··· 设为星标 ★,第一时间获取资源

仅做学术分享,如有侵权,联系删除

转载于 :图与推荐

???? Awesome Efficient Graph Neural Networks

图神经网络在工业界应用非常受欢迎,这是一篇关于高效图神经网络大规模网络中图神经网络应用的精选论文列表。

链接:https://github.com/chaitjo/awesome-efficient-gnn

Efficient and Scalable GNN Architectures

  • [ICML 2019] Simplifying Graph Convolutional Networks. Felix Wu, Tianyi Zhang, Amauri Holanda de Souza Jr., Christopher Fifty, Tao Yu, Kilian Q. Weinberger.

  • [ICML 2020 Workshop] SIGN: Scalable Inception Graph Neural Networks. Fabrizio Frasca, Emanuele Rossi, Davide Eynard, Ben Chamberlain, Michael Bronstein, Federico Monti.

  • [ICLR 2021 Workshop] Adaptive Filters and Aggregator Fusion for Efficient Graph Convolutions. Shyam A. Tailor, Felix L. Opolka, Pietro Liò, Nicholas D. Lane.

  • [ICLR 2021] On Graph Neural Networks versus Graph-Augmented MLPs. Lei Chen, Zhengdao Chen, Joan Bruna.

  • [ICML 2021] Training Graph Neural Networks with 1000 Layers. Guohao Li, Matthias Müller, Bernard Ghanem, Vladlen Koltun.

Source: Simplifying Graph Convolutional Networks

Neural Architecture Search for GNNs

  • [IJCAI 2020] GraphNAS: Graph Neural Architecture Search with Reinforcement Learning. Yang Gao, Hong Yang, Peng Zhang, Chuan Zhou, Yue Hu.

  • [AAAI 2021 Workshop] Probabilistic Dual Network Architecture Search on Graphs. Yiren Zhao, Duo Wang, Xitong Gao, Robert Mullins, Pietro Lio, Mateja Jamnik.

  • [IJCAI 2021] Automated Machine Learning on Graphs: A Survey. Ziwei Zhang, Xin Wang, Wenwu Zhu.

Source: Probabilistic Dual Network Architecture Search on Graphs

Large-scale Graphs and Sampling Techniques

  • [KDD 2019] Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks. Wei-Lin Chiang, Xuanqing Liu, Si Si, Yang Li, Samy Bengio, Cho-Jui Hsieh.

  • [ICLR 2020] GraphSAINT: Graph Sampling Based Inductive Learning Method. Hanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan, Viktor Prasanna.

  • [KDD 2020] Scaling Graph Neural Networks with Approximate PageRank. Aleksandar Bojchevski, Johannes Klicpera, Bryan Perozzi, Amol Kapoor, Martin Blais, Benedek Rózemberczki, Michal Lukasik, Stephan Günnemann.

  • [ICML 2021] GNNAutoScale: Scalable and Expressive Graph Neural Networks via Historical Embeddings. Matthias Fey, Jan E. Lenssen, Frank Weichert, Jure Leskovec.

  • [ICLR 2021] Graph Traversal with Tensor Functionals: A Meta-Algorithm for Scalable Learning. Elan Markowitz, Keshav Balasubramanian, Mehrnoosh Mirtaheri, Sami Abu-El-Haija, Bryan Perozzi, Greg Ver Steeg, Aram Galstyan.

Source: GraphSAINT: Graph Sampling Based Inductive Learning Method

Low Precision and Quantized GNNs

  • [EuroMLSys 2021] Learned Low Precision Graph Neural Networks. Yiren Zhao, Duo Wang, Daniel Bates, Robert Mullins, Mateja Jamnik, Pietro Lio.

  • [ICLR 2021] Degree-Quant: Quantization-Aware Training for Graph Neural Networks. Shyam A. Tailor, Javier Fernandez-Marques, Nicholas D. Lane.

  • [CVPR 2021] Binary Graph Neural Networks. Mehdi Bahri, Gaétan Bahl, Stefanos Zafeiriou.

Source: Degree-Quant: Quantization-Aware Training for Graph Neural Networks

Knowledge Distillation for GNNs

  • [CVPR 2020] Distilling Knowledge from Graph Convolutional Networks. Yiding Yang, Jiayan Qiu, Mingli Song, Dacheng Tao, Xinchao Wang.

  • [WWW 2021] Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Framework. Cheng Yang, Jiawei Liu, Chuan Shi.

Source: Distilling Knowledge from Graph Convolutional Networks

Hardware Acceleration of GNNs

  • [IPDPS 2019] Accurate, Efficient and Scalable Graph Embedding. Hanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan, Viktor Prasanna.

  • [IEEE TC 2020] EnGN: A High-Throughput and Energy-Efficient Accelerator for Large Graph Neural Networks. Shengwen Liang, Ying Wang, Cheng Liu, Lei He, Huawei Li, Xiaowei Li.

  • [FPGA 2020] GraphACT: Accelerating GCN Training on CPU-FPGA Heterogeneous Platforms. Hanqing Zeng, Viktor Prasanna.

  • [IEEE CAD 2021] Rubik: A Hierarchical Architecture for Efficient Graph Learning. Xiaobing Chen, Yuke Wang, Xinfeng Xie, Xing Hu, Abanti Basak, Ling Liang, Mingyu Yan, Lei Deng, Yufei Ding, Zidong Du, Yunji Chen, Yuan Xie.

  • [ACM Computing 2021] Computing Graph Neural Networks: A Survey from Algorithms to Accelerators. Sergi Abadal, Akshay Jain, Robert Guirado, Jorge López-Alonso, Eduard Alarcón.

Source: Computing Graph Neural Networks: A Survey from Algorithms to Accelerators

Industrial Applications and Systems

  • [KDD 2018] Graph Convolutional Neural Networks for Web-Scale Recommender Systems. Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L. Hamilton, Jure Leskovec.

  • [VLDB 2019] AliGraph: A Comprehensive Graph Neural Network Platform. Rong Zhu, Kun Zhao, Hongxia Yang, Wei Lin, Chang Zhou, Baole Ai, Yong Li, Jingren Zhou.

  • [DeepMind Blog 2021] Traffic prediction with advanced Graph Neural Networks. Oliver Lange, Luis Perez.

Source: Graph Convolutional Neural Networks for Web-Scale Recommender Systems

---------♥---------

声明:本内容来源网络,版权属于原作者

图片来源网络,不代表本公众号立场。如有侵权,联系删除

AI博士私人微信,还有少量空位

如何画出漂亮的深度学习模型图?

如何画出漂亮的神经网络图?

一文读懂深度学习中的各种卷积

点个在看支持一下吧

论文阅读gnn阅读笔记

...xff1a;人物在场景里同时出现数据集:Qm9化学分子式Cora论文引用wikipedia知识图引用图在图上可以定义什么问题图层面比如给一张图,对图进行分类顶点层面节点分类边层面边的属性预测将机器学习用在图上会遇到什么挑战... 查看详情

论文笔记之gpt-gnn:generativepre-trainingofgraphneuralnetworks

参考技术A文中指出训练GNN需要大量和任务对应的标注数据,这在很多时候是难以获取的。一种有效的方式是,在无标签数据上通过自监督的方式预训练一个GNN,然后在下游任务上只需要少量的标注数据进行fine-tuning。本文提出了... 查看详情

论文笔记:dropmessage:unifyingrandomdroppingforgraphneuralnetworks

...#xff0c;从邻居处聚合信息尽管GNN有显著的进步,但是在大规模图中训练GNN会遇到各种问题:过拟合过拟合之后,GNN的泛化能力就被限制了过渡平滑经过多轮邻居信息整合的迭代之后,GNN中不同点之前的表征会很相似... 查看详情

来看看几篇nature上的gnn吧~

...#xff01;我是Charmve,随着该领域的成熟,图神经网络论文的数量也在增长,作者仔细研究了一些科学应用,并收集了几篇发表在Nature上的GNN论文。我们周围的很多信息都可以用图表来表示。一个例子是城市道路网络&#... 查看详情

阿里安全×icdm202220万奖金池!大规模电商图上的风险商品检测赛火热报名中!...

#黑灰产VS风控系统近年来,图计算尤其是图神经网络等技术获得了快速的发展以及广泛的应用。在电商平台上的风险商品检测场景中,黑灰产和风控系统之间存在着激烈的对抗,黑灰产为了躲避平台管控,会蓄意... 查看详情

图神经网络学习笔记|基础知识与gnn介绍直观透彻理解

...、异常检测等图学习任务需求的算法总称。GCN实现了CNN在图上的平移不变、局部感知和权值共享,为接下来其他GNN框架的构造和改进提供了思想上的指导和借鉴,下面给出GNN中相关符号的说明和定义。定义1:图(Graph)(Graph)(Grap 查看详情

论文盘点:基于图卷积gnn的多目标跟踪算法解析

论文盘点:基于图卷积GNN的多目标跟踪算法解析Source:PaperWeekly  [1]JiangX,LiP,LiY,etal.GraphNeuralBasedEnd-to-endDataAssociationFrameworkforOnlineMultiple-ObjectTracking[J].arXivpreprintarXiv:1907.05315,2019.&nb 查看详情

zz清华nlp图神经网络gnn论文分门别类,16大应用200+篇论文最新推荐

【清华NLP】图神经网络GNN论文分门别类,16大应用200+篇论文最新推荐图神经网络研究成为当前深度学习领域的热点。最近,清华大学NLP课题组JieZhou,GanquCui,ZhengyanZhangandYushiBai同学对GNN相关的综述论文、模型与应用进行了综述,并... 查看详情

论文泛读deeplearning论文合集

【论文泛读】DeepLearning论文合集文章目录【论文泛读】DeepLearning论文合集BatchNormalization:AcceleratingDeepNetworkTrainingbyReducingInternalCovariateShiftImageNetClassificationwithDeepConvolutionalNeuralNetworksVeryDeepConvo 查看详情

论文泛读deeplearning论文合集

【论文泛读】DeepLearning论文合集文章目录【论文泛读】DeepLearning论文合集BatchNormalization:AcceleratingDeepNetworkTrainingbyReducingInternalCovariateShiftImageNetClassificationwithDeepConvolutionalNeuralNetworksVeryDeepConvo 查看详情

一个高效且友好的tensorflow图神经网络(gnn)框架:tf_geometric(代码片段)

...有趣的模型。Github主页:https://github.com/CrawlScript/tf_geometric论文:EfficientGraphDeepLearninginTensorFlowwithtf_geometric高效且友好的APItf_geometric使用消息传递机制来实现图神经网络:相比于基于稠密矩阵的实现,它具有更高的效率;... 查看详情

一个高效且友好的tensorflow图神经网络(gnn)框架:tf_geometric(代码片段)

...有趣的模型。Github主页:https://github.com/CrawlScript/tf_geometric论文:EfficientGraphDeepLearninginTensorFlowwithtf_geometric高效且友好的APItf_geometric使用消息传递机制来实现图神经网络:相比于基于稠密矩阵的实现,它具有更高的效率;... 查看详情

gnn论文笔记:graphneuralnetworkswithconvolutionalarmafilters

0摘要        流行的图神经网络基于多项式谱滤波器实现图的卷积运算。        在本文中,我们提出了一种新的图卷积层,其灵感来自自回归移动平均(ARMA)滤波器.        与多项式滤波器相比,它提供了... 查看详情

论文笔记acomprehensivesurveyongraphneuralnetworks(gnn综述)

前言近年来,深度学习促进了很多机器学习任务的发展,这些任务很多都表示在规则的欧几里得空间中表示。但是图作为具有复杂关系和对象之间相互依赖,其数据是从非欧几里得域生成的,最近也有很多关于图... 查看详情

第十四周.直播.论文写作讲解2

文章目录论文选题论文构思论文选题写作举例本文内容整理自深度之眼《GNN核心能力培养计划》公式输入请参考:在线Latex公式论文选题论文构思如何选题:新问题(GNN应用到生物化学,MPNN;GNN应用到推荐系... 查看详情

论文笔记:semi-supervisedclassificationwithgraphconvolutionalnetworks

...>这种平滑性假设在一定程度上限制了模型的表达能力论文中直接使用一个神经网络f(X,A)来编码图结构提取学到的nodeembedding中,有label的那一部分,计算L0,以此进行训练2图卷积的快速估计考虑一个多层的GCN,其... 查看详情

论文笔记:semi-supervisedclassificationwithgraphconvolutionalnetworks

...>这种平滑性假设在一定程度上限制了模型的表达能力论文中直接使用一个神经网络f(X,A)来编码图结构提取学到的nodeembedding中,有label的那一部分,计算L0,以此进行训练2图卷积的快速估计考虑一个多层的GCN,其... 查看详情

cvpr2021论文合集下载论文大全下载论文分类汇总

1.CVPR2021接受论文&代码解读&PPT(持续更新中,敬请关注)论文合集下载:百度网盘:https://pan.baidu.com/s/1caJ8PKQizDYt1TInEVBjSg提取码:uuro下载链接和提取码已更新(2021-03-02)分类目录:检测图像目标检... 查看详情