attention-mechanism

Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)

roadmap neural-network cnn dnn tts speech-synthesis speech-recognition rnn seq2seq automatic-speech-recognition papers language-model attention-mechanism speaker-verification timit-dataset acoustic-model recognition-synthesis

Updated Aug 13, 2021

sgrvinod / a-PyTorch-Tutorial-to-Image-Captioning

Star

Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning

computer-vision pytorch image-captioning show-attend-and-tell attention-mechanism encoder-decoder pytorch-tutorial mscoco

Updated Jul 26, 2021
Python

Diego999 / pyGAT

Star

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

python pytorch neural-networks attention-mechanism graph-attention-networks self-attention

Updated Aug 15, 2021
Python

lucidrains / reformer-pytorch

Star

Reformer, the efficient Transformer, in Pytorch

machine-learning transformers pytorch artificial-intelligence attention-mechanism

Updated May 9, 2021
Python

lucidrains / lambda-networks

Star

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

computer-vision deep-learning artificial-intelligence attention attention-mechanism

Updated Nov 18, 2020
Python

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

python deep-learning jupyter pytorch attention attention-mechanism graph-attention-networks self-attention pytorch-implementation gat graph-attention-network pytorch-gat gat-tutorial

Updated Feb 12, 2021
Jupyter Notebook

awslabs / sockeye

Star

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

machine-learning deep-neural-networks translation deep-learning mxnet machine-translation transformer seq2seq neural-machine-translation sequence-to-sequence gluon attention-mechanism encoder-decoder attention-model sequence-to-sequence-models attention-alignment-visualization attention-is-all-you-need sockeye transformer-architecture transformer-network

Updated Aug 13, 2021
Python

richliao / textClassifier

Star

Text classifier for Hierarchical Attention Networks for Document Classification

text-classification recurrent-neural-networks convolutional-neural-networks attention-mechanism hierarchical-attention-networks

Updated Sep 12, 2019
Python

lucidrains / x-transformers

Star

A simple but complete full-attention transformer with a set of promising experimental features from various papers

deep-learning transformers artificial-intelligence attention-mechanism

Updated Aug 20, 2021
Python

charlesXu86 / Chatbot_CN

Star

基于金融-司法领域(兼有闲聊性质)的聊天机器人，其中的主要模块有信息抽取、NLU、NLG、知识图谱等，并且利用Django整合了前端展示,目前已经封装了nlp和kg的restful接口

reinforcement-learning deep-learning sentiment-analysis text-classification tensorflow nlu knowledge-graph recommendation nlg ner attention-mechanism ir dialogue-systems slot-filling oriented-dialogs intent-detection django-restful chatbot-cn tenserflow-serving text-correct

Updated Jun 13, 2021

yunjey / show-attend-and-tell

Star

TensorFlow Implementation of "Show, Attend and Tell"

tensorflow image-captioning show-attend-and-tell attention-mechanism mscoco-image-dataset

Updated Jul 28, 2018
Jupyter Notebook

lucidrains / alphafold2

Star

To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

deep-learning artificial-intelligence attention-mechanism protein-folding

Updated Aug 10, 2021
Python

datalogue / keras-attention

Star

Visualizing RNNs using the attention mechanism

machine-learning natural-language-processing deep-neural-networks translation deep-learning recurrent-neural-networks attention-mechanism

Updated Jun 25, 2019
Python

atulkum / pointer_summarizer

Sponsor Star

Open

Need help for retraining and cross validation

12

atulkum commented Nov 30, 2018

Need help for retraining and cross validation and see if the ROUGE score matches exactly (or better) with the numbers reported in the paper.
I just train for 500k iteration (with batch size 8) with pointer generation enabled + coverage loss disabled and next 100k iteration (with batch size 8) with pointer generation enabled + coverage loss enabled.

It would be great if someone can help re-r

lucidrains / performer-pytorch

Star

An implementation of Performer, a linear attention-based transformer, in Pytorch

deep-learning transformers artificial-intelligence attention attention-mechanism

Updated Aug 21, 2021
Python

cedrickchee / awesome-bert-nlp

Star

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

nlp natural-language-processing awesome transformer neural-networks awesome-list transfer-learning language-model attention-mechanism bert gpt-2 xlnet pre-trained-language-models gpt-3

Updated Jul 19, 2021

Canjie-Luo / MORAN_v2

Star

MORAN: A Multi-Object Rectified Attention Network for Scene Text Recognition

attention-mechanism image-rectification scene-text image-deformation scene-text-recognition

Updated Feb 8, 2021
Python

ibrahimjelliti / Deeplearning.ai-Natural-Language-Processing-Specialization

Star

This repository contains my full work and notes on Coursera's NLP Specialization (Natural Language Processing) taught by the instructor Younes Bensouda Mourri and Łukasz Kaiser offered by deeplearning.ai

nlp machine-learning deep-learning naive-bayes coursera neural-networks logistic-regression attention-mechanism neural specialization probabilistic-models encoder-decoder sequence-models deeplearning-ai

Updated Jun 28, 2021
Jupyter Notebook

CyberZHG / keras-self-attention

Star

Attention mechanism for processing sequential data that considers the context for each timestamp.

keras attention-mechanism

Updated Jun 15, 2021
Python

The-AI-Summer / self-attention-cv

Star

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

machine-learning deep-learning machine-learning-algorithms transformers artificial-intelligence transformer attention attention-mechanism self-attention

Updated Jul 26, 2021
Python

lvapeab / nmt-keras

Star

Neural Machine Translation with Keras

machine-learning theano deep-learning tensorflow machine-translation keras decoding transformer gru neural-machine-translation sequence-to-sequence score nmt newer attention-mechanism web-demo attention-model lstm-networks attention-is-all-you-need attention-seq2seq nmt-keras

Updated Jul 30, 2021
Python

lucidrains / bottleneck-transformer-pytorch

Star

Implementation of Bottleneck Transformer in Pytorch

deep-learning transformers artificial-intelligence vision image-classification attention-mechanism

Updated Feb 1, 2021
Python

lucidrains / TimeSformer-pytorch

Star

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

deep-learning transformers artificial-intelligence attention-mechanism video-classification

Updated Aug 16, 2021
Python

Here are 793 public repositories matching this topic...

brightmart / text_classification

lucidrains / vit-pytorch

benedekrozemberczki / awesome-graph-classification

Kyubyong / transformer

lucidrains / DALLE-pytorch

philipperemy / keras-attention-mechanism

PetarV- / GAT

zzw922cn / awesome-speech-recognition-speech-synthesis-papers

sgrvinod / a-PyTorch-Tutorial-to-Image-Captioning

Diego999 / pyGAT

lucidrains / reformer-pytorch

lucidrains / lambda-networks

gordicaleksa / pytorch-GAT

awslabs / sockeye

richliao / textClassifier

lucidrains / x-transformers

charlesXu86 / Chatbot_CN

yunjey / show-attend-and-tell

lucidrains / alphafold2

datalogue / keras-attention

atulkum / pointer_summarizer

Need help for retraining and cross validation

lucidrains / performer-pytorch

cedrickchee / awesome-bert-nlp

Canjie-Luo / MORAN_v2

ibrahimjelliti / Deeplearning.ai-Natural-Language-Processing-Specialization

CyberZHG / keras-self-attention

The-AI-Summer / self-attention-cv

lvapeab / nmt-keras

lucidrains / bottleneck-transformer-pytorch

lucidrains / TimeSformer-pytorch

Improve this page

Add this topic to your repo

Jul	AUG	Sep
	21
2020	2021	2022