greedy search
-
5 Text Decoding TechniquesNatural Language Processing 2022. 2. 24. 17:22
아래 글을 공부하고 정리하는 글입니다. Reference https://towardsdatascience.com/5-text-decoding-techniques-that-every-nlp-enthusiast-must-know-6908e72f8df9 5 Text Decoding Techniques that every “NLP Enthusiast” Must Know Popular Text Decoding Methods in NLP with Visuals towardsdatascience.com NLP의 text generation 작업에서 모델은 디코딩 전략에 따라 생성하는 시퀀스가 다름 여기서는 유명한 text sampling 기술 random sampling, greedy sampling, beam se..
-
seq2seq 그리고 attentionNatural Language Processing 2022. 2. 4. 23:06
Reference https://guillaumegenthial.github.io/sequence-to-sequence.html Seq2Seq with Attention and Beam Search Sequence to Sequence basics for Neural Machine Translation using Attention and Beam Search guillaumegenthial.github.io https://wikidocs.net/24996 1) 시퀀스-투-시퀀스(Sequence-to-Sequence, seq2seq) 이번 실습은 케라스 함수형 API에 대한 이해가 필요합니다. 함수형 API(functional API, https://wikidocs.net/38861 )에 대해서 우선 숙 ..