Devlog Devlog

text generation

• 5 Text Decoding Techniques

  Natural Language Processing 2022. 2. 24. 17:22

  아래 글을 공부하고 정리하는 글입니다. Reference https://towardsdatascience.com/5-text-decoding-techniques-that-every-nlp-enthusiast-must-know-6908e72f8df9 5 Text Decoding Techniques that every “NLP Enthusiast” Must Know Popular Text Decoding Methods in NLP with Visuals towardsdatascience.com NLP의 text generation 작업에서 모델은 디코딩 전략에 따라 생성하는 시퀀스가 다름 여기서는 유명한 text sampling 기술 random sampling, greedy sampling, beam se..

  Read More
• GPT2 vs XLNet

  Natural Language Processing 2022. 1. 13. 19:36

  아래 사이트 공부하고 적은 글 https://amanrusia.medium.com/xlnet-speaks-comparison-to-gpt-2-ea1a4e9ba39e XLNet speaks. Comparison to GPT-2 This was not me, but the XLNet model talking (prompt text is in the bold). For more samples and quick usage go to… amanrusia.medium.com Language Modeling의 3가지 전략 1. Unidirectional/Casual Language Modeling (단방향) - 단어들이 왼쪽에서 오른쪽 혹은 오른쪽에서 왼쪽으로 auto-regressive한 방식으로 공급됨 - LST..

  Read More