Skip to content

Latest commit

Β 

History

History
27 lines (17 loc) Β· 1014 Bytes

mixed-info-on-nlp.md

File metadata and controls

27 lines (17 loc) Β· 1014 Bytes
description
Mixed Info On Natural Language Processing

πŸ’¬ Mixed Info On NLP

πŸ€Έβ€β™€οΈ Applications

πŸ”  Neural Machine Translation

  • A machine translation model is similar to a language model except it has an encoder network placed before.
  • It is sometimes referred as a conditional language model.

πŸ•΅οΈβ€β™€οΈ Neural Machine Translation with Attention

  • If you had to translate a book's paragraph from French to English, you would not read the whole paragraph, then close the book and translate πŸ˜…
  • Even during the translation process, you would read/re-read and focus on the parts of the French paragraph corresponding to the parts of the English you are writing down πŸ€”
  • The attention mechanism tells a Neural Machine Translation model where it should pay attention to at any step πŸ‘©β€πŸ«

πŸ”Š Speech Recognition

  • Converting an audio (x-input) to text (y-output)
    • By measuring air pressure πŸ™„
  • Sequence-to-Sequence model

TODO: Add details