NLP Lecture 2: NLP Pipeline and Tools Quiz
16 Questions
3 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is the purpose of tokenization in natural language processing?

  • Dividing the context into a set of sentences
  • Determining the lexical category of the word based on its meaning in the context
  • Splitting the sentence into a set of tokens/words based on spaces (correct)
  • Identifying the syntactic structure of the text

    • What is a challenge in tokenization in natural language processing?

  • Dividing the context into a set of sentences
  • Lack of spaces between words in languages like Japanese and Chinese (correct)
  • Finding the maximum length of letters to form an understood meaning
  • Identifying the syntactic structure of the text

    • What is the purpose of sentence segmentation in natural language processing?

  • Dividing the context into a set of sentences using ML algorithms (correct)
  • Determining the lexical category of the word based on its meaning in the context
  • Dividing the sentence into a set of tokens/words based on spaces
  • Identifying the syntactic structure of the text

    • What does POS tagging aim to determine in natural language processing?

    <p>Lexical category of the word based on its meaning in the context</p> Signup and view all the answers

    Which step of the traditional NLP pipeline involves identifying Named Entities within the text?

    <p>NER (Named Entity Recognition)</p> Signup and view all the answers

    What is one of the purposes of using ML algorithms for sentence segmentation?

    <p>Finding End Of Statements (EOS)</p> Signup and view all the answers

    What is the main focus of POS tagging?

    <p>Identifying and categorizing parts of speech in a sentence</p> Signup and view all the answers

    Which type of word reduction removes all affixes to reduce the word to its stem?

    <p>Stemming</p> Signup and view all the answers

    What is the purpose of Name Entity Recognition (NER)?

    <p>Identifying and classifying important names in text</p> Signup and view all the answers

    What is the role of Lemmatization in word processing?

    <p>Reducing words to their roots by removing all affixes</p> Signup and view all the answers

    What technique aids in word disambiguation by reducing words to their roots?

    <p>Stemming</p> Signup and view all the answers

    Which factor is considered in POS tagging for word disambiguation?

    <p>Knowledge of neighboring words in the context</p> Signup and view all the answers

    Which technology is NOT supported by Spacy for word processing?

    <p>Stemming</p> Signup and view all the answers

    What is the percentage accuracy limit of current models for POS tagging?

    <p>~97%</p> Signup and view all the answers

    Which part of speech is NOT classified under Closed POS Classes?

    <p>Proper Noun</p> Signup and view all the answers

    What is the focus of Closed vs. Open POS Classes?

    <p>Classifying different types of nouns and adjectives</p> Signup and view all the answers

    More Like This

    Use Quizgecko on...
    Browser
    Open
    Browser
    Browser