Text Vector Spaces and Nearest Neighbors Quiz

Play an AI-generated podcast conversation about this lesson

Which of the following actions should NOT be done in the building during a fire?

Properly disposing of flammable substances

Remaining calm

Starting a fire

Smoking inside the building (correct)

What is the most important rule to follow in case of a fire?

Call the fire department immediately

Warn others about the fire

Stay calm (correct)

Evacuate the building

What should you do after reporting a fire to the emergency services?

Inform the service staff

Wait for further instructions (correct)

Evacuate the building

Attempt to extinguish the fire

Which of the following is a branch of ethics that deals with the behavior of machines?

Machine Ethics Signup and view all the answers

What is the main focus of Applied Ethics?

Determining moral course of action in specific situations Signup and view all the answers

Which of the following is NOT a cluster of principles in AI Ethics Guidelines?

Accuracy Signup and view all the answers

What is the main focus of Supervised Machine Learning?

Learning from manually labeled training examples Signup and view all the answers

Which of the following is NOT a potential cause of disagreement in inter-annotator agreement (IAA)?

Inconsistent labels Signup and view all the answers

What is the purpose of revising or aggregating annotations if IAA is too low?

To average over annotations Signup and view all the answers

What is the purpose of the calibration set in the data annotation workflow?

To compute the IAA Signup and view all the answers

What is the gold (or 'ground truth') set in the data annotation workflow?

The revised dataset Signup and view all the answers

Which agreement measure is used to compute the chance-corrected inter-annotator agreement (IAA)?

Cohen's Kappa Signup and view all the answers

What is the range of values for Cohen's Kappa?

-1 to 1 Signup and view all the answers

What is the formula to compute observed agreement (Ao) for Cohen's Kappa?

Ao = p11 + p22 Signup and view all the answers

Which agreement measure is used when one annotator's results are taken as the true labels?

Cohen's Kappa Signup and view all the answers

Which of the following evaluation measures is commonly used for classification?

Accuracy Signup and view all the answers

What is the purpose of splitting the labeled test set into a training set and a test set?

To evaluate the classifier's generalization ability Signup and view all the answers

What is the main advantage of using the micro-average measure for multi-class classification evaluation?

It is less affected by classes with fewer instances Signup and view all the answers

Why is accuracy not recommended for skewed class distributions?

It may give misleading results when there are too many negative examples Signup and view all the answers

Which of the following is a goal of supervised machine learning?

To learn from training data a classifier that maps an instance to a class Signup and view all the answers

What does the tf-idf weighting scheme take into account?

The number of occurrences of a term within a document and the rarity of the term in the collection Signup and view all the answers

What is the purpose of the kNN algorithm in text classification?

To identify the k nearest neighbors of an instance and estimate the probability of each class Signup and view all the answers

What are the pros and cons of the Nearest-Neighbor learning algorithm?

Learning/training is simple, but testing requires computing similarity with all examples Signup and view all the answers