Podcast
Questions and Answers
What is the first step to request approval for a Workspace?
What is the first step to request approval for a Workspace?
- Click request review on the top left (correct)
- Submit the Workspace directly to the approver
- Assign the reviewer manually
- Email the review committee for feedback
What happens if you need to make changes to the Meaning Schema or induction examples?
What happens if you need to make changes to the Meaning Schema or induction examples?
- You will need to restart the entire approval process
- Additional evaluations will be necessary (correct)
- No changes can be made once submitted
- You can submit the Workspace without additional checks
What could commonly cause a submission to fail during the pre-submit checks?
What could commonly cause a submission to fail during the pre-submit checks?
- Missing workspace link
- Reviewer comments not addressed
- Invisible diffs (correct)
- Incorrect approver selected
What action is needed if the submission fails due to pre-submit checks?
What action is needed if the submission fails due to pre-submit checks?
What must be done first to create a new Meaning Schema in Intent Lab?
What must be done first to create a new Meaning Schema in Intent Lab?
Which tool can be used to check existing Meaning Schemas before creating a new one?
Which tool can be used to check existing Meaning Schemas before creating a new one?
What should you avoid enabling unless you are sure of high precision in interpretation?
What should you avoid enabling unless you are sure of high precision in interpretation?
What is the maximum suggested length for a description when defining a Meaning Schema?
What is the maximum suggested length for a description when defining a Meaning Schema?
After creating a Meaning Schema, which area should be set as Management Area?
After creating a Meaning Schema, which area should be set as Management Area?
What is the initial action when using the Model tool to create a new Meaning Schema?
What is the initial action when using the Model tool to create a new Meaning Schema?
What happens if you try to create a Meaning Schema while not in a Workspace?
What happens if you try to create a Meaning Schema while not in a Workspace?
What should be enabled in the left panel after creating a Meaning Schema for typical intent triggering?
What should be enabled in the left panel after creating a Meaning Schema for typical intent triggering?
What must be linked in the Workspace Description when answerless voting is enabled?
What must be linked in the Workspace Description when answerless voting is enabled?
When defining slots in Meaning Schemas, what must be specified?
When defining slots in Meaning Schemas, what must be specified?
Why is it important to calculate net wins versus losses in answerless voting cases relating to Trust and Safety?
Why is it important to calculate net wins versus losses in answerless voting cases relating to Trust and Safety?
What kind of data tag do the patterns receive when added through the Expand tool?
What kind of data tag do the patterns receive when added through the Expand tool?
What is the primary purpose of using slots in Meaning Schemas?
What is the primary purpose of using slots in Meaning Schemas?
Which of the following best describes the 'Expand tool'?
Which of the following best describes the 'Expand tool'?
What should be done after defining the slots for your Meaning Schema?
What should be done after defining the slots for your Meaning Schema?
In the context of answerless voting, what is the key reason for not allowing certain answers?
In the context of answerless voting, what is the key reason for not allowing certain answers?
What happens when a pattern is marked as good?
What happens when a pattern is marked as good?
What should be done with patterns after they are added to the Meaning Schema?
What should be done with patterns after they are added to the Meaning Schema?
What feature suggests patterns based on previously marked good patterns?
What feature suggests patterns based on previously marked good patterns?
Which of the following describes the process of adding multiple patterns at once?
Which of the following describes the process of adding multiple patterns at once?
What is the outcome of marking a pattern as bad?
What is the outcome of marking a pattern as bad?
What is the significance of KScorer salient terms?
What is the significance of KScorer salient terms?
How does the system identify patterns that should trigger a search stack?
How does the system identify patterns that should trigger a search stack?
What must be done if a new Meaning Schema is created?
What must be done if a new Meaning Schema is created?
What is the main purpose of the KE SxS eval?
What is the main purpose of the KE SxS eval?
What should be included in the KE SxS eval to enhance its effectiveness?
What should be included in the KE SxS eval to enhance its effectiveness?
Which eval is specifically designed to ensure that implementing the Meaning Schema does not break anything?
Which eval is specifically designed to ensure that implementing the Meaning Schema does not break anything?
How can the load test be initiated?
How can the load test be initiated?
What is the function of the 'Modify' option in the Workspace description?
What is the function of the 'Modify' option in the Workspace description?
What does the tags section in the Workspace description accomplish?
What does the tags section in the Workspace description accomplish?
What happens to the tags once an eval is completed?
What happens to the tags once an eval is completed?
Which statement describes the purpose of the Workspace Review tool?
Which statement describes the purpose of the Workspace Review tool?
Flashcards
Meaning Schema
Meaning Schema
A defined structure representing a specific meaning or understanding, used for query processing.
Intent Lab (IL)
Intent Lab (IL)
A tool for creating and managing Meaning Schemas.
Model Tool
Model Tool
The Intent Lab tool where new Meaning Schemas are built. Used for creating schemas and properties.
Workspace
Workspace
Signup and view all the flashcards
Loose Parsing
Loose Parsing
Signup and view all the flashcards
Offline Parsing
Offline Parsing
Signup and view all the flashcards
Management Area (Search)
Management Area (Search)
Signup and view all the flashcards
Catalog of Meaning Schemas
Catalog of Meaning Schemas
Signup and view all the flashcards
Answerless Voting
Answerless Voting
Signup and view all the flashcards
SxS Evaluation
SxS Evaluation
Signup and view all the flashcards
Workspace Description
Workspace Description
Signup and view all the flashcards
Meaning Schema Slots
Meaning Schema Slots
Signup and view all the flashcards
KG Collections
KG Collections
Signup and view all the flashcards
Required vs. Optional Slots
Required vs. Optional Slots
Signup and view all the flashcards
Query Examples
Query Examples
Signup and view all the flashcards
Expand Tool
Expand Tool
Signup and view all the flashcards
Adding Patterns
Adding Patterns
Signup and view all the flashcards
Marking Patterns as Good/Bad
Marking Patterns as Good/Bad
Signup and view all the flashcards
Fetch and Rank
Fetch and Rank
Signup and view all the flashcards
KScorer Salient Terms
KScorer Salient Terms
Signup and view all the flashcards
Evaluations
Evaluations
Signup and view all the flashcards
Induction Tag
Induction Tag
Signup and view all the flashcards
Request Review
Request Review
Signup and view all the flashcards
Reviewers' Feedback
Reviewers' Feedback
Signup and view all the flashcards
Submit Meaning Schema
Submit Meaning Schema
Signup and view all the flashcards
Pre-submit Checks
Pre-submit Checks
Signup and view all the flashcards
Production Release
Production Release
Signup and view all the flashcards
KE SxS Eval
KE SxS Eval
Signup and view all the flashcards
KE Eval
KE Eval
Signup and view all the flashcards
Load Test
Load Test
Signup and view all the flashcards
Workspace Review
Workspace Review
Signup and view all the flashcards
Tags in Workspace Description
Tags in Workspace Description
Signup and view all the flashcards
Send for Review
Send for Review
Signup and view all the flashcards
Study Notes
Modeling Meaning Schemas
- Modeling a Meaning Schema is easy using Intent Lab
- General SLS team approach is outlined
- Detailed modeling for complex schemas may need specialized tools/evaluation
- Refer to
go/meaning/concepts
for in-depth information
- Refer to
Creating a Meaning Schema
- Check existing schemas in the Meaning Schema catalog
- Use Query Examples Tool or Query Debugger to see if intended queries match existing schemas
- Use Model Tool or Meaning Explorer Tool to review slots of a schema
- If a schema does not exist, use Intent Lab (IL)
- Familiarize yourself with IL tools and associated concepts
- Refer to the Glossary for clarification
Workspace Creation
- Work within an existing workspace to create a new schema
- Refer to the link for workspace creation workflow
Model Tool
- Create new Meaning Schema (MS) using the Model Tool, and provide details
- Give relevant name, description, and define slots
- Understand Google's meaning definition (refer to
go/meaning
)
- Steps to create new MS:
- Navigate to the Model tool
- Input new MS name
- Use "Create NameOfSchema" button
- Provide a description (typically a sentence)
- Select "Search" as the Management Area
- Wait for Management area approval
- Click "Create"
- Verify completion of previous steps
Loose Parsing and Answerless Voting
- Enable Loose Parsing in the left panel for Search
- Enable offline parsing when enabling Loose Parsing for a MS
- Disable answerless voting unless needed (e.g., high precision is required) and link Workspace Description with a justification
- Add slots for location etc., using KG collections or MIDs
- Specify required/optional slots
Adding Patterns (Expand Tool)
- Use the Expand tool to manage patterns matching a meaning schema
- Define the slots of the meaning Schema before using the Expand Tool to add patterns
- Add multiple patterns on separate lines
- Mark patterns as "good" (triggering the schema in a search stack) or "bad" (blocking the pattern)
- Use "Fetch and Rank" functionality to suggest patterns
- Predicted patterns are light green and automatically trigger the schema
KScorer Salient Terms
- Generate KScorer salient terms, for new schemas, to be submitted to the system
- Salient terms are important for the KScorer Model (Google's ranking algorithm)
Evaluations
- Run evaluations to ensure Search functionality isn't compromised
- Use KE Evals and SxS evals; Refer to
Overview: Evals and KE Quality
for more details on these
- Use KE Evals and SxS evals; Refer to
KE SxS
orKE SxS with fallback fulfillment
evaluates the schema against a production version of Search
Workspace Review
- Navigate to the Workspace Review tool to examine changes
- Patterns from the expand tool are shown using the query examples
- Update workspace description by pressing "Modify"
- Add links to evaluations for clarity
Submission
- After approval, submit the schema
- Pre-submission validation checks exist
- Issues (like invisible diffs) might arise, address them, if faced
- Use resources (e.g.,
go/pp-where-is-my-cl
,go/pp-where-is-my-cl-dashboard
) to see when the changes will be available in production
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.