KwickClips Artificial Intelligence · 38 sec · free
What is the first step?
Short answer. Make the dictionary.
What is a document vector?
The row of word counts for one document.
Bag of Words
| Doc | Vector |
|---|---|
| Riya plays | 1 1 0 |
| Aman plays | 0 1 1 |
| Riya, Aman | 1 0 1 |
Remember
| Make the dictionary |
| Count words per document |
How do three sentences become numbers? Here are the three rows. The dictionary is riya, plays, aman. Count each word per document. Each row of counts is a document vector. Two steps. Make the dictionary. Count words per document.
This clip is from the full lesson: Text Processing: Normalisation, Tokenisation, Bag of Words and TF-IDF — 8 minutes, with the tables, the quick answers and the whole lesson in text.
Useful for: CBSE Class 10 Artificial Intelligence (417), CBSE Class 10 Artificial Intelligence (417), CBSE Class 10 Artificial Intelligence (417)
More KwickClips from this lesson
What comes after sentence segmentation?46 sec
What is the stem of 'studies'?42 sec
Why does 'the' score zero?42 secDisclaimer. KwickAcademy is free study material for general learning and revision. Parts of it, including the voice-over, are produced with the help of AI tools and may contain errors; if you spot one, please tell us and we will correct it. Syllabus, marks and exam details follow the latest official board publications available to us, and boards can change them at any time, so always confirm against your board's official website and your school. Using this material does not guarantee any marks or result. Board names and trademarks belong to their owners; Kwickprep is not affiliated with or endorsed by any examination board. We never ask for passwords, OTPs or ID numbers. Your progress is saved only in this browser. Full disclaimer · Privacy