5.1cosine_similarity_wshop

pdf

School

Nanyang Technological University *

*We aren’t endorsed by this school

Course

1701X

Subject

Computer Science

Date

Nov 24, 2024

Type

pdf

Pages

2

Uploaded by DukeLemur2884

Report
NLP – Cosine Similarity Workshop Objective To practice using Cosine Similarity as a tool for performing searching for relevant documents based on a given query string Exercise You are given a text file called “ quotes .txt” that contains 51 quotes. Given a query string, list out the most relevant quotes. First, treat each quote as a separate document and compute TFIDF values for each word in the 51 documents (remember to treat each line of quote as a separate document; your corpus is the 51 documents). Next, treat the query string as a separate document and compute its TFIDF values as well. Then, perform Cosine Similarity between the query string (treat it as a document) and the 51 documents. A cosine similarity greater than 0 is regarded as a relevant document for the query string. Rank the documents (i.e. lines of quote) by their cosine similarity scores (descending order - higher cosine similarity first) For pre-processing, remember to remove stop-words from your corpus and stem each word in the text.
Use the query string – “ life wise choices ” to test your results. Given the above query string, your results should be:
Your preview ends here
Eager to read complete document? Join bartleby learn and gain access to the full version
  • Access to all documents
  • Unlimited textbook solutions
  • 24/7 expert homework help

Related Documents

Screenshot (508).png
ThejasviNarayanaPasupulety_Module8_HandsOn_Assignment.docx
attachment_1 - 2023-11-24T152234.893.docx
C Programming Assignment.docx
murachs_php_4E_chapter10.rtf
Sri Discussion 3 ML.docx
photo_16_2024-02-15_13-41-00.jpg
attachment_2 (20).docx
Lecture.cs
murachs_php_4E_chapter05.rtf
TestOut LabSim 3.12.5.pdf
EE5731_Questions_updated_3-3.pdf
Recommended textbooks for you
Text book image
COMPREHENSIVE MICROSOFT OFFICE 365 EXCE
Computer Science
ISBN:9780357392676
Author:FREUND, Steven
Publisher:CENGAGE L
Text book image
Programming Logic & Design Comprehensive
Computer Science
ISBN:9781337669405
Author:FARRELL
Publisher:Cengage
Text book image
C++ for Engineers and Scientists
Computer Science
ISBN:9781133187844
Author:Bronson, Gary J.
Publisher:Course Technology Ptr
Text book image
Programming with Microsoft Visual Basic 2017
Computer Science
ISBN:9781337102124
Author:Diane Zak
Publisher:Cengage Learning
Text book image
EBK JAVA PROGRAMMING
Computer Science
ISBN:9781337671385
Author:FARRELL
Publisher:CENGAGE LEARNING - CONSIGNMENT
Text book image
C++ Programming: From Problem Analysis to Program...
Computer Science
ISBN:9781337102087
Author:D. S. Malik
Publisher:Cengage Learning
SEE MORE TEXTBOOKS
Recommended textbooks for you
Text book image
COMPREHENSIVE MICROSOFT OFFICE 365 EXCE
Computer Science
ISBN:9780357392676
Author:FREUND, Steven
Publisher:CENGAGE L
Text book image
Programming Logic & Design Comprehensive
Computer Science
ISBN:9781337669405
Author:FARRELL
Publisher:Cengage
Text book image
C++ for Engineers and Scientists
Computer Science
ISBN:9781133187844
Author:Bronson, Gary J.
Publisher:Course Technology Ptr
Text book image
Programming with Microsoft Visual Basic 2017
Computer Science
ISBN:9781337102124
Author:Diane Zak
Publisher:Cengage Learning
Text book image
EBK JAVA PROGRAMMING
Computer Science
ISBN:9781337671385
Author:FARRELL
Publisher:CENGAGE LEARNING - CONSIGNMENT
Text book image
C++ Programming: From Problem Analysis to Program...
Computer Science
ISBN:9781337102087
Author:D. S. Malik
Publisher:Cengage Learning
SEE MORE TEXTBOOKS