Almost all businesses deal with texts: invoices, proposals, research papers, reports, resumes, job descriptions, emails, news, and other documents. Some of these text documents require processing, such as sorting, extracting and entering information into a database, evaluating for sentiment, and so on. According to Forbes Magazine, 84% of businesses still rely on some sort of …
I’m often asked, what is it that you do? When I mention the word NLP, frequently the next question is what is that? So here is a blog post that has both the short and the long versions of my answer. Here is the short answer. NLP stands for Natural Language Processing. The “Natural” in …
Social media posts and reviews from review sites like Yelp are an important and powerful marketing and feedback tool for businesses. They are readily available on the Internet and provide customers’ opinions on different aspects of restaurants, car mechanics, cinemas, IT consulting firms, mobile apps, Internet hosting companies and every other kind of business out …
What are chatbots? So what are chatbots all about? They are a general category of programs that interact with people via messaging or speech. Speech bots are Alexa, Siri, etc. In this post I will talk about messaging chatbots. Messaging chatbots use your favorite messaging platform: Facebook, WhatsApp, Slack, Telegram, Kik, etc. The program interacts …
If you have lots of HTML files that you collected for a project, chances are you can’t really use those files as is. Usually, you are looking to extract some information from these files, for example, an article (like in my project), a product description, or user reviews. Depending on the data you want to …
LTE: Extracting relevant text and features from HTML Read More »
After I labeled all the data by topic, I took a quick look at the topic tallies, both overall and by newspaper, keeping in mind the newspapers’ locations. The overall percentages are shown in the graph below: Some of these stats were expected, others surprising. I expected most of the letters to be about politics …
For the project of automatically assigning topics to the letters to the editor, I needed labeled data. Sometimes blog posts, or articles in a newspaper will have assigned labels (for example, this post is tagged with “machine learning” and “natural language processing”). However, none of the newspapers I got my data from did that. Thus, …
See if you can determine whether the author of the following texts is male or female. Text A: When my children were younger, my goal was to get them into the gifted program or even charter schools, because I just wanted a high-quality option. I was thankful that one of my daughters was accepted to …
LTE: Letters to the editor corpus analysis using machine learning Read More »
