Skip to main content

NLP - Natural Language processing

Natural Language Processing (NLP) refers to AI method of communicating with an Intelligent systems using a natural language such as English.



Processing of Natural Language is required when you want an intelligent system like robot to perform as per your instructions, when you want to hear decision from a dialogue based clinical expert system, etc.
The field of NLP involves making computers to perform useful tasks with the natural languagesh use. The input and output of an NLP system can be:
  •  Speech
  •  Written Text


Components of NLP


Natural Language Understanding (NLU)
Understanding involves the following tasks:
  •  Mapping the given input in natural language into useful representations.
  •  Analyzing different aspects of the language.

Natural Language Generation (NLG)
It is the process of producing meaningful phrases and sentences in the form of natural language from some internal representation.
It involves:
  • Text planning: It includes retrieving the relevant content from knowledge base.
  •  Sentence planning: It includes choosing required words, forming meaning.  
  • Text Realization: It is mapping sentence plan into sentence structure.

Steps  in NLP
There are general five steps:

  1.  Lexical Analysis It involves identifying and analyzing the structure of words. Lexicon of a language means the collection of words and phrases in a language. Lexical analysis is dividing the whole chunk of txt into paragraphs, sentences, and words.
  2.  Syntactic Analysis (Parsing) It involves analysis of words in the sentence for grammar and arranging words in a manner that shows the relationship among the words. The sentence such as “The school goes to boy” is rejected by English syntactic analyzer.
  3. Semantic Analysis It draws the exact meaning or the dictionary meaning from the text. The text is checked for meaningfulness. It is done by mapping syntactic structures and objects in the task domain. The semantic analyzer disregards sentence such as “hot ice-cream”.
  4. Discourse IntegrationThe meaning of any sentence depends upon the meaning of the sentence just beforeit. In addition, it also brings about the meaning of immediately succeeding sentence.
  5. Pragmatic Analysis During  what was said is re-interpreted on what it actually meant. It involves deriving those aspects of language which require real world knowledge.

NLP Terminology

  • Phonology: It is study of organizing sound systematically.
  •  Morphology: It is a study of construction of words from primitive meaningful units.
  • Morpheme: It is primitive unit of meaning in a language.
  •  Syntax: It refers to arranging words to make a sentence. It also involves determining the structural role of words in the sentence and in phrases.
  • Semantics: It is concerned with the meaning of words and how to combine words into meaningful phrases and sentences.
  • Pragmatics: It deals with using and understanding sentences in different situations and how the interpretation of the sentence is affected.
  • Discourse: It deals with how the immediately preceding sentence can affect the interpretation of the next sentence.
  •  World Knowledge: It includes the general knowledge about the world.

Difficulties in NLU

  •  NL has an extremely rich form and structure.
  • It is very ambiguous. There can be different levels of ambiguity:
  1. Lexical ambiguity: It is at very primitive level such as word-level.For example, treating the word “board” as noun or verb? Syntax Level ambiguity: A sentence can be parsed in different ways.For example, “He lifted the beetle with red cap.” – Did he use cap to lift the beetle or he lifted a beetle that had red cap 
  2. Referential ambiguity: Referring to something using pronouns. For example, Rima went to Gauri. She said, “I am tired.” - Exactly who is tired One input can mean different meanings. Many inputs can mean the same thing.


AI issues - 


AI is developing with such an incredible speed, sometimes it seems magical. There is an opinion among researchers and developers that AI could grow so immensely strong that it would be difficult for humans to control.
Humans developed AI systems by introducing into them every possible intelligence they could, for which the humans themselves now seem threatened.

  • Threat to Privacy
  • An AI program that recognizes speech and understands natural language is theoretically capable of understanding each conversation on e-mails and telephones.

  • Threat to Human Dignity
  • AI systems have already started replacing the human beings in few industries. It should not replace people in the sectors where they are holding dignified positions which are pertaining to ethics such as nursing, surgeon, judge, police officer, etc. 

  • Threat to Safety
  • The self-improving AI systems can become so mighty than humans that could be very difficult to stop from achieving their goals, which may lead to unintended consequences.

Labels

Labels:

Comments

Post a Comment

Popular posts from this blog

SEO - SEARCH ENGINE OPTIMIZATION

What is SEO? SEO stands for  Search engine Optimization , which is the practice of increasing the  quantity  and  quality  of traffic to your website through  organic search engine results . What goes into SEO? To understand the true meaning of SEO , let's break that definition down and look at the parts: Quality of traffic.  You can attract all the visitors in the world, but if they're coming to your site because Google tells them you're a resource for Apple computers when really you're a farmer selling apples, that is not quality traffic. Instead you want to attract visitors who are genuinely interested in products that you offer. Quantity of traffic.  Once you have the right people clicking through from those search engine results pages (SERPs), more traffic is better. Organic results .  Ads make up a significant portion of many SERPs. Organic traffic is any traffic that you don't have to pay for. Organic search traffic is spe...
1 comment
Read more

OFF PAGE SEO

Off-Page SEO What is off-page SEO? "Off-page SEO " (also called "off-site SEO") refers to actions taken outside of your own website to impact your rankings within search engine results pages (SERPs).   Optimizing for off site rankings factor involves improving search engine and user perception of a site's popularity, relevance trustworthiness    and authority . This is accomplished by other reputable places on the Internet (pages, sites, people, etc.) linking to or promoting your website, and effectively "vouching" for the quality of your content. Why does off-page SEO matter? While search algorithms and ranking factors are constantly changing, the general consensus within the  SEO community is that the relevance, trustworthiness, and authority that effective off-page SEO affords a website still play a major role in a page's ability to rank. While we don't know the full algorithm Google uses to rank content , data from ...
2 comments
Read more

Bigginers guide of SEO

Bigginer’s guide to understand What is SEO? search engine optimization  (SEO) is  a process of improving positions in organic (non-paid) search results  in search engines. The higher the website is, the more people see it. The history of  SEO  dates back to the 90s when the search engines emerged for the first time. Nowadays, it is an essential marketing strategy and an ever-growing industry. If you want to learn SEO, you should be ready for a lot of creative, technical and analytical work. There are many techniques with different goals, however, the main point will remain the same – to be among the highest results in organic searches. Simply said,  SEO is about running the right website for the right people. It isn’t only about a perfect structure or technical background of the website. Your website has to be filled with quality and  well-optimized content  tailored to the needs of your audience.  And of co...
2 comments
Read more

ON PAGE SEO

On-Page SEO Basics What is On-Page SEO? On-page  SEO (also known as “on-site SEO”) is the practice of optimizing web page content for search engines and users. Common on-page SEO practices include optimizing title tags, content, internal links and URLs. This is different from Off page SEO , which is optimizing for signals that happen off of your website (for example, back links ). Why is On-Page SEO Important? Does traditional on-page SEO still make a difference in 2020? Yup! Even though Google is MUCH smarter than it was back in the day, they still use old school stuff (like looking for a specific keyword on your page). And there’s data to back this up. Our analytics of 1M Google Search  found a correlation between keyword-rich title tags and first page rankings. And if you search for any competitive keyword, you’ll notice that the top ranking pages almost all use that exact keyword in their title tag. That said: There’s more to on-page  SEO than cramming k...
Post a Comment
Read more

Research Areas Of AI

Shortly, how AI we use in daily life ? Artificial intelligence is the development of computer systems that are able to perform tasks that would require human intelligence. Due to artificial intelligence, we had achieved success to solve the complex problems also by using intelligent machines. These machines can think, behave and act like humans.              AI making all life easy. There are many real life examples of AI that are we using daily, like self driving cars, Boston dynamics, navigation system, ASIMO, chatbots, computer games and many more.         The brief study will we discuss about the research areas of AI.  Gaming AI plays crucial role in strategic games such as chess, poker, tic-tac-toe, etc., where  machine can think of large number of possible positions based on heuristic knowledge.  Natural Language Processing It is possible to interact with the computer that understands  natural language spo...
Post a Comment
Read more