Various ways to avoid duplicate content - SEO Tips

Blocking in Robots.txt

Search engine bots will see the robots.txt file and when it sees to exclude a URL of the hosted domain name, this URL is no longer crawled and indexed.

User-agent: Mediapartners-Google
Disallow: /search
User-agent: *
Allow: /
Sitemap: http://ravihonakamble.blogspot.com/sitemap.xml

NoIndex/Follow tag

Another way to eliminate duplicate content, is to use the Meta Robots tag noindex/follow:

Syntax:
meta name="robots" content="noindex,follow"

noindex value is telling search engines not to index the page, thus eliminating duplicate content. And the follow value is telling search engines to still follow the links found on this page, thus still passing around link juice.

The 301 Redirect

A 301 redirect is a permanent redirect from one URL to the other. If someone doesn't know you moved, you want to make sure all your mail is forwarded to your new place.

Once you have new domain then set up a 301 redirect from your old URL to your new one so the inbound links to your old domain will send the same authority to your new domain.

Example:
Redirect 301 / http://newsite.com/blog/

The Canonical Link Tag
search engines behave in the same way how it would look at a 301 redirect. It is not going to index the duplicate content page. Only the destination page will appear in the search engine index.
Syntax:
link rel="canonical" href="http://www.demo.com/shoes/mens/nike"
All links going to the duplicate content pages will be counted as links of the main content page.

Example:
http://www.demo.com/shoes/mens/nike
http://www.demo.com/nike/shoes/mens

How to Start and Stop Endeca Dgraphs? - MDEX and Dgraphs

Here are two ways to do it:
1) Run Script on the Endeca box

/opt/app/endeca/apps/Discover/control>./runcommand.bat|sh DistributeIndexAndApply

[04.03.16 13:33:51] INFO: Checking definition from AppConfig.xml against existing
EAC provisioning.
[04.03.16 13:33:53] INFO: Updating provisioning for component 'WeeklyReportGenerator'.
[04.03.16 13:33:59] INFO: Updating definition for component 'WeeklyReportGenerator'.
[04.03.16 13:34:21] INFO: Definition updated.
[04.03.16 13:34:24] INFO: [AuthoringMDEXHost] Starting shell utility 'cleanDir_local-dgraph-input'.
[04.03.16 13:34:56] INFO: [AuthoringMDEXHost] Starting copy utility
'copy_index_to_host_AuthoringMDEXHost_AuthoringDgraph'.
[04.03.16 13:35:14] INFO: Applying index to dgraphs in restart group 'A'.
[04.03.16 13:35:14] INFO: [AuthoringMDEXHost] Starting shell utility 'mkpath_dgraph-input-new'.
[04.03.16 13:35:33] INFO: [AuthoringMDEXHost] Starting copy utility
'copy_index_to_temp_new_dgraph_input_dir_for_AuthoringDgraph'.
[04.03.16 13:35:57] INFO: Stopping component 'AuthoringDgraph'. 
[04.03.16 13:36:20] INFO: [AuthoringMDEXHost] Starting shell utility
'move_dgraph-input_to_dgraph-input-old'.
[04.03.16 13:36:42] INFO: [AuthoringMDEXHost] Starting shell utility
'move_dgraph-input-new_to_dgraph-input'.
[04.03.16 13:37:01] INFO: [AuthoringMDEXHost] Starting backup utility
'backup_log_dir_for_component_AuthoringDgraph'.
[04.03.16 13:37:19] INFO: [AuthoringMDEXHost] Starting component 'AuthoringDgraph'.
[04.03.16 13:37:54] INFO: Publishing Workbench 'authoring' configuration to MDEX 'AuthoringDgraph'
[04.03.16 13:37:54] INFO: Pushing authoring content to dgraph: AuthoringDgraph
[04.03.16 13:38:06] INFO: Finished pushing content to dgraph.
[04.03.16 13:38:13] INFO: [AuthoringMDEXHost] Starting shell utility 'rmdir_dgraph-input-old'.
[04.03.16 13:38:35] INFO: [LiveMDEXHostA] Starting shell utility 'cleanDir_local-dgraph-input'.
[04.03.16 13:39:12] INFO: [LiveMDEXHostA] Starting copy utility
'copy_index_to_host_LiveMDEXHostA_DgraphA1'.
[04.03.16 13:39:30] INFO: Applying index to dgraphs in restart group '1'.
[04.03.16 13:39:30] INFO: [LiveMDEXHostA] Starting shell utility 'mkpath_dgraph-input-new'.
[04.03.16 13:39:55] INFO: [LiveMDEXHostA] Starting copy utility
'copy_index_to_temp_new_dgraph_input_dir_for_DgraphA1'.
[04.03.16 13:40:20] INFO: Stopping component 'DgraphA1'.
[04.03.16 13:40:41] INFO: [LiveMDEXHostA] Starting shell utility
'move_dgraph-input_to_dgraph-input-old'.
[04.03.16 13:41:06] INFO: [LiveMDEXHostA] Starting shell utility
'move_dgraph-input-new_to_dgraph-input'.
[04.03.16 13:41:31] INFO: [LiveMDEXHostA] Starting backup utility
'backup_log_dir_for_component_DgraphA1'.
[04.03.16 13:41:50] INFO: [LiveMDEXHostA] Starting component 'DgraphA1'.
[04.03.16 13:42:24] INFO: Publishing Workbench 'live' configuration to MDEX 'DgraphA1'
[04.03.16 13:42:24] INFO: Job #: update-dgraph-1459708944605 Sending update to server  -
file: C:\Users\rhonakamble\AppData\Local\Temp\soap-mdex4253393206289650693.xml
[04.03.16 13:42:25] INFO: The request to the Dgraph at localhost:15000 was successfully sent
The return code was : 200
[04.03.16 13:42:31] INFO: [LiveMDEXHostA] Starting shell utility 'rmdir_dgraph-input-old'.

2) Use Endeca Experience Manager EAC console to restart 

Endeca Tools which does not require baseline update? - Endeca Experience Manager

Below Search Tools does not require Endeca baseline update:
1) Keyword Redirects
2) Thesaurus
3) Automatic Phrasing