Back to Question Center
0

Semalt: Yadda Za A Kashe Darodar Robots.txt

1 answers:

fayil Robots.txt shi ne fayil na rubutu na al'ada wanda ya ƙunshi umarnin game da yadda mahaukaciyar yanar gizo ko batu ya kamata su zana wani shafin. Aikace-aikacen su yana bayyana a injin binciken injiniya bots waɗanda suke da yawa a cikin shafukan yanar gizo masu yawa. A matsayin ɓangare na Rukunin Ƙasidar Robots (REP), fayil na robots.txt yana samar da wani muhimmin al'amari na kayan yanar gizon intanet da kuma damar uwar garken don tabbatar da buƙatun mai amfani bisa ga yadda ya kamata.

Julia Vashneva, da Semalt Babban Abokin Kasuwanci Success Manager, ya bayyana cewa danganta wani ɓangare ne na Binciken Bincike na Bincike (SEO), wanda ya haɗa da samun zirga-zirga daga wasu yankuna a cikin gininku. Ga masu haɗin "bin" don canja wurin ruwan haɗin link, yana da muhimmanci a hada da fayil na robots.txt a kan shafin yanar gizon yanar gizon ku don yin aiki a matsayin mai koyar da yadda uwar garken yayi hulɗa tare da shafinku. Daga wannan tashar, umarnin suna samuwa ta hanyar kyale ko dakatar da yadda wasu takamaiman masu amfani masu aiki suka nuna.

Rubutun Magana na fayil na robots.txt

Wani fayil na robots.txt ya ƙunshi nau'i biyu masu muhimmanci:

Mai amfani-mai amfani: [sunan mai amfani-mai amfani]

Rushewa: [URL string ba za a crawled]

Tsarin fayil na robots.txt ya ƙunshi waɗannan layi biyu. Duk da haka, wasu daga cikinsu zasu iya ƙunsar hanyoyi masu yawa na masu amfani-jamiái da umarnin. Waɗannan umarni na iya ƙunshi al'amurran da suka shafi damar, raguwa ko raguwa-jinkirin. Yawancin lokaci akwai hutu wanda yake rarrabe kowane tsarin koyarwa. Kowace damar da aka ba da izini ko raguwa da raguwa ta rabu da wannan shinge, musamman ga robots.txt tare da layi da yawa.

Misalai

Alal misali, fayil na robots.txt zai iya ƙunsar lambobi kamar:

Mai amfani mai amfani: darodar

Kwashe: / plugin

Kwashe: / API

Raguwa: / _comments

A cikin wannan yanayin, wannan wani ɓangare na robots.txt na ƙuntata Darodar web crawler daga samun dama ga shafin yanar gizonku. A cikin haɗin da aka ambata a sama, ƙananan fayiloli na ƙwaƙwalwa na shafukan yanar gizon kamar su plugins, API, da sassan da aka faɗi. Daga wannan ilimin, yana yiwuwa a cimma amfanin da yawa daga aiwatar da rubutun fayil na robot daidai. Robots..fayilolin txt zasu iya yin ayyuka masu yawa. Alal misali, suna iya shirye su:

1. Izinin duk abun cikin yanar gizo a cikin shafin yanar gizo. Alal misali;

Mai amfani-mai amfani: *

Kwance:

A wannan yanayin, duk abun da ke amfani da mai amfani zai iya samun dama ta kowane intanet wanda ake buƙata don zuwa shafin yanar gizo.

2. Block wani takamaiman yanar gizo daga wani babban fayil. Alal misali;

Mai amfani: Googlebot

Kwashe: / misali-subfolder /

Wannan haɗin gizon dake dauke da sunan Googlebot mai amfani da Google shine Google. Yana ƙuntata maɓallin shiga daga kowane shafin yanar gizon a cikin layi www.ourexample.com/example-subfolder/.

3. Block wani shafukan yanar gizo na musamman daga wani shafin yanar gizon. Alal misali;

Mai amfani-mai amfani: Bingbot

Kwashe: /example-subfolder/blocked-page.html

Binciken Bing na mai amfani yana da masu amfani da fasahar yanar gizon Bing. Irin wannan fayil na robots.txt yana ƙuntata crawler yanar gizo na yanar gizo daga samun damar takamaiman shafi tare da kirtani www.ourexample.com/example-subfolder/blocked-page.

Bayani mai mahimmanci

  • Ba kowane mai amfani yana amfani da fayil ɗin robts.txt ba. Wasu masu amfani zasu iya yanke shawara su yi watsi da ita. Yawanci irin waɗannan masu amfani da yanar gizo sun haɗa da Trojans da malware.
  • Don fayil Robots.txt a bayyane, ya kamata a samuwa a cikin tashar yanar gizon kai tsaye.
  • Rubutun "robots.txt" suna da damuwa. A sakamakon haka, kada ka canza su a kowane hanya ciki har da ƙaddamarwa na wasu fannoni.
  • "/robots.txt" shine yankin jama'a. Duk wanda zai iya samun wannan bayanin lokacin da ta ƙara shi zuwa abinda ke cikin kowane URL. Bai kamata ku kirkiro bayanai masu mahimmanci ko shafukan da kuke son su zama masu zaman kansu ba.
November 29, 2017
Semalt: Yadda Za A Kashe Darodar Robots.txt
Reply