User-agent: *

User-agent: Googlebot

User-agent: Mozilla/4.0 

User-agent: InfoNaviRobot

User-agent: TV33_Mercator

User-agent: AVSearch

User-agent: Mercator

User-agent: Scooter

User-agent: Slurp

User-agent: SearchengineLicenceSheep

User-agent: shadow

User-agent: MultiText

User-agent: FAST-WebCrawler

User-agent: Lycos_Spider

User-agent: Atomz

User-agent: htdig

User-agent: spider00.logika.net

User-agent: NetMechanic

User-agent: libwww-perl

User-agent: Teleport Pro


Disallow: /yoga
Disallow: /backup
Disallow: /myadminsql
Disallow: /sounds
Disallow: /stats


User-agent: EmailSiphon
Disallow:/

User-agent: Cherry Piker
Disallow:/

Entry Meaning 
User-agent: *
Disallow:
 The asterisk (*) in the User-agent field is shorthand for "all robots". Because nothing is disallowed, everything is allowed.
 
User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /private/
 In this example, all robots can visit every directory except the three mentioned. 
User-agent: BadBot
Disallow: / In this case, the BadBot robot is not allowed to see anything. The slash is shorthand for "all directories"

The User Agent can be any unique substring, and robots are not supposed to care about capitalization.
 
User-agent: BadBot
Disallow: /