creating a robots.txt

That is easy, just create a new text document,
rename it to robots.txt
and copy inside the following lines

User-agent: *
Disallow:
Disallow: /cgi-bin/

The example above will exclude the searchbots from crawling the cgi-bin directory, you an axclude this line, or add more on your own to exclude directories.