The user_agent object

The user_agent object returns the user-agent, which is the name of the crawler, for a specific group in the robots.txt file. It consists of a User-agent directive, and a value of the user-agent name.

For example:

The user_agent object has the following attributes:


Returns User-agent.


Returns the user-agent name.