The user_agent object

The user_agent object returns the user-agent, which is the name of the crawler, for a specific group in the robots.txt file. It consists of a User-agent directive, and a value of the user-agent name.

For example:

The user_agent object has the following attributes:

user_agent.directive

Returns User-agent.

user_agent.value

Returns the user-agent name.