Short answer
Yes, and you should be able to. If a vendor won’t show you, that’s reason enough to rule them out. Every action the agent takes has to be logged with what it did, on which account, when and in which conversation. Without that log you can’t review a mistake, you can’t answer a customer who complains, and you won’t pass a mid-sized customer’s security questionnaire.
In detail
What has to be logged
The action, the account, the time, the conversation it came from and the data it checked before acting. With those five you can rebuild any case. Without the last one you know what happened but not why, and why is what you need to fix it.
What it’s used for
More for improving than for auditing. The log shows that the agent handles one kind of case well and another poorly, and that turns a hunch into a concrete task, such as a missing article or a configuration change.
What to ask a vendor
"Show me the screen where I can see this." The screen, not the description. It’s one of the biggest differences between products, and it rarely shows up in comparison tables.