-
Legend
-
Test execution type
- Automated integration testing
- Automated UI testing
- Manual testing
-
Test execution status
- Pass
- Fail
-
Before Evaluation
-
Owner of the conversation
-
Agent
-
Coversation's Owner Can not Evaluator.
ie Owner and Evaluator of a Conversation can not be same user.
- Pass
-
Manager
-
Coversation's Owner Can not Evaluator.
ie Owner and Evaluator of a Conversation can not be same user.
- Pass
-
QA Auditor
-
Coversation's Owner Can not Evaluator.
ie Owner and Evaluator of a Conversation can not be same user.
- Pass
-
Change rubric button is visible or not?
- Fail
-
Admin
-
Coversation's Owner Can not Evaluator.
ie Owner and Evaluator of a Conversation can not be same user.
- Pass
-
Change rubric button is visible or not?
- Fail
-
Super Admin
-
Coversation's Owner Can not Evaluator.
ie Owner and Evaluator of a Conversation can not be same user.
- Pass
-
Change rubric button is visible or not?
- Fail
-
Non Owner
-
Agent
- N/A
-
User cannot perform any actions
- Pass
-
Manager
- N/A
-
User cannot perform any actions, Drop-downs are not visible and user
- Pass
-
QA Auditor
-
User able to evaluate a conversation and submit button is visible
- Pass
-
Admin
-
User able to Evalutate, select/change rubric, and Submit
- Pass
-
Super Admin
-
User able to Evalutate, select/change rubric, and Submit
- Pass
-
Post Evaluation
-
Owner of the conversation
-
Agent
-
Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
-
Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Not visible
- Pass
- ACCEPT-- Always if No dispute
- Pass
- UPDATE-- Visible after a dispute cancel
- Pass
-
Action Performed— Accept Dispute - (Not Visible)
- Pass
-
Action performed— Reject Dispute - (Not Visible)
- Pass
-
QA Auditor
-
Coversation's Owner Can not Evaluator.
ie Owner and Evaluator of a Conversation can not be same user.
- Pass
-
Manager
-
N/A
- Manager cannot be owner of the conversation- Hence N/A
- Fail : https://levelai.atlassian.net/browse/PE-2256
-
Admin
-
User is able to delete the evaluation
- Fail : PE-2257
-
Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Fail :
- Fail
-
Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT-- Always if No dispute
- Pass
- UPDATE-- Visible after a dispute cancel
- Fail
-
Action Performed— Accept Dispute - (Not Visible)
- Pass
-
Action performed— Reject Dispute - (Not Visible)
- Fail :
-
Perform Update in the evaluation is not allowed
- Pass
-
Super Admin
-
User is able to delete the evaluation
- Fail : PE-2257
-
Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Fail :
- Fail
-
Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT-- Always if No dispute
- Pass
- UPDATE-- Visible after a dispute cancel
- Fail
-
Action Performed— Accept Dispute - (Not Visible)
- Pass
-
Action performed— Reject Dispute - (Not Visible)
- Fail :
-
Perform Update in the evaluation is not allowed
- Pass
-
Non Owner
-
Evaluator
-
Agent
- N/A
- Agent cant evaluate
- Pass
-
QA Auditor
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- Perform Update in the evaluation is allowed
- Pass
-
Manager
- N/A
- User cannot perform any actions, Manager Cant evaluate a conversation
- Pass
-
Admin
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- User is able to delete the evaluation
- Pass
- Perform Update in the evaluation is allowed
- Pass
-
Super Admin
- User able to Evalutate, select/change rubric, and Submit
- Pass
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- User is able to delete the evaluation
- Pass
- Perform Update in the evaluation is allowed
- Pass
-
Non Evaluator (on others evaluated conversation)
-
Agent
- N/A
- Agent cant see other user conversations
- Pass
-
QA Auditor
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- Perform Update in the evaluation is not allowed
- Fail (PE-2255)
-
Manager
- Others conversation and Other evaluators Conversation]
- Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
- Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Not visible
- Pass
- ACCEPT-- Always if No dispute
- Pass
- UPDATE-- Visible after a dispute cancel
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- Accept button is visible if dispute is 0, or first time if opened
- Pass
-
Admin
- Others conversation and Other evaluators Conversation]
- Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
- Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT-- Always if No dispute
- Pass
- UPDATE-- Never visible
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- User is able to delete the evaluation
- Pass
- Pass
- User is able to update the evaluation
- Pass
-
Super Admin
- Others conversation and Other evaluators Conversation]
- Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
- Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT-- Always if No dispute
- Pass
- UPDATE-- Never visible
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- User is able to delete the evaluation
- Pass
- User is able to update the evaluation
- Pass
- Subtopic 3
-
Disputed
-
Owner of the conversation
-
Agent
-
Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Never
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Always
- Pass
-
Actions performed: - Cancel Dispute
- Top Level Button Visibility
(Self marked)
- DISPUTE-- Never
- Pass
- ACCEPT-- Always if No dispute
- Pass
- UPDATE- Always if Dispute exisits
- Pass
- Other marked dispute
- Cancel dispute should not be allowed
- Fail :
- Fail
-
Action Performed— Accept Dispute - (Not Visible)
- Pass
-
Action performed— Reject Dispute - (Not Visible)
- Pass
-
QA Auditor
-
N/A
- Coversation's Owner Can not Evaluator.
ie Owner and Evaluator of a Conversation can not be same user.
- Pass
-
Manager
-
N/A
- Manager cannot be owner of the conversation- Hence N/A
- Partial Pass
-
Admin
-
User is able to delete the evaluation
- Fail
-
Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Not visible as its disputed
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Always visible
- Pass
-
Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT
-- Always if no dispute
- Pass
- UPDATE
-- Always if any dispute exist
- Pass
-
Action Performed— Accept Dispute - (Not Visible)
- Pass
-
Action performed— Reject Dispute - (Not Visible)
- Fail
-
Perform Update in the evaluation is not allowed
- Pass
-
Super Admin
-
User is able to delete the evaluation
- Fail
-
Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Not visible as its disputed
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Always visible
- Pass
-
Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT
-- Always if no dispute
- Pass
- UPDATE
-- Always if any dispute exist
- Pass
-
Action Performed— Accept Dispute - (Not Visible)
- Pass
-
Action performed— Reject Dispute - (Not Visible)
- Fail
-
Perform Update in the evaluation is not allowed
- Pass
-
Non Owner
-
Evaluator
-
Agent
- N/A
- Agent cant see other user conversations
- Pass
-
QA Auditor
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - Allowed
- DISPUTE-- Never
- ACCEPT-- Never visible
- UPDATE-- Always
- Fail
- Action performed— Reject Dispute - Allowed
- DISPUTE-- Never
- ACCEPT-- Never visible
- UPDATE-- Always
- Perform Update in the evaluation is allowed
-
Manager
- N/A
- Manager Cannot be evaluator, Hence N/A
- Pass
-
Admin
- User able to Evalutate, select/change rubric, and Submit
- Pass
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - Allowed
- DISPUTE-- Never
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Always
- Pass
- Action performed— Reject Dispute - Allowed
- DISPUTE-- Never
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Always
- Pass
- User is able to delete the evaluation
- Pass
- Perform Update in the evaluation is allowed
- Pass
-
Super Admin
- User able to Evalutate, select/change rubric, and Submit
- Pass
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - Allowed
- DISPUTE-- Never
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Always
- Pass
- Action performed— Reject Dispute - Allowed
- DISPUTE-- Never
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Always
- Pass
- User is able to delete the evaluation
- Pass
- Perform Update in the evaluation is allowed
- Pass
-
Non Evaluator (on others evaluated conversation)
-
Agent
- N/A
- Agent cant see other user conversations
- Pass
-
QA Auditor
- Cannot make changes on any other's evaluations
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
-
Manager
- Others conversation and Other evaluators Conversation]
- Actions performed: - Mark Dispute (Manager can mark dispute to more question )
- Top Level Button Visibility
- DISPUTE-- Not visible as its disputed,
- Pass
- Pass
- ACCEPT-- Not visible
- Pass
- UPDATE-- Always visible
- Pass
- Actions performed: - Cancel Dispute (Manager can cancel dispute done by an agent)
- Top Level Button Visibility
- DISPUTE-- Not visible
- Pass
- ACCEPT-- Not vsible
- Pass
- UPDATE-- Always visible (As User has to update the cancel dispute done)
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
-
Admin
- Others conversation and Other evaluators Conversation]
- Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Not visible
- Pass
- ACCEPT-- Not
- Pass
- UPDATE-- Always Visible
- Pass
- Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Never
- Pass
- ACCEPT-- Always if No dispute
- Pass
- UPDATE-- Always if dispute exisits
- Pass
- Action Performed— Accept Dispute -
- Other Mark Dispute -- Allowed
- DISPUTE-- Not visible
- Fail
- ACCEPT-- Not
- Fail
- UPDATE-- Always Visible
- Fail
- Other Mark Dispute
- Not allowed to accept Dispute
- Fail
- Fail
- Action performed— Reject Dispute - Allowed
- Other Mark Dispute -- Allowed
- DISPUTE-- Never
- Pass
- ACCEPT-- Never
- Pass
- UPDATE-- Always
- Pass
- Self Mark Dispute
- Not allowed to Reject Dispute
- Fail
- https://levelai.atlassian.net/browse/PE-2261
- User is able to delete the evaluation
- Pass
-
Super Admin
- Others conversation and Other evaluators Conversation]
- Actions performed: - Mark Dispute
- Top Level Button Visibility
- DISPUTE-- Not visible
- Pass
- ACCEPT-- Not
- Pass
- UPDATE-- Always Visible
- Pass
- Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Never
- Pass
- ACCEPT-- Always if No dispute
- Pass
- UPDATE-- Always if dispute exisits
- Pass
- Action Performed— Accept Dispute -
- Other Mark Dispute -- Allowed
- DISPUTE-- Not visible
- Fail
- ACCEPT-- Not
- Fail
- UPDATE-- Always Visible
- Fail
- Self Mark Dispute
- Not allowed to accept Dispute
- Fail
- Action performed— Reject Dispute - Allowed
- Other Mark Dispute -- Allowed
- DISPUTE-- Never
- Pass
- ACCEPT-- Never
- Pass
- UPDATE-- Always
- Pass
- Self Mark Dispute
- Not allowed to Reject Dispute
- Fail
- https://levelai.atlassian.net/browse/PE-2261
- User is able to delete the evaluation
- Pass
-
Accepted
-
Owner of the conversation
-
Agent
-
Actions performed: - Mark Dispute [Re dispute]
- Not Allowed
- Fail
-
Actions performed: - Cancel Dispute
- Not Allowed
- Pass
-
Action Performed— Accept Dispute - (Not Visible)
- Not Allowed
- Pass
-
Action performed— Reject Dispute - (Not Visible)
- Not Allowed
- Pass
-
QA Auditor
-
N/A
- Coversation's Owner Can not Evaluator.
ie Owner and Evaluator of a Conversation can not be same user.
- Pass
-
Manager
-
N/A
- Manager cannot be owner of the conversation- only in case of promotion of user it can happen then follow the below cases
-
Actions performed: - Mark Dispute [Re dispute allowed]
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
-
Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
- Pass
-
Action Performed— Accept Dispute - (Not Visible)
- Pass
-
Action performed— Reject Dispute - (Not Visible)
- Pass
-
Admin
- User is able to delete the evaluation
-
Actions performed: - Mark Dispute [Re dispute allowed]
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
-
Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Action performed— Reject Dispute - (Not Visible)
- Perform Update in the evaluation is not allowed
-
Super Admin
-
User is able to delete the evaluation
- Pass
-
Actions performed: - Mark Dispute [Re dispute allowed]
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
-
Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Action performed— Reject Dispute - (Not Visible)
- Perform Update in the evaluation is not allowed
-
Non Owner
-
Evaluator
-
Agent
- N/A
- Agent cant see other user conversations
- Pass
-
QA Auditor
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- Perform Update in the evaluation is not allowed
- Pass
-
Manager
- N/A
- User cannot perform any actions, Manager Cant evaluate a conversation
- Pass
-
Admin
- User able to Evalutate, select/change rubric, and Submit
- Pass
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- User is able to delete the evaluation
- Pass
- Perform Update in the evaluation is allowed but for now status remains same
(Change the status in next enhancement)
- Pass
-
Super Admin
- User able to Evalutate, select/change rubric, and Submit
- Pass
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- User is able to delete the evaluation
- Pass
- Pass
- Perform Update in the evaluation is allowed but for now status remains same
- Pass
-
Non Evaluator (on others evaluated conversation)
-
Agent
- N/A
- Agent cant see other user conversations
- Pass
-
QA Auditor
- Actions performed: - Mark Dispute- (Not Visible)
- Pass
- Actions performed: - Cancel Dispute (Not Visible)
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
-
Manager
- Others conversation and Other evaluators Conversation]
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- Actions performed: - Mark Dispute [Re dispute allowed]
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
- Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
-
Admin
- Others conversation and Other evaluators Conversation]
- Actions performed: - Mark Dispute [Re dispute allowed]
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Visible
- Pass
- Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Always visible
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- User is able to delete the evaluation
- Pass
-
Super Admin
- Others conversation and Other evaluators Conversation]
- Actions performed: - Mark Dispute [Re dispute allowed]
- Top Level Button Visibility
- DISPUTE-- Always
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
- Actions performed: - Cancel Dispute
- Top Level Button Visibility
- DISPUTE-- Always if any dispute
- Pass
- ACCEPT-- Never visible
- Pass
- UPDATE-- Never visible
- Pass
- Action Performed— Accept Dispute - (Not Visible)
- Pass
- Action performed— Reject Dispute - (Not Visible)
- Pass
- User is able to delete the evaluation
- Pass