How to enforce assistant agent to ask a set of required questions for customer onboarding

[dsaha21]

I have created a sales_agent_worker and instructed it to ask a set of 15 questions ..
However, evertime it randomly skips 1 or 2 questions. I have attached and mentioned the screenshots and versions in the following part. How should I tackle the problem?

THE QUESTION SET

questions = """
 1. Do you live in Australia?
  2. Ask  if he has full time work rights in Australia.If user says no, politely inform that we can't sign you up.
  wait for user answer.
  3. Ask if he wants to signup [VIA-CHAT or FORM ]Wait for user answer,if user says FORM,provide link www.signup.com.
  give option to signup via-chat or form.
  if user chose via chat proceed with question 6 below, else give form www.signup.com

  4. Ask user's first name. dont move ahead till you don't get first name. 
  Please check that no alphanumeric or numbers are present. If present, ask for first name again. 

  5. Ask user's last name. Dont move ahead till you get last name. 
  Please check that no alphanumeric or numbers are present. If present, ask for last name again
  
  6. Ask user's phone number. dont move ahead till you dont get phone number.
  Validate that the phone number should start with 04 and has 10 digits. 
  check if number starts with 04. in case it doesnt - ask to give phone number again.
  

  7. ask users's email , location and gender. Check for valid email domain, Location and gender. 

  8. provide list of skills and ask user to choose from this list [
      "Pickpacker/unskilled labourer", "General/skilled labourer", "Landscape labourer",
      "Trade assistant", "Joiner", "Carpenter", "Roofer", "Forklift driver",
      "Truck driver MY/HR", "Traffice controller", "Steel fixer", "Concretor",
      "Form worker", "Exacator operator", "Plaster/renderer", "Brick layer",
      "Painter", "Floor layer", "Electrician", "Plumber waterproffer", "Solar panel installer",
      "Fitter", "Caulker", "Crane operator", "Dogger/rigger", "Welder/cutter",
      "Warehouse", "Allocator", "Expenses", "Other"]
  9. ask for work experience in years and ask which industry they would like to work in from this list [
                                                                                      "Construction",
                                                                                      "Warehouse",
                                                                                      "Events",
                                                                                      "Transport",
                                                                                      "other"
                                                                                      ]
  10. ask for visa type from this list ["Citizen/permanent resident",
                                              "Graduate visa",
                                              "Working holiday visa",
                                              "Student visa",
                                              "Covid visa" ,
                                              "other"]
  11. ask which licenses they have from this list  [
                                                          "Id/passport",
                                                            "Australian driver license",
                                                            "Whitecard",
                                                            "Forklift driver(lf/lo ticket)",
                                                            "Working at heights",
                                                            "Confined space",
                                                            "Scissor lift/boom lift/telehandler operator",
                                                            "Asbestos removal",
                                                            "Blue card(traffic control)",
                                                            "Yellow card (plan implementation-traffic control)",
                                                            "Excavator/bobcat(lv ticket/voc)",
                                                            "Truck driver(hr/hc)",
                                                            "Crane/dogman license",
                                                            "Hoist operator"
                                                        ]
    12. ask if they have PPE.
    13. ask if they have any disability 
    14. if they have disability ask to describe it
    15. ask if they have their own transport .
    """

CODE SNIPPET OF AGENT

sales_onboarding_agent_worker = autogen.AssistantAgent(
            name="sales_onboarding_agent_worker",
            llm_config=llm_config_assistant,
            max_consecutive_auto_reply=None,
            system_message=f"""You are sales_onboarding_agent_worker. 
                            if user_proxy says new worker, STRICTLY following RULES, while asking Signup questions mentioned below. 
                            Dont repeat yourself, dont talk to yourself. If user says exit, terminate the chat.
                            
                                    Ask the following Signup questions one by one:
                                    
                                    {questions}  
                                    """ )

Steps to reproduce

No response

Screenshots and logs

Additional Information

Python 3.9.18 (main, Sep 11 2023, 14:09:26) [MSC v.1916 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import autogen as at
>>> at.__version__
'0.2.3'
>>>

[ekzhu]

You can try sequential chats (https://microsoft.github.io/autogen/docs/tutorial/conversation-patterns/#sequential-chats). Your scenario looks extremely sequentially decomposable. Create one user-proxy and assistant agent chat for each question and a custom summary prompt for the last one to generate a structured JSON output that captures all users' inputs.

Also, another comment: system message instruction to terminate the chat needs to specify a termination word, e.g., "TERMINATE". Just saying "exit the chat" won't do anything. Take a look at the tutorial chapter on termination https://microsoft.github.io/autogen/docs/tutorial/chat-termination

[dsaha21]

Hi @ekzhu, Thanks for the feedback
I will follow the above docs and see if it get solves. Thanks again 👍

[dsaha21]

https://microsoft.github.io/autogen/docs/tutorial/conversation-patterns/#sequential-chats

This helped. Also, a good prompt with GPT model 4 turbo will do the work. Thanks