- Don't go over 10k tokens in the prompts as the intelligence and memory degrades
- Summarize sessions and save the summaries, potentially summarize the summaries as well
- use VAPI or realtime api if you want to build fast. Building the full pipeline takes a while
- try out different models and see how personality varies. Our favorite is gpt4.1 with temperature 1.
- goal system. The promot should always contain the current goal, and the next goal. Evaluate goals with another LLM, and dynamically change the prompt
- Don't go over 10k tokens in the prompts as the intelligence and memory degrades
- Summarize sessions and save the summaries, potentially summarize the summaries as well
- use VAPI or realtime api if you want to build fast. Building the full pipeline takes a while
- try out different models and see how personality varies. Our favorite is gpt4.1 with temperature 1.
- goal system. The promot should always contain the current goal, and the next goal. Evaluate goals with another LLM, and dynamically change the prompt