How to Use OpenThaiGPT 1.5 for Text Generation

Oct 28, 2024 | Educational

Welcome to the exciting world of OpenThaiGPT 1.5, a state-of-the-art language model specifically designed for Thai language queries. In this guide, we will walk you through the setup, use, and troubleshooting of OpenThaiGPT to leverage its capabilities in text generation.

Understanding OpenThaiGPT 1.5

OpenThaiGPT 1.5 is a 7-billion-parameter chat model capable of engaging in extended dialogues and answering complex questions related to the Thai language. Think of this model as a highly knowledgeable librarian who not only reads Thai texts but can also hold meaningful conversations about them.

Setting Up OpenThaiGPT 1.5

  • Access the API: Before using OpenThaiGPT, ensure you have access to the API service hosted by either Siam.AI or Float16.cloud.
  • Install Required Libraries: Use Python to interact with OpenThaiGPT. Make sure you have the necessary libraries installed, such as openai for API calls.
  • Model Configuration: The model can handle inputs of up to 131,072 tokens and generate texts of up to 8,192 tokens.

Example API Calls

Below are example API calls that demonstrate how to use OpenThaiGPT for simple and multi-turn conversations.


curl -X POST https://api.aieat.or.th/v1/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer dummy" \
-d '{
    "model": "openthaigpt/openthaigpt1.5-7b-instruct",
    "prompt": "ระบบ: คุณคือผู้ช่วยตอบคำถามที่ฉลาดและซื่อสัตย์\nผู้ใช้: สวัสดีครับ\n",
    "max_tokens": 512,
    "temperature": 0.7
}'

Using Python for API Interaction

Here is a basic example of how to interact with OpenThaiGPT using Python:


import openai

openai.api_key = "your_api_key_here"

response = openai.Completion.create(
    model="openthaigpt/openthaigpt1.5-7b-instruct",
    prompt="ระบบ: คุณคือผู้ช่วยตอบคำถามที่ฉลาดและซื่อสัตย์\nผู้ใช้: สวัสดีครับ\n",
    max_tokens=512,
    temperature=0.7
)

print("Generated Text:", response.choices[0].text)

Troubleshooting Tips

While using OpenThaiGPT, you might encounter some hiccups. Here are a few troubleshooting tips:

  • If you are receiving errors regarding API keys, ensure that your API key is valid and properly configured.
  • For issues relating to long input texts, check your context length settings. Utilize the recommended configurations from the documentation.
  • If the model response times are slow or unresponsive, try reducing the number of tokens being generated.

For more insights, updates, or to collaborate on AI development projects, stay connected with fxis.ai.

Conclusion

At fxis.ai, we believe that such advancements are crucial for the future of AI, as they enable more comprehensive and effective solutions. Our team is continually exploring new methodologies to push the envelope in artificial intelligence, ensuring that our clients benefit from the latest technological innovations.

Stay Informed with the Newest F(x) Insights and Blogs

Tech News and Blog Highlights, Straight to Your Inbox