Welcome to your go-to guide for Langtrace, an open-source observability software designed specifically for applications that utilize large language model (LLM) APIs, vector databases, and LLM frameworks. With Langtrace, you can capture, debug, and analyze traces and metrics from all your applications efficiently. Let’s dive into how you can set it up and troubleshoot any issues you encounter along the way!

Understanding Langtrace and Open Telemetry

Langtrace is akin to a meticulous librarian who catalogs every resource (data) in a library (your applications). It keeps track of who borrowed which book (trace metrics) and ensures that every mistake (debug) is corrected and accounted for. The library is structured according to the Open Telemetry (OTEL) standards, ensuring consistency and reliability.

In this analogy, each LLM framework is like a genre section within the library, where each book represents a different application, making it easier for developers to find what they need!

Getting Started with Langtrace

Follow these steps to kick-start your journey with Langtrace:

• Langtrace Cloud
  1. Sign up by going to this link.
  2. Create a new project. Projects act as containers for organizing traces and metrics from your application.
  3. Generate an API key within the project you just created.
  4. Integrate the Langtrace SDK into your application, initialized with the generated API key.
  5. Refer to the specific SDK installation depending on your application’s language:
• Typescript/JavaScript

  npm i @langtrace/typescript-sdk
  import * as Langtrace from '@langtrace/typescript-sdk'; // Must precede any LLM module imports
  Langtrace.init({ api_key: your_api_key });

• Python

  pip install langtrace-python-sdk
  from langtrace_python_sdk import langtrace
  langtrace.init(api_key=your_api_key)

• Langtrace Self-Hosted

  To run Langtrace locally, you need to set up:

  • Next.js App
  • Postgres Database
  • Clickhouse Database

  Ensure you have Docker and Docker Compose installed. After setting up your environment, you can run:

  bash docker compose up

  To take down the setup when you’re done:

  bash docker compose down -v

Troubleshooting Tips

If you encounter any issues while setting up Langtrace, here are some troubleshooting ideas:

• API Key Issues: Ensure that the API key used in the SDK initialization is correctly referenced.
• Environment Variables: Make sure that environment variables are set correctly and are accessible from within the application.
• Container Issues: If your local instance fails to load, verify that all required Docker containers are running properly.
• Documentation Check: Double-check the documentation for your specific issue.

For more insights, updates, or to collaborate on AI development projects, stay connected with fxis.ai.

Conclusion

At fxis.ai, we believe that such advancements are crucial for the future of AI, as they enable more comprehensive and effective solutions. Our team is continually exploring new methodologies to push the envelope in artificial intelligence, ensuring that our clients benefit from the latest technological innovations.

Explore Further

Want to contribute or have questions? Dive deeper! Check out the following SDK repositories:

• Langtrace Typescript SDK
• Langtrace Python SDK
• Semantic Span Attributes

Engage with Us

If you have feature requests or issues, please visit the respective links to engage with the community. Happy tracking!