How to Run LangChain Ollama with ngrok URL

by

What will you learn?

By following this tutorial, you will master the process of exposing a local server running LangChain Ollama using ngrok. You’ll learn how to create a public URL for seamless access to your locally hosted services.

Introduction to the Problem and Solution

When we operate a local server like LangChain Ollama, it remains confined within our system’s boundaries. However, when the need arises to share these services over the internet, tools like ngrok come to our rescue. Ngrok establishes a secure tunnel and furnishes us with a temporary public URL. This enables effortless sharing of our locally hosted services with others.

Code

# Install the ngrok package using pip (if not already installed)
# !pip install pyngrok

from pyngrok import ngrok

# Set up the connection with Ngrok
http_tunnel = ngrok.connect(3000, "http")
print("Public URL:", http_tunnel.public_url)

# Keep the connection open until user interrupts or stops execution
input("Press Enter to exit...")
ngrok.disconnect(http_tunnel.public_url)

# Copyright PHD

Explanation

In the provided code snippet: 1. Install the pyngrok package if it is not already installed. 2. Establish a tunnel connection through ngrok on port 3000 for HTTP traffic. 3. Print out the public URL generated by ngrok for remote access to the local LangChain Ollama server. 4. Utilize input(“Press Enter to exit…”) to keep the tunnel active until manually stopped. 5. Disconnect from Ngrok after usage.

    How does ngrok work?

    Ngrok creates secure tunnels from public URLs to localhost, facilitating easy sharing of locally hosted services.

    Can I customize my ngrok subdomain?

    Yes, by registering an account on Ngrok’s website and following their documentation.

    Is there a limit on how many tunnels I can create with Ngork?

    The free version of Ngork permits one simultaneous tunnel per account.

    Can I use HTTPS with Ngork tunnels?

    Yes, but HTTPS support necessitates upgrading to one of Ngork’s paid plans.

    Does Ngork work with any programming language?

    Yes, as long as you have an application running on your machine that listens for HTTP requests on a specific port.

    Is there an alternative to using ngokr for exposing local servers publicly?

    Tools like Localtunnel or Serveo offer similar functionalities as Ngork for exposing local servers over the internet.

    How do I stop an active tunnel created by Ngok?

    To stop an active tunnel created by Ngok, call .disconnect() method from pyngok library providing Public Url.

    Conclusion

    In conclusion, leveraging tools like ngroks streamlines sharing locally hosted services such as LangChain Ollama by effortlessly creating temporary public URLs accessible over the internet.

    Leave a Comment