Stardog’s Karaoke: On-Premises Zero Hallucination LLM Solution Designed for Enterprises

Stardog: Pioneering Enterprise Data Management with Innovative AI Solutions

Founded in 2006 and headquartered in Arlington, Virginia, Stardog is at the forefront of enterprise data management and knowledge graphs. Recognizing early on that 21st-century businesses are driven by data, founder and CEO Kendall Clark understood the critical need for digitization and instant accessibility.

To date, Stardog has successfully raised $40 million in funding and works with notable clients, including NASA, the Department of Defense, Raytheon, and Bosch. With the escalating demand for generative AI solutions, Stardog’s services have become increasingly vital for organizations across various sectors.

Introducing Karaoke: Revolutionizing On-Premises AI

In a collaborative effort with Nvidia and Supermicro, Stardog is launching “Karaoke,” an innovative on-premises server built to host Stardog’s Voicebox Large Language Model (LLM) platform. This enterprise-grade solution, a specialized version of Llama 2 unveiled in October 2023, enables users—regardless of technical expertise—to pose natural language queries in Stardog Cloud. Users can seamlessly access information drawn from their company’s structured data.

As Clark explains, “For large enterprises, particularly in regulated industries, moving all data to the cloud is often not feasible. Karaoke bridges this gap, bringing cloud capabilities directly to the on-premises setup, allowing businesses to leverage generative AI while maintaining data accessibility.”

Flexible Server Configurations

Karaoke is offered in various sizes, from the compact Micro server, which accommodates 500 concurrent users, to the robust Enterprise model featuring 2304 CPU cores, supporting up to 20,000 users.

Voicebox: The Data Science Translator

The Voicebox LLM acts as a translator for user inquiries, transforming questions—such as “What trade on the Euro last quarter violated sanctions?”—into relevant data science queries (JavaScript, Python, or SQL). This allows for accurate retrieval from Stardog's Knowledge Graph.

To ensure accuracy and eliminate hallucinations, Voicebox employs the Safety RAG (Rapid Accuracy Guarantee) design. As Clark highlights, “We never present a response solely generated by the LLM. Users only see answers directly derived from their data, empowering them to trust the results.”

Instead of merely summarizing or retrieving data, Voicebox translates user queries into programmatic forms that a data scientist would create. If it cannot interpret a query, it simply replies, “I don’t know how to answer your question.”

Transparency and Traceability

Voicebox also provides users with a digital footprint, showing the source of retrieved information, complete with citations and links. This feature enhances verification, enabling users to trust the data with confidence. As Clark emphasizes, “Our platform ensures traceability and lineage, allowing users to validate answers and ensure data integrity.”

Pricing and Availability

Stardog plans to offer the Voicebox LLM layer for $39 per user per month, operable in both cloud and virtual private cloud environments without the need for the Karaoke box. Pricing for the Karaoke box depends on user count and hardware specifications, with leasing options available for 3 to 5 years.

For regulated industries aiming to harness generative AI while maintaining compliance, Stardog's Karaoke serves as an effective solution. As businesses increasingly integrate AI tools into their operations, Stardog is well-equipped to lead the safe deployment of on-premises generative AI applications.

For more information on Stardog Karaoke and Voicebox, visit . With Karaoke, Stardog is setting a new benchmark for secure, efficient, and compliant AI technology in the enterprise landscape.